To Code, or Not To Code? Exploring Impact of Code in Pre-training · HackerPapers discussions

To Code, or Not To Code? Exploring Impact of Code in Pre-training — mentioned by aspenmartin

Fri, 27 Mar 2026 14:12:49 GMT

So what do you think the difference is between humans and an agent in this respect? What makes you think this has any relevance to the problem? everything is combinatorially explosive: the combination of words that we can string into sentences and essays is also combinatorially explosive and yet LLMs and humans have no problem with it. It's just the wrong frame of thinking for what's going on. These systems are obtaining higher and higher levels of abstractions because that is the most efficient thing for them to do to gain performance. That's what reasoning looks like: compositions of higher…

Paper and discussion history. A mention is not an endorsement.

To Code, or Not To Code? Exploring Impact of Code in Pre-training — mentioned by strken

Sun, 01 Dec 2024 21:14:08 GMT

That sounds interesting, but I'm a layman and don't know anything about it. Can you provide a link? I was able to find https://arxiv.org/abs/2408.10914, but I don't have the context to know whether it's the paper you're talking about.

Paper and discussion history. A mention is not an endorsement.

To Code, or Not To Code? Exploring Impact of Code in Pre-training — HN submission

Fri, 04 Oct 2024 20:02:19 GMT

Pre-training with code improves performance on NL reasoning

2 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

To Code, or Not To Code? Exploring Impact of Code in Pre-training — HN submission

Thu, 22 Aug 2024 11:09:37 GMT

To Code, or Not to Code? Exploring Impact of Code in Pre-Training

1 point; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

To Code, or Not To Code? Exploring Impact of Code in Pre-training — HN submission

Wed, 21 Aug 2024 14:24:33 GMT

To Code, or Not to Code? Exploring Impact of Code in Pre-Training

1 point; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

To Code, or Not To Code? Exploring Impact of Code in Pre-training — HN submission

Wed, 21 Aug 2024 03:38:33 GMT

Exploring Impact of Code in Pre-Training

5 points; 2 discussion replies on HN. Paper and source history. A submission is not an endorsement.