The Limits of Inference Scaling Through Resampling — mentioned by feznyng

Tue, 24 Dec 2024 00:03:46 GMT

I'm a junior engineer and not an AI expert so please take the following rambling with a massive grain of salt. The black box that lets non-technical folk type in business requirements and generate an end to end application is still very much an open research question. Getting 70% on SWEBench is an absolute accomplishment, but have you seen the problems? 1. These aren't open-ended requests like here's a codebase, implement x feature and fix y bug. They're issues with detailed descriptions written by engineers evaluated against a set of unit tests. Who writes those descriptions? Who writes the…

Paper and discussion history. A mention is not an endorsement.

The Limits of Inference Scaling Through Resampling — HN submission

Wed, 27 Nov 2024 18:15:21 GMT

Inference Scaling FLaws: The Limits of LLM Resampling with Imperfect Verifiers

3 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

The Limits of Inference Scaling Through Resampling · HackerPapers discussions

The Limits of Inference Scaling Through Resampling — mentioned by feznyng

The Limits of Inference Scaling Through Resampling — HN submission