Algorithmic progress in language models · HackerPapers discussions

Algorithmic progress in language models — mentioned by tmnvdb

Sun, 09 Feb 2025 13:42:40 GMT

This is incorrect, there are real effiency gains. Slightly old by the standards of this field, but a good overview: https://arxiv.org/abs/2403.05812

Paper and discussion history. A mention is not an endorsement.

Algorithmic progress in language models — mentioned by ctoth

Mon, 22 Apr 2024 16:41:41 GMT

> a bombshell scientific paper recently cast serious doubt on AI developers’ ability to continue to dramatically improve their models’ performance. This is the problem with this type of (AI isn't real, I promise!) writing. Each and every single time. This bombshell scientific result that he links to? Is Gary Marcus lamenting about a single paper, specific to a single architecture, which primarily shows how quickly algorithmic improvements are bringing down energy costs[0]. We get it. You don't like AI. But you don't have to lie about it, unless of course you are Gary Marcus and this is how…

Paper and discussion history. A mention is not an endorsement.

Algorithmic progress in language models — HN submission

Wed, 13 Mar 2024 15:00:15 GMT

Algorithmic Progress in Language Models

2 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

Algorithmic progress in language models — HN submission

Tue, 12 Mar 2024 11:20:04 GMT

Algorithmic Progress in Language Models

3 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.