The Curse of Depth in Large Language Models · HackerPapers discussions

The Curse of Depth in Large Language Models — mentioned by imranq

Tue, 10 Mar 2026 20:05:48 GMT

Amazing write up and i wish more people showed the process for discovery which is often even more interesting than the result itself Still the result is really interesting being able to stack abstract reasoning and get better performance and the heat maps to show the prob results The academic literature seems to be catching up: - *[SOLAR / DUS (Kim et al., 2023)](https://arxiv.org/abs/2312.15166)* — duplicated transformer layers to build a 10.7B model that outperformed 30B parameter baselines. - *[The Curse of Depth (2025)](https://arxiv.org/abs/2502.05795)* — explains why this works: Pre-LN…

Paper and discussion history. A mention is not an endorsement.

The Curse of Depth in Large Language Models — HN submission

Fri, 21 Mar 2025 05:49:48 GMT

The Curse of Depth in Large Language Models

1 point; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

The Curse of Depth in Large Language Models — HN submission

Tue, 18 Feb 2025 15:08:24 GMT

The Curse of Depth in Large Language Models

2 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

The Curse of Depth in Large Language Models — HN submission

Thu, 13 Feb 2025 00:15:24 GMT

The Curse of Depth in Large Language Models

4 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

The Curse of Depth in Large Language Models — HN submission

Tue, 11 Feb 2025 19:12:07 GMT

The Curse of Depth in Large Language Models [pdf]

2 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.