Hallucination Stations: On Some Basic Limitations of Transformer-Based Language Models · HackerPapers discussions

Hallucination Stations: On Some Basic Limitations of Transformer-Based Language Models — mentioned by anonymid

Mon, 16 Feb 2026 04:02:14 GMT

Thanks for reading, and I really appreciate your comments! > who feed their produced tokens back as inputs, and whose tuning effectively rewards it for doing this skillfully Ah, this is a great point, and not something that I considered. I agree that the token feedback does change the complexity, and it seems that there's even a paper by the same authors about this very thing! https://arxiv.org/abs/2310.07923 I'll have to think on how that changes things. I think it does take the wind out of the architecture argument as it's currently stated, or at least makes it a lot more challenging. I'll…

Paper and discussion history. A mention is not an endorsement.

Hallucination Stations: On Some Basic Limitations of Transformer-Based Language Models — HN submission

Tue, 27 Jan 2026 03:24:07 GMT

Hallucination Stations: On Some Basic Limitations of Transformer-Based Language

2 points; 1 discussion reply on HN. Paper and source history. A submission is not an endorsement.

Hallucination Stations: On Some Basic Limitations of Transformer-Based Language Models — HN submission

Mon, 26 Jan 2026 13:28:55 GMT

Some Basic Limitations of Transformer-Based Language Models

1 point; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

Hallucination Stations: On Some Basic Limitations of Transformer-Based Language Models — HN submission

Sat, 24 Jan 2026 15:41:41 GMT

Hallucination Stations: Limitations of Transformer-Based Language Models (2025)

1 point; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.