Limits of Deep Learning: Sequence Modeling through the Lens of Complexity Theory — mentioned by namaria

Mon, 21 Apr 2025 20:23:37 GMT

Theoretical limitations of multi-layer Transformer https://arxiv.org/abs/2412.02975 On Limitations of the Transformer Architecture https://arxiv.org/abs/2402.08164 Limits of Deep Learning: Sequence Modeling through the Lens of Complexity Theory https://arxiv.org/abs/2405.16674 TL;DR transformers are inherently limited with tasks requiring composition of sequential steps

Paper and discussion history. A mention is not an endorsement.

Limits of Deep Learning: Sequence Modeling through the Lens of Complexity Theory · HackerPapers discussions

Limits of Deep Learning: Sequence Modeling through the Lens of Complexity Theory — mentioned by namaria