Transformers as Algorithms: Generalization and Stability in In-context Learning — mentioned by teleforce

Sun, 07 Jul 2024 17:39:44 GMT

Maybe Transformer? [1] Fourier Transform was discovered in early 19th century initially for heat application [2] and Fast Fourier Transform or FFT was discovered in 20th century to significantly improve the speed of the detection process of seismic activities resulting from nuclear testing during the Cold War [3]. [1] Transformers as Algorithms: Generalization and Stability in In-context Learning: https://arxiv.org/abs/2301.07067 [2] Highlights in the History of the Fourier Transform: https://www.embs.org/pulse/articles/highlights-in-the-histor... [3] The Algorithm That Almost Stopped The…

Paper and discussion history. A mention is not an endorsement.

Transformers as Algorithms: Generalization and Stability in In-context Learning · HackerPapers discussions

Transformers as Algorithms: Generalization and Stability in In-context Learning — mentioned by teleforce