On the Computational Power of Transformers and its Implications in Sequence Modeling · HackerPapers discussions

On the Computational Power of Transformers and its Implications in Sequence Modeling — mentioned by naasking

Wed, 15 Mar 2023 15:38:32 GMT

> I must have missed the part when it started doing anything algorithmically. I thought it’s applied statistics, with all the consequences of that. This is a common misunderstanding. Transformers are actually Turing complete: * On the Turing Completeness of Modern Neural Network Architectures, https://arxiv.org/abs/1901.03429 * On the Computational Power of Transformers and its Implications in Sequence Modeling, https://arxiv.org/abs/2006.09286

Paper and discussion history. A mention is not an endorsement.

On the Computational Power of Transformers and its Implications in Sequence Modeling — mentioned by naasking

Sun, 12 Mar 2023 14:00:32 GMT

* On the Turing Completeness of Modern Neural Network Architectures, https://arxiv.org/abs/1901.03429 * On the Computational Power of Transformers and its Implications in Sequence Modeling, https://arxiv.org/abs/2006.09286

Paper and discussion history. A mention is not an endorsement.

On the Computational Power of Transformers and its Implications in Sequence Modeling — mentioned by shawnz

Fri, 10 Feb 2023 01:46:25 GMT

To be clear, transformer networks are turing-complete: https://arxiv.org/abs/2006.09286

Paper and discussion history. A mention is not an endorsement.