Pretrained Transformers as Universal Computation Engines · HackerPapers discussions

Pretrained Transformers as Universal Computation Engines — HN submission

Mon, 30 Jun 2025 14:29:08 GMT

Pretrained Transformers as Universal Computation Engines

2 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

Pretrained Transformers as Universal Computation Engines — mentioned by astrange

Mon, 07 Aug 2023 19:52:36 GMT

https://arxiv.org/pdf/2103.05247.pdf https://openreview.net/pdf?id=gEZrGCozdqR

Paper and discussion history. A mention is not an endorsement.

Pretrained Transformers as Universal Computation Engines — HN submission

Fri, 13 May 2022 16:36:18 GMT

Pretrained Transformers As Universal Computation Engines (2021)

3 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

Pretrained Transformers as Universal Computation Engines — mentioned by visarga

Mon, 24 Jan 2022 12:15:09 GMT

I think large frozen LMs are going to become the "operating system" of tomorrow. They are almost universal task solvers, with the right prompt or verbalizer. The trend now is to make them multi language, multi modal, multi task, multi memory ([1] and this paper), and scale computation with the problem complexity instead of keeping it fixed. After that the next step I think is to make LMs that map arguments to functions from unstructured input, externally run the function and use the result in the next token predictions. LMs could write functions and execute them as regular code. They could…

Paper and discussion history. A mention is not an endorsement.

Pretrained Transformers as Universal Computation Engines — HN submission

Tue, 16 Mar 2021 20:06:50 GMT

Pretrained Transformers as Universal Computation Engines

3 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.