Transformers Can Do Arithmetic with the Right Embeddings · HackerPapers discussions

Transformers Can Do Arithmetic with the Right Embeddings — mentioned by riku_iki

Tue, 01 Oct 2024 00:03:04 GMT

> https://arxiv.org/abs/2405.17399 they built specialized model which is after bunch of trickery still has 99% accuracy(naive model had very low accuracy) on very simple deterministic algo. I also think most of the accuracy came from memorization of training set(model didn't provide intermediate results, and started failing significantly at sligtly larger input). In my book it is fundamental inability to learn and reproduce algorithm. They also demonstrated that transformer can't learn sorting.

Paper and discussion history. A mention is not an endorsement.

Transformers Can Do Arithmetic with the Right Embeddings — mentioned by famouswaffles

Mon, 30 Sep 2024 23:47:38 GMT

> there are some benchmarks which show fundamental inability of LLM perform certain tasks which human can, for example add 100 digits numbers. fundamental inability ? No. Current Sota LLM (4o, claude, gemini) woes with arithmetic is not a transformer weakness never mind a large language modelling one. Those benchmarks show that those particular models have problems with accuracy on that many digits, not that LLMs fundamentally cannot be accurate on that many digits. https://arxiv.org/abs/2405.17399 https://arxiv.org/abs/2307.03381 https://arxiv.org/abs/2310.02989 Ultimately, numbers are…

Paper and discussion history. A mention is not an endorsement.

Transformers Can Do Arithmetic with the Right Embeddings — HN submission

Tue, 28 May 2024 17:03:20 GMT

Transformers Can Do Arithmetic with the Right Embeddings

1 point; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

Transformers Can Do Arithmetic with the Right Embeddings — HN submission

Tue, 28 May 2024 04:39:39 GMT

Transformers Can Do Arithmetic with the Right Embeddings

207 points; 211 discussion replies on HN. Paper and source history. A submission is not an endorsement.