Inference economics of language models — mentioned by sanxiyn

Thu, 28 Aug 2025 23:02:17 GMT

While the broad point that no, OpenAI and Anthropic are not losing money on inference, is almost certainly correct, the model itself is quite incomplete. If you actually want to know, I recommend Inference economics of language models from Epoch AI, which is probably the best public model as of 2025-06. https://arxiv.org/abs/2506.04645

Paper and discussion history. A mention is not an endorsement.

Inference economics of language models · HackerPapers discussions

Inference economics of language models — mentioned by sanxiyn