HackerPapers

arXiv:2307.05782cs.CL

Large Language Models

Michael R. Douglas

HN submission. Found in a submission link or body. Submitters do not count as commenters in the main ranking; a submission is not an endorsement.

Abstract

Artificial intelligence is making spectacular progress, and one of the best examples is the development of large language models (LLMs) such as OpenAI's GPT series. In these lectures, written for readers with a background in mathematics or physics, we give a brief history and survey of the state of the art, and describe the underlying transformer architecture in detail. We then explore some current ideas on how LLMs work and how models trained to predict the next word in a text are able to perform other tasks displaying intelligence.

arXiv comments
47 pages (v2: added references, corrected typos)
Journal reference
DOI
Subjects
cs.CLComputation and Language hep-thHigh Energy Physics, Theory math.HOHistory and Overview physics.comp-phComputational Physics

On Hacker News

No comments linking this paper were found in the collected sources. Found in 2 HN submissions from Jul 2023 to Oct 2023. Open submission discussions.

Comments linking this paper, per year.

Discussed in comments0 threads

No comments linking this paper were found in the collected sources. Open submission discussions.

Submitted to Hacker News

Connected through shared HN threads, not inferred similarity or a recommendation.