Holistic Evaluation of Language Models — mentioned by ninjin

Tue, 28 Mar 2023 09:27:45 GMT

I am actually not quite sure what would be best to recommend, as the pandemic has seen me lag behind the zeitgeist somewhat. A recent favourite would be the Toolformer paper [1], that I intend to read in detail later today. If an LLM would be able to use external tools efficiently, it could be rather powerful and perhaps allow us to scale down the parameter sizes, which somewhat fascinates me. [1]: https://arxiv.org/abs/2302.04761 Other research questions, but without concrete papers to reference to that current keeps me up at night: 1.) to which degree can we train substantially smaller LLMs…

Paper and discussion history. A mention is not an endorsement.

Holistic Evaluation of Language Models · HackerPapers discussions

Holistic Evaluation of Language Models — mentioned by ninjin