Tulu 3: Pushing Frontiers in Open Language Model Post-Training · HackerPapers discussions

Tulu 3: Pushing Frontiers in Open Language Model Post-Training — mentioned by danielmarkbruce

Sat, 05 Sep 2026 16:25:35 GMT

Nathan Lambert wrote a good book recently, and he and his team wrote the paper below about Tulu 3 (Allen Institute). Both are good reads. https://arxiv.org/pdf/2411.15124

Paper and discussion history. A mention is not an endorsement.

Tulu 3: Pushing Frontiers in Open Language Model Post-Training — mentioned by miki123211

Tue, 15 Apr 2025 08:29:47 GMT

Most of the improvements in this model, basically everything except the longer context, image understanding and better pricing, are basically things that reinforcement learning (without human feedback) should be good at. Getting better at code is something you can verify automatically, same for diff formats and custom response formats. Instruction following is also either automatically verifiable, or can be verified via LLM as a judge. I strongly suspect that this model is a GPT-4.5 (or GPT-5???) distill, with the traditional pretrain -> SFT -> RLHF pipeline augmented with an RLVR stage, as…

Paper and discussion history. A mention is not an endorsement.

Tulu 3: Pushing Frontiers in Open Language Model Post-Training — mentioned by anon373839

Sat, 22 Feb 2025 04:28:42 GMT

To answer my own question in case anyone else has it: The Tülu 3 paper is really illuminating: > Language model post-training is applied to refine behaviors and unlock new skills across a wide range of language models, but open recipes for applying these techniques lag behind proprietary ones. The underlying training data and recipes for post-training are simultaneously the most important pieces of the puzzle and the portion with the least transparency. To bridge this gap, we introduce Tülu 3, a family of fully-open state-of-the-art post-trained models, alongside its data, code, and training…

Paper and discussion history. A mention is not an endorsement.

Tulu 3: Pushing Frontiers in Open Language Model Post-Training — HN submission

Fri, 31 Jan 2025 12:59:43 GMT

Tulu 3: Pushing Frontiers in Open Language Model Post-Training

2 points; 1 discussion reply on HN. Paper and source history. A submission is not an endorsement.

Tulu 3: Pushing Frontiers in Open Language Model Post-Training — mentioned by popol1991

Fri, 06 Dec 2024 21:00:30 GMT

Checkout the TULU3 report from AI2: https://arxiv.org/pdf/2411.15124

Paper and discussion history. A mention is not an endorsement.