Deliberative Alignment: Reasoning Enables Safer Language Models · HackerPapers discussions

Deliberative Alignment: Reasoning Enables Safer Language Models — mentioned by ben_w

Sat, 27 Jun 2026 13:21:14 GMT

> They raised money on the basis of replacing labor by cheaper AI. Not on the basis of being more safe then nebulous "others". They are not "safe" and do nothing to make world safer or better. Original founding says otherwise, for both OpenAI (famously) and Anthropic with this in a copy of their certificate of incorporation I found: ARTICLE III The specific public benefit that the Corporation will promote is to responsibly develop and maintain advanced Al for the cultural, social and technological improvement of humanity. In addition, the Corporation may engage in any lawful act or activity…

Paper and discussion history. A mention is not an endorsement.

Deliberative Alignment: Reasoning Enables Safer Language Models — mentioned by ndr_

Sat, 02 May 2026 10:34:38 GMT

Yes. OpenAI's GPT-OSS was training using Deliberative Alignment (which was found to be flawed in a competition on Kaggle, but still). https://arxiv.org/abs/2412.16339

Paper and discussion history. A mention is not an endorsement.

Deliberative Alignment: Reasoning Enables Safer Language Models — mentioned by theptip

Sat, 24 May 2025 16:53:07 GMT

Thanks! So, how does this impact Deliberative Alignment[1], where IIUC the intermediate tokens are assessed (eg for referencing the appropriate policy fragment)? Does you see your result as putting that paradigm in question, or does the explicit reasoning assessment perhaps ameliorate the issue? [1]: https://arxiv.org/html/2412.16339v2

Paper and discussion history. A mention is not an endorsement.