HackerPapers

arXiv:1908.09203cs.CL

Release Strategies and the Social Impacts of Language Models

Irene Solaiman, Miles Brundage, Jack Clark, Amanda Askell, Ariel Herbert-Voss, Jeff Wu, Alec Radford, Gretchen Krueger, Jong Wook Kim, Sarah Kreps, Miles McCain, Alex Newhouse, Jason Blazakis, Kris McGuffie, Jasmine Wang

Abstract

Large language models have a range of beneficial uses: they can assist in prose, poetry, and programming; analyze dataset biases; and more. However, their flexibility and generative capabilities also raise misuse concerns. This report discusses OpenAI's work related to the release of its GPT-2 language model. It discusses staged release, which allows time between model releases to conduct risk and benefit analyses as model sizes increased. It also discusses ongoing partnership-based research and provides recommendations for better coordination and responsible publication in AI.

arXiv comments
71 pages, report
Journal reference
DOI
Subjects
cs.CLComputation and Language cs.AIArtificial Intelligence cs.CYComputers and Society

On Hacker News

Linked by 3 identifiable commenters in 3 comments across 3 threads, from Apr 2020 to May 2024. Found in 3 HN submissions from Aug 2019 to Sep 2019. Open submission discussions.

Comments linking this paper, per year.

Discussed in comments3 threads

  1. Reflections on our Responsible Scaling Policy 1 comment

    • Here is the more relevant paper released by OpenAI. [1] It obsesses on dangers, misuse, and abuse for a model which was mostly incoherent. [1] - https://arxiv.org/pdf/1908.09203

      somenameformeView on HNParent context

  2. Sam Altman exposes the charade of AI accountability 1 comment

    • > OpenAI's product was technically made by Ilya Nope, he is not a core contributor of GPT-4, GPT-3, GPT-2, DALLE-3, DALLE-2: https://arxiv.org/abs/2303.08774 https://cdn.openai.com/papers/dall-e-2.pdf https://arxiv.org/pdf/2005.14165.pdf https://arxiv.org/abs/1908.09203

      ipsum2View on HNParent context

  3. Generating MIDI Music with GPT-2 1 comment

    • It does work, though. Here's an example: https://techscience.org/a/2019121801/ There's also https://arxiv.org/pdf/1908.09203.pdf#page=48 Why aren't bad actors using it in the wild? I think it's a combination of them being technically unsophisticated and conservative, propaganda…

      gwernView on HNParent context

Submitted to Hacker News

Connected through shared HN threads, not inferred similarity or a recommendation.