HackerPapers

arXiv:1805.01109cs.AI

AGI Safety Literature Review

Tom Everitt, Gary Lea, Marcus Hutter

Abstract

The development of Artificial General Intelligence (AGI) promises to be a major event. Along with its many potential benefits, it also raises serious safety concerns (Bostrom, 2014). The intention of this paper is to provide an easily accessible and up-to-date collection of references for the emerging field of AGI safety. A significant number of safety problems for AGI have been identified. We list these, and survey recent research on solving them. We also cover works on how best to think of AGI from the limited knowledge we have today, predictions for when AGI will first be created, and what will happen after its creation. Finally, we review the current public policy on AGI.

arXiv comments
Published in International Joint Conference on Artificial Intelligence (IJCAI), 2018
Journal reference
DOI
Subjects
cs.AIArtificial Intelligence

On Hacker News

Linked by 2 identifiable commenters in 3 comments across 2 threads, from Feb 2023 to Dec 2023.

Comments linking this paper, per year.

Discussed in comments2 threads

  1. Helen Toner shares her side 1 comment

    • >So I guess my question is there a real scientific field of AI Safety? Are there any real experts? Are there any real insights? I'd say so, and in fact it's older than you might think. Here's a lit review from 2018 for example: https://arxiv.org/pdf/1805.01109.pdf This post is…

      0xDEAFBEADView on HNParent context

  2. Bing: “I will not harm you unless you harm me first” 2 comments

    • Do you think Stuart Russell (coauthor, with Peter Norvig, of the widely used textbook Artificial Intelligence: A Modern Approach) is a grifter? https://people.eecs.berkeley.edu/~russell/research/future/ Does this review look like it only covers alarmist tweets?…

      ShredKazooView on HNParent context

    • >legitimate, practical field It's a mistake to conflate practicality with legitimacy, e.g. philosophy and pure mathematics are legitimate but impractical fields. >None of the arguments you've made so far actually touch in any relevant facts, they're just vague arguments from…

      ShredKazooView on HNParent context

Submitted to Hacker News

Connected through shared HN threads, not inferred similarity or a recommendation.