The AGI Containment Problem · HackerPapers discussions

The AGI Containment Problem — mentioned by jimrandomh

Tue, 12 Jan 2021 18:16:35 GMT

I'm the author of a previous paper about the AI containment problem. This new paper, Alfonseca et al, is kind of crap. This paper defines the term "containment problem" in a nonstandard way. This is different from how I use it in https://arxiv.org/pdf/1604.00545.pdf (which is largely about preventing side-channels and security vulnerabilities in realistic simulator environments) or how Bostrom's uses it. In this paper, the containment problem is defined as executing a Turing machine for unbounded steps, iff it does not cause harm, given a function which defines whether an output counts as…

Paper and discussion history. A mention is not an endorsement.

The AGI Containment Problem — mentioned by logicallee

Tue, 15 May 2018 13:40:22 GMT

No, I wasn't aware of that. This is a great link, thanks! To anyone else here is their excellent 2016 paper linked from the above: "Concrete Problems in AI Safety" https://arxiv.org/abs/1606.06565 and direct link to 29-page PDF: https://arxiv.org/pdf/1606.06565.pdf [PDF!] However, that PDF does not mention "AGI" even a single time, except in reference 17 "The AGI containment problem". That is actually also avaialable online here - https://arxiv.org/abs/1604.00545 but doesn't seem to be what they have in mind. So it seems the use of the term "safe" is actually much more narrow in AI literature…

Paper and discussion history. A mention is not an endorsement.