Robust Cooperation in the Prisoner's Dilemma: Program Equilibrium via Provability Logic · HackerPapers discussions

Robust Cooperation in the Prisoner's Dilemma: Program Equilibrium via Provability Logic — mentioned by benlivengood

Tue, 30 Dec 2025 20:00:23 GMT

With an optimal way of determining fair splitting of gains like Shapley value[0] you can cooperate or defect with a probability that maximizes other participants expected value when everyone act fairly. The ultimatum game is the simplest example; N dollars of prize to split, N/2 is fair, accept with probability M / (N /2) where M is what's offered to you; the opponents maximum expected value comes from offering N/2; trying to offer less (or more) results in expected value to them < N/2. Trust can be built out of clearly describing how you'll respond in your own best interests in ways that…

Paper and discussion history. A mention is not an endorsement.

Robust Cooperation in the Prisoner's Dilemma: Program Equilibrium via Provability Logic — mentioned by dash2

Wed, 01 Jun 2022 19:59:57 GMT

This is quite fun. From a very different starting point, the idea of Team Reasoning is another non-standard way of thinking about rationality, which also starts from the idea of "shared commitments": https://www.tandfonline.com/doi/abs/10.1080/1000200309853874... The paper underlying this discussion is here, by the way, and Eliezer Yudkowsky is an author: https://arxiv.org/abs/1401.5577

Paper and discussion history. A mention is not an endorsement.

Robust Cooperation in the Prisoner's Dilemma: Program Equilibrium via Provability Logic — mentioned by psyc

Fri, 01 Apr 2022 16:41:58 GMT

You keep hammering on with the same lazy slander. Yudkowsky was well known long before he wrote the popular Harry Potter fanfic, which incidentally is pedagogical / allegorical. Because his main roles are teacher and philosopher, and philosophers do that. Here's a sampling of his non-fiction writing: https://www.lesswrong.com/tag/sequences https://intelligence.org/files/EthicsofAI.pdf https://arxiv.org/abs/1710.05060 https://intelligence.org/files/AlignmentMachineLearning.pdf https://arxiv.org/abs/1401.5577 https://arxiv.org/abs/1401.5577 https://intelligence.org/files/Corrigibility.pdf…

Paper and discussion history. A mention is not an endorsement.

Robust Cooperation in the Prisoner's Dilemma: Program Equilibrium via Provability Logic — mentioned by Jach

Wed, 23 Jan 2019 21:04:17 GMT

Read Eliezer himself, 4 years ago: https://www.reddit.com/r/xkcd/comments/2myg86/xkcd_1450_aibo... The "meat" of interest here for those too lazy to click (I encourage people click through, though, really, and maybe even take a glance at https://arxiv.org/abs/1401.5577) is probably this long parenthetical: > (But taking Roko's premises at face value, his idea would zap people as soon as they read it. Which - keeping in mind that at the time I had absolutely no idea this would all blow up the way it did - caused me to yell quite loudly at Roko for violating ethics given his own premises, I…

Paper and discussion history. A mention is not an endorsement.

Robust Cooperation in the Prisoner's Dilemma: Program Equilibrium via Provability Logic — mentioned by Eliezer

Sat, 04 Apr 2015 19:58:48 GMT

This is a relatively old manuscript, and I would recommend instead reading, or at least first reading: * http://intelligence.org/files/ProblemClassDominance.pdf * http://arxiv.org/abs/1401.5577 (The original TDT manuscript occurred via pleas for 'something, anything to be published' that were satisfied by cleaning up an unfinished book draft and publishing it as-was.)

Paper and discussion history. A mention is not an endorsement.

Robust Cooperation in the Prisoner's Dilemma: Program Equilibrium via Provability Logic — mentioned by Eliezer

Sat, 04 Apr 2015 19:56:41 GMT

http://arxiv.org/abs/1401.5577

Paper and discussion history. A mention is not an endorsement.

Robust Cooperation in the Prisoner's Dilemma: Program Equilibrium via Provability Logic — HN submission

Fri, 18 Jul 2014 04:11:55 GMT

Robust Cooperation in the Prisoner's Dilemma

3 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.