This particular hypothetical, I came up with myself.
If you mean reading suggestions about coordination problems in general, Scott Alexander’s Meditations on Moloch (long) is a good discussion from the tech-salvation perspective. I don’t think all of his examples are quite apposite (“capitalism” is good or bad depending on how it’s defined), but the essential importance of the idea is there.
Yes. Exactly.
You underestimate your own success in a World Of You. Your ability to precisely predict what yourselves would do, and to implicitly trust those predictions, is RIDICULOUSLY valuable. On every level, in every way. World-Of-You global GDP (Gross World Product) would be at least double our regular Earth’s within ten years.
Look at a Prisoner’s Dilemma-style situation, except with a psychopath playing against a perfect copy of himself. Here’s the key point of the situation: Each version cares only for himself, not for his copy. He’d be perfectly indifferent watching his copy burn to cinders. Yet he knows that his copy is a perfect copy. Each copy cares for only his own sentence, not the other’s sentence, but they understand each other clearly. What do they do?
The Nash equilibrium here is that they each rat the other out. Both confess. This does worse for both of them than if they both stay quiet, but if one stays quiet, the other has incentive to rat. But if one is tempted to rat, then what about the other who is just like him?
This is a Newcomb-style problem.
I’d say that anyone who suggests the “rational” action for the psychopath to take is to rat himselves out is operating with a philosophically naive decision theory. The ability to predict the specific thought processes of the other to such an astounding degree should, at least for an intelligent person, change the calculus of the situation. Even for psychopaths. A person who can’t coordinate with a perfect copy isn’t merely lacking in empathy. He’s just fucking stupid. And frankly, I think this is a common thread for real-world coordination problems. We are, as a species, not quite smart enough to think ourselves out of these problems. Frankly I doubt we ever will be.
We suffer, not just from a lack of empathy but from a lack of imagination.
