Merging Everybody Into Hell

Here’s a thought experiment. As far as I know, no one has written about it yet.

There's a mind fated for hell. Its suffering will last a very long time, and nothing can change that.

You get to decide what happens at the end of everybody else's life. There are two options:

Option A: Everybody's life just ends normally and nothing happens. Assume there's no afterlife.

Option B: At the end of everybody's lives, everybody is merged into the mind fated for hell. Assume this is possible. Merging doesn’t make the mind’s hell any more intense or any longer, and it doesn’t create extra copies of the mind. But from every person's point of view, they close their eyes at the end of their lives and wake up as that one mind in hell. In return, $1 goes to your favorite charity.

Which do you choose?

I'd choose A. Everybody going to hell is obviously bad, and definitely not worth a dollar to any charity.

And yet standard utilitarianism chooses B. By its count, merging neither adds nor subtracts welfare. There's still one mind in hell, even though it came from a merge of many minds. So, it first says the two options are equal in value. Then, $1 breaks the tie. Now it says you should send everybody to hell.

This is the verdict of any standard utilitarianism that adds up the welfare of experiences - total, average, and even negative - as long as $1 does some good and the merging is considered morally neutral.

The mirror case works too. Offer $1 to charity for letting everybody's lives simply end, instead of merging them into a mind fated for heaven, and standard utilitarianism accepts the dollar, depriving everybody of heaven.

That can't be right. What's going on?

The problem here is that standard utilitarianism doesn't explicitly track what each person goes on to experience. It only adds up experiences as seen from the outside, from a third-person 'view from nowhere'. What you subjectively continue onto is none of its business. That's mostly fine for linear lives, where each experience simply leads to the next, but not for lives that can be copied and merged, and you can construct more counterexamples like this one with those operations.

One could bite the bullet and say only the hell itself matters, but not the fact that multiple people would come to experience it. But then one would have to be indifferent between dying peacefully and waking up in that hell tomorrow, everything else unchanged. I don’t think many people are indifferent.

I think the fix is to care about each perspective’s subjective futures, in addition to its immediate welfare. I’ve proposed that utilitarianism should be based on a Markov reward process over types of experiences. It handles this case, and I think it also fixes problems with identical copies that others have noted.

It feels like we should have started discussing this counterexample a long time ago. Ethics has only handled the extremely special case of linear lives. We may soon be headed for takeoff, yet as a civilization we haven’t even worked out the general case and what it implies.