You can be at peace even when thinking the world is doomed. And while at peace you can still work against that Doom, even while being aware that nothing you do will make a difference. I believe there are states of mind like this that can be inhabited by humans.
Here I am not going to argue for imminent doom, or that nothing that you do matters. Rather, I want to point out that even when you believe in the dire circumstance of imminent unpreventable doom, it is possible to be at peace, even while working hard against the doom. Even while believing this to be futile. This is a possible state of mind for a human being.
And if it is possible, to be at peace, and work hard, even in this dire circumstance, it should be possible in any less dire circumstance too.
There are many games about how long can you survive, e.g. Dawn of War 2 the Last Stand, Serious Sam survival mode, and Project Zomboid. The very nature of these games is that you will soon die. And there is no saving. The difficulty will increase more and more until at some point you will get crushed.
But there are loads of people playing these games. Nothing about the impossibility of achieving victory seems to detract from the fun you can have. Would this really change if these games couldn't be restarted?
There is also the game You Only Live Once that you can only play once.
Do people not play these games? Do people not try hard when playing these games? No. To be fair, there is a big difference between AI doom and these games. In these games, you can make visible progress. The natural way to define success is to ask the questions: How long did you survive? Did you survive longer than last time?
This is where death with dignity and Duncan's advice is coming from, as far as I can tell. It's about redefining success as making as much progress as possible toward getting a good outcome, instead of directly aiming for a good outcome. Aiming to survive forever in Dawn of War 2 the last stand would probably be frustrating. You set out for a goal that you know is unachievable after all.
I think these strategies are valuable, though to me it seems they also miss something very basic.
Maybe this is a fluke and I will feel different soon, but today I felt like my expectation of doom did not influence me negatively. No negative qualia arose, generated by a heuristic in my brain, that "wants" to steer me away from executing a futile plan.
I didn't achieve this by pushing the doominess out of my mind, or by redefining success as getting as far as possible (getting as much dignity as possible). Instead, I was in a state of peace while contemplating the doom, with the relevant considerations plainly laid out in my mind. I think to achieve this you need to stop wanting the doominess to go away. And you need to stop grasping for straws of hope.
This might sound bleak, but the resulting first-person experience that you get is the opposite. There is no more aversion and craving arising. And giving up these negative emotions doesn't need to imply that you stop working on preventing the doom. Being in a state of frantic, continuous panic isn't actually that great for productivity anyway.
When I'm talking about giving up hope and giving up the craving, for wanting the world to be better, I'm talking about silencing the emotional components of your mind. I am not saying anything about changing your consequentialist, conscious reasoning. Mine is still targeted at making the biggest cumulative contribution that I can make, for preventing the doom. There is no contradiction here. In my model, the consequentialist reasoning component of your mind is separate from all of these heuristic algorithms that compute feelings that consequently arise in your consciousness, having a positive or negative valence associated with them, and steer you in particular ways.
Well, I don't really think I have done a good job (or any job whatsoever) of conveying how I managed to do this. I think the fact that I can do this is related to meditation. For example, in the Waking Up app, Sam Harris sometimes gives explicit instructions to "give up the struggle", and I think I just intuitively managed to successfully apply this learned mental motion here. So my best (and very lazy) recommendation right now is to also learn it from there.
Though probably it seems worth trying out directly. I expect at least some people might just be able to do this directly, given only the following instruction: "Just give up the struggle."
Dirt Wins
All of this applies to the situation where you think that nothing you do actually matters. I want to tell a little story about how I was wrong about the futility of my own actions in the past.
Once upon a time, I played a round of Zero-k. I think it was my first ever match against another player. In the beginning, it seemed like we were evenly matched, maybe I got a slight advantage. But then after some time, it became very one-sided. All my troops got decimated and I was pushed back into my base. I thought that I would surely lose. But I was not giving up in the face of that. I wanted to fight it out until the end. I definitely felt a pull toward just calling it GG. But I didn't budge. I still tried to do my best. I had no more resources. All I could build was boxes of dirt. But still, I didn't give up. I didn't continue because I thought there is a good chance that I could make a comeback. It was simply raw, unfelt, maybe illogical determination, to not give up.
After some time defending my base using mainly bags of dirt, I managed to slightly push back the enemy. However, it didn't take long and they reorganized an army and came back and again I thought I would surely lose. But still, I didn't give up.
And then something unforeseen happened. My enemy got lazy, or careless. Or perhaps they simply got bored by my persistence? By the fact that I was stretching out the game like an old chewing gum? In any case, I soon managed to accumulate a critical mass of dirt bags. I was starting to throw them at the enemy, slowly but surely pushing them back. That push never ground to a halt for long. Soon I was in the enemy's base, and it was only a matter of time until the dirt prevailed.
Johannes - I agree that it can be important to try to maintain epistemic integrity even if one feels deep moral outrage about something.
However, there are many circumstances in which people won't take empirically & logically valid arguments about important topics seriously if they're not expressed with an authentic degree of outrage. This is less often the case within EA culture. But it's frequently the case in public discourse.
It seems that Eliezer Yudkowsky, for example, has often (for over 20 years) tried to express his concerns about AI X-risk fairly dispassionately. But he's often encountered people saying 'If you really took your own arguments seriously, you'd express a lot more moral outrage, and willingness to use traditional human channels for expressing and implementing outrage, such as calls for moral stigmatization of AI, outlawing AI, ostracizing practitioners of AI, etc. (But then, of course, when he does actually argue that nation-states should be willing to enforce a hypothetical global moratorium on AI using the standard military intervention methods (e.g. drone strikes) that are routinely used to enforce international agreements in every other domain, people act all outraged, as if he's preaching Butlerian Jihad. Sometimes you just can't win....)
Anyway, if normal folks see a disconnect between (1) valid arguments that a certain thing X is really really bad and we should reduce it, and (2) a conspicuous lack of passionate moral outrage about X on the part of the arguer, then they will often infer that the arguer doesn't really believe their own argument, i.e. they're treating it as a purely speculative thought experiment, or they're arguing in bad faith, or they're trolling us, etc.
This is a very difficult issue to resolve, but I expect it to be increasingly important as EAs discuss practical ways to slow down AI capability development relative to AI alignment efforts.