Hide table of contents

There’s a sense in which I’m postulating a trillion dollar bill lying on the ground. If the skills I’ve talked about so far in this sequence would lead to so much more flourishing, why haven’t they become far more common? I’ve already given a partial answer: that our evolutionary environment was much more dangerous than our current environment. But I want to extend this to a more general answer: that coercion is an adaptation to scarcity; and that we only very recently left the era in which scarcity was the dominant feature of people’s lives.

Under conditions of scarcity, you don’t have enough slack that you can afford to take risks. If misbehavior from any individual in the group would risk the lives of many others, you have to coerce them into staying in line; if a loss on any gamble would leave you ruined, then you need to avoid taking those gambles even when they’re winning in expectation. (Poker players think a lot about this when trying to manage their bankroll—if a game has high-enough stakes that they’d be out of money if they lost, they have to avoid it, even if they expect to make money there on average.) 

By contrast, in an abundant environment, you can take the optimal long-term strategy, even if there’s a risk that it’ll leave you way down in the short term. In particular, you can put effort into building trust with others, even though that leaves you more vulnerable to being let down or betrayed. With that trust, you can receive a huge range of gains from cooperation.[1]

Western societies are incredibly abundant in many ways. As a citizen, you face almost zero risk of starvation, dying in a war, or exile from your country; meanwhile deaths from most diseases and accidents are dramatically lower than in the past. There’s more career flexibility than there ever has been before: there are many routes to success, including self-employment. And society is far richer than it’s ever been before: the median person in a western society is incredibly wealthy both by historical standards and by the standards of most people across the world. Even welfare recipients are still well off by historical and global standards.

What does it look like to internalize a feeling of abundance? It might involve not forcing yourself to study when you don’t feel like it; or being less defensive when people criticize you; or deciding to be less harsh on yourself about the possibility that you might fail. The more slack you have, the more of a risk you can take by doing this—in each case it’s a gamble, but one which more often than not pays off in the long run by reducing internal conflict and allowing you to act more coherently towards your goals. Similarly, excitement about the future is a gamble: if you get excited about something which doesn’t work out, you’ll be left in a worse position than if your expectations had stayed low the whole time. The way that rich people can get higher returns to investment because they can absorb more risk is analogous to how fear forces us to take suboptimal actions.

What if you think, like I do, that we live at the hinge of history, and our actions could have major effects on the far future—and in particular that there’s a significant possibility of existential risk from AGI? I agree that this puts us in more of a position of scarcity and danger than we otherwise would be (although I disagree with those who have very high credence in catastrophe). But the more complex the problems we face, the more counterproductive scarcity mindset is. In particular, AGI safety requires creative paradigm-shifting research, and large-scale coordination; those are both hard to achieve from a scarcity mindset. In other words, coercion at a psychological or community level has strongly diminishing marginal returns when dealing with scarcity at a civilizational level.

Here’s Malcolm Ocean:

I recount how in 2019, I heard a podcast where Esther Perel says to a client about his partner who has PTSD flashbacks, “you can tell him ‘you’re safe now’” and I found myself thinking “that’s not okay. I can’t feel that I’m safe in this moment. AI could eat the world, and I’m not doing enough about it. I can’t feel safe until we’ve figured it out.”

I share how I’d realized that this is an utter confusion. that “not feeling safe right now”, as an embodied sense made of cortisol and adrenaline and muscle tension that arises, is for running away from tigers or towards enemy soldiers, not for tackling complex paradigm-transcending technical problems or political problems like AI alignment.

Similar reasoning applies to other big problems too. For example, another major source of scarcity is crime: criminals can still hurt us or kill us no matter how wealthy we are in other ways. But in practice, I think we should usually apply far more of an abundance mindset than we usually do. The character of the Bishop in Les Miserables is perhaps the platonic ideal of extending trust to criminals—responding to Vajean’s theft by giving him even more valuables (as pictured below), which is the crucial act that leads Valjean to redemption. This may seem bizarrely naive, but our world is now wealthy enough that we can often afford to carry out comparably trusting strategies, and reap the rewards. For example, the Scandinavian approach of designing comfortable prisons designed for rehabilitation works much better than using them as tools of punishment, which just leads to cycles of crime.[2]

Another major type of scarcity that affects most people’s lives is social scarcity. But while it’s painful to lose the respect of your friends, the world is much bigger than it used to be. It’s much easier to find a social circle similar to yourself than it used to be; and it’s much easier to discover a new friendship group if your old one rejects you, or even move to a new city or country if you burn ties in your previous scene. Yet our intuitions are still calibrated for an environment where exile means death—hence all the problems I've described in the sequence thus far.

Having said all that, there are still cases where scarcity mindset is appropriate. For example, we easily get addicted to games or drugs, so we have to sometimes apply self-coercion to avoid getting stuck in those traps; our lives are too short for us to be able to explore as much as some parts of us would like; we’re still vulnerable to accidents as well as physical violence; and for many, the costs of housing and university are prohibitive (although the growing spread of anti-credentialist Silicon Valley culture means there’s more abundance with respect to the last than many think).

This post was the last in the section on trust; in the next four posts (which I'll upload in a few days), I'll focus on how to cultivate excitement-based motivation.

The Bishop with the Candlesticks
“But, my friend, you left so early
Surely something slipped your mind.
You forgot I gave these also;
Would you leave the best behind?”
  1. ^

    IFS may be a useful frame on our minds in significant part because we're in a world of abundance. In scarce environments, it might be best to think of your mind as a hierarchy in which order and discipline are sternly imposed from the top down. In abundant environments like ours, though, we can gain more from thinking of our minds as egalitarian "families".

  2. ^

     For example, the Scared Straight program (which tried to scare kids away from becoming criminals) actually led to increased crime rates. Having said that, I think problems can arise when there’s a mismatch between abundance in one area and scarcity in another. For example, it’s often good to avoid prosecuting shoplifters, and to focus on more preventative and rehabilitative approaches. But that only works if there’s actually effort being put into prevention and rehabilitation; and if society is rich enough and high-trust enough overall that it can easily absorb the costs of increased shoplifting for however long it takes the other approaches to pay off. That’s not always the case.

Comments5


Sorted by Click to highlight new comments since:

Counterpoint:

In hunter-gatherers, trust is generally established under conditions of scarcity, when people develop networks of social reciprocity for food-sharing, child-care, sickenss-care, and catastrophe-avoidance. Only when people face starvation, illness, disasters, or warfare can they learn who they can really trust. And the trust functions mostly for risk-pooling.

By contrast, only under conditions of local abundance - e.g. unusually high-productivity hunter-gatherer environments (e.g. pacific northwest salmon & shellfish areas), or farming with agricultural surpluses -- do we see a lot of top-down hierarchical coercion, with persistent inequality, divisions of labor, despotism, harems, large-scale warfare, etc.

Only when people face starvation, illness, disasters, or warfare can they learn who they can really trust.

Isn't this approximately equivalent to the claim that trust becomes much more risky/costly under conditions of scarcity?

only under conditions of local abundance do we see a lot of top-down hierarchical coercion

Yeah, this is an interesting point. I think my story here is that we need to talk about abundance at different levels. E.g. at the highest level (will my country/civilization survive?) you should often be in scarcity mindset, because losing one war is disastrous. Whereas at lower levels (e.g. will my city survive?) you can have more safety: your city is protected by your country (and your family is protected by your city, and you're protected by your family, and so on).

And so even when we face serious threats, we need to apply coercion only at the appropriate levels. AI is a danger on a civilizational level; but the best way to deal with danger on a civilizational level is via cultivating abundance at the level of your own community, since that's the only way it'll be able to make a difference at that higher level.

It's actually kinda upsetting to think about how pre internet people had to sort of adapt their preferences such that they could be friends with people in a mostly geographical dunbar radius. There just must've been way lower standards for friendship quality, compatibility, etc. Leading to more dysfunctions along the lines of abuse (however defined), to say nothing of the conformity. 

Related: I have a high bar for romance because distance relationships, conditioning on my city is a bad time or at least some notion of "settling". 

I guess what I'm saying is if everyone dramatically raises the bar in terms of what kind of interpersonal quality they can expect, shouldn't an observer expect a correspondingly dramatic increase in happiness? 

I'm really enjoying this sequence so far, thanks for writing it!

Curated and popular this week
 ·  · 1m read
 · 
Key details What: The Tarbell Fellowship is a 12-month program for early career journalists covering AI. We provide funded 9-month placements at major newsrooms such as TIME, The Information, MIT Tech Review, and many others. When: June 2025 → June 2026  Benefits: We arrange fully-funded placements at major newsrooms for all fellows. Placements run for 9 months (Sep 2025 - May 2026) and we provide stipends of up to $50,000 to support Tarbell Fellows during this period. We’re open to funding extensions up to 24 months if there is mutual interest in doing so. Fellows also participate in a 10-week AI Journalism Fundamental Program before starting their placements and attend a week-long journalism summit in San Francisco. Who should apply: Our ideal applicants want to build a career in journalism and are concerned about the potential risks of advanced artificial intelligence. Experience in AI governance, technical research, and journalism are all a plus, but not required.  Why journalism? Journalism as a career path is neglected by those interested in reducing risks from advanced AI. Journalists can lead the public debate on AI in important ways, drive engagement with specific policy proposals & safety standards, and hold major AI labs accountable in the public arena. Where you'll work? Tarbell Fellows join a leading newsroom as an AI reporter for 9 months, with an opportunity for extension up to 24 months. 2025 host organisations include: * MIT Technology Review * Los Angeles Times * TIME * The Verge * South China Morning Post * The Information * Platformer * The Dispatch * Euractiv * Lawfare * ChinaTalk * UnderstandingAI Learn more: Visit our website or sign up for our information session on January 15th (6pm GMT / 1pm ET / 10am PT). Video meeting link here. Deadline: Apply by February 28th. Apply now
 ·  · 2m read
 · 
I can’t recall the last time I read a book in one sitting, but that’s what happened with Moral Ambition by bestselling author Rutger Bregman. I read the German edition, though it’s also available in Dutch (see James Herbert's Quick Take). An English release is slated for May. The book opens with the statement: “The greatest waste of our times is the waste of talent.” From there, Bregman builds a compelling case for privileged individuals to leave their “bullshit jobs” and tackle the world’s most pressing challenges. He weaves together narratives spanning historical movements like abolitionism, suffrage, and civil rights through to contemporary initiatives such as Against Malaria Foundation, Charity Entrepreneurship, LEEP, and the Shrimp Welfare Project. If you’ve been engaged with EA ideas, much of this will sound familiar, but I initially didn’t expect to enjoy the book as much as I did. However, Bregman’s skill as a storyteller and his knack for balancing theory and narrative make Moral Ambition a fascinating read. He reframes EA concepts in a more accessible way, such as replacing “counterfactuals” with the sports acronym “VORP” (Value Over Replacement Player). His use of stories and examples, paired with over 500 footnotes for details, makes the book approachable without sacrificing depth. I had some initial reservations. The book draws heavily on examples from the EA community but rarely engages directly with the movement, mentioning EA mainly in the context of FTX. The final chapter also promotes Bregman’s own initiative, The School for Moral Ambition. However, the school’s values closely align with core EA principles. The ITN framework and pitches for major EA cause areas are in the book, albeit with varying levels of depth. Having finished the book, I can appreciate its approach. Moral Ambition feels like a more pragmatic, less theory-heavy version of EA. The School for Moral Ambition has attracted better-known figures in Germany, such as the political e
Ben Anderson
 ·  · 8m read
 · 
(You can read this post as a Google Doc, which may be easier to share with global health focused non-EAs) There is a current consultation by the UK’s International Development Committee which presents a tractable and potentially highly impactful opportunity for people to push the UK government to give greater focus to the use of evidence and increase the effectiveness of the aid budget. The consultation closes in four days on Tuesday January 7th. It doesn’t require you to be an expert or a UK citizen to make a submission, though likely greater weight will be placed on people who do fall under those categories.  I made a similar post recently for another consultation that only ended up receiving around 130 submissions total, meaning if even ten people take 15 minutes to make a submission it could likely be highly impactful! I also led more extensive efforts on another consultation, which was ultimately quite successful (more below). Context The International Development Committee is able to focus on specific policy areas and make recommendations for the government, which may be accepted or rejected. Even when recommendations are rejected, scrutiny of a particular policy area increases the attention which government ministers give to the policy area and to the teams of civil servants working on this policy area.  This consultation concerns how the FCDO defines Value for Money and how this is implemented within its programming. Examples of some of the questions the committee want answered are: * How effective is the FCDO at monitoring the delivery and outputs of its programming to ensure its achieving Value for Money? * How could the FCDO improve its oversight mechanisms to ensure Value for Money of its ODA budget? * How effectively are the FCDO utilising financial instruments? Making a Submission Below are various arguments, with the core three relating to evidence generation, evidence use and strengthening partnerships. If you want to make a submission use