In hunter-gatherers, trust is generally established under conditions of scarcity, when people develop networks of social reciprocity for food-sharing, child-care, sickenss-care, and catastrophe-avoidance. Only when people face starvation, illness, disasters, or warfare can they learn who they can really trust. And the trust functions mostly for risk-pooling.
By contrast, only under conditions of local abundance - e.g. unusually high-productivity hunter-gatherer environments (e.g. pacific northwest salmon & shellfish areas), or farming with agricultural surpluses -- do we see a lot of top-down hierarchical coercion, with persistent inequality, divisions of labor, despotism, harems, large-scale warfare, etc.
Only when people face starvation, illness, disasters, or warfare can they learn who they can really trust.
Isn't this approximately equivalent to the claim that trust becomes much more risky/costly under conditions of scarcity?
only under conditions of local abundance do we see a lot of top-down hierarchical coercion
Yeah, this is an interesting point. I think my story here is that we need to talk about abundance at different levels. E.g. at the highest level (will my country/civilization survive?) you should often be in scarcity mindset, because losing one war is disastrous. Whereas at lower levels (e.g. will my city survive?) you can have more safety: your city is protected by your country (and your family is protected by your city, and you're protected by your family, and so on).
And so even when we face serious threats, we need to apply coercion only at the appropriate levels. AI is a danger on a civilizational level; but the best way to deal with danger on a civilizational level is via cultivating abundance at the level of your own community, since that's the only way it'll be able to make a difference at that higher level.
It's actually kinda upsetting to think about how pre internet people had to sort of adapt their preferences such that they could be friends with people in a mostly geographical dunbar radius. There just must've been way lower standards for friendship quality, compatibility, etc. Leading to more dysfunctions along the lines of abuse (however defined), to say nothing of the conformity.
Related: I have a high bar for romance because distance relationships, conditioning on my city is a bad time or at least some notion of "settling".
I guess what I'm saying is if everyone dramatically raises the bar in terms of what kind of interpersonal quality they can expect, shouldn't an observer expect a correspondingly dramatic increase in happiness?
There’s a sense in which I’m postulating a trillion dollar bill lying on the ground. If the skills I’ve talked about so far in this sequence would lead to so much more flourishing, why haven’t they become far more common? I’ve already given a partial answer: that our evolutionary environment was much more dangerous than our current environment. But I want to extend this to a more general answer: that coercion is an adaptation to scarcity; and that we only very recently left the era in which scarcity was the dominant feature of people’s lives.
Under conditions of scarcity, you don’t have enough slack that you can afford to take risks. If misbehavior from any individual in the group would risk the lives of many others, you have to coerce them into staying in line; if a loss on any gamble would leave you ruined, then you need to avoid taking those gambles even when they’re winning in expectation. (Poker players think a lot about this when trying to manage their bankroll—if a game has high-enough stakes that they’d be out of money if they lost, they have to avoid it, even if they expect to make money there on average.)
By contrast, in an abundant environment, you can take the optimal long-term strategy, even if there’s a risk that it’ll leave you way down in the short term. In particular, you can put effort into building trust with others, even though that leaves you more vulnerable to being let down or betrayed. With that trust, you can receive a huge range of gains from cooperation.[1]
Western societies are incredibly abundant in many ways. As a citizen, you face almost zero risk of starvation, dying in a war, or exile from your country; meanwhile deaths from most diseases and accidents are dramatically lower than in the past. There’s more career flexibility than there ever has been before: there are many routes to success, including self-employment. And society is far richer than it’s ever been before: the median person in a western society is incredibly wealthy both by historical standards and by the standards of most people across the world. Even welfare recipients are still well off by historical and global standards.
What does it look like to internalize a feeling of abundance? It might involve not forcing yourself to study when you don’t feel like it; or being less defensive when people criticize you; or deciding to be less harsh on yourself about the possibility that you might fail. The more slack you have, the more of a risk you can take by doing this—in each case it’s a gamble, but one which more often than not pays off in the long run by reducing internal conflict and allowing you to act more coherently towards your goals. Similarly, excitement about the future is a gamble: if you get excited about something which doesn’t work out, you’ll be left in a worse position than if your expectations had stayed low the whole time. The way that rich people can get higher returns to investment because they can absorb more risk is analogous to how fear forces us to take suboptimal actions.
What if you think, like I do, that we live at the hinge of history, and our actions could have major effects on the far future—and in particular that there’s a significant possibility of existential risk from AGI? I agree that this puts us in more of a position of scarcity and danger than we otherwise would be (although I disagree with those who have very high credence in catastrophe). But the more complex the problems we face, the more counterproductive scarcity mindset is. In particular, AGI safety requires creative paradigm-shifting research, and large-scale coordination; those are both hard to achieve from a scarcity mindset. In other words, coercion at a psychological or community level has strongly diminishing marginal returns when dealing with scarcity at a civilizational level.
I recount how in 2019, I heard a podcast where Esther Perel says to a client about his partner who has PTSD flashbacks, “you can tell him ‘you’re safe now’” and I found myself thinking “that’s not okay. I can’t feel that I’m safe in this moment. AI could eat the world, and I’m not doing enough about it. I can’t feel safe until we’ve figured it out.”
I share how I’d realized that this is an utter confusion. that “not feeling safe right now”, as an embodied sense made of cortisol and adrenaline and muscle tension that arises, is for running away from tigers or towards enemy soldiers, not for tackling complex paradigm-transcending technical problems or political problems like AI alignment.
Similar reasoning applies to other big problems too. For example, another major source of scarcity is crime: criminals can still hurt us or kill us no matter how wealthy we are in other ways. But in practice, I think we should usually apply far more of an abundance mindset than we usually do. The character of the Bishop in Les Miserables is perhaps the platonic ideal of extending trust to criminals—responding to Vajean’s theft by giving him even more valuables (as pictured below), which is the crucial act that leads Valjean to redemption. This may seem bizarrely naive, but our world is now wealthy enough that we can often afford to carry out comparably trusting strategies, and reap the rewards. For example, the Scandinavian approach of designing comfortable prisons designed for rehabilitation works much better than using them as tools of punishment, which just leads to cycles of crime.[2]
Another major type of scarcity that affects most people’s lives is social scarcity. But while it’s painful to lose the respect of your friends, the world is much bigger than it used to be. It’s much easier to find a social circle similar to yourself than it used to be; and it’s much easier to discover a new friendship group if your old one rejects you, or even move to a new city or country if you burn ties in your previous scene. Yet our intuitions are still calibrated for an environment where exile means death—hence all the problems I've described in the sequence thus far.
Having said all that, there are still cases where scarcity mindset is appropriate. For example, we easily get addicted to games or drugs, so we have to sometimes apply self-coercion to avoid getting stuck in those traps; our lives are too short for us to be able to explore as much as some parts of us would like; we’re still vulnerable to accidents as well as physical violence; and for many, the costs of housing and university are prohibitive (although the growing spread of anti-credentialist Silicon Valley culture means there’s more abundance with respect to the last than many think).
This post was the last in the section on trust; in the next four posts (which I'll upload in a few days), I'll focus on how to cultivate excitement-based motivation.
“But, my friend, you left so early Surely something slipped your mind. You forgot I gave these also; Would you leave the best behind?”
IFS may be a useful frame on our minds in significant part because we're in a world of abundance. In scarce environments, it might be best to think of your mind as a hierarchy in which order and discipline are sternly imposed from the top down. In abundant environments like ours, though, we can gain more from thinking of our minds as egalitarian "families".
For example, the Scared Straight program (which tried to scare kids away from becoming criminals) actually led to increased crime rates. Having said that, I think problems can arise when there’s a mismatch between abundance in one area and scarcity in another. For example, it’s often good to avoid prosecuting shoplifters, and to focus on more preventative and rehabilitative approaches. But that only works if there’s actually effort being put into prevention and rehabilitation; and if society is rich enough and high-trust enough overall that it can easily absorb the costs of increased shoplifting for however long it takes the other approaches to pay off. That’s not always the case.
This is the third in a sequence of posts taken from my recent report: Why Did Environmentalism Become Partisan?
Summary
Rising partisanship did not make environmentalism more popular or politically effective. Instead, it saw flat or falling overall public opinion, fewer major legislative achievements, and fluctuating executive actions.
Public Opinion...
I think right now EAs might be making a significant mistake by paying insufficient attention to the political realm. As EAs we tend to figure out what’s most impactful for us to work on and focus hard. That’s great! But there are various actions that are ‘non-delegatable’ - the extent to which an individual can do the action is limited (like voting, going to a protest, making hard money contributions to particular campaigns). It might be useful if we were all more in the habit of doing variou...
Bentham’s Bulldog recently argued that AI won’t definitely make factory farms obsolete. I agree, but I’d go further and argue that by default AI won’t make factory farms obsolete. However, I think it’s possible (though not guaranteed) that AI could make factory farms a lot more humane.
He throws out an 80% chance of cultivated meat being developed, and a 70% chance of it displacing factory far...
Counterpoint:
In hunter-gatherers, trust is generally established under conditions of scarcity, when people develop networks of social reciprocity for food-sharing, child-care, sickenss-care, and catastrophe-avoidance. Only when people face starvation, illness, disasters, or warfare can they learn who they can really trust. And the trust functions mostly for risk-pooling.
By contrast, only under conditions of local abundance - e.g. unusually high-productivity hunter-gatherer environments (e.g. pacific northwest salmon & shellfish areas), or farming with agricultural surpluses -- do we see a lot of top-down hierarchical coercion, with persistent inequality, divisions of labor, despotism, harems, large-scale warfare, etc.
Isn't this approximately equivalent to the claim that trust becomes much more risky/costly under conditions of scarcity?
Yeah, this is an interesting point. I think my story here is that we need to talk about abundance at different levels. E.g. at the highest level (will my country/civilization survive?) you should often be in scarcity mindset, because losing one war is disastrous. Whereas at lower levels (e.g. will my city survive?) you can have more safety: your city is protected by your country (and your family is protected by your city, and you're protected by your family, and so on).
And so even when we face serious threats, we need to apply coercion only at the appropriate levels. AI is a danger on a civilizational level; but the best way to deal with danger on a civilizational level is via cultivating abundance at the level of your own community, since that's the only way it'll be able to make a difference at that higher level.