Hide table of contents
6 min read 6

261

The Forum team published this with Kelsey's permission. We've slightly edited the original content, which you can find here.

Question to the blog 

What do you think about the more fringe parts of EA? 

I get really angry seeing people call themselves EAs but then spending all of their time writing speculative essays on, say (to quote those I came across most recently), how actually wildlife conservation is bad because animals in the wild suffer. Like, it's fun to think about that, but my goals as an EA are very different than those of someone who thinks stuff like that is even comparable with global development or long-term sustainability.

But I do wonder what your opinion is, since you do have a record of being sensible in evaluating ideas regardless of how fringe they are, which I really appreciate.

Kelsey’s response

One big formative influence on how I think about this is imagining that effective altruism had existed at various other moments in history. Would we have been doing any good, or would we have been too stuck in the assumptions of the time period? 

Would an effective altruist movement in the 1840s U.S. have been abolitionist? If we think we would have failed to stand up against slavery, what do we need to change, now, as a movement, to make sure we’re not getting similarly big things wrong? 

Would an effective altruist movement in the 1920s U.S. have been eugenicist? If we think we would have embraced a pseudoscientific and deeply harmful movement like the sterilization campaigns of the Progressive era, what habits of mind and thought would have prevented us from doing that, and are we actively employing them?

I think that for effective altruism to be robustly good — to be a movement that would have done good even when embedded in societies that were doing great evil, or societies that were oriented around entirely the wrong questions, or a society that had a “do-gooder” consensus that was actually terrible — there are a bunch of things that have to be in place.

Firstly, we have to actually be doing things that benefit the people who need it most. Last year, donations moved through GiveWell to top charities (not counting donations from Good Ventures) increased to $65 million. If that number wasn’t impressive, and wasn’t increasing, I would be worried that we were failing as a community. We need the reality check of being accountable for actual results. We need to actually do things.

Next, we need to be continually monitoring for signs that the things we’re doing are actually doing harm, under lots of possible worldviews. That includes worldviews that aren’t intuitive, or that aren’t the way most people think about charity. If recipients aren’t happy, that’s an enormous potential warning sign. If our efforts increase suffering, even if it’s in some weird way that’s hard to take seriously, that’s a warning sign. If there are forces systematically ensuring we don’t hear from recipients, that’s a warning sign. Basically, we need to cast a really, really wide net for possible ways we’re screwing up, so that the right answer is at least available to us.

Next, imagine someone walked into that 1840s EA group and said, ‘I think black people are exactly as valuable as white people and it should be illegal to discriminate against them at all,” or someone walked into the 1920s EA group and said, “I think gay rights are really important.” I want us to be a community that wouldn’t have kicked them out. I think the principle I want us to abide by is something like ‘if something is an argument for caring more about entities who are widely regarded as not worthy of such care, then even if the argument sounds pretty absurd, I am supportive of some people doing research into it. And if they’re doing that research with the intent of increasing everyone’s well-being and flourishing as much as possible, then they’re part of our movement’.

So that’s a bunch of broad movement-level principles about how I’d like effective altruism to work. I want us to be open to the idea that our society is very wrong about important things, I want us to be supportive of efforts to care about more, and I want us to be casting a really wide net for ways we could be going wrong. Finally,  to make sure all of this work stays grounded enough that it can actually help people, I want all of the above to happen only in conjunction with growth in the resources we allocate to concrete priorities.

In other words, at any given time, I hope most of our efforts are dedicated to doing solid, clearly important things — and at the same time, I hope we have space to hear out more speculative things, and specifically to hear out (1) arguments for caring about things we wouldn’t normally think to care about, (2) arguments that our society is fundamentally and importantly wrong, and (3) arguments that we are making important mistakes.

So that provides one angle of argument for why I want people to call themselves EAs even if their work is quite speculative and even if they care about different things than me, as long as they’re trying to do as much good in the world as possible in an impartial, maximizing, outcome-oriented way.

This means many EAs will have very different goals from one another. That’s okay. The main argument against EAs all sharing a single priority is that we’d be very motivated not to change our minds if we had to leave the movement when we became persuaded that something else was the most important thing to do. It works a lot better, given how much uncertainty there is about what the most important priorities are, to have a movement for everyone trying to do as much good as possible in an impartial, maximizing, outcome-oriented way.

Then, in addition to that, I think there’s a very concrete argument that wild animal suffering is an area worth researching.

Right now there is vanishingly little research into what animals’ lives are like, especially wild animals. Almost no research into the effects of climate change, environmental measures, or land use changes examines the effects those will have on the suffering of animals. There’s a new research field focused on these questions, called welfare biology. I think fundamental welfare biology research, like fundamental development economics research or fundamental medicine research, is going to dramatically influence our understanding, ten years from now, of which interventions are a good idea.

 Just like I want people who develop vaccines and research global development to be in EA, I want people who research welfare biology to be in EA. This doesn’t rely on any of the above arguments that speculative work is good in general. The whole core of this argument is ‘welfare biology looks like a field that has important research questions relevant to doing as much good as possible.’ I am excited about what the field will look like in ten years, even though most of its core questions, given the field’s nascent stage, are pretty uncertain.

One last thing: There are so many awful problems in the world, and every person working on them can do so much, that it is hard not to take it personally when someone is wasting their time. After all, there’s so much good they could do if they spent it well! But I think that, long-term, it’s just not sustainable to be mad at people for being wrong about what’s most important. One of the biggest changes in my thinking over the last few years has just been this growing sense of how hard it is to arrive at true understandings of things, and how complicated and detailed reality is. This has made it a lot easier for me to look at people who I feel are totally wrong-headed and be glad they’re trying, and hopeful that there’s some productive fruit down the path they’re walking. I think that every single person doing speculative research in EA really, deeply cares about making the world a better place, and even though I think many of them are off-base, I very much hope their research teaches them important things I can use to try to fix stuff.

 

This work is licensed under a Creative Commons Attribution 4.0 International License.

Comments6


Sorted by Click to highlight new comments since:

Also see Linch's excellent summary of the philosophy paper "The possibility of ongoing moral catastrophe":

https://docs.google.com/document/d/18ZzC-WkDcWK-WPlIzKvDv83j8aBwSfdOxnZRmoio-zE/edit

This is a very beautiful perspective to have

I think the principle I want us to abide by is something like ‘if something is an argument for caring more about entities who are widely regarded as not worthy of such care, then even if the argument sounds pretty absurd, I am supportive of some people doing research into it. And if they’re doing that research with the intent of increasing everyone’s well-being and flourishing as much as possible, then they’re part of our movement’.

That's just beautiful. Thanks for your insight!

[I'm doing a bunch of low-effort reviews of posts I read a while ago and think are important. Unfortunately, I don't have time to re-read them or say very nuanced things about them.]

I like this piece.

‘if something is an argument for caring more about entities who are widely regarded as not worthy of such care, then even if the argument sounds pretty absurd, I am supportive of some people doing research into it. And if they’re doing that research with the intent of increasing everyone’s well-being and flourishing as much as possible, then they’re part of our movement’

I loved reading this. 

This was a joy to read, and I couldn't agree more!

Curated and popular this week
Paul Present
 ·  · 28m read
 · 
Note: I am not a malaria expert. This is my best-faith attempt at answering a question that was bothering me, but this field is a large and complex field, and I’ve almost certainly misunderstood something somewhere along the way. Summary While the world made incredible progress in reducing malaria cases from 2000 to 2015, the past 10 years have seen malaria cases stop declining and start rising. I investigated potential reasons behind this increase through reading the existing literature and looking at publicly available data, and I identified three key factors explaining the rise: 1. Population Growth: Africa's population has increased by approximately 75% since 2000. This alone explains most of the increase in absolute case numbers, while cases per capita have remained relatively flat since 2015. 2. Stagnant Funding: After rapid growth starting in 2000, funding for malaria prevention plateaued around 2010. 3. Insecticide Resistance: Mosquitoes have become increasingly resistant to the insecticides used in bednets over the past 20 years. This has made older models of bednets less effective, although they still have some effect. Newer models of bednets developed in response to insecticide resistance are more effective but still not widely deployed.  I very crudely estimate that without any of these factors, there would be 55% fewer malaria cases in the world than what we see today. I think all three of these factors are roughly equally important in explaining the difference.  Alternative explanations like removal of PFAS, climate change, or invasive mosquito species don't appear to be major contributors.  Overall this investigation made me more convinced that bednets are an effective global health intervention.  Introduction In 2015, malaria rates were down, and EAs were celebrating. Giving What We Can posted this incredible gif showing the decrease in malaria cases across Africa since 2000: Giving What We Can said that > The reduction in malaria has be
Ronen Bar
 ·  · 10m read
 · 
"Part one of our challenge is to solve the technical alignment problem, and that’s what everybody focuses on, but part two is: to whose values do you align the system once you’re capable of doing that, and that may turn out to be an even harder problem", Sam Altman, OpenAI CEO (Link).  In this post, I argue that: 1. "To whose values do you align the system" is a critically neglected space I termed “Moral Alignment.” Only a few organizations work for non-humans in this field, with a total budget of 4-5 million USD (not accounting for academic work). The scale of this space couldn’t be any bigger - the intersection between the most revolutionary technology ever and all sentient beings. While tractability remains uncertain, there is some promising positive evidence (See “The Tractability Open Question” section). 2. Given the first point, our movement must attract more resources, talent, and funding to address it. The goal is to value align AI with caring about all sentient beings: humans, animals, and potential future digital minds. In other words, I argue we should invest much more in promoting a sentient-centric AI. The problem What is Moral Alignment? AI alignment focuses on ensuring AI systems act according to human intentions, emphasizing controllability and corrigibility (adaptability to changing human preferences). However, traditional alignment often ignores the ethical implications for all sentient beings. Moral Alignment, as part of the broader AI alignment and AI safety spaces, is a field focused on the values we aim to instill in AI. I argue that our goal should be to ensure AI is a positive force for all sentient beings. Currently, as far as I know, no overarching organization, terms, or community unifies Moral Alignment (MA) as a field with a clear umbrella identity. While specific groups focus individually on animals, humans, or digital minds, such as AI for Animals, which does excellent community-building work around AI and animal welfare while
Max Taylor
 ·  · 9m read
 · 
Many thanks to Constance Li, Rachel Mason, Ronen Bar, Sam Tucker-Davis, and Yip Fai Tse for providing valuable feedback. This post does not necessarily reflect the views of my employer. Artificial General Intelligence (basically, ‘AI that is as good as, or better than, humans at most intellectual tasks’) seems increasingly likely to be developed in the next 5-10 years. As others have written, this has major implications for EA priorities, including animal advocacy, but it’s hard to know how this should shape our strategy. This post sets out a few starting points and I’m really interested in hearing others’ ideas, even if they’re very uncertain and half-baked. Is AGI coming in the next 5-10 years? This is very well covered elsewhere but basically it looks increasingly likely, e.g.: * The Metaculus and Manifold forecasting platforms predict we’ll see AGI in 2030 and 2031, respectively. * The heads of Anthropic and OpenAI think we’ll see it by 2027 and 2035, respectively. * A 2024 survey of AI researchers put a 50% chance of AGI by 2047, but this is 13 years earlier than predicted in the 2023 version of the survey. * These predictions seem feasible given the explosive rate of change we’ve been seeing in computing power available to models, algorithmic efficiencies, and actual model performance (e.g., look at how far Large Language Models and AI image generators have come just in the last three years). * Based on this, organisations (both new ones, like Forethought, and existing ones, like 80,000 Hours) are taking the prospect of near-term AGI increasingly seriously. What could AGI mean for animals? AGI’s implications for animals depend heavily on who controls the AGI models. For example: * AGI might be controlled by a handful of AI companies and/or governments, either in alliance or in competition. * For example, maybe two government-owned companies separately develop AGI then restrict others from developing it. * These actors’ use of AGI might be dr
Recent opportunities in Building effective altruism
46
Ivan Burduk
· · 2m read