What needs to be true for an estimate to be reasonable?
Pure Earth is a GiveWell grantee that works to reduce lead and mercury exposure. In an August 2023 post, they provided a "preliminary analysis" suggesting that their lead reduction program in Bangladesh "can avert an equivalent DALY for just under $1." By contrast, they estimate that GiveDirectly "has a cost-effectiveness of approximately $836 per DALY-equivalent averted."
About 86% of the money GiveDirectly spends goes directly to recipients, so an $836 donation to GiveDirectly results in about $719 going directly to a very poor person. In effect, Pure Earth is claiming that either GiveDirectly can give a person in poverty $719, or Pure Earth can spend $1 helping people in Bangladesh, and these would be about equally good for human welfare.
Pure Earth calls this an "extraordinary result" and forthrightly identifies places where their analysis might go wrong. But what I'm missing is a sense of why their analysis might be right: a story about why this extraordinary opportunity exists. In other words, theory.
I find this to be a pretty common lacuna in effective altruist CEAs.[1] Our explanations tend to be technical but not contextual. They enumerate our assumptions about the world at large but lack granularity about social and political conditions.
For my tastes, any claim that that boils down to 'we can help poor people more effectively than they can help themselves' requires theoretical buttressing in the form of a plausible and specific story.
What kinds of theories might suffice?
For public health interventions in general, six types of story come to mind.
- Experts have a comparative advantage at helping poor people manage their affairs. (Here is some evidence against this theory.[1])
- There is extraordinary political gridlock that an external organization is especially well-suited to solving. (Pure Earth says that the "project’s impact lies not in identifying and enforcing food safety regulations, but rather in expediting its implementation by several years.")
- There is a narrow opportunity for positive impact stemming from deep insight about a particular context.
- There is a market failure, e.g. a collective action problem, where a push from an NGO can create a self-sustaining equilibrium.
- There is a cognitive bias and/or cultural failure that leads people to undervalue something that is good, or overvalue something that is bad, and they need a push in the right direction.
- Unconditional cash transfers engender negative spillovers, whereas public health interventions typically have positive spillovers.
The story will vary from case to case. For New Incentives, I assume it's some version of theories 4, 5, and 6. For anti-malarial interventions, I am not sure (and am generally a skeptic). For Pure Earth, I am also not sure, because I am not an expert. The supporting story would need to be extraordinary, because the claim is. I can potentially back that story out of a spreadsheet. But I'd prefer to hear it directly.
- ^ I use Pure Earth to illustrate because their CEA was on the far tail of the distribution, so it stuck in my memory, but this point could be made about many CEAs on the forum. As far as I can tell, Pure Earth is doing great work on an important, neglected, and tractable issue.
- ^ Framed differently, what would it take for you to accept the same thing for yourself -- that an organization is hundreds of times better at helping you than you are at helping yourself?
Thank you for the additional context!
re: Pure Earth: GiveWell notes that its Pure Earth estimates are "substantially less rigorous than both our top charity cost-effectiveness estimates," so I don't want to read too much into it. However, a claim that an intervention is merely 18X better at helping poor people than they are at helping themselves still strikes me as extraordinary, albeit in a way that we become acclimated to over time.
As to what good social theory would look like here, there is some nice work in sociology on the causes and consequences of lead exposure in America (see Muller, Sampson, and Winter 2018 for a review). I don't expect EA orgs to produce this level of granularity when justifying their work, but some theory about why an opportunity exist would be very much appreciated, at least by me.
I've followed your work a bit w.r.t. animal welfare. That's 15 chicken DALYs right? That seems plausible to me. The theory I would construct for this would start with the fact that there are probably more chickens living on factory farms at this moment than there are humans alive. Costco alone facilitates the slaughter of ~100M chickens/year. If you improve the welfare of just the Costco chickens by just 1% of a DALY per chicken, that's 1M DALYs. I could very much believe that a corporate campaign of that magnitude might cost about $66K (approximately 1M/15). So I find this claim much less extraordinary.