James Özden and Sam Glover at Social Change Lab wrote a literature review on protest outcomes[1] as part of a broader investigation[2] on protest effectiveness. The report covers multiple lines of evidence and addresses many relevant questions, but does not say much about the methodological quality of the research. So that's what I'm going to do today.
I reviewed the evidence on protest outcomes, focusing only on the highest-quality research, to answer two questions:
1. Do protests work?
2. Are Social Change Lab's conclusions consistent with the highest-quality evidence?
Here's what I found:
Do protests work? Highly likely (credence: 90%) in certain contexts, although it's unclear how well the results generalize. [More]
Are Social Change Lab's conclusions consistent with the highest-quality evidence? Yes—the report's core claims are well-supported, although it overstates the strength of some of the evidence. [More]
Cross-posted from my website.
Introduction
This article serves two purposes: First, it analyzes the evidence on protest outcomes. Second, it critically reviews the Social Change Lab literature review.
Social Change Lab is not the only group that has reviewed protest effectiveness. I was able to find four literature reviews:
1. Animal Charity Evaluators (2018), Protest Intervention Report.
2. Orazani et al. (2021), Social movement strategy (nonviolent vs. violent) and the garnering of third-party support: A meta-analysis.
3. Social Change Lab – Ozden & Glover (2022), Literature Review: Protest Outcomes.
4. Shuman et al. (2024), When Are Social Protests Effective?
The Animal Charity Evaluators review did not include many studies, and did not cite any natural experiments (only one had been published as of 2018).
Orazani et al. (2021)[3] is a nice meta-analysis—it finds that when you show people news articles about nonviolent protests, they are more likely to express support for the protesters' cause. But what people say in a lab setting mig
A reread of 'Judicious Ambition' post from not so long ago is interesting:
"In 2013, it made sense for us to work in a poorly-lit basement, eating baguettes and hummus. Now it doesn’t. Frugality is now comparatively less valuable."
So, I guess, bring the hummus back?
Jokes aside, an explosion in funding changed EA from 'hedge fund for charity' into 'VC for charity'. This analogy goes a long way to explain shifts in attitude, decisions, exuberance. So perhaps going back to hedge-fundiness, and shifting the focus back from 'company builders' building the next big thing to less scalable but cost-effective operations is a good direction?
As someone who (briefly) worked in VC and cofounded nonprofits, I'm not sure that's a good signal.
"VC for charity" makes more sense when you consider that VC focus on high upside, diversification, lower information and higher uncertainty, which reflects the current stage of the EA movement. EA is still discovering new effective interventions, launching new experimental projects, building capacity of new founders and discovering new ways of doing good on a systemic level. Even today, there's an acknowledgement that we might not know what the most cost-effec... (read more)