James Özden and Sam Glover at Social Change Lab wrote a literature review on protest outcomes[1] as part of a broader investigation[2] on protest effectiveness. The report covers multiple lines of evidence and addresses many relevant questions, but does not say much about the methodological quality of the research. So that's what I'm going to do today.
I reviewed the evidence on protest outcomes, focusing only on the highest-quality research, to answer two questions:
1. Do protests work?
2. Are Social Change Lab's conclusions consistent with the highest-quality evidence?
Here's what I found:
Do protests work? Highly likely (credence: 90%) in certain contexts, although it's unclear how well the results generalize. [More]
Are Social Change Lab's conclusions consistent with the highest-quality evidence? Yes—the report's core claims are well-supported, although it overstates the strength of some of the evidence. [More]
Cross-posted from my website.
Introduction
This article serves two purposes: First, it analyzes the evidence on protest outcomes. Second, it critically reviews the Social Change Lab literature review.
Social Change Lab is not the only group that has reviewed protest effectiveness. I was able to find four literature reviews:
1. Animal Charity Evaluators (2018), Protest Intervention Report.
2. Orazani et al. (2021), Social movement strategy (nonviolent vs. violent) and the garnering of third-party support: A meta-analysis.
3. Social Change Lab – Ozden & Glover (2022), Literature Review: Protest Outcomes.
4. Shuman et al. (2024), When Are Social Protests Effective?
The Animal Charity Evaluators review did not include many studies, and did not cite any natural experiments (only one had been published as of 2018).
Orazani et al. (2021)[3] is a nice meta-analysis—it finds that when you show people news articles about nonviolent protests, they are more likely to express support for the protesters' cause. But what people say in a lab setting mig
Using the links you provide, 50% of cash incentives comes from Strategic Performance Goals in three categories (product & strategy, customers & stakeholders, culture & organizational leadership), and of one of those categories diversity and inclusion(D&I) is one of three parts listed, so at a rough guess 5% of annual cash incentives is tied to D&I. Cash incentives at Microsoft for the executives analyzed are about a fifth of total compensation, so about 1% of executive compensation is tied to D&I.
I think that having a headline "base 50% of executive compensation", when the actual fraction seems to be 1%, is actively deceptive, and think that this question should be rewritten.
I would hope that, if EA orgs gave bonuses to leadership for success in diversity and inclusion, it would be more than 1% of total pay.
At Intel, 7% of total compensation (50% the cash incentive is "operational performance", and cash incentive is about a seventh of total pay for the CEO) which is adjusted by D&I, but how much adjustment there is is not made clear. Given that operational performance goals include many other targets, I would be surprised if Intel was substantially different from Microsoft here.