Hide table of contents

Summary 

  • Surveys from Sentience Institute (2021, 20202017) and Norwood & Murray (2018) showed substantial levels of support in the US for banning slaughterhouses (~39-43% support). Evidence of this considerable public support for radical action has been suggested as a reason for animal advocates to push stronger messages and bolder proposals against animal agriculture. 
  • A preregistered study that we present here casts doubt on how substantial support for such radical action against factory farming actually is. In an experiment of 700 US survey respondents, we found 7.9% support (95% CI [4.3% - 14.0%], weighted results), when arguments framed around animal welfare for and against are presented, and respondents are asked to explain their reasoning. We also found 20.4% support (95% CI [11.0%-34.7%], weighted results) in the control condition when respondents were not asked to explain their reasoning. 
  • In the second survey of 2,698 US respondents, we found 15.7% (95% CI [13.0%-18.8%], weighted results) support for a policy banning slaughterhouses, when arguments framed around animal welfare for and against are presented, and respondents are asked to explain their reasoning. 
  • The attitudes expressed by poll respondents in response to broad questions may not be reliable indicators of actual support for specific policies or messages. It would be better to test people's responses to more detailed messages and policy proposals, paying special attention to how radical messages compare to counterfactual moderate messages.

Methods
 

We ran two online surveys: survey 1 in July and survey 2 in August-September of 2022. In both, respondents were presented with a proposal that included a definition of slaughterhouses and arguments framed around animal welfare for and against the proposal. In survey 1, the treatment condition asked respondents to explain their reasoning, with this prompt removed in the control condition. In survey 2, only the treatment condition was presented. The question wording was as follows:

 

Some members of Congress are proposing that slaughterhouses (where farmed animals are killed to then be sold as meat) should be made illegal.

Supporters of this policy say that slaughterhouses should be banned because it is wrong to kill animals. There is no way to kill animals for their meat which is “humane,” so this should be banned.

Opponents of this policy say that people have a right to eat meat if they choose. The practices in place are humane and produce quality meat for consumers at an affordable price. It is possible to prevent animals being killed inhumanely without banning slaughterhouses.

Do you support or oppose this proposed policy? 
[Support/Oppose/Don’t Know]

[Treatment condition] 
Please explain your reasons for the answer you gave above.

Respondents were recruited using Prolific and surveyed using Qualtrics. In survey 1, respondents were filtered to be those currently living in the USA, fluent in English, de facto over 18 years old due to filtering Prolific does automatically, and to set gender quotas so that the sample is 50-50 female-male. The total sample size was 700 with 350 in the control condition and 350 in the treatment condition. In survey 2, respondents were recruited as in survey 1 and were weighted for representativeness using 5-year 2019 American community survey data and general social survey data. At the time of analysis, it had a sample of 2,698 US respondents after filtering based on an honesty check and a basic attention/comprehension check. Respondents were paid $1.38 USD for completing the survey. This was part of a larger forthcoming study on rodenticides (McAuliffe et al, 2022).

Results: Attitudes towards a proposal to ban slaughterhouses 

 

In the survey 1, with a sample of 700 US respondents:

  • We found much lower levels of support in both control (20.4%, 95% CI [11.0%-34.7%]) and treatment (7.9%, 95% CI [4.3% - 14.0%]) conditions compared to the Sentience Institute (2021, 20202017) and Norwood & Murray (2018) studies (~39%-43% when including “No Opinion” responses). (More results in the appendix.)
  • In both the unweighted and weighted analyses, support was lower in the treatment condition than in the control condition. The share of “Don’t Know” respondents increased in the treatment in the unweighted analysis, while in the weighted analysis, the lost support seems to come directly from people choosing to oppose instead.

Weighted results for a proposal banning slaughterhouses (control and treatment)

Survey 2 had a sample of 2,698 US respondents (after filtering based on an honesty check and a basic attention/comprehension check). We presented only the treatment condition (asking for attitudes to the policy followed by open comment). 

  • We found 15.7% (95% CI [13.0%-18.8%]) support in the weighted results.
  • We found 67.7% (95% CI  [64.0%- 71.2%]) oppose, 16.6% (95% CI [13.9%-19.6%]) don’t know. (More results in the appendix.)
  • Support could be higher in this study than in the experimental study because it was included in a survey that had a lot of other questions pertaining to animals (about rodenticide), so it might have nudged people in a socially desirable/pro-animal direction.

Weighted results for a proposal banning slaughterhouses (treatment condition only)

We think the measure deployed here is better, or at least not worse, than existing similar surveys discussed below. Just asking for support in the abstract may be vulnerable to some combination of acquiescence bias, social desirability and symbolic/expressive responding. Presenting arguments for and against the proposal may ameliorate some of these concerns. It may also be more comparable to what people would encounter in a real situation where this matter was actively debated or up for a vote (i.e., people would present opposing arguments as well). A limitation, of course, is that the results may depend on the specific positive/negative arguments which are employed, and further work could explore this. In Sioux Falls, there was a vote on 8th November 2022 on whether new slaughterhouses should be banned from being built and permitted to operate inside the city limits of Sioux Falls. The result was 52% against and 48% in support (Argusleader 2022, electionresults.sd.gov 2022).  However, “the group behind this is doing it entirely for NIMBY reasons and says they support slaughterhouses outside of city limits” (RyanBeck 2022). This non-animal welfare framing and the limited nature of this ban may have led to quite different results than a full US slaughterhouse ban framed around animal welfare arguments. 

Comparison with previous survey results

In 2017, Sentience Institute reported the results of a large US-representative survey (n=1094), examining attitudes towards animal farming and plant-free foods (2017).

Three results were particularly striking:

  • “49% of US adults support a ban on factory farming” 
  • “47% support a ban on slaughterhouses”
  • “33% support a ban on animal farming” (ibid.)[1]

Sentience Institute has since repeated its survey (2021, 2020) and again found substantial support ("49.1%" and "44.8%" support for banning slaughterhouses respectively- when excluding "no opinion"). These figures seem extremely surprising given that only around 1% of Americans appear to be vegetarians, with the percentage of vegans being yet smaller (Šimčikas 2018).[2] It seems odd that large numbers of Americans, who routinely choose to eat animal products, would support measures which would likely severely impinge on the consumption of these products, either by massively restricting supply, significantly increasing price or making the consumption of animal products outright impossible.[3] Of course, it is possible for individuals to have conflicting attitudes about such issues. For example, studies have shown a “vote-buy gap” regarding cage-free eggs; many people vote to ban a product they purchase (Paul et al 2019). Indeed, the Sentience Institute survey itself seems to show a clear and strong conflict with the attitudes their respondents appeared to evince. While 49% of individuals agreed with the statement “I support a ban on factory farming,” 97% agreed that “Whether to eat animals or be vegetarian is a personal choice, and nobody has the right to tell me which one they think I should do” (2017) - the strongest support for any statement in the survey by a wide margin. These results, therefore, seem in quite direct conflict given that bans on slaughterhouses or animal farming would remove personal choice on this matter.[4] 

Norwood & Murray’s (2018) study seemed to suspect non-comprehension might be playing a role, as they write: “Perhaps many Americans simply did not understand what a ‘slaughterhouse’ is?” To test this, they included a question designed to probe whether individuals really understood what a slaughterhouse is. After being asked whether they agreed with the statement “I support a ban on slaughterhouses,” participants who agreed with this statement were asked “Were you aware that slaughterhouses are where livestock are killed and processed into meat, such that, without them, you would not be able to consume meat?”

A significant limitation of this approach is that participants are able, and have a strong incentive, to simply report that they understood the question whether or not they did. This might be to avoid embarrassment or self-delusion. If you have even a vague sense of what a term means, then when a question is explained to you, it might seem that you basically understood it all along; alternatively respondents may have been aware of some of these things about slaughterhouses, but perhaps not that “without them, you would not be able to consume meat” and so erred on the side of saying “yes.” Reported understanding may also be due to demand effects (thinking that saying they understood the question will please the researcher). Stronger forms of comprehension checks require that individuals actually understand the question in order to successfully answer (or at least make it much less likely that they can give the correct answer to the comprehension check without having understood the question).

Even with these significant limitations, Norwood & Murray (2018) found that more than a quarter (27.1%) reported that they did not understand the statement which they had just said they agreed with. We suspect that the true rate of non-comprehension would have been at least somewhat higher. Either way, having removed the 27.1% of individuals who self-reported not understanding what a slaughterhouse was, Norwood & Murray (2018) found that 34% of respondents (as opposed to 47% originally) supported a ban on slaughterhouses.[5]

Given this apparent conflict between these results and individuals’ other attitudes and actual behaviors, there is a need to investigate how these results should be interpreted. Even if one supposes that these responses do reflect real support for these bans, it is necessary to work out how to make sense of what these conflicting attitudes (e.g., ‘I support a ban’ and ‘I believe personal choice should not be infringed’) mean and how individuals might be expected to act. 

Why examining this result matters

One reason why it is important to examine this result further and try to better understand the attitudes people hold about these questions is that we want to work out how individuals will actually behave. If 47% of Americans say they would support a ban on slaughterhouses, but they also say that whether or not to eat meat is a personal choice, should we expect them to vote in favor of a ban which would take away that choice? 

More generally, these results have been taken to carry practical implications for what messages and demands animal advocates can and should use. In the Sentience Institute report, Jacy Reese argued that the results suggest that “animal-free food advocates might be able to succeed with stronger proposals than they currently use” (2017).  Likewise, Lewis Bollard suggested that the results “may suggest broad popular support for reforms” (2018). Animal Ask has written “If this is accurate it could be taken as strong support for pursuing bold ballot initiatives” (2022). Tobias Baumann cited the results as evidence in favor of an institutional messaging approach: “Nevertheless, the results above suggest that animal advocates often make a serious mistake by using the framing (i.e. asking for personal dietary change) that elicits the most resistance and opposition” (2022). As such, the results are a potential crux for central ongoing debates within animal activism about milder reformist approaches versus more radical demands, and more individual vs more institutional approaches. However, if these results are misleading and large percentages of Americans do not really (or unambiguously) support such proposals, then they risk misleading us into supporting stronger messages and proposals than would actually be supported, with potential blowback and costly, failed campaigns.

The survey has also been taken as a potential indicator of changes in public attitudes towards animals and animal farming more broadly. Animal Charity Evaluators argued that the survey, if repeated yearly, may be an “important asset” in assessing the extent to which animal advocates are succeeding in changing attitudes (2018). As such, if the survey  - or one like it - is to be taken as an important bellwether for the influence of animal activists on attitudes, then it is particularly important that we understand what the responses to its questions actually mean.

Why does this survey need further replication, haven’t the results already been well-established?

One might think that even if the results matter for the reasons described above, that there is little need to examine them further. After all, the initial survey was large, pre-registered, used a representative US sample, and appears to have been well analyzed. Furthermore, the results have already been successfully replicated both by repeat surveys from Sentience Institute (2021, 2020) and by an independent group of researchers, who also thought that the original results “frankly, seemed outrageous” (Norwood & Murray 2018). So shouldn’t we be quite confident in these results? 

Even though we think that the initial study and replications were well conducted in the ways described above, this does not assuage our concerns about the validity and interpretations of these results. In brief, the described virtues of the original survey and its successful replications increase our confidence that if we were to replicate the procedure of the original survey again, we would find similar results. However, those results do not suffice to remove our concerns about whether the results of this procedure show that individuals really support these radical bans on typical farming practices. Nor do they allow us to make sense of the conflict between individuals’ stated support for the bans, with their belief that these are matters of personal choice.

To explain why the replications of Sentience Institute’s results don’t assuage our concerns, it is helpful to draw the distinction between direct replication and conceptual replication. Whereas a direct replication aims to exactly replicate the procedure of an experiment, a conceptual replication aims to test the same effect using a distinct procedure (Milkowski et al. 2018). As such, while a direct replication serves to increase our confidence that when we repeat the procedure we find the same result, it is ill-suited to highlight limitations internal to the procedure itself. Conceptual replication, conversely, is necessary to confirm the external validity of the effect and generalizability beyond a procedure (Lynch et al. 2015Crandall et al 2015).[6]

To take a concrete and germane example, suppose that when we ask people “Are you a vegetarian?” at least 60% systematically understand “vegetarian” in some way compatible with eating some meat, or else are biased towards answering “Yes” despite eating meat, due to social desirability or demand effects. If we are concerned about this kind of systematic distortion arising when we use the procedure of asking people whether they are a vegetarian, then no number of direct replications of this procedure should serve to reduce these concerns. Rather, we would need to attempt to examine the putative finding through other procedures, either asking individuals the question differently, for example, “Do you eat any meat products such as...?”, or supplementing our original question with distinct approaches, such as a food frequency questionnaire. As another example, research on intelligence that uses hair length as a measure of intelligence would be highly misleading; highly replicable gender differences in hair length would be interpreted as evidence that women are more intelligent than men. This inference would be false because hair length is not a valid measure of intelligence, even though the relationship between gender and hair length is highly replicable. Thus, even successful and replicable tests of a theory may be false if measures lack construct validity, that is, they do not measure what researchers assume they are measuring. (See Schimmack's recent (2021) validation crisis paper.) 

Concluding thoughts

A claim made about the original Sentience Institute study was that the evidence of strong public support for radical action suggests advocates can push for stronger proposals and messages.[7] Insofar as we take the responses to slaughterhouse ban proposals as a proxy for 'support for more radical action,' if only 16% would in fact be supportive, this does not offer a strong basis for more radical action. (It may well be a net negative due to a majority of people opposing such moves. Recall that 68% opposed the slaughterhouse ban in our large study.)

Of course, treating responses to these items as proxies may itself be dubious. These responses may reflect a symbolic desire to signal that people think the current state of factory farms/slaughterhouses is bad, but not imply that people actually think that getting rid of them would be desirable. The attitudes expressed by poll respondents in response to broad questions may not be reliable indicators of actual support for specific policies or messages. It would be better to test people's responses to more detailed messages and policy proposals, paying special attention to how radical messages compare to counterfactual moderate messages. One could also test a radical ask (ban factory farming) and a moderate ask (labelling for cage-free eggs, say) each with a radical message ("meat is murder") versus a moderate one ("human/consumer welfare"). 

Acknowledgements

This post is a project of Rethink Priorities–a think tank dedicated to informing decisions made by high-impact organizations and funders across various cause areas. It was written by Neil Dullaghan. Thanks to contributions from David Moss and William McAuliffe, Jamie Elsey and Willem Sleegers for running the survey, analyzing the results, and providing data visualization, and Adam Papineau for copyediting. If you are interested in RP’s work, please visit our research database and subscribe to our newsletter

References

Amalia Zimmerman. (2018). Sentience Institute Survey Analysis. Animal Charity Evaluators. https://perma.cc/4EQB-46BT

Andrew S. Paul, Jayson L. Lusk, F. Bailey Norman, & Glynn T. Tonsor. (2019). An experiment on the vote-buy gap with application to cage-free eggs. Journal of Behavioral and Experimental Economics. https://doi.org/10.1016/j.socec.2019.02.005

Animal Ask. (2022). Pathways to victory: How can we end animal agriculture? Animal Ask. https://perma.cc/3WXU-E2MY

Argus Leader. (2022). 2022 Minnehaha County Results. https://perma.cc/FM3B-5KVW

Bailey Norman & Susan Murray. (2018). FooDS Demand Survey. Oklahoma State University. https://web.archive.org/web/20190806000018/http://agecon.okstate.edu/files/january%202018.pdf

Christian S. Crandall & Jeffrey W. Sherman. (2015). On the scientific superiority of conceptual replications for scientific progress: Journal of Experimental Social Psychology66, 93–99. https://doi.org/doi.org/10.1016/j.jesp.2015.10.002

Jacy Reese Anthis. (2017). Animals, Food, and Technology (AFT) Survey: 2017 Update. The Sentience Institute. https://perma.cc/NV2J-UK7M

Jacy Reese Anthis & Ali Ladak. (2021). Animals, Food, and Technology (AFT) Survey: 2020 Update. The Sentience Institute. https://perma.cc/JDX7-QV6A

Jacy Reese Anthis & Ali Ladak. (2022). Animals, Food, and Technology (AFT) Survey: 2021 Update. The Sentience Institute. https://doi.org/10.31234/osf.io/3v6ku

John G. Lynch Jr, Eric T. Bradlow, John C. Huber, & Donald R. Lehmann. (2015). Reflections on the replication corner: In praise of conceptual replications. International Journal of Research in Marketing32(4), 333–342. https://doi.org/10.1016/j.ijresmar.2015.09.006

Lewis Bollard. (2018). The 2018 Elections and Farm Animals. Open Philanthropy Farm Animal Welfare Newsletter. https://perma.cc/LAG6-RXU6

Marcin Miłkowski, Witold M. Hensel, & Mateusz Hohol. (2018). Replicability or reproducibility? On the replication crisis in computational neuroscience and sharing only relevant detail. Journal of Computational Neuroscience45, 163–172. https://doi.org/10.1007/s10827-018-0702-z

Ryan Beck. (2022). Comment on ‘Support for Sioux Falls Slaughterhouse Ban’. Metaculus. https://perma.cc/PLF5-2XQR

Šimčikas, S. (2018, August 16). Is the percentage of vegetarians and vegans in the U.S. increasing? Animal Charity Evaluators. https://animalcharityevaluators.org/blog/is-the-percentage-of-vegetarians-and-vegans-in-the-u-s-increasing/

South Dakota Secretary of State. (2022). Sioux Falls Results. Electionresults.Sd.Gob. https://perma.cc/7N2J-R7PA

Tobias Baumann. (2022, February). How the animal movement could do even more good [Forum]. Effective Altruism Forum. https://perma.cc/CW55-NLPM

Ulrich Schimmack. (2021). The Validation Crisis in Psychology. Meta-Psychology5. https://doi.org/10.15626/MP.2019.1645

William McAuffile, David Moss, Holly Elmore, Marcus A. Davis, & James Elsey. (2022). Rodenticides Polling. https://doi.org/10.17605/OSF.IO/3UNZB

Appendix

Survey 1, N=700

Weighted results 
ConditionResponse%Lower 95% CIUpper 95% CI
ControlSupport20.4%11.0%34.7%
ControlOppose62.7%48.6%74.9%
ControlDon't Know16.9%8.9%29.6%
TreatmentSupport7.9%4.3%14.0%
TreatmentOppose75.3%62.6%84.7%
TreatmentDon't Know16.9%8.7%30.2%


 

Unweighted results
ConditionResponse%Lower 95% CIUpper 95% CI
ControlSupport16.5%12.9%20.8%
ControlOppose70.6%65.5%75.2%
ControlDon't Know12.9%9.8%17.0%
TreatmentSupport11.5%8.5%15.5%
TreatmentOppose71.8%66.7%76.4%
TreatmentDon't Know16.7%13.0%21.1%



 

 

Survey 2, N=2698

Weighted results
Response%Lower 95% CIUpper 95% CI
Support15.7%13.0%18.8%
Oppose67.7%64.0%71.2%
Don't Know16.6%13.9%19.6%


 

Unweighted results
Response%Lower 95% CIUpper 95% CI
Support16.6%15.2%18.0%
Oppose65.6%63.8%67.3%
Don't Know17.9%16.5%19.4%

 


 

  1. ^

    These figures are higher than the raw percentages agreeing because Sentience Institute reports the percentages agreeing out of those who either agreed or disagreed. But since many respondents selected “Don’t know” regarding the bans on slaughterhouses (11%), factory farming (12%) or animal farming (10%), the overall percentages supporting these bans are slightly lower: slaughterhouses (43%), factory farming (42%), animal farming (30%).

  2. ^

    This is the number of people that self-report being vegetarian and don’t report eating meat when asked. Between 2% and 6% of Americans report that they are vegetarians and yet report eating some meat when administered a food frequency questionnaire (Šimčikas 2018). Fewer than 0.4% of adults reported consuming no animal products in two non-consecutive 24-hour periods (Šimčikas 2018).

  3. ^

    In principle, a ban (within the United States) of these forms of animal product production does not necessarily entail that the consumption of animal products would be illegal. People might imagine that it would still be possible to import animal products and that they will still be able to (sometimes) consume animal products outside of the United States. Nevertheless, it seems clear that any of these bans would likely be a significant barrier to animal product consumption given that presently the vast majority of animals raised on farms within the US are raised in a factory farming system.

  4. ^

    One could argue that a ban on factory farming specifically would not entail telling people whether they could “eat animals or be vegetarian” tout court, since individuals could still eat animals raised on non-factory farms. Whether this is a plausible interpretation of respondents’ attitudes is, of course, a further question.

  5. ^

    After removing respondents who straightlined, almost a quarter (23.2%) reported that they did not understand the statement, and removing these uncomprehending respondents, the final support for a ban was 37% as opposed to 43% originally.

  6. ^

    We make no claims about the general superiority of either form of replication.

  7. ^

    Sentience Institute writes “if, for example, the public is much more opposed to factory farming and animal farming than we expect, that might suggest we should use stronger messages in our advocacy, e.g. ‘end animal farming’ instead of ‘end battery cages,’” and the results suggest that “animal-free food advocates might be able to succeed with stronger proposals than they currently use” (2017). 

Comments10
Sorted by Click to highlight new comments since: Today at 2:18 AM
Jacy
1y26
3
2

This is great data to have! Thanks for collecting and sharing it. I think the Sioux Falls (Metaculus underestimate of the 48% ban support) and Swiss (Metaculus overestimate of the 37% ban support)  factory farming ban proposals are particularly interesting opportunities to connect this survey data to policy results. I'll share a few scattered, preliminary thoughts to spark discussion, and I hope to see more work on this topic in the future.

  • These 2022 results seem to be in line with the very similar surveys conducted by Rethink Priorities in 2019, which I found very useful, but I don't know if those results have been shared publicly. Will you be sharing that data too? I know it's been eagerly anticipated, and Sentience Institute has held off on similar work while waiting for it. I'm not sure if that 2019 data is now seen as just a pilot for this 2022 data collection?
  • In addition to 2017 and 2020, Sentience Institute asked these questions in the 2019 and 2021 Animals, Food, and Technology (AFT) surveys with similar results.
  • In 2017, we preregistered credible intervals and informally solicited estimates from many others. The data was surprisingly ban-supporting relative to priors, which may be a more important takeaway than any post-hoc explanation. I didn't preregister any CIs for the 2019 or 2022 RP results. I think these drops in ban support are around what I'd expect, but it's very hard to say in hindsight, especially with other variation (e.g., different outcome scales, presumably different samples).
  • The Sentience Institute AFT survey also has questions with pro/con information, e.g., "Some people think that we should ban all animal farming and transition to plant-based and cultured foods, to reduce harm to humans and animals. Others think that we should keep using animals for food, to provide the conventional meat consumers are used to eating. Where would you place yourself on this scale?" (wording based on the GSS). That wording seems to elicit much stronger ban support than this new wording (though take with a large grain of salt due to other variation in the surveys), which seems to make sense as it is much more ban-supporting than the ban-opposing "it is wrong to kill animals" and "right to eat meat if they choose" wordings. Concretely, on a 1–6 support scale, we found a mean of 4.12 (95% CI: 4.04–4.21)  for "ban all animal farming" with our nationally representative sample in 2021. I think it's fair to say that's much higher despite also having pro/con information, and I think it's important qualification for interpreting the 2022 RP results that people may miss out on in this post.
  • Social scientists have long asked "Is there really any such thing as public opinion?" (Lewis 1939), and I think the majority answer has been some version of  "public opinion does not exist" (e.g., Blumer 1948, Bourdieu 1972): There are many interesting wordings to consider: simple vs complex, ban-supporting vs ban-opposing, socially desirable and acquiescing vs socially undesirable and anti-acquiescing, politically left vs right favored, financially incentivized, politically engaged, etc. All question wordings matter, and none are objectively correct or objectively biased. I think we may disagree on this point because you say some question wordings  "are biased towards answering “Yes”...", though you may mean some subjective standard of bias, such as distance from likely counterfactual ballot measure results. Some wordings more naturally jibe with what people have in mind when they see survey results—I prioritize simple wordings in part for this reason—but ideally we share the exact survey wording alongside percentages or scores whenever possible to ensure that clarity.
  • If you have time, what was the sample (M Turk, Prolific, Civis Analytics, Ipsos Omnibus, Knowledge Panel, etc.), what were the demographics, and was it weighted for representativeness, and if so, how?
  • What exactly do you mean by "strong" in "strong basis for more radical action"? One operationalization I like is: All things considered, I think these survey and ballot results should update the marginal farmed animal advocate towards more radical approaches relative to their prior. I'd love to know if you agree.

Well-done again on this very interesting work! [minor edits made to this comment for clarity and fixing typos]

Thanks for reading and engaging with our work!

  • In 2019 we conducted some exploratory small-N, low-confidence studies on this topic that informed these high-quality, larger N studies. We feel comfortable presenting these recent results as we want to promote the norm of advocates choosing strategies and messages based on the best quality evidence, so would rather the community update based on the results of high-quality studies rather than low-confidence small-N studies where the wrong inferences may be drawn.
  • [Update 2022-Nov-18: I added a methods section to make it clearer for readers. Thanks Jacy for flagging this issue]. Respondents were recruited via Prolific and surveyed using Qualtrics and were weighted for representativeness using 5-year 2019 American community survey data and general social survey data. More details and data are available in the OSF project, but let us know if it's not clear or something is missing since the 2nd survey was part of a larger survey that is described here which we have not finished publication of yet. (minor update- the pre-registration for the experimental study was still, unintentionally, embargoed at the time of publication so that information wasn't easily accessible for readers, but it has been lifted and should be available here by Nov 12)
  • I don't think one should take a survey showing 16% support for banning slaughterhouses when animal welfare frames are used as reason for the marginal farmed animal advocate to update towards more radical approaches relative to their prior, unless that farmed advocate assumed there would be basically 0% support. In practice, I imagine many advocates have been relying on surveys showing much higher support as their benchmark so this survey would update them toward more pessimism. 
  • More generally, given the clear variation in support results from well-done surveys from different organizations on this specific item it doesn't seem advisable for advocates to update their beliefs strongly on how support for other specific or the whole class of radical policies will be. As we wrote, it would be better to test the specific policies in question with a variety of messages to get closer to understanding how the public might actually act if given the chance to vote. And of course compare these to more moderate asks that the movement thinks are also worthwhile in expectation. I don't think we should take attitudes towards a specific policy as very indicative of attitudes to all of animal agriculture or other anti-factory farming policies. I also don't think we should take attitudes towards all of animal agriculture as indicative of support for specific policy proposals advocated for under specific messages. It was the claim that support for banning slaughterhouses should encourage advocates to push stronger messages and policies that we wanted to raise more questions about. 
  • Thanks for the reminder about the 2021 AFT survey!- which if I'm correct also showed ~43% support for banning slaughterhouses, when including No Opinion. I'll add it to the report.

We should also note that Norwood (one of the authors who replicated SI’s original 2017 study) this year ran a new slaughterhouse ban survey experiment  ([Britton & Norwood 2022](https://doi.org/10.1017/aae.2022.17)) and found lower support. (I only just received the data from them so I couldn’t include it in the post).

Here is my summary from just skimming the article and quickly aggregating the data.

They test a hypothesis that the question ordering in the 2017 SI study cued respondents' ideal self (like whether voting is a moral virtue) rather than their common self (like whether they actually voted). Their theory is that by asking respondents first whether they agreed with statements about meat reduction, discomfort with the way animals are used in the food industry, and animal sentience it cued their ideal self so that “the desire to not appear hypocritical induced them to activate a mixture of their ideal and common self” when answering questions about bans on animal farming, factory farming, and slaughterhouses.


The actual design of their study is a little too complicated to explain here (involving four treatments that altered the order and wording of ideal and common self questions, some food-related and some non-food related, as well as inserting buffer questions), but basically some respondents saw the ban questions before the ideal self questions, and others saw them in the same order as in the original 2017 SI study. Furthermore, to build on their tests about whether respondents understood the implications of bans,  "roughly half of the subjects are given the [common self] statements exactly as they appeared on the Animal Sentience survey, while the other half contain an addition [. . .] For example, some see the statement “I support a ban on slaughterhouses” while others see the statement “I support a ban on slaughterhouses and will stop eating meat”. "

While the primary aim of their study was to test something they call “identity inertia” and they fail to find convincing evidence of it, their finding on the slaughterhouse ban issue was "once individuals are informed about the implications of actions like banning slaughterhouses, they are less eager to do so." 

Data were collected via an online survey through Qualtrics from August to October 2019 of a representative sample of nearly 2600 drawn from the U.S. population. A subset of the results (N=1528) show

  • 26.48% "agreed" with the statement "I support a ban on slaughterhouses" (36.5% disagreed, 37.02% no opinion) (N=759)
  • 18.21% "Agreed" with the statement "I support a ban on slaughterhouses and will stop eating meat." (58.13% disagreed, 23.67% no opinion (N=769)

(Though Norwood say they couldn’t confirm this was correct since they never went into the data to get raw numbers like that, and I couldn't see an easy way to break these results down according to whether respondents saw the ideal-self or common-self questions first- though that probably doesn't matter since Norwood didn't find a lot of evidence that it matters)


 

Hazo
1y21
3
0

Thanks for doing this important work! I think this is one of the most important findings in animal advocacy research, so understanding it deeply and accurately is critical.

My operating model of the underlying psychology is that "slaughterhouse", "factory farm" and "animal farming"  can suggest to varying degrees the idea of "place where animals are treated poorly." People  generally don't want animals to be treated poorly, so they express support for banning such places. Then, if it's made clear that, in fact, slaughterhouses are just where animals are killed for meat, this support goes away.

If we think of people as being pro-animal welfare, but also pro-meat, all the data is explainable. As activist, it can be easy to go from "animals are mistreated on farms" to "we shouldn't eat them," but for most people I think the more natural response is "The people mistreating them should stop."

Just wanted to throw this out there, since I think all this data is still consistent with a surprisingly pro-welfare stance of a lot of people :)

Banning slaughterhouses is essentially a ban on eating meat, right? I can't imagine that 43% of the US public would support that, when no more than 10% of the US public is vegetarian in the first place. (Estimates vary, you say 1% in this article, and 10% is the most aggressive one I could find.)

It seems much more likely that these surveys are invalid for some reason. Perhaps the word "slaughterhouses" confused people, or perhaps people are just answering surveys based on emotion without bothering to think through what banning slaughterhouses actually means.

Yes I implore readers to defer to common sense here. The face validity of there results is poor and I would suggest further work is done to improve the survey methodology, understanding people's understanding of the question and how they'd change their response in relation to a political campaign where there would be a saturation of information from very powerful commercial agricultural interests. I'm sick of seeing EA making political blunders.

Thanks for doing this work Neil (and the great RP survey team) - it's super interesting and helpful as useful! I'm particularly quite interested in this idea you had in your conclusion:

It would be better to test people's responses to more detailed messages and policy proposals, paying special attention to how radical messages compare to counterfactual moderate messages. One could also test a radical ask (ban factory farming) and a moderate ask (labelling for cage-free eggs, say) each with a radical message ("meat is murder") versus a moderate one ("human/consumer welfare"). 

Is RP planning on doing anything in this vein? I know of one experimental paper released quite recently that tested this for both different radical messages, and also radical tactics (in a 2x2 design). They found that radical messages (ending all animal use vs improve animal welfare) didn't increase support for more moderate messages, but the use of radical tactics did. The author isn't an animal person (I'm fairly sure) so the different conditions were quite broad - which you can see in the supplemental files of the paper. For example, the radical agenda spoke about  'eliminating the human consumption of meat and creating a "vegan world"' whereas the moderate treatment focused on 'increasing the number of farms using humane methods' which is fairly coarse-grained! 

Would be interesting to try replicate this experiment with more specific policy proposals as you mention, as it will probably yield more realistic results. 

You might also be interested in this recent polling by Data for Progress* on likely U.S. voters' attitudes around farm animal cruelty. We found strong support across political ideologies for preventing farm animal cruelty. Note, though, that we did not ask about things like banning slaughterhouses.

https://www.dataforprogress.org/blog/2022/8/2/voters-demand-farm-animal-protections-from-both-politicians-and-companies

* I work here, but was not involved in fielding this survey.

In the fourth decade of animal advocacy, I honestly wonder what has hurt animals more than AR advocates pointing to polls. 

Why would we ever, ever, ever look at opinion polls, when every day, everyone is casting an actual ballot at the grocery store and restaurant? 

This reminds me of all the interviews where Beyond Meat's Ethan Brown said, "People tell me they don't want GMOs." He is simply talking to the wrong people. Nearly everyone only cares about cheap meat. Full stop. Nothing else matters, no matter what they say.

I think polls can be useful indicators for the likelihood of success of a ballot measure (e.g. banning intensive confinement, like some US states have), but they have to be framed concretely and with enough context to emphasize the costs to consumers. Also, people have voted to ban cages and crates despite it increasing their costs and not already really buying cage-free or crate-free. See this for some discussion: https://jaysonlusk.com/blog/2019/2/18/why-dont-we-vote-like-we-shop