I think this article makes its case compellingly, and appreciate that you spell-out the sometimes subtle ways uncertainty gets handled.
Did the question "Why should justification standards be the same?" arise in a sociological / EA movement context? My interpretation (from the question wording alone) would be more epistemic, along the lines of the unity of science. In my view, standards for justification have to be standardized, otherwise they wouldn't be standards; one could just offer an arbitrary justification to any given question.
Hi Dorsal, thank you for your kind words about the work and thoughtful questions. I agree with Seth's reply and would add for (A), there is some evidence of this effect for plant-based foods in general, for example: Garnett 2019, Parkin 2021, and Pechey 2022. I don't know of any studies which have tested adding animal-based meats.
Thank you for writing this thoughtful piece! I especially appreciate the transparency in reasoning and the careful attention to empirical evidence (some of which I’ve contributed to).
I wanted to share a few notes on the displacement section—specifically, some important papers that weren’t mentioned and a few potential misinterpretations of others:
I'm thinking more about this interpretation, but I'm not sure it is correct because WFP's calculations are designed to be conservative in estimating the welfare improvements and exclude various welfare harms. For example, it looks like the broiler estimates exclude welfare harms from transport to slaughter. When these hours of suffering are added back in, the ratio between the two scenarios can go down.
As a hypothetical example, suppose BCC chickens are currently estimated to suffer 50 hours, while non-BCC chickens suffer 100 hours. If we add in 10 hours o...
Thank you for writing this! It was very helpful learn how these initiatives went and I found my self agreeing with much of what you wrote.
I am curious to learn more of what costly signals you had in mind when you write:
politicians wanting to make extremely costly signals to show how much they support animal agriculture — two states have already preemptively banned the sale of cultivated meat.
My initial thinking was that these were pretty low costs for these politicians: cultivated meat isn't salient to the constituency, there are no sales in the state, and the industry is very small, so no one is really bothered to inflict a cost, but I'm curious what else I should consider.
Hi Elliot, I cite a couple of studies similar to that in my review Price-, Taste-, and Convenience-Competitive Plant-Based Meat Would Not Currently Replace Meat; I suspect you're thinking of Malan 2022.
Hi Bruce, thank you for your questions. I’m leading this project and made the decision to recruit volunteers, so thought I’d be best positioned to respond. (And Ben’s busy protesting for shrimp welfare today anyway!)
- Did the team consider a paid/minimum wage position instead of an unpaid one? How did it decide on the unpaid positions?
Yes, we would prefer to offer additional paid positions. However, given the budget for this project, we were not able to offer such positions. We regularly receive unsolicited inquiries from people interested in volunteer...
I've made some updates and corrections to this paper—(2) and (3) are most important in my opinion and make the Malan 2022 field experiment a somewhat weaker test of the PTC hypothesis. Thanks to all who commented!
Changes are noted below (which I've also added to the post):
Corrections and updates in the "Malan 2022 field experiment" section:
Replace "On Thursdays, students had the option of receiving prepared burritos with either Impossi
This source suggests the rate of self-identified veganism in Germany is about 3% in 2022. (We did not do any data collection ourselves; this report is a re-analysis of existing data collected by Brachem et al.)
they don’t discuss (let alone defend) “strong form PTC” theory.
I suppose we simply disagree here. The first quote I cite states "the products need to taste the same or better and cost the same or less." The next sentence strongly implies that "the market can kick in and take it from there, just shoot us up the S-curve," with "necessary but not sufficient" relegated to a "quibble." In conjunction with the Q&A, I think reasonable audience member would infer that your statements mean roughly "if price and taste parity were met, a majority of consumers...
Thanks! My subsequent reply to Bruce might be helpful here—while Bruce doesn't defend the claim here, I do think he says things that strongly resemble it elsewhere.
Are you referring to the blind taste test?
Yes. The Sogari blind taste test is indeed affected by saltiness; it also includes an informed taste test similarly effected (but again finding Impossible and animal-based meat tied for first). There is a second blind taste test cited immediately thereafter (Chicken and Burger Alternatives, 2018), although salt levels were not reported.
Have you compared these foods yourself?
No, I haven't.
...It seems really hard to draw conclusions about taste competitiveness of a meat substitute from this kind of n=1 study, b
Hi Paul, thanks for checking the analysis so closely! (And apologies for the slow reply; I've been gathering some more information.)
But wouldn't Impossible be a comparison for ground beef, not for steak? Am I misunderstanding something here?
This is a good point and I've now confirmed with the authors that the steak was cubed, rather than minced or ground, so indeed not likely directly comparable to Impossible ground beef. I'll be making some updates to the paper accordingly. Thank you!
The build-your-own-entree bar offers shredded beef, which while also...
Yes, I'm not entirely certain Impossible meat is equivalent in taste to animal-based ground beef. However, I do find the evidence I cite in the second paragraph of this section somewhat compelling.
Are you referring to the blind taste test? It seems like that's the only direct evidence on this question.
It doesn't look like the preparations are necessarily analogous. At a minimum the plant burger had 6x more salt. All burgers were served with a "pinch" of salt but it's hard to know what that means, and in any case the plant burger probably ended up at least ...
Hi Bruce, thank you for your reply. I'll focus on a few key disagreements here, although I'm happy to elaborate further if it's helpful.
Finally fifth: I'm not sure about your current thesis (the “strong-form” version of PTC). [...] In my opinion, these are very weak citations, and your inference based on them is not (I don’t think) tenable.
I'll address this first as I think it's trenchant to determine whether the hypothesis I work to refute is in fact held. I’d contend that you (and GFI) have, at times, prominently promoted and supported the strong PTC...
Thanks for your response, Jacob -
Here’s my/GFI’s principal thesis on this topic:
Taste and price are essential to the success of plant-based and cultivated meat, and it’s going to be very hard to reach taste and price parity for either product. So we think it makes sense to focus on those two factors. But that doesn’t mean that once we’ve solved those two factors, we’re done.
As noted in a previous post, we have added nutrition as a third critical factor, mostly in the face of negative messaging around ultra processing and the critical role of ea...
Hi Bruce, thank you for your response and engagement with the paper over the course of the project.
However, I don’t think this reply engages with the key arguments I make in the paper.
Why did GFI initially adopt the PTC paradigm?
I cite and discuss a number of the studies you mention to support this point in the section The PTC premise. I make four specific critiques of this body of literature—can you address these directly?
Thanks very much, Jacob - I’m in Asia for work at the moment and in all-day meetings, so it’s going to take me a bit to get back to this, but I’m grateful to you for getting this conversation going. I skimmed the discussion but want to read that more thoroughly, too. I should be able to read all comments with intentionality and offer a few more thoughts this coming weekend, I expect/hope.
[EDIT, Sunday night: I read through all comments this weekend, but it will be next weekend before I'm able to craft my thoughts into something intelligible and (I ho...
Thanks for your kind words, Lizka!
I should also say that it doesn't seem appropriate (to me) to strongly update towards "it's not important to lower price and improve taste and convenience of plant-based meat alternatives." (I don't think the post is seriously arguing for this, but figured that I would flag it.)
I agree, with emphasis on 'strongly update.'
which is indeed a belief I've heard implied or stated in EA
This is especially helpful as people have (understandably) doubted this is the case.
...I expect that without improvements in price and tast
Hi Michael, thanks for engaging; just flagging this will be my last reply on this thread :)
Quickly reviewing the RethinkX report, it seems like the dramatic changes forecast on very short timelines have not come to pass:
The cost curves in Fig 5 does not cite any sour...
(Abraham and I both work for Rethink Priorities.)
I agree, especially with your points on "necessary but not sufficient." In my view, this represents mostly a pivot from the PTC hypothesis. I'm not sure whether to view this as post hoc hypothesizing (generally bad) or merely updating-on-evidence (generally good).
I do think the question of "what percent of the 'work' is PTC?" is probably not well-defined, but is likely a worthwhile starting point for disagreement.
Hi Jack, thanks for your comment and so thoroughly checking my sources!
I agree with your interpretation of Szejda. I intended to cite this study with regards to the PTC premise—that PTC primarily determine food choice—not the PTC hypothesis in full (that PTC-competitive PBM would largely displace animal-based meat).
However, I don't agree that no one holds this view. I'd refer to three lines of evidence:
...the hypothesis proposes that plant-based meat "can compete o
Hi Mark, thank you for your kind words and thoughtful comment! Also, welcome to the forum :) Please forgive my referring you to particular sections of the paper if you've already read them; I understand it's a lengthy read.
Indeed, I consider general evidence on PTC in food choice in the section The PTC premise. Chris Bryant has actually subsequently pointed me toward Cunha (2018), which I think is stronger than what I cite there, but still subject to the same critiques. The paper is also not cited in any of the discourse on plant-based meats that I know of...
I agree that the PTC hypothesis is generally unsupported by the data available.
Glad to hear!
neither of these things are going to be true for longer than 1-2 years because of the cost curve of alternative meats and the technologies involved.
the most likely future is one in which alternative meat has the following attributes: • At least 80% cheaper • At least as tasty as the best meat today • Consistently the same quality, every time • At least as healthy, likely far healthier • At least 100X less contamination issues. • A longer shelf life
This is ...
On the Malan trial, I write:
...With regards to taste, Impossible ground beef specifically has not been subjected to any public taste tests. However, as reviewed above, the Impossible Burger, which is made of similar ingredients, has been found to taste equivalent in some studies. The study does not describe exactly the form of the beef in the steak burrito, making its taste equivalence less certain but probably still a reasonable inference. For the ground beef served on the build-your-own entree line, taste equivalence seems very likely. We can further surm
Hi Brad, thanks for your comment. I'd contend that the Malan 2022 field experiment, among other studies, does give us some insight into behavior towards a putatively PTC-competitive plant-based meat. (There is also some survey data included which might cover attitudes, but I'm assuming you mean something closer to behavior. Let me know if not.) Can you clarify why you don't find it compelling, if that's the case?
Ditto, really appreciate your taking the time to so thoughtfully engage. :) A good day on the Forum! I'll try to wrap up here as well.
(a) Thanks for this reference—I wasn't aware of it! This definitely seems like useful evidence in the right direction and I agree with the XKCD's comic sentiment. That said, it seems like there are still many possible contingencies where price might be a partial rather than full cause. This seems like a ripe area for further research.
(b) I agree, my list is incomplete, and these are good considerations. By the same token, I ...
I also think that the energy tech analogy might be useful, in particular the case of solar panels, which, unlike nuclear and other energy sources, are also consumer products that went from "rich persons vanity project" to "you'd be dumb not to buy one".
Decades ago, solar cells were highly expensive, and mainly used for niche applications. There was environmentalists pressure towards clean energy, but the high cost meant only a few wealthy enthusiasts would undergo the switch, and the industry was small and non-influential.
The environmentalist m...
Thank you, Fergus, that's very kind of you! I would note that I think it's quite possible and somewhat likely the Malan field experiment found a very small effect on beef sales at 0.3 percentage points. That said, there may have been a couple percentage point decline in poultry sales, which would be much more valuable. (I didn't get in to this as it was besides the main point of the paper.)
Thanks for reading, Jonas! I think these are pretty reasonable takeaways. I'd only add that it'd be useful to define for yourself what PTC actually, concretely mean. Also, I don't think many folks believe we'll reach some standard of PTC parity across most animal-products within ~5 years, if that's roughly what you mean by "the next years."
Thank you, I appreciate the nuance! [Also, I realize it’s a long paper, so I quote some relevant passages, but apologies if you already read them. I figure it might help other folks following our thread as well.]
"One could go away from your piece thinking there is a lot of evidence that should have one update against long-term PTC" Reasonable, although I did try to avoid this and emphasize the results apply to current consumers. So I also agree it "seems not warranted by most of the kind of evidence you cite" and specifically didn't cite evidence that f
Hi Jacob,
thank you -- strongly upvoted for quality of exchange!
In the interest of time (this has to be my last comment), I ignore the smaller disagreements and focus on what seem like the two cruxes we have here (opposite sequence in your comment, but I think answering in this order is easier here):
(a) Does PTC or PTC-likeness causally drive adoption?
(b) Are clean energy technologies a good comparator?
On (a), here is a visual from the latest IPCC report:
Of course, correlation does not equal causation, but we know from many richer accounts than those ...
Thanks for your question—forgive my quoting from the paper in response, I understand it's quite lengthy! To your first question, I don't think most interpretations of the PTC hypothesis would qualify tempeh as taste-equivalent (although, as I emphasize here, these factors aren't very well defined).
I've included a case study on hot dogs specifically:
...the home-goods-retailer-cum-cafeteria Ikea sells plant-based hotdogs that are equally or lower-priced, readily available alongside animal-based hot dogs, and "received a 95 percent approval rating" in taste te
Hi Sanjay, thank you for reading and your thoughtful comment! The evidence I reviewed here already spans a couple of years, so I do think it might be reasonable to extrapolate closer to 3-5 years. That said, there isn't any analysis of trends of over time, so maybe not.
I agree conditional on the existence of similar alternatives, regulating against animal-based meat is easier than if those alternatives don't exist. Can you elaborate on the why you think the arguments apply differently to lab-grown rather than plant-based meat in your third point? If one be...
Hi Jack, thank you for your comment! I largely agree the future prospects of plant-based meat might be quite different from the current prospects and write:
...Important alternatives to the PTC hypothesis might consider the role of future consumers rather than present-day consumers, who have been the focus of this paper. Future consumers might experience a large change in social norms or otherwise shift their preferences toward consuming plant-based rather than animal-based meats. This is a common feature of many animal advocacy theories of change (Delon et
Hi Jacob,
thanks for your reply -- a couple of reactions, hopefully quite nuanced (I agree with you a bunch, and disagree on others).
1. I did not mean to imply that you do not consider this possibility at all (you do!), but rather was reacting to the general rationale of the piece of using present-day evidence on behaviors as informative with regards to long-term prospects.
One could go away from your piece thinking there is a lot of evidence that should have one update against long-term PTC and alternative protein transition which seems not warranted by mos...
It only took me 18 months or so :), but I've published my paper that partially addresses this question, Price-, Taste-, and Convenience-Competitive Plant-Based Meat Would Not Currently Replace Meat.
Gladly, thank you for your kind words! Sometimes people include health or nutrition as well. But there are really myriad factors that influence food choice, as I talk about some here, so I think there are still issues with models that simply add a factor or two (discussed some in the paragraph starting "Producing compelling evidence to substantiate just the premise of the PTC hypothesis would require an ambitious experimental effort.")
(Caveat: Views my own, not my employer's)
I think this sort of first-hand investigation is potentially pretty valuable. I know Ren discourages folks from conducting similar self-experimentation, but I would be curious to see safe and careful experiments of this bent to understand the impact of deliberate experiences of suffering on moral views. Perhaps a worthwhile task for some empirical ethicists.
Caveat: I work for Rethink Priorities, as do the authors of this post
Great to have this timely research and good antidote to some of the gloomy outlooks on how this has affected the community!
I especially liked the two convergent approaches for measuring the effect of the FTX crisis on EA satisfaction. I noticed in the satisfaction over time analysis, you can kind of eyeball a (slight) negative pre-trend. This made me wonder how you thought about the causal inference concerns both in that specific analysis and for this report generally? By extension, I won...
I agree with the substance of your post and appreciate your taking the time to do the fact checking. I also sympathize with your potential frustration that the fact checking showe didn't support the claim.
However, I do think your comment comes off as a bit dismissive: neither OP nor Food Empowerment Project themselves claim FEP to be "real researchers," whatever this might mean; OP merely states FEP might have helpful resources. Furthermore, the comment might be taken to imply that being an activist and a real researcher are at odds, which I don't believe to be the case.
I also feel sad that your comments feel slightly condescending or uncharitable, which makes it difficult for me to have a productive conversation.
I'm really sorry to come off that way, James. Please know it's not my intention, but duly noted, and I'll try to do better in the future.
Got it; that's helpful to know, and thank you for taking the time to explain!
SDB is generally hard to test for post hoc, which is why it's so important to design studies to avoid it. As the surveys suggest, not supporting protests doesn't imply people don't report suppo
Thank you for your responses and engagement. Overall, it seems like we agree 1 and 2 are problems; still disagree about 3; and I don't think I made my point on 4 understood and your explanation raises more issues in my mind. While I think these 4 issues are themselves substantive, I worry they are the tip of an iceberg as 1 and 2 are in my opinion relatively basic issues. I appreciate your offer to pay for further critique; I hope someone is able to take you up on it.
Great, I think we agree the approach outlined in the original report should be changed.
I think I agree with the central theses here, as I read them: indeed, ideally we would (1) measure what happens to people individually, rather than on average, due to taking psychiatric drugs, and (2) measure an outcome that reflects people's aggregate preference for their experience of life with the drug versus the counterfactual experience of life without the drug.
However, I think these problems are harder to resolve than the post suggests. Neither can be measured directly (outside circumscribed / assumption-laden situations) due to the fundamental probl... (read more)