All of Jacob_Peacock's Comments + Replies

I've made some updates and corrections to this paper—(2) and (3) are most important in my opinion and make the Malan 2022 field experiment a somewhat weaker test of the PTC hypothesis. Thanks to all who commented!

Changes are noted below (which I've also added to the post):

  1. Correction to Figure 1 to indicate Ikea 2019 data represent all stores globally, rather than just the United States.

Corrections and updates in the "Malan 2022 field experiment" section:

  1. Replace "On Thursdays, students had the option of receiving prepared burritos with either Impossi

... (read more)

This source suggests the rate of self-identified veganism in Germany is about 3% in 2022. (We did not do any data collection ourselves; this report is a re-analysis of existing data collected by Brachem et al.)

they don’t discuss (let alone defend) “strong form PTC” theory.

I suppose we simply disagree here. The first quote I cite states "the products need to taste the same or better and cost the same or less." The next sentence strongly implies that "the market can kick in and take it from there, just shoot us up the S-curve," with "necessary but not sufficient" relegated to a "quibble." In conjunction with the Q&A, I think reasonable audience member would infer that your statements mean roughly "if price and taste parity were met, a majority of consumers... (read more)

1
BruceF
7mo
Thanks for clarifying w/r/t strong form PTC theory - that’s helpful. I think it makes sense to focus on taste, price, and nutrition as the three factors that are absolutely necessary for success; we can address other factors later (or let private companies address those other factors later). Sorry that caused you some confusion, though I think you took an untenable leap with your assumptions.  W/r/t “many times the penetration” and “huge, huge dent,” I think that will depend a lot on what happens between now and reaching price/taste/nutrition parity. But the numbers in your hypothetical discrete choice experiments are extremely promising (for the reasons already discussed). Surveys w/r/t cultivated meat are equally promising - and as discussed, this is all in a world where the products don’t yet exist and many/most consumers are dubious that they’re even possible (i.e., survey respondents don’t think taste and price parity are possible, so they simply reject the premise - and still acceptance numbers are extremely high).  W/r/t your four critiques of the early studies: For anyone who doesn’t remember what the four critiques are, here you go: 1. These studies generally don’t find PTC to be the top three factors in determining food choice. 2. The rankings in these studies reflect what people perceive as the most important factors rather than what would actually cause them to change their diets. 3. The cited studies were designed primarily to investigate the role of a few particular factors in food choice rather than to identify the most important factors.  4. These studies analyze the average ranking of each factor rather than how individual consumers rank the factors.) On the first point, the studies mostly find price and taste to be most important. That said, even if all four critiques are totally accurate, that just indicates subpar study design and doesn’t mean that the conclusions are wrong. We spent the rest of our back-and-forth discussing other studie

Thanks! My subsequent reply to Bruce might be helpful here—while Bruce doesn't defend the claim here, I do think he says things that strongly resemble it elsewhere.

Are you referring to the blind taste test?

Yes. The Sogari blind taste test is indeed affected by saltiness; it also includes an informed taste test similarly effected (but again finding Impossible and animal-based meat tied for first). There is a second blind taste test cited immediately thereafter (Chicken and Burger Alternatives, 2018), although salt levels were not reported.

Have you compared these foods yourself?

No, I haven't.

It seems really hard to draw conclusions about taste competitiveness of a meat substitute from this kind of n=1 study, b

... (read more)

Hi Paul, thanks for checking the analysis so closely! (And apologies for the slow reply; I've been gathering some more information.)

But wouldn't Impossible be a comparison for ground beef, not for steak? Am I misunderstanding something here?

This is a good point and I've now confirmed with the authors that the steak was cubed, rather than minced or ground, so indeed not likely directly comparable to Impossible ground beef. I'll be making some updates to the paper accordingly. Thank you!

The build-your-own-entree bar offers shredded beef, which while also... (read more)

Yes, I'm not entirely certain Impossible meat is equivalent in taste to animal-based ground beef. However, I do find the evidence I cite in the second paragraph of this section somewhat compelling.

Are you referring to the blind taste test? It seems like that's the only direct evidence on this question.

It doesn't look like the preparations are necessarily analogous. At a minimum the plant burger had 6x more salt. All burgers were served with a "pinch" of salt but it's hard to know what that means, and in any case the plant burger probably ended up at least ... (read more)

Hi Bruce, thank you for your reply. I'll focus on a few key disagreements here, although I'm happy to elaborate further if it's helpful.

Finally fifth: I'm not sure about your current thesis (the “strong-form” version of PTC). [...] In my opinion, these are very weak citations, and your inference based on them is not (I don’t think) tenable.

I'll address this first as I think it's trenchant to determine whether the hypothesis I work to refute is in fact held. I’d contend that you (and GFI) have, at times, prominently promoted and supported the strong PTC... (read more)

Thanks for your response, Jacob - 

Here’s my/GFI’s principal thesis on this topic: 

Taste and price are essential to the success of plant-based and cultivated meat, and it’s going to be very hard to reach taste and price parity for either product. So we think it makes sense to focus on those two factors. But that doesn’t mean that once we’ve solved those two factors, we’re done.

As noted in a previous post, we have added nutrition as a third critical factor, mostly in the face of negative messaging around ultra processing and the critical role of ea... (read more)

Sorry if I missed it, but are the logarithms here base 10?

3
Willem Sleegers
8mo
No, they're natural logarithms.

Agree, forecasts would be great and I'd work on this is I end up spending more time on the future prospects of PBM!

Hi Bruce, thank you for your response and engagement with the paper over the course of the project.

However, I don’t think this reply engages with the key arguments I make in the paper.

Why did GFI initially adopt the PTC paradigm?

I cite and discuss a number of the studies you mention to support this point in the section The PTC premise. I make four specific critiques of this body of literature—can you address these directly?

  1. These studies generally don’t find PTC to be the top three factors in determining food choice. [Two of the three studies I cite d
... (read more)

Thanks very much, Jacob - I’m in Asia for work at the moment and in all-day meetings, so it’s going to take me a bit to get back to this, but I’m grateful to you for getting this conversation going. I skimmed the discussion but want to read that more thoroughly, too. I should be able to read all comments with intentionality and offer a few more thoughts this coming weekend, I expect/hope. 

[EDIT, Sunday night: I read through all comments this weekend, but it will be next weekend before I'm able to craft my thoughts into something intelligible and (I ho... (read more)

Thanks for your kind words, Lizka!

I should also say that it doesn't seem appropriate (to me) to strongly update towards "it's not important to lower price and improve taste and convenience of plant-based meat alternatives." (I don't think the post is seriously arguing for this, but figured that I would flag it.)

I agree, with emphasis on 'strongly update.'

which is indeed a belief I've heard implied or stated in EA

This is especially helpful as people have (understandably) doubted this is the case.

I expect that without improvements in price and tast

... (read more)

Hi Francis, I don't think there's much work on this, although I do believe an advocacy group tried this but found the results underwhelming.

Hi Michael, thanks for engaging; just flagging this will be my last reply on this thread :)

Quickly reviewing the RethinkX report, it seems like the dramatic changes forecast on very short timelines have not come to pass:

  • Precision fermentation beef is not currently ~$2/kg (Figure 11)
  • 30% of the US beef 'tissue' market is not from cultured or precision fermentation (Figure 12)
  • US cattle population is forecast to decline ~80M but remains steady at 94M as of 2021
  • Similarly, US chicken populations remain stable

The cost curves in Fig 5 does not cite any sour... (read more)

2
Michael Simm
8mo
Thanks Jacob, I definitely appreciate your input too as I am no expert on the production of cellular meat or precision fermentation. I'm generally interested in reducing costs of living & reducing suffering. That said here are my thoughts on what you said. I entirely agree that their predictions in this space in the near term have proven inaccurate on the market. However the $2 figure might not be referring to sales costs, but the cost of production in a large state of the art factory. Basically if an optimized factory was built with the best 2023 technology, could they get the cost of production below $2/Kg? We're in complete agreement about their 2023 timeline predictions, they were overly optimistic. What's important though is if the overall cost curve over the next decade is going to take the shape they've predicted (exponential declines versus linear or logarithmic). With input costs, cows & chickens are inefficient machines that require massive amounts of (water especially) input materials, land area, and maintenance. I agree the feed & fuel costs for animals could in theory be reduced by an order of magnitude, but animals will always be inefficient. Importantly, if PF & cell based meats take market share from the most affordable meats first (ground beef & whatever chicken nuggets are made of), the animal meat sellers will encounter a negative feedback loop as they loose economies of scale and margins reduce. By disruptions, I mean any system that is 5X or more better at doing something than the incumbent system. You're right that PF Meats are not - yet - a disruptive technology, I should have worded it better, but I the costs are declining by a consistent percentage each year. If the cost keeps declining exponentially according to Wrights Law, these predictions will come to pass. At the end of the day, how much room for improvement is there in R&D and mass manufacturing in this space? How much extra room can be created by AI enabled advancement, pro

(Abraham and I both work for Rethink Priorities.)

I agree, especially with your points on "necessary but not sufficient." In my view, this represents mostly a pivot from the PTC hypothesis. I'm not sure whether to view this as post hoc hypothesizing (generally bad) or merely updating-on-evidence (generally good).

I do think the question of "what percent of the 'work' is PTC?" is probably not well-defined, but is likely a worthwhile starting point for disagreement.

4
Jack_S
8mo
Thanks for both of your responses (@Jacob_Peacock and @abrahamrowe). I was going to analyse the podcast in more detail to resolve our different understandings, but I think @BruceF 's response to the piece clarifies his views on the "negative/positive" PTC hypothesis. The views that he would defend are: (negative) "First, if we don’t compete on price and taste, the products will stay niche, and meat consumption will continue to grow." and (positive) "Second, if we can create products that compete on price and taste, sales will go up quite a lot, even if other factors will need to be met to gain additional market share.”  I expect that these two claims are less controversial, albeit with "quite a lot" leaving some ambiguity.  My initial response was based on my assumption that everyone involved in alt protein realises that PTC-parity is only one step towards widespread adoption. But I agree that it's worth getting more specific and checking how people feel about Abraham's "how much of the work is PTC doing- 90% vs 5%?" question.    I assume if you surveyed/ interviewed people working in the space, there would be a fairly wide range of views. I doubt if people have super-clear models, because we're expecting progress in the coming years to come on multiple fronts (consumer acceptance, product quality, product suitability, policy, norms), and to mutually reinforce each other, but it would be worth clarifying so that you can better identify what you're arguing against.  From my own work on alt-protein adoption in Asia I sense that PTC-parity is only a small part of the puzzle, but it would also be far easier to solve the other pieces if we suddenly had some PTC-competitive killer products, so PTC interact with other variables in ways that make it difficult to calculate.  Overall, I stand by my criticism that I don't think the positive PTC-hypothesis as you frame it is commonly held. But I'd like to understand better what the views are that you're critiquing. It woul

Thank you, Alain, and interesting to hear similar accounts for someone more closely involved with the industry!

Hi Jack, thanks for your comment and so thoroughly checking my sources!

I agree with your interpretation of Szejda. I intended to cite this study with regards to the PTC premise—that PTC primarily determine food choice—not the PTC hypothesis in full (that PTC-competitive PBM would largely displace animal-based meat).

However, I don't agree that no one holds this view. I'd refer to three lines of evidence:

  1. Direct textual evidence. In particular, I think the main source I cite is pretty clear cut:

the hypothesis proposes that plant-based meat "can compete o

... (read more)

Hi Mark, thank you for your kind words and thoughtful comment! Also, welcome to the forum :) Please forgive my referring you to particular sections of the paper if you've already read them; I understand it's a lengthy read.

Indeed, I consider general evidence on PTC in food choice in the section The PTC premise. Chris Bryant has actually subsequently pointed me toward Cunha (2018), which I think is stronger than what I cite there, but still subject to the same critiques. The paper is also not cited in any of the discourse on plant-based meats that I know of... (read more)

2
Mark Onley
8mo
Thanks for the reply! Bruce Friedrich's reply does a better job responding than I could, so I'll leave it to you both and look forward to seeing the conversation. Appreciate you engaging with me here and the welcome to the forum :)

I agree that the PTC hypothesis is generally unsupported by the data available.

Glad to hear!

neither of these things are going to be true for longer than 1-2 years because of the cost curve of alternative meats and the technologies involved.

the most likely future is one in which alternative meat has the following attributes: • At least 80% cheaper • At least as tasty as the best meat today • Consistently the same quality, every time • At least as healthy, likely far healthier • At least 100X less contamination issues. • A longer shelf life

This is ... (read more)

1
Michael Simm
8mo
Thanks for the insight, I'm no expert on this topic so I've been going off conversations with friends in the space, RethinkX, and I take a first principles approach to solving problems. I read the study and the conclusion seems to say the top problems are metabolic efficiency enhancements and the development of low-cost media from plant hydrolysates. But there are a lot of other engineering problems. However I didn't see any fundamental problems (physics based) that would force a floor on how good it can get. There were and are plenty of engineering problems with making batteries & solar cheaper as well (and AI better). I also took at look at the forecasting articles, and they all seem to revolve around explicitly looking at cell based meat predictions and the bad predictions made by startups in the space. It might be much better to forecast based on the historical price declines of precision fermentation per kg over the last several decades which this covers: https://rethinkdisruption.com/the-roadmap-to-disruption/ "from what I recall I didn't find it especially compelling. Are there any particular attributes or analyses that stood out to you, besides the reputation of its publisher?" I read the entire report a few years ago, and I found it quite compelling. I've studied the s-curve adoption of many technologies and I've found the 'Seba Disruption Framework" to be very reliable. It's not just their reputation, I've personally seen their predictions in other spaces be far more accurate than other prediction organizations. I'm interested to know what you found particularly uncompelling about the report? Let's talk raw materials. The vast majority of the elemental components of meat can be sourced directly from the air using electricity. Carbon, hydrogen, oxygen, and nitrogen. Some minerals and other elements (Sulphur Iron, Zinc, Selenium) would need to be sourced, which would entail transportation to a factory for processing. I asked GPT4 to calculate the cos

On the Malan trial, I write:

With regards to taste, Impossible ground beef specifically has not been subjected to any public taste tests. However, as reviewed above, the Impossible Burger, which is made of similar ingredients, has been found to taste equivalent in some studies. The study does not describe exactly the form of the beef in the steak burrito, making its taste equivalence less certain but probably still a reasonable inference. For the ground beef served on the build-your-own entree line, taste equivalence seems very likely. We can further surm

... (read more)

Hi Brad, thanks for your comment. I'd contend that the Malan 2022 field experiment, among other studies, does give us some insight into behavior towards a putatively PTC-competitive plant-based meat. (There is also some survey data included which might cover attitudes, but I'm assuming you mean something closer to behavior. Let me know if not.) Can you clarify why you don't find it compelling, if that's the case?

5
Brad West
8mo
Was there data suggesting that the students in the dining hall believed that the beyond meat tasted the same? It will be perception of parity that would matter for such experiments. In a post-parity world actual parity may quickly translate into perceived parity. Probably if you were to survey the steak burrito eaters, they would say they got it because it tastes better. I'm also skeptical that the brief campaigns are an adequate substitute for for the discussion that would be prompted by a post-PTC(N) world. It seems intuitive to me that if you give people the opportunity to get a product that tastes the same, costs the same, is just as convenient and nutritionally identical, most people will shift. It will probably take a reasonable period of time for people to adjust to the weirdness factor of something like cultivated meat, but I anticipate that it would happen quickly (whether PTC(N)can be achieved on a reasonable time line is a different question.) People are selfish and awful, but not typically psychopathic. If they can not contribute to animal abuses without sacrificing anything, they will. It will take some modest degree of time and effort to make this choice clear to people (which is why I don't think these experiments are very probative), but I think the outcome will be analogous to recycling or drunk driving campaigns. People suck, but not quite as much as EAs often think they do.

Ditto, really appreciate your taking the time to so thoughtfully engage. :) A good day on the Forum! I'll try to wrap up here as well.

(a) Thanks for this reference—I wasn't aware of it! This definitely seems like useful evidence in the right direction and I agree with the XKCD's comic sentiment. That said, it seems like there are still many possible contingencies where price might be a partial rather than full cause. This seems like a ripe area for further research.

(b) I agree, my list is incomplete, and these are good considerations. By the same token, I ... (read more)

I also think that the energy tech analogy might be useful, in particular the case of solar panels, which, unlike nuclear and other energy sources, are also consumer products that went from "rich persons vanity project" to "you'd be dumb not to buy one". 

Decades ago, solar cells were highly expensive, and mainly used for niche applications. There was environmentalists pressure towards clean energy, but the high cost meant only a few wealthy enthusiasts would undergo the switch, and the industry was small and non-influential. 

The environmentalist m... (read more)

Thank you, Fergus, that's very kind of you! I would note that I think it's quite possible and somewhat likely the Malan field experiment found a very small effect on beef sales at 0.3 percentage points. That said, there may have been a couple percentage point decline in poultry sales, which would be much more valuable. (I didn't get in to this as it was besides the main point of the paper.)

Thanks for reading, Jonas! I think these are pretty reasonable takeaways. I'd only add that it'd be useful to define for yourself what PTC actually, concretely mean. Also, I don't think many folks believe we'll reach some standard of PTC parity across most animal-products within ~5 years, if that's roughly what you mean by "the next years."

Thank you, I appreciate the nuance! [Also, I realize it’s a long paper, so I quote some relevant passages, but apologies if you already read them. I figure it might help other folks following our thread as well.]

  1. "One could go away from your piece thinking there is a lot of evidence that should have one update against long-term PTC" Reasonable, although I did try to avoid this and emphasize the results apply to current consumers. So I also agree it "seems not warranted by most of the kind of evidence you cite" and specifically didn't cite evidence that f

... (read more)

Hi Jacob,

thank you -- strongly upvoted for quality of exchange!

In the interest of time (this has to be my last comment), I ignore the smaller disagreements and focus on what seem like the two cruxes we have here (opposite sequence in your comment, but I think answering in this order is easier here):

(a) Does PTC or PTC-likeness causally drive adoption?

(b) Are clean energy technologies a good comparator?


On (a), here is a visual from the latest IPCC report:


Of course,  correlation does not equal causation, but we know from many richer accounts than those ... (read more)

Thanks for your question—forgive my quoting from the paper in response, I understand it's quite lengthy! To your first question, I don't think most interpretations of the PTC hypothesis would qualify tempeh as taste-equivalent (although, as I emphasize here, these factors aren't very well defined).

I've included a case study on hot dogs specifically:

the home-goods-retailer-cum-cafeteria Ikea sells plant-based hotdogs that are equally or lower-priced, readily available alongside animal-based hot dogs, and "received a 95 percent approval rating" in taste te

... (read more)

Hi Sanjay, thank you for reading and your thoughtful comment! The evidence I reviewed here already spans a couple of years, so I do think it might be reasonable to extrapolate closer to 3-5 years. That said, there isn't any analysis of trends of over time, so maybe not.

I agree conditional on the existence of similar alternatives, regulating against animal-based meat is easier than if those alternatives don't exist. Can you elaborate on the why you think the arguments apply differently to lab-grown rather than plant-based meat in your third point? If one be... (read more)

Hi Jack, thank you for your comment! I largely agree the future prospects of plant-based meat might be quite different from the current prospects and write:

Important alternatives to the PTC hypothesis might consider the role of future consumers rather than present-day consumers, who have been the focus of this paper. Future consumers might experience a large change in social norms or otherwise shift their preferences toward consuming plant-based rather than animal-based meats. This is a common feature of many animal advocacy theories of change (Delon et

... (read more)

Hi Jacob,

thanks for your reply -- a couple of reactions, hopefully quite nuanced (I agree with you a bunch, and disagree on others).

1. I did not mean to imply that you do not consider this possibility at all (you do!), but rather was reacting to the general rationale of the piece of using present-day evidence on behaviors as informative with regards to long-term prospects.

One could go away from your piece thinking there is a lot of evidence that should have one update against long-term PTC and alternative protein transition which seems not warranted by mos... (read more)

Gladly, thank you for your kind words! Sometimes people include health or nutrition as well. But there are really myriad factors that influence food choice, as I talk about some here, so I think there are still issues with models that simply add a factor or two (discussed some in the paragraph starting "Producing compelling evidence to substantiate just the premise of the PTC hypothesis would require an ambitious experimental effort.")

Thanks, Willem, that all makes sense! I agree, the overall conclusion certainly seems fair, especially given the convergent evidence you cite.

Not sure why this is being so heavily down-voted. I believe it's accurate and contributes, especially re: my comments where a safe and non-permanent way of causing severe pain would be needed.

(Caveat: Views my own, not my employer's)

I think this sort of first-hand investigation is potentially pretty valuable. I know Ren discourages folks from conducting similar self-experimentation, but I would be curious to see safe and careful experiments of this bent to understand the impact of deliberate experiences of suffering on moral views. Perhaps a worthwhile task for some empirical ethicists.

Caveat: I work for Rethink Priorities, as do the authors of this post

Great to have this timely research and good antidote to some of the gloomy outlooks on how this has affected the community!

I especially liked the two convergent approaches for measuring the effect of the FTX crisis on EA satisfaction. I noticed in the satisfaction over time analysis, you can kind of eyeball a (slight) negative pre-trend. This made me wonder how you thought about the causal inference concerns both in that specific analysis and for this report generally? By extension, I won... (read more)

3
Willem Sleegers
1y
Yeah it’s fair to worry about the causal interpretation of the satisfaction results, although I think the pre-trend you mention is mostly a result of the GAM model pulling the regression line down a bit due to the later observations. Limiting the analysis to the period before, say, November 9th, shows no such pre-trend. I’m personally more worried about possible confounds such as the one we note about engagement. It could also be that the FTX crisis motivated a certain group of people to take the survey and share their dissatisfaction. So, it’s true that the design of the survey does not lend itself to easily answer questions of causality, leaving it a matter of interpretation based on the results as a whole and context.   Regarding the overall interpretation, I think it might still be fair to conclude that the FTX crisis has decreased satisfaction if we take into account the other results, including the recalled satisfaction pre and before the FTX crisis and the explicit reports of concerns related to FTX, decreased trust etc.

I agree with the substance of your post and appreciate your taking the time to do the fact checking. I also sympathize with your potential frustration that the fact checking showe didn't support the claim.

However, I do think your comment comes off as a bit dismissive: neither OP nor Food Empowerment Project themselves claim FEP to be "real researchers," whatever this might mean; OP merely states FEP might have helpful resources. Furthermore, the comment might be taken to imply that being an activist and a real researcher are at odds, which I don't believe to be the case.

I also feel sad that your comments feel slightly condescending or uncharitable, which makes it difficult for me to have a productive conversation.

I'm really sorry to come off that way, James. Please know it's not my intention, but duly noted, and I'll try to do better in the future.

  1. Got it; that's helpful to know, and thank you for taking the time to explain!

  2. SDB is generally hard to test for post hoc, which is why it's so important to design studies to avoid it. As the surveys suggest, not supporting protests doesn't imply people don't report suppo

... (read more)

Thank you for your responses and engagement. Overall, it seems like we agree 1 and 2 are problems; still disagree about 3; and I don't think I made my point on 4 understood and your explanation raises more issues in my mind. While I think these 4 issues are themselves substantive, I worry they are the tip of an iceberg as 1 and 2 are in my opinion relatively basic issues. I appreciate your offer to pay for further critique; I hope someone is able to take you up on it.

  1. Great, I think we agree the approach outlined in the original report should be changed.

... (read more)
5
James Özden
2y
Thanks for your quick reply Jacob! I think I still largely degree on how substantive you think these are, and address these points below. I also feel sad that your comments feel slightly condescending or uncharitable, which makes it difficult for me to have a productive conversation. The first one - Our aim was to examine all the papers (within our other criteria of recency, democratic context, etc) that related to the impacts of protest on public opinion, policy change, voting behaviour, etc. We didn’t exclude any because they found negative or negligible results - as that would obviously be empirically extremely dubious. I didn’t make this clear enough in my first comment (I’ve now edited it) but I think your social desirability critique feels somewhat off. Only 18% of people in the UK were supportive of these protests (according to our survey), with a fair bit of negative media attention about the protests. This makes it hard to believe that respondents would genuinely feel any positive social desirability bias, when the majority of the public actually disapprove of the protests. If anything, it would be much more likely to have negative social desirability bias. I'm open to ways on how we might test this post-hoc with the data we have, but not sure if that's possible.  Just to reiterate what I said above for clarity: Our aim was to examine all the papers that related to the impacts of protest on public opinion, policy change, voting behaviour, etc. We didn’t exclude any because they found negative or negligible results - as that would obviously be empirically extremely dubious. The only reason we specified that our research looks at large and influential protest movements is that this is by default what academics study (as they are interesting and able to get published). There are almost no studies looking at the impact of small protests, which make up the majority of protests, so we can’t claim to have any solid understanding of their impacts. The research w

Updated view

Thank you to James for clarifying some of the points below. 1, 3 and 4 all result from miscommunications in the report that on clarification don't reflect the authors' intentions. I think 2 continues to be relevant, and we disagree here.

I've updated towards putting somewhat more credence in parts of the work, although I have other concerns beyond the most glaring ones I flagged here. I'm reticent to get into them here since this comment has a long contextual thread; perhaps I'll write another comment. I do want to represent my overall view her... (read more)

Hi Jacob - thanks for giving critical feedback. It’s much appreciated so thank you for your directness. Whilst I agree with some aspects of your comment, I also disagree with some parts (or don’t think they’re important enough to not update at all based on the research). 

  1. In the literature review, strength of evidence was evaluated based on the number of studies supporting a particular conclusion. This metric is entirely flawed as it will find support for any conclusion with a sufficiently high number of studies. For example, suppose you ran 1000 studi
... (read more)

I think there are two additional sources on corporate animal welfare campaigns worth mention here; neither cover all the topics you outline in tractability, but I think do fill in some of the blanks:

... (read more)
2
Enginar
2y
Thanks! I haven't read those sources (didn't know), but I will. Your study looks very meticulous, great to see more quality literature on this topic. I will add those sources in the text as well if the contest organizers allow editing. I hope we finally see that book soon!

I don't find the case against bivalve sentience that strong, especially for the number of animals potentially involved and the diversity of the 10k bivalve species. (For example, scallops are motile and have hundreds of image-forming eyes—it'd be surprising to me if pain wasn't useful to such a lifestyle!)

I agree, pricing in impact seems reasonable. But do you think this is currently happening? if so, by what mechanism? I think the discrepancies between Redwood and ACE salaries are much more likely explained by norms at the respective orgs and funding constraints rather than some explicit pricing of impact.

I agree the system is far from perfect and we still have a lot of room to grow. Broadly I think donors  (albeit imperfectly) give more money to places they think are expected to have higher impact, and an org prioritizes (albeit imperfectly) having higher staffing costs if they think staffing on the margin is relatively more important to the org's marginal success.

I think we're far from that idealistic position now but we can and are slowly moving towards it.

Thanks for these Peter! (Note that Peter and I both work at Rethink Priorities.)

Do you think your study is sufficiently well powered to detect very small effect sizes on meat consumption?

No, and this is by design as you point out. We did try to recruit a population that may be more predisposed to change in Study 3 and looked at even more predisposed subgroups.

substantially larger than the effects we usually find for animal interventions even on more moveable things

I think we were informed by the results of our meta-analysis, which generally found e... (read more)

Yes, we did and found no meaningful increases in interest in animal activism, including voting intentions. Full questions available in in the supplementary materials.

Thank you taking the time to engage, much appreciated! Forgive my responding quickly and feel free to ask for clarification if I miss anything:

  • Definitely, could be different results with different docs. But ours showed a much stronger effect than the average of similar interventions we found in a previous meta-analysis, suggesting Good for Us is pretty good. It is probably better than Cowspiracy on changing intentions, with longer studies of excerpts of Cowspiracy also finding no effect.
  • Agree especially with your sub-point. We also tried to recruit pop
... (read more)

+1 As well. I would emphasize that number of animal alive at any given time is significantly more important than slaughter as many animals die prior to slaughter.

Ah, I see—in that case, it makes a lot of sense for you to pursue these case studies. I appreciate the time you invested to get to a double crux here, thanks!

Thank you for your replies, Jamie, I appreciate the discussion. As a last point of clarification when you say ~40%, does this, for example, mean that if a priori I was uninformed on momentum v complacency and so put 50/50% credence on either possibility, that a series of case studies might potentially update you to 90/10%?

When I'm thinking about the value of social movement case studies compared to RCTs, I'm also thinking about their ability to provide evidence on the questions that I think are most important

I don't disagree—but my point with this intu

... (read more)
1
Jamie_Harris
4y
Yes to the first part! (I was also thinking something like: If you had read some of the other available evidence but not the historical case studies and had 70/30% credence, then reading the historical case studies might update your views to 30/70%. But that's a bit messier.) And got it with the second; I think we mostly agree there.
Load more