Cost-effectiveness of Shrimp Welfare Project’s Humane Slaughter Initiative

Vasco Grilo🔸

Cost-effectiveness of Shrimp Welfare Project’s Humane Slaughter Initiative

Vasco Grilo🔸

6 min readOct 6, 2024

Comments 28

Sorted by

New & upvoted

Aaron Boddy🔸

Thanks so much Vasco for your work on this! As with MHR in the past, we really appreciate folks doing in-depth analyses like this, and are very appreciative of the interest in our work :)

In the spirit of this week’s Forum theme, I wanted to provide some more context regarding SWP’s room for more funding.

Our overheads (i.e. salaries, travel/conferences) and program costs for the India sludge removal work, are currently covered by grants until the end of 2026. Meaning that any additional funds are put towards HSI. (For context, our secured grants do also cover the cost of some stunners, but HSI as a program is still able to absorb more funding).

Each stunner costs us $55k and we ask the producers we work with to commit to stunning a minimum of 120 million shrimps per annum. This results in a cost-effectiveness of ~2,000+ shrimps helped / $ / year (i.e. our marginal impact of additional dollars is higher than our historical cost-effectiveness).

We’re having our annual team retreat (which we call “Shrimposium”) next week, during which we hope to map out how we can deploy stunners in such a way as to catalyse a tipping point so that pre-slaughter stunning becomes the industry standard.

We’ve had some good indications recently that HSI does contribute to “locking-in” industry adoption, with Tesco and Sainsbury’s recently publishing welfare policies, building on similar wins in the past (such as M&S and Albert Heijn).

This has always been the Theory of Change for the HSI project. Although we’re very excited by how cost-effective it is in its own right, ultimately we want to catalyse industry-wide adoption - deploying stunners to the early adopters in order to build towards a tipping point that achieves critical mass. In other words, over the next few years we want to take the HSI program from Growth to Scale.

I would be surprised if post-Shrimposium our targets regarding HSI required less funding than our current projections. In other words, though I don’t currently have an exact sense of our room for more funding, I’m confident SWP is in a position to absorb significantly more funding to support our HSI work.

If anyone wants to reach out to me directly, you can contact me at [email protected]. You can also donate to SWP through our website, or book a meeting with me via this link.

Angelina Li

Can I directly ask: Is SWP one of the orgs that has been affected by Good Ventures dropping support for some cause areas? (I couldn't parse all the context previously on a quick skim.)

I'm not sure how much they funded you previously, or if this is a concern. No worries if you can't or would prefer not to say :)

Aaron Boddy🔸

Hey Angelina! Sure - happy to answer :)
Yes we were affected by the Good Ventures announcement, and our current funding update is actually very similar to that of Wild Animal Initiative, as in:

The Navigation Fund (TNF) plans to fill SWP's funding gap left by OP, at least through the end of 2026.
We're keen on diversifying our funding, so as not to continue relying on a single funder

However we differ in that our budget is smaller than that of WAI, and the majority of it is put toward a single program (HSI)

Angelina Li

Wow, go TNF 🙌 💜 I didn't realize they were bailing out non wild animal welfare orgs as well, that's very cool -- and must have been a lift. That all makes sense. Congrats, and I'm wishing you success on the funding diversity front!

Vasco Grilo🔸

Thanks for the great context, Aaron!

Is there any chance HSI may increase the number of shrimp? I guess it would tend to increase costs, and therefore decrease the number of shrimp. I ask because I estimate that moving from ice slurry to electrical stunning only increases welfare by 4.34 % (= 1 - 4.85/5.07). In this case, since I think farmed shrimp have negative lives (for any slaughter method), an increase of more than 4.34 % in the number of shrimp would make HSI harmful.

Aaron Boddy🔸

Hey Vasco! Interesting question, unfortunately I don't know the answer...

My sense is no, as you say, the intervention increases costs without an increase in productivity for the producers. But ultimately an incentive here is continued market access, which I'm sure an economist could model whether or not this could lead to an increase in the number of shrimps (over time).

Another point to emphasise though - it's my sense that the intervention should be modelled as electrical stunning replaces air asphyxiation, rather than (perfectly implemented) ice slurry. Ice slurry slaughter is just a very difficult thing to do correctly in practice (and I’ve not seen it happen) - as even if at some point the shrimps are submerged in ice for a short period of time, it's often not long enough to kill them (~30seconds).

Vasco Grilo🔸

Another point to emphasise though - it's my sense that the intervention should be modelled as electrical stunning replaces air asphyxiation, rather than (perfectly implemented) ice slurry.

Do you think it would be best for me to assume than 100 % of the shrimp helped are originally being slaughtered via air asphyxiation? I am currently assuming 62.5 % are originally being slaughtered via air asphyxiation, and the other 37.5 % via perfectly implemented ice slurry, but this seems way too high considering you have not seen it happen.

Aaron Boddy🔸

I would probably model it with https://www.getguesstimate.com/ to give a range of uncertainty in the numbers. But yeah it wouldn't surprise me if the number was ~100%

Vasco Grilo🔸

Thanks. I will update the analysis using 95 % (= (0.9 + 1)/2), which results in the same expected cost-effectiveness as using a uniform distribution ranging from 90 % to 100 %.

Vasco Grilo🔸

Thanks, Aaron.

Another point to emphasise though - it's my sense that the intervention should be modelled as electrical stunning replaces air asphyxiation, rather than (perfectly implemented) ice slurry. Ice slurry slaughter is just a very difficult thing to do correctly in practice (and I’ve not seen it happen) - as even if at some point the shrimps are submerged in ice for a short period of time, it's often not long enough to kill them (~30seconds).

I accounted for badly implemented ice slurry slaughter. I assumed:

All of the shrimps helped transition to electrical stunning, 62.5 % (= 1 - 0.375) from air asphyxiation, and 37.5 % from ice slurry (= 0.75*0.5). I got these fractions assuming 75 % of the targeted producers use some form of ice slurry, half of those implement it properly, and the other half improperly to the point of it being practically equivalent to air asphyxiation. I made these assumptions having in mind Aaron’s comment at the end of this section.

In any case, based on my assumptions, it does not matter whether HSI is harmful for the 37.5 % of the affected shrimp which go from well implemented ice slurry to electrical stunning slaughter. The overall cost-effectiveness is dominated by making 62.5 % of the affected shrimp go from air asphyxiation to electrical stunning slaughter. I estimate 97.3 % (= 0.625*0.0447/0.0287) of the benefits come from helping shrimp slaughtered via air asphyxiation, and that the increase in welfare for these is 48.6 % (= 1 - 4.85/9.44), whereas the number of shrimp would very hardly increase by that. So the question of whether the number of shrimp increases is only relevant if a very small fraction of the helped shrimp is slaughtered via air asphyxiation (again, conditional on my assumptions).

MHR🔸

Thanks for looking at this Vasco, it's always great to see others doing this kind of cost-effectiveness analysis.

Your results indicate a substantially higher direct cost-effectiveness for SWP relative to the analysis I did last year. From looking at your methodology, I believe our primary difference comes from a difference in weighting the relative badness of different levels of pain. I used the same numbers as a 2023 RP report which weighted excruciating pain as 33 times worse than hurtful pain, while your weights put excruciating pain at 100000x worse than hurtful pain.

I've updated towards thinking 33x is probably at least an order of magnitude too low (and more recent RP reports have used weights in the vicinity of 600x), but I would personally be skeptical of 100000x.

Of course much of SWP's impact is through creating systemic change, so I don't want to over-emphasize the importance of these direct impact CEAs, as valuable as they are.

Vasco Grilo🔸

Thanks for engaging, MHR!

Disabling pain is 100 times as bad as hurtful pain. This means 14.4 min (= 24*60/1/100) of disabling pain neutralise 1 day of fully healthy life.
Excruciating pain is 1 k times as bad as disabling pain. This implies 0.864 s (= 14.4*60/10^3) of excruciating pain neutralise 1 day of fully healthy life.

I think these are my 2 most uncertain assumptions.

I've updated towards thinking 33x is probably at least an order of magnitude too low (and more recent RP reports have used weights in the vicinity of 600x), but I would personally be skeptical of 100000x.

Nice that you updated. If excruciating pain was only 33 times as bad as hurtful pain, and this was as intense as fully healthy life (as I assumed), a fully healthy life plus less than 43.6 min (= 24*60/33) of excruciating pain per day would still be positive. For excruciating pain 600 times as bad as hurtful pain, a fully healthy life plus less than 2.4 min (= 24*60/600) of excruciating pain per day would still be positive. Excruciating pain is defined as follows by WFP (emphasis mine):

All conditions and events associated with extreme levels of pain that are not normally tolerated even if only for a few seconds. In humans, it would mark the threshold of pain under which many people choose to take their lives rather than endure the pain. This is the case, for example, of scalding and severe burning events. Behavioral patterns associated with experiences in this category may include loud screaming, involuntary shaking, extreme muscle tension, or extreme restlessness. Another criterion is the manifestation of behaviors that individuals would strongly refrain from displaying under normal circumstances, as they threaten body integrity (e.g. running into hazardous areas or exposing oneself to sources of danger, such as predators, as a result of pain or of attempts to alleviate it). The attribution of conditions to this level must therefore be done cautiously. Concealment of pain is not possible.

Do you think adding to a fully healthy 2.4 min/d of scalding and severe burning would make it neutral (instead of negative)? The global healthy life expectancy in 2021 was 62.2 years, so maybe one can roughly say that a child taking their live due to excruciating pain would loose 50 years of fully healthy life. Under my assumptions, 0.864 s of excruciating pain neutralise 1 day of fully healthy life, so 4.38 h (= 0.864*50*365.25/60^2) of excruciating pain neutralise 50 years of fully healthy life. However, I guess many people take their lives (if they can) after a few seconds (not hours) of excruciating pain. So, even if people should hold excruciating pain a few orders of magnitude longer to maximise their own welfare, my numbers could still make sense. 4.38 h is 5.26 k (= 4.38*60^2/3) times as long as 3 s (a few seconds). One complication is that people may be maximising their welfare in taking their lives because excruciating pain quickly decreases their remaining healthy life expectancy, such that there is a decreased opportunity cost of taking their lives.

I think it would be useful to run surveys of the public to figure out conversion rates between fully healthy life and WFP's various types of pain (annoying pain, hurtful pain, disabling pain, and excruciating pain) and pleasure (satisfaction, joy, euphoria, and bliss).

For reference, based on Rethink Priorities' conversions rates between fully healthy life and WFP's various types of pain (using the geometric mean between the lower and upper bound), I conclude the past cost-effectiveness of HSI is 48.8 times the marginal cost-effectiveness of GiveWell's top charities.

bruce

Without checking the assumptions / BOTEC in detail, I'll just flag that this implies you are indifferent between saving 1 human life (not just averting 1 malaria death) and helping ~1000-1900 shrimp die via electrical stunning instead of dying via air asphyxiation / ice slurry.^[1]

(This is not an anti-SWP comment tbc!)

^{^}
Depending on whether you are using $3000 to $5500 per life saved;

15000 * 3000 / 43500 = 1034.5
15000 * 5500 / 43500 = 1896.6

Vasco Grilo🔸

Thanks for the note, Bruce. Your estimate makes sense. Based on GiveWell's implicit valuation of saving a life of 51 DALY/life^[1], and my 0.0288 DALYs averted per shrimp helped, helping 1.77 k (= 51/0.0288) shrimp is as good as saving a life.

^{^}
According to OP, “GiveWell uses moral weights for child deaths that would be consistent with assuming 51 years of foregone life in the DALY framework (though that is not how they reach the conclusion)”.

Angelina Li

Edit: I think I was just wrong about this, per Aaron's response here :) Whoops!

~~Small to medium nit: the costs reported in the~~ ~~SWP CEA~~ ~~you are using as a base don't seem to include operational overhead (e.g. see Aaron's~~ ~~comment~~ ~~that the stunners cost $55k, which is the same as the total cost reported in the CEA).~~

~~I understand SWP has fundraised for overhead separately, but IMO it should be best practice to include overhead costs in your denominator — obviously~~ ~~someone~~ ~~has to cover those costs, it's not like they don't exist!~~

Michael St Jules 🔸

If the overhead is already covered, the marginal cost-effectiveness, what we get from further donations, should just reflect what's not covered.

Angelina Li

Quick pushback: overhead is a part of the costs needed to make this product (good management is needed to keep systems running)^[1] and ignoring that leads to weird conclusions.

e.g. I think under some versions of your view, if donor A pitches in $50k for a stunner, and then donor B pitches in last $5k, you give donor B all the credit. (Obligatory Nuno ref.) I might be misunderstanding you, apologies if so.

^{^}
There's a nearby thing about how "not all overhead costs are necessary program costs" or something, and I probably buy that multiplying by [total costs] / [program specific costs] might not be the right way to apportion overhead.

Michael St Jules 🔸

I agree that we should treat credit assignment differently, but when deciding what to fund, we should always be able to reduce the problem to "What maximizes?" or "What's the best that can be done with my $X?". I think the relevant question here is something like "If I donate $X to SWP, what happens?" And then you divide the (expected) difference in the counterfactuals by $X to get your cost-effectiveness.

I have three possibilities in mind. 1 is the scenario I expected to actually be the case here. 1 is mutually exclusive with 2 and 3, but 2 and 3 can happen together or either alone.

If the overhead costs are fixed and already fully covered either way, then your donations just go towards non-overhead costs, and the marginal cost-effectiveness should not reflect overhead. This is the scenario I had in mind.
If your donations influence how much overhead is necessary, e.g. because they need to hire more, and some of your donations go to that, then you need to include the extra overhead in the costs and make sure your impact reflects that.
If your donations influence how much overhead costs are covered by the funders covering the overhead, then you need to worry about their counterfactuals, i.e. what they would have otherwise done with their money. That goes into the impact of your donations.

1 could still involve indirect effects to worry about, i.e. you might increase the probability that funders cover overhead in the future like this, for SWP or others, which actually means we get something like 3.

saulius

1y*

Thanks for a very useful post. I can't find: does this account for the differences in moral weight and probability of sentience between different animals. If yes, how?

Vasco Grilo🔸

You are welcome, Saulius! Yes, it does. All the cost-effectiveness estimates of animal welfare interventions involved in the post are proportional to the welfare range of the species of the helped animals, which I set to "RP’s median welfare range[s]" (presented here; 0.332 for chickens, and 0.031 for shrimp).

Vasco Grilo🔸

Disabling pain is 10 times as intense as fully healthy life.

I was previously assuming disabling pain to be 100 times as intense as fully healthy life, i.e. 10 (= 100/10) times as intense as I am assuming now. I updated after going through the studies discussed here, especially Wallenstein et. al (1980). According to this, it looks like disabling pain is 8.16 to 18.8 times as bad as annoying pain, whereas I was supposing disabling pain to be 1 k times as bad as annoying pain. Now I am assuming disabling pain is 100 times (= 10^2) as bad as annoying pain, which is still more intense than the suggested by the study, but not so much so.

My updated past cost-effectiveness of HSI is 431 DALY/$, which is 99.5 % (= 431/433) of my previous value of 433 DALY/$. There is basically no change because the cost-effectiveness is approximately proportional to the intensity of excruciating pain, which I have not updated.

Henry Howard🔸

I would discourage you from doing guesswork this rough and legitimising it by calling it a "Fermi estimate".

Most cells in your spreadsheet are commented "my guess".

Sometimes confidence intervals are so wide that they don't tell us anything. I think that's the case here.

Vasco Grilo🔸

Thanks for looking into my calculations, Henry.

I would discourage you from doing guesswork this rough and legitimising it by calling it a "Fermi estimate".

Interesting. I was thinking that calling it a "Fermi estimate" would highlight it is a rough calculation instead of legitimising it. I also did not want to say something like "please note these numbers are super speculative, and you should not trust them at all", because I have only guessed parameters for which there is basically no data, so it seems hard to easily improve on my estimate. However, I definitely encourage people to make a copy of my sheet, and use their own numbers.

Most cells in your spreadsheet are commented "my guess".

Nitpick. Not "most", as only 30 % (= 6/20) of the inputs of the tab you were referring to say "My guess." in the notes. The fraction is lower considering all the cells in the tab, and even lower considering all the cells of all tabs.

The 6 cells in the tab you printed saying "My guess." in the notes refer to the following assumptions (which I mentioned in the post; I did not hide in the sheet any of my assumptions) for both air asphyxiation and electrical stunning slaughter:

Time in excruciating pain as a fraction of that in disabling pain equal to that of ice slurry.
Time in hurtful pain as a fraction of that in disabling pain equal to that of ice slurry.
Time in annoying pain as a fraction of that in hurtful pain equal to that of ice slurry.

I have now clarified these in the notes of the relevant cells in the tab. I made them because I only had data about the time in disabling pain for air asphyxiation and electrical stunning slaughter. Assuming these have the same proportion of time in pain across categories as ice slurry slaughter felt the most agnostic assumption to me (i.e. the one which would minimise over or underestimating cost-effectiveness). Do you have a better assumption?

Even if I assume air asphyxiation slaughter does not involve annoying, hurtful or excruciating pain to minimise the badness of the initial conditions, thus underestimating cost-effectiveness, I still conclude the past cost-effectiveness of HSI is 1.36 k times the marginal cost-effectiveness of GiveWell's top charities. @Henry Howard🔸^[1], I encourage you to make a copy of the sheet, and try to get to a ratio lower than 1. I believe this is very hard, which makes me think HSI is robustly more cost-effective than GiveWell's top charities.

^{^}
I am tagging you here because I have added this sentence to the comment after posting it for the 1st time.

Henry Howard🔸

-1

The definition of Fermi estimate linked in this post defines a Fermi estimate as aiming to be within 1 magnitude of true. Given just the Rethink Priorities welfare range estimates span several magnitudes (infinite really, given lower bound is 0), this at least is incorrect.

This sort of chaining of EV calculations is common on this forum. I think it's counterproductive. Show the confidence intervals and it becomes clear that the result is as good as "I have no idea", which is a fine thing to say. Just say that.

Vasco Grilo🔸

Could you clarify the argument you are making? I agree the 5th percentile past cost-effectiveness of HSI is 0 given this is RP's 5th percentile welfare range of shrimps. However, I think what matters is the expected cost-effectiveness. Are you suggesting one should disregard interventions whose 5th percentile cost-effectiveness is 0? Imagine one could pay 1 k$ to save 0 lives with 10 % probability, and 1 life with 90 % probability. The 5th percentile cost-effectiveness is 0 (the 5th percentile cost-effectiveness of deworming programs could also be super low?), but the expected cost-effectiveness is 0.9 life/k$, i.e. around 4.5 times the cost-effectiveness of GiveWell's top charities of 0.2 life/k$ (= 1/(5*10^3)).

Vasco Grilo🔸

My estimate for the past cost-effectiveness of HSI is:
28.7 times my estimate for the cost-effectiveness of corporate campaigns for chicken welfare of 15.0 DALY/$.
43.4 k times my estimate for the cost-effectiveness of GiveWell’s top charities of 0.00994 DALY/$.

For HSI to be as cost-effective as GiveWell’s top charities, for example, one of the following would have to happen:

All my pain intensities becoming 0.00230 % (= 1/(43.4*10^3)) as high.
The welfare range of shrimp becoming 0.00230 % as high, i.e. 7.13*10^-7 (= 0.031*2.30*10^-5).
All my pain intensities and the welfare range of shrimp each becoming 0.480 % (= (2.30*10^-5)^0.5) as high.

Vasco Grilo🔸

All of the shrimps helped transition to electrical stunning, 95 % from air asphyxiation, and 5 % (= 1 - 0.95) from ice slurry. These fractions are informed by Aaron’s comment at the end of this section, here and here.

I was previously assuming 67.5 % for air asphyxiation, and 37.5 % for ice slurry. I have updated to the above based on Aaron's comments linked just above. The cost-effectiveness is now 1.48 (= 639/431) times as high as before.

Vasco Grilo🔸

My comparison between HSI and corporate campaigns for chicken welfare now relies on my updated cost-effectiveness analysis of the latter (instead of this one).

Comments

Cost-effectiveness of Shrimp Welfare Project’s Humane Slaughter Initiative

Cost-effectiveness of Shrimp Welfare Project’s Humane Slaughter Initiative

Summary

Cost-effectiveness of HSI

Cost-effectiveness of sludge removal

Acknowledgements