TL;DR Having a good research track record is some evidence of good big-picture takes, but it's weak evidence. Strategic thinking is hard, and requires different skills. But people often conflate these skills, leading to excessive deference to researchers in the field, without evidence that that person is good at strategic thinking specifically. I certainly try to have good strategic takes, but it's hard, and you shouldn't assume I succeed!
Introduction
I often find myself giving talks or Q&As about mechanistic interpretability research. But inevitably, I'll get questions about the big picture: "What's the theory of change for interpretability?", "Is this really going to help with alignment?", "Does any of this matter if we can’t ensure all labs take alignment seriously?". And I think people take my answers to these way too seriously.
These are great questions, and I'm happy to try answering them. But I've noticed a bit of a pathology: people seem to assume that because I'm (hopefully!) good at the research, I'm automatically well-qualified to answer these broader strategic questions. I think this is a mistake, a form of undue deference that is both incorrect and unhelpful. I certainly try to have good strategic takes, and I think this makes me better at my job, but this is far from sufficient. Being good at research and being good at high level strategic thinking are just fairly different skillsets!
But isn’t someone being good at research strong evidence they’re also good at strategic thinking? I personally think it’s moderate evidence, but far from sufficient. One key factor is that a very hard part of strategic thinking is the lack of feedback. Your reasoning about confusing long-term factors need to extrapolate from past trends and make analogies from things you do understand better, and it can be quite hard to tell if what you're saying is complete bullshit or not. In an empirical science like mechanistic interpretability, however, you can get a lot more fe
This is a cool idea, I upvoted (from -1 to 0). I'd really like to see more detailed analysis and well-documented sources to answer this question. I couldn't really tell from the post whether the numbers were about right or not.
I worked on a report with others at Longview. We calculated that severely reducing the burden of HIV, Malaria and Tuberculosis would be around $219 billion. Essentially, we adjusted numbers from a variety of reports from e.g. the WHO to estimate these numbers (possibly some of the same sources, it's hard to tell). This is already quite a bit more than the $10 billion estimate you have. I think the main difference is due to adjusting for inflation and in-kind medicine donations.
However, this wouldn't allow us to eradicate these diseases in all likelihood. In fact, the target for Tuberculosis was to reduce deaths by about 90%. It is plausible that the last 10% is actually much more expensive to target, because the low hanging fruit has been picked, so to speak. (I'm not an expert in this area, and this could be completely wrong).
This makes me think that the cost of eliminating these diseases is likely well over $100 billion each.
(We also estimated the costs of severely reducing the burden of disease from neglected tropical diseases, and that was lower per disease.)
Hey Riley. I think the 10 billion is on average "per disease", in the post they listed 100 billion as the number for malaria which is in the ballpark of your estimates.
Thanks for this interesting stuff! I like that stat about 10% of diseases causing over 50% of the morbidity/mortality, and eradicating those having a much smaller cost. For that reason me that 1.4 trillion number to potentailly eradicate 50% of the might be more important than the 14 trilllion one.
I'll have a look at the lancet paper - I don't really understand the 8.5 billion being needed to "maintain" the situation after malaria is eradicated, I thought the definition of eradication was that it was gone (like smallpox) - so would no longer need money pumped into it. Perhaps they are assuming malaria remains in animals continuing the life cycle?
Why are you ballparking $10b when all of the examples given are many multiples of that? $100b seems like a better estimate.
I also suspect we're targeting easy to eradicate diseases. Those without animal reservoirs that will cause resurgences and where there are effective interventions. Therefore, I'd suggest this is a lower bound.
I'm also confused as to why $10bn per disease is suggested, given the much higher costs of the listed examples.
However, it seems plausible that costs per disease will substantially decrease as we learn more about biology and how to successfully run eradication campaigns. For example, developing a new vaccine technology against one virus could make it much easier and cheaper to develop vaccines against related viruses.