Great post. Although there seems to be quite a lot of interest in AI safety in the EA community, the number of technical AI safety researchers is still surprisingly small. I spent some time estimating the number of researchers and I think the 100-200 number sounds right to me as an order of magnitude estimate.
Given AI safety technical research is so important and neglected, it seems like a high-impact field to get into. The field is still relatively immature and therefore there could be many low-hanging insights to discover.
Thanks for the summary. I think the dath ilan world is a really interesting concept and useful for thinking about how to maximize the chance of the alignment problem being solved.
Maybe someone will write an essay like this about aging in a few decades when we find a solution for it.
Great post. I think it explains the important concept of expected value in a simple way.