Thanks for this interesting analysis!
One small note: the MCF survey results in your first chart appear to sum to ~104% rather than 100%. It looks like the other two sources in the comparison do sum to 100%, which might make direct comparison a bit tricky.
This could just be a rounding artefact, or perhaps the survey methodology allowed responses that didn’t need to sum to 100% - but given some of the percentage differences between sources are fairly small, it might be worth a quick note explaining the discrepancy (or normalising the MCF data if appropriate).
Flagging mainly because I found myself a bit distracted by this when trying to interpret the comparison, and I imagine other readers might have the same reaction.
Thank you, Marcus and Austin - I found this post fascinating and a really useful exercise.
I have some thoughts on how you could develop this further.
My main critique is that the current calculations focus a lot on consumption (watching a video) rather than impact (change in the world) - of course this is arguably pretty hard to do without loads of assumptions, but given that the current calcs still use qualitative assumptions, it might be worth trying this other angle.
I'd start sketching this out with a light touch logic model/theory of change, to map where input (money, time) lead to an outcome (hopefully, reduced AI risk). I think the main metric used here (quality-adjusted viewer-minutes) captures the beginning of this process, but would be interesting to go further. A simple logic model could look like:
Inputs: Cost (money, time) -->
Outputs:Video created -->
Outcomes:
Impact: Reduced AI risk
I think currently you're using some assumptions to essentially derive comprehension, but there's not much in your calcs about engagement or behaviour change. I think it would be useful to try to measure these.
For instance, you could add in:
Anyway, these are just some thoughts, but hope you'll find at least some of them useful.
Thanks again for sharing this post, really interesting and I'm excited to see how it evolves.
Was going to ask the same about Italian!
I’ve been trying to explain EA to my (often Catholic) Italian family and friends for a long time - I think they’d be very receptive to this book.