I work in product rather than AGI safety research, and I have no credentials in
this field. Given its imminency, large impact, and the path we are on, I think far more people need to understand the AGI safety problem while there is still room to steer it, which is why I spent my spare time building safeagi.ca.
It is meant to be a primer. Someone who knows nothing about any of this should
be able to read it once and come away with enough to understand the problem
and do something about it, without needing a textbook or a stack of papers
first.
Being an outsider is why I am asking here. Where does the argument not hold up,
and where does the page lose you as a reader? Anything else you notice is
welcome too, whether that is a technique I described wrong, a claim I graded
too generously, or a section that should not exist. A primer that misleads
people is worse than no primer at all, so I would rather hear it now.
Would you also have recommendation on how might we promote this to raise more awareness among the public, and/or steer the policy toward safe AGI?
Thank you for your help!
