This is a crosspost from the new Animal Welfare Alignment Newsletter by Anima International. You can subscribe on Substack if you are interested in following these efforts. Audio reading also available on Substack.
The goals of this post are to:
1. Raise a question I see as crucially important to the goal of aligning AI to animal welfare...
Hello! I'm Justin Portela. I got hired by GWWC to make YouTube videos after AI in Context did such a kickass job.
My channel is using that same cinematic, high-production value beauty to talk about everything in the EA universe that isn't AI.
...
I used AI to fix transcription errors, rerrarange the ideas, and suggest tweaks to the title and some sentences.
Three of the most exciting projects to come out of EA in recent years are, in a vague sense, CEA spinouts:
* Kairos is directly a spinout of CEA and now handles most support for university AI safety groups. Basically everyone I've found who knows them is really excited about what they do
* NEST is an opinionated ideas-fi...
Yes, fully agree. The only reason current models are (relatively) safe is because they are weaker than us. Open AI brag that:
29%!? That's really not going to cut it when the models are able to overpower us (or produce output that does). All the doom will flow through the tiniest cracks of imperfect alignment. In the limit of superintelligent AI, we need 100% perfect, 0 failure modes, alignment. And the burden should totally be on the company releasing the model that has the potential to scale to superintelligence (and endangering all 8 billion people on the planet), to prove that.
If there are small remaining risks, then releasing the model needs to be a globally democratic decision (e.g. by unanimous vote at the UN).