TL;DR: 9-week, full-time AI safety research fellowship in London. Work closely with mentors from leading orgs such as Google DeepMind, Redwood Research, SecureBio, etc. Receive a £6-8k stipend, £2k accommodation + travel support, £2.5k+ compute, co-working (with meals) at LISA. ~70% of recent fellows continued on fully-funded extensions (up to 6 months).
Work with your mentor from Google DeepMind, GovAI, UK AISI, Redwood Research, SecureBio, FAR AI, and other leading organisations to produce AI safety research (in Technical Safety, Governance & Policy, Technical Governance, or AIxBio). Most fellows complete a 10-20 page research paper or report. 70% of recent fellows are doing fully funded extensions for up to 6 months.
Support
We try to provide everything that helps you focus on and succeed with your research:
Julian Stastny (Redwood): Studying Scheming and Alignment
Lewis Hammond (Cooperative AI): Cooperative AI
Max Reddel (CFG): Middle-Power Strategies for Transformative AI
Noah Y. Siegel (GDM): Understanding Explanatory Faithfulness
Noam Kolt (Hebrew University): Legal Safety Evals
Oscar Delaney (IAPS): Geopolitical Power and ASI
Peter Peneder & Jasper Götting (SecureBio): Building next-generation evals for AIxBio
Stefan Heimersheim (FAR AI): Mechanistic Interpretability
Tyler Tracy (Redwood): Running control evals on more complicated settings
Who Should Apply
Anyone wanting to dedicate at least 9 weeks to intensive research and excited about making AI safe for everyone. Our fellows share one thing (in our biased opinion): they're all excellent. But otherwise, they vary tremendously – from 18 y.o. CS undergrad to physics PhD to software engineer with 20 years of experience.
Our alumni have gone on to:
Work at leading organisations like GovAI, UK AISI, Google DeepMind, Timaeus, etc.
Found AI safety organisations like PRISM Evals and Catalyze Impact
This is our 7th cohort. If you're on the fence about applying, we encourage you to do so. Reading the mentor profiles and application process itself helps clarify research interests, and we've seen fellows from diverse backgrounds produce excellent work.
Epistemic status: Speculation from two decently informed advocates armed with anecdata.
Note on process: After having some version of this conversation several times and saying, “we should probably write about this publicly,” we took the less heroic route: we recorded one of our conversations, fed the transcript into an LLM, and then substantially revised the structure, substance, and framing ourselves. We will not be sharing the transcript, as it is in...
I want to start by noting that I am amazed and somewhat in awe of what's been accomplished by the EA animal welfare movement. I am enthusiastically supportive of all campaigns that make living and dying conditions less bad for farmed animals.
I worked on such campaigns for almost 20 years, and I'm proud of that work.
That said, I do think it's a strategic error that the EA animal movement has so thoroughly moved on from advocacy for animal liberation and diet change.&n...
The swarm has made me feel AI risk in my bones for the first time
Until the Hugging Face / OpenAI swarm thing, I think I deep down felt pretty skeptical that extinction or serious loss of control scenarios were plausible in the next few years.
I’ve been lurking on LessWrong for years, and I remember being freaked out by Yudkowsky’s ‘List of Lethalities’ in 2022, and thinking that this did seem intellectually convincing, and maybe I should do something about it. But it didn...