Comments
Will MacAskill’s latest post helps me identify that my focus when establishing ‘vitae per person’ was on making ‘primary goods’ — health, material abundance — accessible to everyone. That requires me to justify why I think this isn’t priced-in / won’t automatically happen by default.
I think the most likely reason it doesn’t happen is we can’t find a way to build AI that does all three:
(1) advances R&D / manufacturing at the necessary rates
(2) is objectively safe — doesn’t hurt lots of people (vs. counterfactual world without it)
(3) satisfies the naysayers (Yudkowsky & Soares, CAIS, equivalently pessimistic policy efforts)
(1) & (2) should satisfy (3).
Interestingly, public access to frontier AI systems is not required for (1). This suggests I should shift my focus towards advancing AI systems that are safe when wielded by only good-faith actors, rather than ensuring frontier systems are safe when accessible by everyone with every intention.
Good-faith actors might take many (overlapping) forms:
The Good-Faith Actor Principle: Frontier technologies should be safe when wielded by people who are setting out to cause good, not harm. They don’t have to be safe when wielded by people setting out to cause harm.
We already apply the Good-Faith Actor Principle to nuclear and biological technologies. Given the stakes associated with increasing primary goods provision, I think we should apply it to AI systems.
There are three reasons you might think it’s important to make frontier AI systems safe when used by every possible actor, not just good-faith ones.
We need all hands on deck. You might think that the cause of advancing science / society is a collaborative effort, and that limited actors (frontier labs, government agencies) can’t do it alone: you need all of society to use their creativity and ingenuity to apply frontier systems to their particular problems.
To discuss this, let me introduce three levels of technology access: Universal, Restricted, and Controlled.
Right now, Opus-4.5 and GPT-5.2 are ‘Universal’ technologies. Proprietary base models have often been ‘Restricted’ technologies. Staged releases often pass through the three levels, from Controlled to Restricted to Universal, to allow for early user testing and feedback.
I’m optimistic about us being able to reap the benefits of society-wide creativity while keeping frontier AI systems a ‘Restricted’ technology.
Inseparability: Aside from the sociotechnical problem of vetting ‘good-faith’ actors to be granted access, you might think that the safety of AI systems when wielded by (A) bad-faith actors and (B) good-faith actors are correlated, such that improving (A) improves (B).
This is not obvious. Some of the techniques you have to apply to regularize / reduce variance in AI behavior have tradeoffs — muting beneficial variance, and, importantly, introducing brittleness.
An AI system optimized for Universal access might look quite different to an AI system optimized for Restricted access.
I’d be concerned if we forfeit lots of benefits from frontier AI systems by prioritizing Universal access.
Looking at the design/spec of a system, I evaluate it according to the Good-Faith Actor Principle: checking good-faith actors can reliably use it to good ends. That’s because I think the following:
This implies that when the development of Restricted and Universal technologies trade off, we should prioritize Restricted.
