Ilya Sutskever is starting Safe Superintelligence Inc.

Is this a disturbing pattern? Disgruntled Engineer leaves AI org and starts new one which claims to be more safety orientated than the last. Then the forces of the market, greed and power take over and we are left with another competitive player in the high stakes race.

Doesn't feel ideal but I'm not part of this scene

Co-founder Daniel Gross’ thoughts on AI safety are at best unclear beyond this statement. Here is an article he wrote a year ago: The Climate Justice of AI Safety, and he’s also appeared on the Stratechery podcast a few times and spoken about AI safety once or twice. In this space, he’s most well known as an investor, including in Leopold Aschenbrenner’s fund.

I think it would be good for Daniel Gross & Daniel Levy to clarify their positions on AI safety, and what exactly ‘commercial pressure’ means (do they just care about short-term pressure and intend to profit immensely from AGI?).

(Disclosure: I received a ~$10k grant from Daniel in 2019 that was AI-related)

Beware safety washing:

An increasing number of people believe that developing powerful AI systems is very dangerous, so companies might want to show that they are being “safe” in their work on AI.

Being safe with AI is hard and potentially costly, so if you’re a company working on AI capabilities, you might want to overstate the extent to which you focus on “safety.”

I wonder how do they plan to get GPUs at scale while remaining "insulated from short-term commercial pressures"