Instrumental convergence thesis

The instrumental convergence is the alleged overlap in instrumental goals expected to be exhibited by a broad class of future AI systems, due to their usefulness for the attainment of a wide range of possible final goals.

Commonly expected instrumental goals towards which all intelligent agents would converge are self-preservation and securing resources, as no agent will be able to achieve any goal in the future without first preserving its own existence into the future, and virtually any goal requires resources to be achieved.

Further reading

Bostrom, Nick (2012) The superintelligent will: motivation and instrumental rationality in advanced artificial agents, Minds and Machines, vol. 22, pp. 71–85.

Yudkowsky, Eliezer (2013) Five theses, two lemmas, and a couple of strategic implications, Machine Intelligence Research Institute's Blog, May 5.

basic AI drive | orthogonality thesis