Instrumental convergence thesis

brook (+12/-7)
Pablo (+53/-208)
Pablo (+8/-6)
Pablo (+7)
Andrea_Miotti (+311) Added explanation of self-preservation and securing resources as two classic goals that emerge from instrumental convergence.
Pablo (+17)
Pablo (+62/-30)
Leo (+15/-12)
Pablo (+315)
Pablo (+224)

The instrumental convergence thesis is the allegedhypothesised overlap in instrumental goals expected to be exhibited by a broad class of advanced AI systems, due to their usefulness for the attainment of a wide range of possible final goals.

Commonly expected instrumental goals towards which all intelligent agents would converge are self-preservationpreservation, goal preservation, and securing resources, as no agent will be able to achieve any goal in the future without first preserving its own existence into the future, and virtually any goal requires resources to be achieved.resource acquisition.

The instrumental convergence thesis is the alleged overlap in instrumental goals expected to be exhibited by a broad class of futureadvanced AI systems, due to their usefulness for the attainment of a wide range of possible final goals.

The instrumental convergence thesis is the alleged overlap in instrumental goals expected to be exhibited by a broad class of future AI systems, due to their usefulness for the attainment of a wide range of possible final goals.

Commonly expected instrumental goals towards which all intelligent agents would converge are self-preservation and securing resources, as no agent will be able to achieve any goal in the future without first preserving its own existence into the future, and virtually any goal requires resources to be achieved.

TheInstrumental instrumental convergence is the alleged overlap in instrumental goals expected to be exhibited by a broad class of future artificial agents,AI systems, due to their usefulness for the attainment of a wide range of possible final goals.

Related entries

orthogonality thesis

Bibliography

Bostrom, Nick (2012) The superintelligent will: motivation and instrumental rationality in advanced artificial agents, Minds and Machines, vol. 22, pp. 71–85.

Yudkowsky, Eliezer (2013) Five theses, two lemmas, and a couple of strategic implications, Machine Intelligence Research Institute's Blog, May 5.

Instrumental convergence is the alleged overlap in instrumental goals expected to be exhibited by a broad class of future artificial agents, due to their usefulness for the attainment of a wide range of possible final goals.