Publication of the International Scientific Report on the Safety of Advanced AI (Interm Report)

James Herbert

Executive summary: The interim International Scientific Report on the Safety of Advanced AI, commissioned by the UK government, provides an up-to-date, science-based understanding of the capabilities, potential benefits, and risks associated with general-purpose AI systems.

Key points:

General-purpose AI can advance public interest, but experts disagree on the pace of future progress.
There is limited understanding of the capabilities and inner workings of general-purpose AI systems, which should be a priority to improve.
AI can be used maliciously for disinformation, fraud, and scams, and malfunctioning AI can cause harm through biased decisions.
Future advances in general-purpose AI could pose systemic risks, such as labor market disruption and economic power inequalities.
Technical methods like benchmarking, red-teaming, and auditing training data can help mitigate risks, but have limitations and require improvements.
The future of AI is uncertain, and societal and governmental decisions will significantly impact its trajectory.

This comment was auto-generated by the EA Forum Team. Feel free to point out issues with this summary by replying to the comment, and contact us if you have feedback.

Background information

The report was commissioned by the UK government and chaired by Yoshua Bengio, a Turing Award-winning AI academic and member of the UN’s Scientific Advisory Board. The work was overseen by an international Expert Advisory Panel made up of 30 countries including the UK and nominees from nations who were invited to the AI Safety Summit at Bletchley Park in 2023, as well as representatives of the European Union and the United Nations.

The report’s aim is to drive a shared, science-based, up-to-date understanding of the safety of advanced AI systems, and to develop that understanding over time. To do so, the report brings together world-leading AI countries and the best global AI expertise to analyse the best existing scientific research on AI capabilities and risks. The publication will inform the discussions taking place at the AI Seoul Summit in May 2024.

Summary

The International Scientific Report on the Safety of Advanced AI interim report sets out an up-to-date, science-based understanding of the safety of advanced AI systems. The independent, international, and inclusive report is a landmark moment of international collaboration. It marks the first time the international community has come together to support efforts to build a shared scientific and evidence-based understanding of frontier AI risks.

The intention to create such a report was announced at the AI Safety Summit in November 2023 .This interim report is published ahead of the AI Seoul Summit to be held next week. The final report will be published in advance of the AI Action Summit to be held in France.

The interim report restricts its focus to a summary of the evidence on general-purpose AI, which have advanced rapidly in recent years. The report synthesises the evidence base on the capabilities of, and risks from, general-purpose AI and evaluates technical methods for assessing and mitigating them.

The interim report highlights several key takeaways, including:

General-purpose AI can be used to advance the public interest, leading to enhanced wellbeing, prosperity, and scientific discoveries.

According to many metrics, the capabilities of general-purpose AI are advancing rapidly. Whether there has been significant progress on fundamental challenges such as causal reasoning is debated among researchers.

Experts disagree on the expected pace of future progress of general-purpose AI capabilities, variously supporting the possibility of slow, rapid, or extremely rapid progress.

There is limited understanding of the capabilities and inner workings of general-purpose AI systems. Improving our understanding should be a priority.

Like all powerful technologies, current and future general-purpose AI can be used to cause harm. For example, malicious actors can use AI for large-scale disinformation and influence operations, fraud, and scams.

Malfunctioning general-purpose AI can also cause harm, for instance through biassed decisions with respect to protected characteristics like race, gender, culture, age, and disability.

Future advances in general-purpose AI could pose systemic risks, including labour market disruption, and economic power inequalities. Experts have different views on the risk of humanity losing control over AI in a way that could result in catastrophic outcomes.

Several technical methods (including benchmarking, red-teaming and auditing training data) can help to mitigate risks, though all current methods have limitations, and improvements are required.

The future of AI is uncertain, with a wide range of scenarios appearing possible. The decisions of societies and governments will significantly impact its future.

The report underlines the need for continuing collaborative international efforts to research and share knowledge about these rapidly evolving technologies. The approach taken was deliberately inclusive of different views and perspectives, and areas of uncertainty, consensus or dissent are highlighted, promoting transparency.