Forethought[1] is a new AI macrostrategy research group cofounded by Max Dalton, Will MacAskill, Tom Davidson, and Amrit Sidhu-Brar.
We are trying to figure out how to navigate the (potentially rapid) transition to a world with superintelligent AI systems. We aim to tackle the most important questions we can find, unrestricted by the current Overton window.
More details on our website.
Why we exist
We think that AGI might come soon (say, modal timelines to mostly-automated AI R&D in the next 2-8 years), and might significantly accelerate technological progress, leading to many different challenges. We don’t yet have a good understanding of what this change might look like or how to navigate it. Society is not prepared.
Moreover, we want the world to not just avoid catastrophe: we want to reach a really great future. We think about what this might be like (incorporating moral uncertainty), and what we can do, now, to build towards a good future.
Like all projects, this started out with a plethora of Google docs. We ran a series of seminars to explore the ideas further, and that cascaded into an organization.
This area of work feels to us like the early days of EA: we’re exploring unusual, neglected ideas, and finding research progress surprisingly tractable. And while we start out with (literally) galaxy-brained schemes, they often ground out into fairly specific and concrete ideas about what should happen next. Of course, we’re bringing principles like scope sensitivity, impartiality, etc to our thinking, and we think that these issues urgently need more morally dedicated and thoughtful people working on them.
Research
Research agendas
We are currently pursuing the following perspectives:
* Preparing for the intelligence explosion: If AI drives explosive growth there will be an enormous number of challenges we have to face. In addition to misalignment risk and biorisk, this potentially includes: how to govern the development of new weapons of mass destr
tl;dr it'd take more digging to identify which charities would be the best candidates for donation to execute this kind of effort, though it seems likely the right charities for this effort can be identified among those already in the orbit of the global health & development arm of EA.
I'm not aware of which organizations there may be that have launched in the last few years independent of the pandemic that have already received major funding from EA-affiliated donors and would be ready to receive more of the same funding to rapidly roll out a project like this. ("Major funding from EA-affiliated donors" here means grants worth at least five figures from EA-aligned foundations with an endowment worth at least a few million dollars, like Open Philanthropy.)
I'm aware there of at least some organizations that have received major funding from EA-affiliated donors that have either launched in the last few years as a response to the pandemic, or have pivoted or launched a new project, in response to the pandemic, as an extension of their previous and ongoing efforts. I'm not aware whether there are any EA-affiliated non-governmental organizations that have launched after the pandemic began to specifically address this issue. It'd take more research to figure out which organizations there might be ready to do this and that EA-aligned funders are ready to back, though it definitely seems feasible with existing and available infrastructure.