This is a linkpost for "The ideas of economists", a new blog post that describes two grants we made from the FP Climate Fund around COP 26, focused on changing conversations (and, subsequently, action) around (a) the fact that expensive-looking early-stage deployment policies are much better than their reputation due to strong trajectory-changing innovation effects and (b) the challenge of committed emissions, lots of new coal plants with long lifetimes left, and the importance of a broader solution set to deal with this problem (including advanced nuclear for repowering).
As always, this is an FP blog post so the style is a bit different than EA Forum post, but I thought it would be good to share here given how many EAs are contributing to the Climate Fund.
Reactions
Curated and popular this week
·
In recent months, the CEOs of leading AI companies have grown increasingly confident about rapid progress:
* OpenAI's Sam Altman: Shifted from saying in November "the rate of progress continues" to declaring in January "we are now confident we know how to build AGI"
* Anthropic's Dario Amodei: Stated in January "I'm more confident than I've ever been that we're close to powerful capabilities... in the next 2-3 years"
* Google DeepMind's Demis Hassabis: Changed from "as soon as 10 years" in autumn to "probably three to five years away" by January.
What explains the shift? Is it just hype? Or could we really have Artificial General Intelligence (AGI)[1] by 2028?
In this article, I look at what's driven recent progress, estimate how far those drivers can continue, and explain why they're likely to continue for at least four more years.
In particular, while in 2024 progress in LLM chatbots seemed to slow, a new approach started to work: teaching the models to reason using reinforcement learning.
In just a year, this let them surpass human PhDs at answering difficult scientific reasoning questions, and achieve expert-level performance on one-hour coding tasks.
We don't know how capable AGI will become, but extrapolating the recent rate of progress suggests that, by 2028, we could reach AI models with beyond-human reasoning abilities, expert-level knowledge in every domain, and that can autonomously complete multi-week projects, and progress would likely continue from there.
On this set of software engineering & computer use tasks, in 2020 AI was only able to do tasks that would typically take a human expert a couple of seconds. By 2024, that had risen to almost an hour. If the trend continues, by 2028 it'll reach several weeks.
No longer mere chatbots, these 'agent' models might soon satisfy many people's definitions of AGI — roughly, AI systems that match human performance at most knowledge work (see definition in footnote).
This means that, while the compa
·
SUMMARY:
ALLFED is launching an emergency appeal on the EA Forum due to a serious funding shortfall. Without new support, ALLFED will be forced to cut half our budget in the coming months, drastically reducing our capacity to help build global food system resilience for catastrophic scenarios like nuclear winter, a severe pandemic, or infrastructure breakdown. ALLFED is seeking $800,000 over the course of 2025 to sustain its team, continue policy-relevant research, and move forward with pilot projects that could save lives in a catastrophe. As funding priorities shift toward AI safety, we believe resilient food solutions remain a highly cost-effective way to protect the future. If you’re able to support or share this appeal, please visit allfed.info/donate.
Donate to ALLFED
FULL ARTICLE:
I (David Denkenberger) am writing alongside two of my team-mates, as ALLFED’s co-founder, to ask for your support. This is the first time in Alliance to Feed the Earth in Disaster’s (ALLFED’s) 8 year existence that we have reached out on the EA Forum with a direct funding appeal outside of Marginal Funding Week/our annual updates. I am doing so because ALLFED’s funding situation is serious, and because so much of ALLFED’s progress to date has been made possible through the support, feedback, and collaboration of the EA community.
Read our funding appeal
At ALLFED, we are deeply grateful to all our supporters, including the Survival and Flourishing Fund, which has provided the majority of our funding for years. At the end of 2024, we learned we would be receiving far less support than expected due to a shift in SFF’s strategic priorities toward AI safety.
Without additional funding, ALLFED will need to shrink. I believe the marginal cost effectiveness for improving the future and saving lives of resilience is competitive with AI Safety, even if timelines are short, because of potential AI-induced catastrophes. That is why we are asking people to donate to this emergency appeal
·
Or on the types of prioritization, their strengths, pitfalls, and how EA should balance them
The cause prioritization landscape in EA is changing. Prominent groups have shut down, others have been founded, and everyone is trying to figure out how to prepare for AI. This is the first in a series of posts examining the state of cause prioritization and proposing strategies for moving forward.
Executive Summary
* Performing prioritization work has been one of the main tasks, and arguably achievements, of EA.
* We highlight three types of prioritization: Cause Prioritization, Within-Cause (Intervention) Prioritization, and Cross-Cause (Intervention) Prioritization.
* We ask how much of EA prioritization work falls in each of these categories:
* Our estimates suggest that, for the organizations we investigated, the current split is 89% within-cause work, 2% cross-cause, and 9% cause prioritization.
* We then explore strengths and potential pitfalls of each level:
* Cause prioritization offers a big-picture view for identifying pressing problems but can fail to capture the practical nuances that often determine real-world success.
* Within-cause prioritization focuses on a narrower set of interventions with deeper more specialised analysis but risks missing higher-impact alternatives elsewhere.
* Cross-cause prioritization broadens the scope to find synergies and the potential for greater impact, yet demands complex assumptions and compromises on measurement.
* See the Summary Table below to view the considerations.
* We encourage reflection and future work on what the best ways of prioritizing are and how EA should allocate resources between the three types.
* With this in mind, we outline eight cruxes that sketch what factors could favor some types over others.
* We also suggest some potential next steps aimed at refining our approach to prioritization by exploring variance, value of information, tractability, and the
Thanks for this Johannes - nice to see the agility and thoughtfulness of the FP Climate Fund!
I've got a couple of questions about the tracking the impact of the EEIST report via media uptake:
I'm curious in general to any other thoughts you have about quantifying impact via media mentions as that is one of the main outputs of activist groups that I'll be researching. It assume it would be more straightforward in this case as there's no sentiment issues to deal with (I imagine?) in terms of negative coverage vs positive coverage hence no backfire effects to include. The theory of change / path to impact still seems slightly opaque though so any thoughts on that would be helpful.
Hi James,
thanks for your questions!
Re 1, the ToC is actually different -- the report was already produced, but -- we believe -- would not have been sufficiently amplified absent the grant, so it is more about the latter part of your chain.
Re 2, this is roughly what we would do if the sums justified it -- this was a small grant and we operate by the principle of keeping detail of analysis roughly proportional to money moved, so we accepted higher uncertainty here. Something we will be thinking more about going forward if we evaluate similar grants.
Re 3, this is recorded in the article -- actually we wrote those sections ("what we expected") before the grants had effects ("what we achieved") to allow for this comparison.
Re 4, we spent about 30k so reaching >3m million is about 100 people per USD. There's more media uptake trickling in still, so it could be significantly more once all is set and done.
Re 5, this is a tool that the PR agency uses, I don't know which tool this is specifically.
Happy to connect more on those issues, though I probably won't have time to dig deeper into this before December.