For example, could we pay experts to spend time reading and giving careful detailed responses to specific articles or posts on EA-related topics? I would particularly love to get relevant non-EA or EA-adjacent experts to provide point-by-point responses to key claims made by AI risk proponents. (I'm picking AI risk as an example and because it's one of the topics I spend most of my own research time on, but this idea is certainly not limited to AI risk.)

Note that this is not a proposal to just hire those experts to work on EA problems. Rather it's a proposal to pay those experts just to spend a few hours or days to do a careful point-by-point analysis of some article or topic. My impression is that organizations hire experts to do analogous things on a regular basis - for example paying them to do short contracting-style work, or paying for their time and travel expenses to attend workshops, or paying for them to spend time writing commissioned articles or books.

Many experts are of course also strongly motivated by prestige factors, especially since their career incentive structures tend to reward prestige. This is part (most?) of why many experts will readily agree to write review articles for prestigious journals, give talks at conferences, or participate as a panelist in a workshop. I am not sure exactly how to use prestige factors here, but I'm guessing it should be possible and I'd be very interested to hear ideas for how to do this. Maybe create dedicated workshops for this at relevant conferences?

For many critics in particular I think this would appeal to their already existing love of critiquing whatever it is they love to critique, so it might be a relatively easy sell for them. I frequently find it frustrating when reading what these critics write, because I often have particular arguments or sets of arguments that I'd really like them to address but they don't. Even if I attend a Q&A session at a talk they give, I usually only have the chance to ask very short targeted questions, and if I mess up how I phrase the question then they often don't respond to what I really wanted to ask. In the past I have frequently found myself wanting to show them particular articles and ask them to give point-by-point responses. The proposal in this post is my idea for how to get them to actually give those point-by-point responses. (But note that the idea is not limited to prominent critics. I would also love to ask other relevant experts for their point-by-point analyses of key claims. That might actually turn out to be of higher value than asking already vocal and opinionated critics to do the same.)

24

0
0

Reactions

0
0
Comments7


Sorted by Click to highlight new comments since:

I want to run this at some point. Pro statistical consultants could handle many posts, and philosophy grad students many of the rest. I was thinking in terms of one review per important post here.

Riffing further: 

  • Academic peer review generally doesn't run code, so this is one way we could surpass them. 
  • Also publishing the reviews, 
  • and doing them within a month, rather than within a year.

"And doing them within a month, rather than within a year." - Might be hard to determine what posts are important after just a month?

I'd be fine with some false positives

I think Open Philanthropy has done some of this. For example:

The Open Philanthropy technical reports I've relied on have had significant external expert review. Machine learning researchers reviewed Bio Anchors; neuroscientists reviewed Brain Computation; economists reviewed Explosive Growth; academics focused on relevant topics in uncertainty and/or probability reviewed Semi-informative Priors.2 (Some of these reviews had significant points of disagreement, but none of these points seemed to be cases where the reports contradicted a clear consensus of experts or literature.)

https://forum.effectivealtruism.org/posts/7JxsXYDuqnKMqa6Eq/ai-timelines-where-the-arguments-and-the-experts-stand

In some cases it might be easier to do this as a structured interview rather than asking for written analyses. For example, I could imagine that it might be possible to create a podcast where guests are given an article or two to read before the interview, and then the interviewer asks them for their responses on a point-by-point basis. This would also allow the interviewer (if they're particularly good) to do follow-up questions as necessary. On the other hand, my personal impression is that written analyses tend to be more carefully argued and thought through than real-time interviews.

Have you read the transcripts from Vael Gates's structured interviews with people working in AI about safety stuff, they seem to have done something pretty close to what you're asking.

Good point! I started reading those a while ago but got distracted and never got back to them. I'll try looking at them again.

Curated and popular this week
 ·  · 20m read
 · 
Advanced AI could unlock an era of enlightened and competent government action. But without smart, active investment, we’ll squander that opportunity and barrel blindly into danger. Executive summary See also a summary on Twitter / X. The US federal government is falling behind the private sector on AI adoption. As AI improves, a growing gap would leave the government unable to effectively respond to AI-driven existential challenges and threaten the legitimacy of its democratic institutions. A dual imperative → Government adoption of AI can’t wait. Making steady progress is critical to: * Boost the government’s capacity to effectively respond to AI-driven existential challenges * Help democratic oversight keep up with the technological power of other groups * Defuse the risk of rushed AI adoption in a crisis → But hasty AI adoption could backfire. Without care, integration of AI could: * Be exploited, subverting independent government action * Lead to unsafe deployment of AI systems * Accelerate arms races or compress safety research timelines Summary of the recommendations 1. Work with the US federal government to help it effectively adopt AI Simplistic “pro-security” or “pro-speed” attitudes miss the point. Both are important — and many interventions would help with both. We should: * Invest in win-win measures that both facilitate adoption and reduce the risks involved, e.g.: * Build technical expertise within government (invest in AI and technical talent, ensure NIST is well resourced) * Streamline procurement processes for AI products and related tech (like cloud services) * Modernize the government’s digital infrastructure and data management practices * Prioritize high-leverage interventions that have strong adoption-boosting benefits with minor security costs or vice versa, e.g.: * On the security side: investing in cyber security, pre-deployment testing of AI in high-stakes areas, and advancing research on mitigating the ris
 ·  · 15m read
 · 
In our recent strategy retreat, the GWWC Leadership Team recognised that by spreading our limited resources across too many projects, we are unable to deliver the level of excellence and impact that our mission demands. True to our value of being mission accountable, we've therefore made the difficult but necessary decision to discontinue a total of 10 initiatives. By focusing our energy on fewer, more strategically aligned initiatives, we think we’ll be more likely to ultimately achieve our Big Hairy Audacious Goal of 1 million pledgers donating $3B USD to high-impact charities annually. (See our 2025 strategy.) We’d like to be transparent about the choices we made, both to hold ourselves accountable and so other organisations can take the gaps we leave into account when planning their work. As such, this post aims to: * Inform the broader EA community about changes to projects & highlight opportunities to carry these projects forward * Provide timelines for project transitions * Explain our rationale for discontinuing certain initiatives What’s changing  We've identified 10 initiatives[1] to wind down or transition. These are: * GWWC Canada * Effective Altruism Australia funding partnership * GWWC Groups * Giving Games * Charity Elections * Effective Giving Meta evaluation and grantmaking * The Donor Lottery * Translations * Hosted Funds * New licensing of the GWWC brand  Each of these is detailed in the sections below, with timelines and transition plans where applicable. How this is relevant to you  We still believe in the impact potential of many of these projects. Our decision doesn’t necessarily reflect their lack of value, but rather our need to focus at this juncture of GWWC's development.  Thus, we are actively looking for organisations and individuals interested in taking on some of these projects. If that’s you, please do reach out: see each project's section for specific contact details. Thank you for your continued support as we
 ·  · 3m read
 · 
We are excited to share a summary of our 2025 strategy, which builds on our work in 2024 and provides a vision through 2027 and beyond! Background Giving What We Can (GWWC) is working towards a world without preventable suffering or existential risk, where everyone is able to flourish. We do this by making giving effectively and significantly a cultural norm. Focus on pledges Based on our last impact evaluation[1], we have made our pledges –  and in particular the 🔸10% Pledge – the core focus of GWWC’s work.[2] We know the 🔸10% Pledge is a powerful institution, as we’ve seen almost 10,000 people take it and give nearly $50M USD to high-impact charities annually. We believe it could become a norm among at least the richest 1% — and likely a much wider segment of the population — which would cumulatively direct an enormous quantity of financial resources towards tackling the world’s most pressing problems.  We initiated this focus on pledges in early 2024, and are doubling down on it in 2025. In line with this, we are retiring various other initiatives we were previously running and which are not consistent with our new strategy. Introducing our BHAG We are setting ourselves a long-term Big Hairy Audacious Goal (BHAG) of 1 million pledgers donating $3B USD to high-impact charities annually, which we will start working towards in 2025. 1 million pledgers donating $3B USD to high-impact charities annually would be roughly equivalent to ~100x GWWC’s current scale, and could be achieved by 1% of the world’s richest 1% pledging and giving effectively. Achieving this would imply the equivalent of nearly 1 million lives being saved[3] every year. See the BHAG FAQ for more info. Working towards our BHAG Over the coming years, we expect to test various growth pathways and interventions that could get us to our BHAG, including digital marketing, partnerships with aligned organisations, community advocacy, media/PR, and direct outreach to potential pledgers. We thin