Effective Altruism Forum
EA Forum

Hide table of contents
Comment Permalink
Risto Uuk3
0
0

If you're a thoughtful American interested in developing expertise and technical abilities in the domain of AI policy, then this may be one of your highest impact options, particularly if you have been to or can get into a top grad school in law, policy, international relations or machine learning. (If you’re not American, working on AI policy may also be a good option, but some of the best long-term positions in the US won’t be open to you.)

What do you think about similar type of work within the European Union? Could it potentially be a high-impact career path for those who are not Americans?

Reply
Niel_Bowerman2
0
0

I think working on AI policy in an EU context is also likely to be valuable, however few (if any) of the world's very top AI companies are based in the EU (except DeepMind, which will soon be outside the EU after Brexit). Nonetheless, I think it would be very helpful to more AI policy expertise within an EU context, and if you can contribute to that it could be very valuable. It's worth mentioning that for UK citizens it might be better to focus on British AI policy.

Reply
See in context
by 80000_Hours
2 min read 2

37

Career choiceAI safety80,000 HoursAI governanceExpertise
Frontpage

We recently completed an in-depth article on US AI policy careers that should be of interest to many people on this forum. It begins:

At 80,000 Hours we think a significant number of people should build expertise to work on United States (US) policy relevant to the long-term effects of the development and use of artificial intelligence (AI).

In this article we go into more detail on this claim, as well as discussing arguments in favor and against. We also briefly outline which specific career paths to aim for and discuss which sorts of people we think might suit these roles best.

This article is based on multiple conversations with three senior US Government officials, three federal employees working on science and technology issues, three congressional staffers, and several other people who have served as advisors to government from within academia and non-profits. We also spoke with several research scientists at top AI labs and in academia, as well as relevant experts from foundations and nonprofits.

We have hired Niel Bowerman as our in-house specialist on AI policy careers. If you are a US citizen interested in pursuing a career in AI public policy, please let us know and Niel may be able to work with you to help you enter this career path.

Summary

  • The US Government is likely to be a key actor in how advanced AI is developed and used in society, whether directly or indirectly.
  • One of the main ways that AI might not yield substantial benefits to society is if there is a race to the bottom on AI safety. Governments are likely to be key actors that could contribute to an environment leading to such a race, or could actively prevent one.
  • Good scenarios seem more likely if there are more thoughtful people working in government who have expertise in AI development and are concerned about its effects on society over the long-term.
  • This is a high-risk, high-reward career option, and there is a chance that pursuing this career path will result in little social impact over your career. However we think there are scenarios in which this work is remarkably important, and so the overall value of work on AI policy seems high.
  • We think there is room for hundreds of people to build expertise and career capital in roles that may one day allow them to work on the most relevant areas of AI policy.
  • If you're a thoughtful American interested in developing expertise and technical abilities in the domain of AI policy, then this may be one of your highest impact options, particularly if you have been to or can get into a top grad school in law, policy, international relations or machine learning. (If you’re not American, working on AI policy may also be a good option, but some of the best long-term positions in the US won’t be open to you.)

Table of contents

  • The problem to solve
  • Key actors
  • What do we mean by US AI public policy careers?
  • Why pursue this path?
  • Arguments against
  • How to pursue a career in US AI public policy
  • Be careful to avoid doing harm
  • Fit: Who is especially well placed to pursue this career?
  • Questions for further investigation
  • Conclusion
  • Further reading

Continue reading the full article...

Photo of Congress

37

0
0

Reactions

0
0
Mentioned in

More posts like this

Comments2


Sorted by
New & upvoted
Click to highlight new comments since:
Risto Uuk3
0
0

If you're a thoughtful American interested in developing expertise and technical abilities in the domain of AI policy, then this may be one of your highest impact options, particularly if you have been to or can get into a top grad school in law, policy, international relations or machine learning. (If you’re not American, working on AI policy may also be a good option, but some of the best long-term positions in the US won’t be open to you.)

What do you think about similar type of work within the European Union? Could it potentially be a high-impact career path for those who are not Americans?

Reply
Niel_Bowerman2
0
0

I think working on AI policy in an EU context is also likely to be valuable, however few (if any) of the world's very top AI companies are based in the EU (except DeepMind, which will soon be outside the EU after Brexit). Nonetheless, I think it would be very helpful to more AI policy expertise within an EU context, and if you can contribute to that it could be very valuable. It's worth mentioning that for UK citizens it might be better to focus on British AI policy.

Reply
More from 80000_Hours
View more
Curated and popular this week
 ·  · 20m read
 · 
Advanced AI could unlock an era of enlightened and competent government action. But without smart, active investment, we’ll squander that opportunity and barrel blindly into danger. Executive summary See also a summary on Twitter / X. The US federal government is falling behind the private sector on AI adoption. As AI improves, a growing gap would leave the government unable to effectively respond to AI-driven existential challenges and threaten the legitimacy of its democratic institutions. A dual imperative → Government adoption of AI can’t wait. Making steady progress is critical to: * Boost the government’s capacity to effectively respond to AI-driven existential challenges * Help democratic oversight keep up with the technological power of other groups * Defuse the risk of rushed AI adoption in a crisis → But hasty AI adoption could backfire. Without care, integration of AI could: * Be exploited, subverting independent government action * Lead to unsafe deployment of AI systems * Accelerate arms races or compress safety research timelines Summary of the recommendations 1. Work with the US federal government to help it effectively adopt AI Simplistic “pro-security” or “pro-speed” attitudes miss the point. Both are important — and many interventions would help with both. We should: * Invest in win-win measures that both facilitate adoption and reduce the risks involved, e.g.: * Build technical expertise within government (invest in AI and technical talent, ensure NIST is well resourced) * Streamline procurement processes for AI products and related tech (like cloud services) * Modernize the government’s digital infrastructure and data management practices * Prioritize high-leverage interventions that have strong adoption-boosting benefits with minor security costs or vice versa, e.g.: * On the security side: investing in cyber security, pre-deployment testing of AI in high-stakes areas, and advancing research on mitigating the ris
 ·  · 11m read
 · 
Our Mission: To build a multidisciplinary field around using technology—especially AI—to improve the lives of nonhumans now and in the future.  Overview Background This hybrid conference had nearly 550 participants and took place March 1-2, 2025 at UC Berkeley. It was organized by AI for Animals for $74k by volunteer core organizers Constance Li, Sankalpa Ghose, and Santeri Tani.  This conference has evolved since 2023: * The 1st conference mainly consisted of philosophers and was a single track lecture/panel. * The 2nd conference put all lectures on one day and followed it with 2 days of interactive unconference sessions happening in parallel and a week of in-person co-working. * This 3rd conference had a week of related satellite events, free shared accommodations for 50+ attendees, 2 days of parallel lectures/panels/unconferences, 80 unique sessions, of which 32 are available on Youtube, Swapcard to enable 1:1 connections, and a Slack community to continue conversations year round. We have been quickly expanding this conference in order to prepare those that are working toward the reduction of nonhuman suffering to adapt to the drastic and rapid changes that AI will bring.  Luckily, it seems like it has been working!  This year, many animal advocacy organizations attended (mostly smaller and younger ones) as well as newly formed groups focused on digital minds and funders who spanned both of these spaces. We also had more diversity of speakers and attendees which included economists, AI researchers, investors, tech companies, journalists, animal welfare researchers, and more. This was done through strategic targeted outreach and a bigger team of volunteers.  Outcomes On our feedback survey, which had 85 total responses (mainly from in-person attendees), people reported an average of 7 new connections (defined as someone they would feel comfortable reaching out to for a favor like reviewing a blog post) and of those new connections, an average of 3
 ·  · 15m read
 · 
In our recent strategy retreat, the GWWC Leadership Team recognised that by spreading our limited resources across too many projects, we are unable to deliver the level of excellence and impact that our mission demands. True to our value of being mission accountable, we've therefore made the difficult but necessary decision to discontinue a total of 10 initiatives. By focusing our energy on fewer, more strategically aligned initiatives, we think we’ll be more likely to ultimately achieve our Big Hairy Audacious Goal of 1 million pledgers donating $3B USD to high-impact charities annually. (See our 2025 strategy.) We’d like to be transparent about the choices we made, both to hold ourselves accountable and so other organisations can take the gaps we leave into account when planning their work. As such, this post aims to: * Inform the broader EA community about changes to projects & highlight opportunities to carry these projects forward * Provide timelines for project transitions * Explain our rationale for discontinuing certain initiatives What’s changing  We've identified 10 initiatives[1] to wind down or transition. These are: * GWWC Canada * Effective Altruism Australia funding partnership * GWWC Groups * Giving Games * Charity Elections * Effective Giving Meta evaluation and grantmaking * The Donor Lottery * Translations * Hosted Funds * New licensing of the GWWC brand  Each of these is detailed in the sections below, with timelines and transition plans where applicable. How this is relevant to you  We still believe in the impact potential of many of these projects. Our decision doesn’t necessarily reflect their lack of value, but rather our need to focus at this juncture of GWWC's development.  Thus, we are actively looking for organisations and individuals interested in taking on some of these projects. If that’s you, please do reach out: see each project's section for specific contact details. Thank you for your continued support as we
Recent opportunities in AI safety
14
MATS is hiring!
Ryan Kidd
·
1
1
54
Stripe Economics of AI Fellowship
basil.halperin
· · 3m read
0
0
43
Center on Long-Term Risk: Summer Research Fellowship 2025
Center on Long-Term Risk
· · 1m read
0
0
View more