Effective Altruism Forum
EA Forum

Hide table of contents
Comment Permalink
EuanMcLean1
0
0

This qualitative survey of AI safety experts I just finished, I think it might be a useful resource for people just starting their career in AI safety! https://www.lesswrong.com/s/xCmj2w2ZrcwxdH9z3 

Reply
See in context
by Lizka
5 min read 5

49

AI safetyAI safety resources and materialsNewslettersCollections and resourcesBuilding the field of AI safety
Frontpage
List of AI safety newsletters and other resources
Podcast & video channels
Newsletters
General-audience, safety-oriented newsletters on AI and AI governance
AI Safety Newsletter (Center for AI Safety) (🔉)
Transformer (Shakeel Hashim)
AI Policy Weekly (Center for AI Policy)
More in-the-weeds safety-oriented newsletters
GovAI newsletter (Centre for the Governance of AI)
ChinAI (Jeffrey Ding)
AI safety takes (Daniel Paleka)
The EU AI Act Newsletter (Future of Life Institute (FLI))
The Autonomous Weapons Newsletter (Future of Life Institute (FLI))
Other AI newsletters (not necessarily safety-oriented)
EuropeanAI newsletter (Charlotte Stix)
Import AI (Jack Clark)
Policy.ai (Center for Security and Emerging Technology (CSET))
The AI Evaluation Substack
TLDR AI
Newsletters on related topics, or which often cover AI or AI safety
RAND newsletters (and research you can get on RSS feeds)
GCR Policy Newsletter
Forecasting newsletter (and Alert/Sentinel minutes)
Crypto-Gram (Schneier on Security)
Oxford Internet Institute
Statecraft (Santi Ruiz)
Don't Worry About the Vase (Zvi Mowshowitz)
Other resources: collections, programs, reading lists, etc.
Closing notes
5 comments

This is a list of AI safety newsletters (and some other ways to keep up with AI developments).[1] 

  • If you know of any that I’ve missed, please comment![2]
  • And I'd love to hear about your experiences with or reflections on the resources listed. 

Thanks to everyone who puts together resources like the ones I'm collecting here!

Created with DALL-E

Just to be clear: the list includes newsletters and resources that I haven’t engaged with much.

Podcast & video channels

Newsletters

General-audience, safety-oriented newsletters on AI and AI governance

Note that the EA Newsletter, which I currently run, also often covers relevant updates in AI safety. 

AI Safety Newsletter (Center for AI Safety) (🔉)

  • Stay up-to-date with the latest advancements in the world of AI and AI safety with our newsletter, crafted by the experts at the Center for AI Safety. No technical background required. 
  • Audio available via the Forum cross-posts.

Transformer (Shakeel Hashim)

  • A weekly briefing of AI and AI policy updates and media/popular coverage.

AI Policy Weekly (Center for AI Policy)

  • Each week, this newsletter provides summaries of three important developments that AI policy professionals should know about, especially folks working on US AI policy. Visit the archive to read a sample issue.

More in-the-weeds safety-oriented newsletters

GovAI newsletter (Centre for the Governance of AI)

  • Includes research, annual reports, and rare updates about programmes and opportunities. They also have a blog.  

ChinAI (Jeffrey Ding)

  • This weekly newsletter, sent out by Jeff Ding, a researcher at the Future of Humanity Institute, covers the Chinese AI landscape and includes translations from Chinese government agencies, newspapers, corporations, and other sources.

AI safety takes (Daniel Paleka)

  • Summaries of news and research in AI safety (once every month or two). 

The EU AI Act Newsletter (Future of Life Institute (FLI))

  • A bi-weekly newsletter about up-to-date developments and analyses of the proposed EU AI law.

The Autonomous Weapons Newsletter (Future of Life Institute (FLI))

  • Monthly updates on the technology and policy of autonomous weapons.

Other AI newsletters (not necessarily safety-oriented)

EuropeanAI newsletter (Charlotte Stix)

  • This bi-monthly newsletter covers the state of European AI and the most recent developments in AI governance within the EU Member States.ai

Import AI (Jack Clark)

  • This is a weekly newsletter about artificial intelligence, covering everything from technical advances to policy debates, as well as a weekly short story.

Policy.ai (Center for Security and Emerging Technology (CSET))

  • A biweekly newsletter on artificial intelligence, emerging technology and security policy.

The AI Evaluation Substack

  • The AI Evaluation Substack is a monthly digest that covers the latest developments, research trends, and critical evaluations in the field of artificial intelligence.

TLDR AI

  • Daily email about new AI tech.

Newsletters on related topics, or which often cover AI or AI safety

RAND newsletters (and research you can get on RSS feeds)

GCR Policy Newsletter

  • A twice-monthly newsletter that highlights the latest research and news on global catastrophic risk.

Forecasting newsletter (and Alert/Sentinel minutes) 

  • Covers prediction markets and forecasting platforms as well as some changes in recent forecasts. 

Crypto-Gram (Schneier on Security)

  • Crypto-Gram is a free monthly e-mail digest of posts from Bruce Schneier’s Schneier on Security blog.

Oxford Internet Institute 

  • This newsletter, which is distributed eight times a year, provides information about the Oxford Internet Institute, a multidisciplinary research and teaching department of the University of Oxford dedicated to the social science of the Internet.

Statecraft (Santi Ruiz)

  • Interviews with policymakers and others.

Don't Worry About the Vase (Zvi Mowshowitz)

  • A blog "Don't Worry About the Vase" is a Substack newsletter: "Doing both speed premium short term updates and long term world model building. Currently focused on weekly AI updates. Explorations include AI, policy, rationality, medicine and fertility, education and games."

Other resources: collections, programs, reading lists, etc.

Closing notes

  • Please suggest additions by commenting! 
  • Please post reflections and thoughts on the different resources (or your personal highlights). 
  • Links to no longer active newsletters can be found in this footnote.[3]
  • Thanks again to everyone. 
  1. ^

    The closest thing to this that I’m aware of is Lots of Links by AI Safety Support, which is great, but you can’t comment on it to add more and share reflections, which I think is a bummer. There’s probably more. (Relevant xkcd.)

  2. ^

    Thanks to folks who directed me to some of the resources listed here! 

    Note also that in some cases, I'm quoting near-verbatim from assorted places that directed me to these or from the descriptions of the resources listed on their websites.

  3. ^

     AI Safety Support (AI Safety Support)

    Opportunities in AGI safety (BlueDot Impact)

    ML Safety Newsletter (Center for AI Safety)

    Alignment Newsletter (Rohin Shah)

    This week in security (@zackwhittaker)

49

0
0

Reactions

0
0
Mentioned in

More posts like this

Comments5


Sorted by
New & upvoted
Click to highlight new comments since:
Jeremy10
5
0

Zvi does a pretty in-depth AI news round up every week or two now, plus some individual posts on AI topics. Not exclusively about safety, but often gives his own safety-informed perspective on capabilities news, etc. https://thezvi.substack.com/

Reply
EuanMcLean1
0
0

This qualitative survey of AI safety experts I just finished, I think it might be a useful resource for people just starting their career in AI safety! https://www.lesswrong.com/s/xCmj2w2ZrcwxdH9z3 

Reply
Henry P2
0
0

The navigating AI risks newsletter could be relevant as well: "Welcome to Navigating AI Risks, where we explore how to govern the risks posed by transformative artificial intelligence. "  https://navigatingairisks.substack.com/ 

Reply
JakubK1
0
0

Probably worth adding a section of similar collections / related lists. For instance, see Séb Krier's post and https://aisafety.video/.

Apart Research has a newsletter that might be on hiatus.

Reply
Curated and popular this week
Paul Present
 ·  · 28m read
 · 
Note: I am not a malaria expert. This is my best-faith attempt at answering a question that was bothering me, but this field is a large and complex field, and I’ve almost certainly misunderstood something somewhere along the way. Summary While the world made incredible progress in reducing malaria cases from 2000 to 2015, the past 10 years have seen malaria cases stop declining and start rising. I investigated potential reasons behind this increase through reading the existing literature and looking at publicly available data, and I identified three key factors explaining the rise: 1. Population Growth: Africa's population has increased by approximately 75% since 2000. This alone explains most of the increase in absolute case numbers, while cases per capita have remained relatively flat since 2015. 2. Stagnant Funding: After rapid growth starting in 2000, funding for malaria prevention plateaued around 2010. 3. Insecticide Resistance: Mosquitoes have become increasingly resistant to the insecticides used in bednets over the past 20 years. This has made older models of bednets less effective, although they still have some effect. Newer models of bednets developed in response to insecticide resistance are more effective but still not widely deployed.  I very crudely estimate that without any of these factors, there would be 55% fewer malaria cases in the world than what we see today. I think all three of these factors are roughly equally important in explaining the difference.  Alternative explanations like removal of PFAS, climate change, or invasive mosquito species don't appear to be major contributors.  Overall this investigation made me more convinced that bednets are an effective global health intervention.  Introduction In 2015, malaria rates were down, and EAs were celebrating. Giving What We Can posted this incredible gif showing the decrease in malaria cases across Africa since 2000: Giving What We Can said that > The reduction in malaria has be
Ronen Bar
 ·  · 10m read
 · 
"Part one of our challenge is to solve the technical alignment problem, and that’s what everybody focuses on, but part two is: to whose values do you align the system once you’re capable of doing that, and that may turn out to be an even harder problem", Sam Altman, OpenAI CEO (Link).  In this post, I argue that: 1. "To whose values do you align the system" is a critically neglected space I termed “Moral Alignment.” Only a few organizations work for non-humans in this field, with a total budget of 4-5 million USD (not accounting for academic work). The scale of this space couldn’t be any bigger - the intersection between the most revolutionary technology ever and all sentient beings. While tractability remains uncertain, there is some promising positive evidence (See “The Tractability Open Question” section). 2. Given the first point, our movement must attract more resources, talent, and funding to address it. The goal is to value align AI with caring about all sentient beings: humans, animals, and potential future digital minds. In other words, I argue we should invest much more in promoting a sentient-centric AI. The problem What is Moral Alignment? AI alignment focuses on ensuring AI systems act according to human intentions, emphasizing controllability and corrigibility (adaptability to changing human preferences). However, traditional alignment often ignores the ethical implications for all sentient beings. Moral Alignment, as part of the broader AI alignment and AI safety spaces, is a field focused on the values we aim to instill in AI. I argue that our goal should be to ensure AI is a positive force for all sentient beings. Currently, as far as I know, no overarching organization, terms, or community unifies Moral Alignment (MA) as a field with a clear umbrella identity. While specific groups focus individually on animals, humans, or digital minds, such as AI for Animals, which does excellent community-building work around AI and animal welfare while
Max Taylor
 ·  · 9m read
 · 
Many thanks to Constance Li, Rachel Mason, Ronen Bar, Sam Tucker-Davis, and Yip Fai Tse for providing valuable feedback. This post does not necessarily reflect the views of my employer. Artificial General Intelligence (basically, ‘AI that is as good as, or better than, humans at most intellectual tasks’) seems increasingly likely to be developed in the next 5-10 years. As others have written, this has major implications for EA priorities, including animal advocacy, but it’s hard to know how this should shape our strategy. This post sets out a few starting points and I’m really interested in hearing others’ ideas, even if they’re very uncertain and half-baked. Is AGI coming in the next 5-10 years? This is very well covered elsewhere but basically it looks increasingly likely, e.g.: * The Metaculus and Manifold forecasting platforms predict we’ll see AGI in 2030 and 2031, respectively. * The heads of Anthropic and OpenAI think we’ll see it by 2027 and 2035, respectively. * A 2024 survey of AI researchers put a 50% chance of AGI by 2047, but this is 13 years earlier than predicted in the 2023 version of the survey. * These predictions seem feasible given the explosive rate of change we’ve been seeing in computing power available to models, algorithmic efficiencies, and actual model performance (e.g., look at how far Large Language Models and AI image generators have come just in the last three years). * Based on this, organisations (both new ones, like Forethought, and existing ones, like 80,000 Hours) are taking the prospect of near-term AGI increasingly seriously. What could AGI mean for animals? AGI’s implications for animals depend heavily on who controls the AGI models. For example: * AGI might be controlled by a handful of AI companies and/or governments, either in alliance or in competition. * For example, maybe two government-owned companies separately develop AGI then restrict others from developing it. * These actors’ use of AGI might be dr
Recent opportunities in AI safety
54
Stripe Economics of AI Fellowship
basil.halperin
· · 3m read
0
0
60
I'm hiring a Research Assistant for a nonfiction book on AI!
Garrison
· · 1m read
2
2
102
AI Moral Alignment: The Most Important Goal of Our Generation
Ronen Bar
· · 10m read
21
21
View more