Rank best universities for AI Saftey

Parker_Whitfill

[Question]

Rank best universities for AI Saftey

Parker_Whitfill

1 min readMay 6, 2023

Comments 4

Sorted by

New & upvoted

akash 🔸

I think the better question might be, "who are ~~the best~~ some professors/academic research groups in AI Safety to work with?"

Two meta-points I feel might be important —

For PhDs, the term "best university" doesn't mean much (there are some cases in which infrastructure makes a difference, but R1 schools, private or public, generally seem to have good research infrastructure). Your output as a graduate student heavily depends on which research group/PI you work with.
Specifically for AI safety, the sample size of academics is really low. So, I don't think we can rank them from best-to-eh. Doing so becomes more challenging because their research focus might differ, so a one-to-one comparison would be unsound.

With that out of the way, three research groups in academia come to mind:

Stuart Russell's group at the Center for Human Compatible AI (CHAI), UC Berkeley
David Kruegger's group at Cambridge
The Algorithmic Alignment Group at MIT EECS

Others:

Center for Human Inspired AI (CHIA) is a new research center at Cambridge; I don't know if their research would focus on subdomains of Safety; someone could look into this more.
I remember meeting two lovely folks from Oregon State University working on Safety at EAGx Berkeley. I cannot find their research group, and I forget what exactly they were working on; again, someone who knows more about this could comment perhaps.
An interesting route for a Safety-focused Ph.D. could be having a really good professor at a university who agrees to have an outside researcher as a co-advisor. I am guessing that more and more academics would want to start working on the Safety problem, so such collaborations would be pretty welcome, especially if they are also new to the domain.
- One thing to watch out for: which research groups get funded by this NSF proposal. There will soon be new research groups that Ph.D. students interested in the Safety problem could gravitate towards!

RyanCarey

Also Jacob Steinhardt, Vincent Conitzer, David Duvenaud, Roger Grosse, and in my field (causal inference), Victor Veitch.

Going beyond AI safety, you can get a general sense of strength from CSRankings (ML) and ShanghaiRankings (CS).

Arsalaan Alam

there's also CASMI at Northwestern, which I think not a lot of people know about. I find their research & agendas to be very aligned.

Link - https://casmi.northwestern.edu/

akash 🔸

Nice, I didn't know! Their research goals seem quite broad, which is good. Within the context of AI existential risk, this project looks interesting.

Comments

More from the author

139

Estimating the Substitutability between Compute and Cognitive Labor in AI Research

Parker_Whitfill, CherylWu·1y ago·Curated 1y ago·11m read

Curated and popular this week

What would an animal-aligned AI be aligned to?

Aidan Kankyoku, Anima International·1w ago·Curated 4d ago·15m read

This is a crosspost from the new Animal Welfare Alignment Newsletter by Anima International. You can subscribe on Substack if you are interested in following these efforts. Audio reading also available on Substack. The goals of this post are to: 1. Raise a question I see as crucially important to the goal of aligning AI to animal welfare...

191

The first video from Giving What We Can's new channel is out now!

JustinPortela·6d ago·1m read

Hello! I'm Justin Portela. I got hired by GWWC to make YouTube videos after AI in Context did such a kickass job. My channel is using that same cinematic, high-production value beauty to talk about everything in the EA universe that isn't AI. ...

100

Let's taboo the V-word

lincolnq·1d ago·8m read

“How long have you been v*g*n?” This is one of the most common icebreakers at animal protection events. It’s a baseline assumption, and it mostly holds true: if you’re out advocating for animals not to be tortured or abused, realistically these days you are v**n, or close. And it makes for good conversation. It seems fairly safe to assume when you meet strangers. But this assumption is hurting the movement in a way which we don’t always notice: someone new comes into the sp...

Recent opportunities to take action

EA Organisation Updates thread: July 2026

Dane Valerie·10h ago·1m read

The EA Opportunities Board now has full-time roles

Agnes Hasselblad 🔸·12h ago·3m read

Hiring: Grants & Operations Associate - Giving What We Can

Giving What We Can🔸, Zou Xinyi 🔸·8h ago·2m read

akash 🔸

I think the better question might be, "who are ~~the best~~ some professors/academic research groups in AI Safety to work with?"

Two meta-points I feel might be important —

For PhDs, the term "best university" doesn't mean much (there are some cases in which infrastructure makes a difference, but R1 schools, private or public, generally seem to have good research infrastructure). Your output as a graduate student heavily depends on which research group/PI you work with.
Specifically for AI safety, the sample size of academics is really low. So, I don't think we can rank them from best-to-eh. Doing so becomes more challenging because their research focus might differ, so a one-to-one comparison would be unsound.

With that out of the way, three research groups in academia come to mind:

Stuart Russell's group at the Center for Human Compatible AI (CHAI), UC Berkeley
David Kruegger's group at Cambridge
The Algorithmic Alignment Group at MIT EECS

Others:

Center for Human Inspired AI (CHIA) is a new research center at Cambridge; I don't know if their research would focus on subdomains of Safety; someone could look into this more.
I remember meeting two lovely folks from Oregon State University working on Safety at EAGx Berkeley. I cannot find their research group, and I forget what exactly they were working on; again, someone who knows more about this could comment perhaps.
An interesting route for a Safety-focused Ph.D. could be having a really good professor at a university who agrees to have an outside researcher as a co-advisor. I am guessing that more and more academics would want to start working on the Safety problem, so such collaborations would be pretty welcome, especially if they are also new to the domain.
- One thing to watch out for: which research groups get funded by this NSF proposal. There will soon be new research groups that Ph.D. students interested in the Safety problem could gravitate towards!