Quick takes

Set topic
Frontpage
Global health
Animal welfare
Existential risk
Biosecurity & pandemics
12 more

You should volunteer at your first EAG! (Especially if you are a student or early career)

  • If you don’t have a network in EA, EAG’s can be overwhelming. Volunteering gives you a ready-made, organic network.
  • Volunteering is pretty chill - a lot of the shifts aren’t that hard.
  • At your first EAG, it’s unlikely that you are using your time so efficiently that a few hours of volunteering would cut into the value of your conference.

And also, AFAIK if you volunteer your ticket is free :)

LLM disclosure: used to search references, and to proofread in the end.

Lighting has been getting ridiculously cheaper. And for the most part we seem to be not taking advantage of that positive externality: reducing crime through better lighting. This has been battle-tested as one of the effective ways for public security, see Chalfin, Hansen, Lerner & Parker (2022), an RCT in NYC public housing finding ~36% reductions in nighttime outdoor index crimes from added street lighting. Many, many major cities still haven't copied this at the right levels!

But ... (read more)

Maybe my biggest medium-term worry about transformative AI, other than the takeover stuff, is a constellation of concerns I sometimes abbreviate to "political economy." Right now a large fraction of humans in democracies can live and support their families as a direct result of voluntarily exchanging their labor. It'd take active acts of violence to break from this (pretty good, all things considered) status quo. As a peacetime norm, this is unusually good relative to the history of human civilization. 

At some point in the future (in the "good" future... (read more)

Showing 3 of 5 replies (Click to show all)
10
Linch
My current first-pass answer is that  1. Windfall shares. Some fraction of AI stocks should be given one-time to every human alive 1. This still requires some form of largesse/threat but one-time largesse feels less scary to me than continuously need to uphold the norm. 2. And it's not exactly largesse while people (especially outside of AI companies) still have real power, more like a structured negotiation 3. For reasons of political-economy realities, probably with more given towards rich countries and/or countries that are closer to developing AGI 1. I'm imagining maybe ratios like 10:1 4. Not sure about the exact amount of shares but should be way more than enough to support everybody indefinitely at significantly above modern Western standards, excepting positional goods 5. After the initial transfer, this completely solves the largesse and political economy problems. The "dignity" problem of having your consumption no longer tied to your labor is still there but I'm less worried about this (seems more like a framing problem). 6. Children can still be a problem. My guess is that normal inheritance stuff is enough though in edge cases maybe we say that you aren't allowed to disown your children completely from your windfall shares. 1. If people live forever maybe we have a rule that reproduction means a minimum fraction of your shares automatically go to your children I dunno. 2. Charter. Later on, some version of this is also written directly into the charters of the AIs, so at minimum something like 0.1-10% of their values ought to care something like all of current humanity's preferences 1. Assuming alignment is solved, now superintelligence is (0.1-10%) on the side of all humanity. 3. (probably optional) some form of protection against manipulation/theft/expropriation 1. If there's a transition period where AIs are good enough to do most work in the economy and generate a lot of wealth and/or disemploy most

Thanks Linch <3

4
Linch
Claude gives some references to prior work. Maybe the most interesting is Anton Korinek:

Thinking of drafting a post on war crimes, trying to answer the following puzzles:

  1. Why do we have a notion of war crimes at all, given how bad war itself is?
  2. Why are some things war crimes and not others?
  3. Why do precursor notions to war crimes appear, independently, in essentially every culture that has fought wars at scale?
  4. Given that essentially every culture has also broken these norms, sometimes spectacularly, why does the norm always come back, and often come back stronger?

Common answers to these questions seem profoundly misguided. The naive answer, that... (read more)

Showing 3 of 14 replies (Click to show all)

You might like this post I wrote earlier about the bargaining theory puzzle of war. I engaged with the academic literature on the subject pretty significantly, particularly James Fearon, so you might like it. On the other hand Fearon himself mostly reasoned from first-principles rather than conduct a careful historical assessment, so in that regard it might fit your interests less.

The post never got very popular but a few people who read it carefully really enjoyed it. One of the better compliments I've gotten on my writing is when somebody said they were ... (read more)

2
Mo Putera
Your experience reminded me of how Holden Karnofsky described his career so far:
2
Linch
Thanks, though tbc Holden's way better at it than I am! 

A quick reminder that applications for EA Global: London 2026 close this Sunday (May 10)!

We already have more applications than last year, and this looks set to be our biggest EAG yet (again)! If you've been meaning to apply but haven't gotten around to it, this is your sign.

The admissions bar is more accessible than people often assume. If you're working on or seriously exploring a high-impact problem, you should apply.

This is the EAG I've been most excited to put together yet. I'd love to see you all there.

📍 InterContinental London, The O2 · 29-31 May 2... (read more)

[comment deleted]*1
0
0
Showing 3 of 4 replies (Click to show all)

The best thing I’ve read on it so far is this article by Kelsey Piper

3
Mihkel Viires 🔹
Despite the real risk from hantavirus being low, it is getting covered a lot in media right now. I think this is actually good. A lot of people had already forgotten about the pandemic that we had not that long ago and moved on to worrying about other problems currently dominating the news cycle. Hopefully this serves as a (small) reminder to people that pandemic preparedness / biosecurity really does matter. 
5
Ian Turner
At the risk of being too curmudgeonly, I'd say the main take is to stay away from the news cycle.

Just was watching Dwarkesh/David Reich podcast, fascinating stuff. Looking back at how I was taught taxonomy and anthropological history I find it frustrating. Note that I don't know much about (evolutionary) biology or genetics or the frontier of what genetic-history research so this is my layman attempt to explain why it's generally been puzzling for me how i have had this explained by other people who probably don't understand either, not trying to propose that I understand something david reich doesn't. 

My main gripe is that we are taught evolutio... (read more)

FYI, next week we will be highlighting the first batch of articles from In Development, @Lauren Gilbert's new global development magazine

Lauren and most of the authors will be on the Forum to answer your questions throughout the week. More info to come on Monday, but I figured I'd mention in case anyone wanted to read the articles in advance (they are here, and all authors apart from Paul Niehaus will be around to answer questions). 

I'm looking forward to the discussion. 

I have been disappointed by the support some EAs have expressed for recent activist actions at Ridglan Farms. I share others’ outrage at the outcome of the state animal cruelty investigation, which found serious animal cruelty law violations but led to a settlement that still permits Ridglan to sell beagles through July and to continue in-house experimentation. But I personally think the tactics used in the recent open rescues, including property damage and forced entry to remove animals, violate reasonable moral bounds on what actions are p... (read more)

Showing 3 of 18 replies (Click to show all)
2
MHR🔸
I see what you're getting at here. But if we agree that the externalities of crime aren't internalized, then I think we're just back in the position of the original post. You think the act utilitarian calculus checks you, I'm both skeptical that it does and think that there are non-act-utilitarian reasons why we ought to avoid lawbreaking. 
3
Ethan Prall
I’ve been somewhat disappointed in reading this post. But as I know some folks I like are reading it, I feel the need to share a few thoughts as a legal scholar and theorist. Your post I think demonstrates some misunderstandings about the nature of law. 1. You seem to misunderstand contractarianism, by making it an argument for quietism, as well as the nature of law in a democracy. We don’t agree to many laws as a society; most extant laws are conditions that no one ever agrees on. They are traditions. Take property law — no one ever voted to make animals property. That’s an inherited concept. There is a difference between a law that is democratically enacted, and a vestige of the English common law. The same goes for trespass, a common law principle. Moreover, no contractarian worth her salt is going to claim you can never break an unjust law. Going back to Aquinas, there is broad agreement that sometimes breaking an unjust law is morally appropriate, or at least defensible.  2. No one could reasonably argue this tactic is universalizable. It is strategic — it is a non-universalizable tactic meant to create significant attention and pressure for change toward universalizable norms. And more — the argument that if they do it, everyone will, can be a dangerous slippery slope. It’s infeasible for everyone to do this: they have jobs. More important, I would very much caution against that kind of thinking. It has been used to justify atrocities in the past. Take slaveholders: they used that kind of argument to push back against slave rebellions—it would destroy the antebellum south, socially and economically. That is not an argument worth keeping. I am not defending the Ridglan approach, but I am cautioning against these types dismissals of what they are doing. 3. Historically, you seem to again misunderstand the nature of law. Slaves were considered property, and their rebellions certainly damaged their property status. They also moved the north toward abolitionism

Thanks for engaging with the post! You made a lot of different points, so I'll do my best to separate them out and consider them one-by-one: 

(1)

  • I'm not making an argument for quietism. Saying that we have an obligation to follow the law is compatible with having obligations (even extraordinarily strong ones) to use non-illegal means to combat injustice (e.g. by advocating for changes to laws).
  • It's a genuinely interesting point that many of our laws are inherited traditions, rather than the direct product of the democratic process. However, I don't thi
... (read more)

Earning to give is lonely and requires repeated decisions. This is bad.

If you're earning to give, you are lucky if you have one EtG team-mate. The people you talk to every day do not have moral intuitions similar to yours, and your actions seem weird to them.

If you do direct work, the psychological default every day is to wake up and do work. You are surrounded by people who think the work is important, and whose moral values at least rhyme with your own.

If you earn to give, most days you do not give (you're probably paid bi-weekly, and transaction costs d... (read more)

Showing 3 of 10 replies (Click to show all)

I'm EtG and would love to connect with others. My DMs are open! A bit about me: I'm a SWE based in Europe, and my preferred cause area is animal welfare.

5
D_M_x
We have a regular EtG meetup in London. You might be interested in setting up something similar where you live, perhaps branching off a preexisting Effective Giving/Giving What We Can group?
1
dan.pandori
Oh totally. I'm lucky to be in the Bay Area where EA is a thing at all.

Somewhat meta point on epistemic modesty, calling it out here because it is a pattern that has deeply frustrated me about EA/rationalism for as long as I have known them: 
(making a quick take rather than commenting due to an app.operation_not_allowed error - I'm responding to @Linch's quick take on war crimes)
I guess these are just EA/rationalist norms, but an approach that glosses major positions as being so quickly dismissible strikes me as insufficiently epistemically modest. I would expect such a treatment will fail to properly consider alternativ... (read more)

Showing 3 of 4 replies (Click to show all)

I feel like I've heard this position a lot before, and I have some sympathy for it, but I feel like it implicitly overlooks a lot of what I find valuable about writing EA Forum comments, and it sets an overly high bar.

When one writes academic papers, one is expected to cite relevant previous work. Credit assignation is an important mechanism for tracing the evidence for claims and for assigning credit. Even in academic spheres, I think this is perhaps taken pathologically far (to the point where it probably sometimes is unduly burdensome and vaguely implie... (read more)

4
Ben Stewart
I'm not trying to be unkind, and I apologise if I was. I'll take this down if you ask here or via DM. I overreacted to what is a quick take because I think it was emblematic of a bad pattern - but that is unfair and disproportionate of me.  My main thing here is to push for better intermediate thinking. Like the standard EA/rat approach is so often based on dismissing mainstream or non-EA views, and then acting like their individual opinion is clearly superior, often reinventing current or past views that have had lots of non-EA examination. I want EA thinking to be better, and a lot of the time it would be improved by people reading more before opining, and not thinking the views of EA are so special.  We just have very different experiences then.  Do you mean critique someone on epistemic immodesty grounds? This is probably true but can you point me to the examples you have in mind? (I may indeed be doing this too much and seeing the examples would help)
16
Linch
Thanks for the much kinder response and the serious engagement! :) Please don't take your comment down, it's good to have this discussion in the open. (Also apologies for the long comment, brain not working really well so less succinct than I want to be) I want to defend my own approach here, and won't speak for the" standard EA/rat approach" except insomuch as my thinking is constitutive of that approach (as the old joke goes, "you're not in traffic, you are traffic"). Generally when I try to learn information about the world, what I go for is to seek facts and models that are  * interesting (ie, novel to me) * true * useful The best way to do this typically involves some combination of Google searches, original thinking, reading papers, conversations, reading, toy models, and (since ~2025) talking to AIs[1]. Since college, I've honed an ability to form views very quickly that I can defend, and believe I'm reasonably calibrated on. I think this is sometimes surprising to people but it shouldn't be. The first data point tells you a lot[2]. Similarly my bar for publishing my thoughts, ignoring opportunity cost, is also fairly low. The primary thing I'm interested in from a content perspective is some combination of novel/true/useful to my readers. Novel to whom? For me I have an implicit model of who my readers are and I try to calibrate accordingly. I want to write things that are new to a large fraction of my readers. I think you might have more of an academia-derived model where it's very important to only share thoughts that are novel to humanity.  I think this is less good of a norm. If I can write a better intro to stealth than is widely understood/disseminated, I think this is a useful service even if no individual point there is original.  Similarly, I think it's less important in non-academic contexts to attribute the originators of an idea or an analysis. I don't think it's useless, I just think it's less important. But if I'm thinking about a pro

This is too tangential from the forecasting discussion to justify being a comment there so I'm putting it here:

Forecasting makes no sense as a cause area, because cause areas are problems, something like "people lack resources/basic healthcare/etc.", "we might be building superintelligent AI and we have no idea what we're doing". Forecasting is more like a tool. People use forecasting to address AI, global poverty, and all sorts of more general problems, including ones that aren't major EA focuses.

For instance, we could treat vaccines as a cause area. All ... (read more)

The recent work on SAEBER, which applies sparse autoencoders (SAEs) to the screening of dna synthesis printers marks a big step towards effective function based screening.

This allows for printers to be monitored just as a lab technician uses computational gel electrophoresis to separate a messy mixture into clear, readable bands through the use of a specialized gel. SAEs happen to do the exact same thing by taking the muddied activation results of a neural network and projecting them out onto a higher dimensional space until the individual viral motifs can... (read more)

At what level of compute spending will AI Safety research be cut off from being considered effective altruism (if any)?

Of course, saving humanity from misaligned AI could be argued to be close to priceless. But how many experiments have a direct theory of change (ToC) of how it's going to mitigate existential risk?  Perhaps a general one is fine at low compute ("it only costs $10 and 'control research' is generally thought to be a good research agenda").  

But what about $5,000? What about $10,000? These numbers start to compare to or surpass what... (read more)

Showing 3 of 4 replies (Click to show all)

It seems very unlikely to me that there are AI safety projects that are both worth doing but also not worth doing if they spent $10k on compute. The human capital cost is typically far in excess of that.

3
MichaelDickens
Right now I would give very little marginal philanthropic money to compute-based experiments. AI companies already do a lot of those, and I don't expect them to work anyway. ML experiments are not addressing the fundamental barriers to solving AI misalignment. A core problem is that experiments can't deal with the sharp left turn. (I would make an exception for CaML-style alignment-to-animals work, but that's not about AI safety as it's normally construed.)
2
Brandon Riggs
Fair question, I guess some of the numbers I've been hearing can wipe out a (high) yearly salary well within a month (or days).   Perhaps one layer deeper I generally "back" money spent on someone working on AIS full time for a year and think there will probably be some good to come out of that.  Although it may happen quickly, it seems that at least some level of thought goes into which positions are needed to fill before the job posting goes out.  However, on individual experiments level, I think the level of scrutiny is much lower/potentially nonexistent.   There seem to be plausible arguments for paying market rate to retain top talent (although you may disagree with them), but I don't really think there's an argument to spend huge sums on experiments without even double-checking if there's a way this can reduce x-risk. 

huh. I recalled "xyz ways to become unstoppably agentic", an old EA forum post, that me and some friends liked quite a lot. 

https://forum.effectivealtruism.org/posts/Pc3CFbYxPXgyjoDpB/seven-ways-to-become-unstoppably-agentic

it appears the author has retracted it? or some other notion of it being no longer readable. I'm curious for their take on why they did that. 

(in general when this happens to one of your posts, seems much better to edit the title from xyz to [retracted] xyz and leave a comment explaining why your mind changed) 

You can use https://web.archive.org/ for deleted web pages, e.g. https://web.archive.org/web/20250426145325/https://forum.effectivealtruism.org/posts/Pc3CFbYxPXgyjoDpB/seven-ways-to-become-unstoppably-agentic 

The author also deleted their EA Forum and LessWrong accounts, so you'd need to reach out to them directly to ask why

The 85 million children we cannot count


New wars are starting before the old ones have ended. Humanitarian budgets are being cut with a chainsaw. And in this time of ultra-prioritisation, even more than before, we are asked to prove that every euro or dollar is spent on saving lives.

I have been working in this sector for 15 years. I have seen its inefficiencies up close. I have also seen what it holds together.

For the last few years, I have been exploring Effective Altruism and asking whether its principles can be brought into mainstream humanitarian aid. W... (read more)

Food for thought. I learnt that the most essential person in a system wasn't necessarily the leader, it was whoever was preventing it from breaking today. This person is often the invisible glue that keeps everything together. But how do you measure that or even detect it as an outsider?

 

I want to write something expanding more fully on what we decide is worth measuring and how that impacts decisions. 

Has anyone talked about the role the Green Revolution probably played in making factory farming economically viable? 

Among other enabling factors (e.g. antibiotics), factory farming, especially of pigs and poultry, depends on cheap grain feed. The system only works at scale if feed costs are low enough to make confinement viable relative to pasture. The Green Revolution roughly tripled global grain production between 1960 and 2000, and maize in particular became cheap enough to feed to animals at industrial volumes.

Every time I see a celebration of No... (read more)

I understand the concern, but I don't think we gain much from vilifying scientific discovery because of what humans do with it down the line, especially a second order effect like this. I don't think it's super complex. Was it bad to discover nuclear fission because the USA bombed Hiroshima?  

I think important discoveries well intended should be praised, and it's a separate discussion why it was then used for ill. 

It’s a dog eat dog world...

Unless and until we decide otherwise.

The Blog fka the Blog with No Name is now dba The 1001.

I'm pledging[1] to stop[2] saving[3] additional[4] money[5] & donate instead.

Fine print:

[1] This pledge is only good until 2030 unless renewed, and becomes invalid if I start working at a nonprofit.

[2] I'm still allowed to max out my 401k, partially since I have a 50% match there.

[3] Spending money is fine. I only spend 5% my gross, so that isn't the problem.

[4] I'm allowed to keep up with inflation, should the stock market not already do so.

[5] I'm allowed to keep saving illiquid equity, although I am encouraged to liquidate to the extent feasible to align with the spirit of the pledge.

1
Tristan Katz
I think this is so awesome, and I hope I can make a similar pledge someday, if I achieve enough financial security.  I'm kinda curious how frugally you live with 5%. A concern I have is that as I get older, the lifestyles of those around me improve (since they have more money) and so it's quite hard not to raise my standards as well.  Also I guess you have no concerns about potentially having to support family?

The explanation is IMO less about frugality and more about getting lucky with my career choice. I spend about 45k a year, which is kinda frugal for my peers but globally I'm a spendthrift. I spend about 1.8k a month on rent, a few hundred on food, and take a vacation once or twice a year. My main hobbies are cheap (video games, board games, birding, pickleball).

It is often much easier to make more money than it is to save more. I would personally focus more on that side of the equation.

My wife & I don't want kids. If we did, I probably would want to save more (just for college). But even if we did, we were very lucky to have software engineering jobs over the last 10 years. We'd basically be fine.

huh. I recalled "xyz ways to become unstoppably agentic", an old EA forum post, that me and some friends liked quite a lot. 

https://forum.effectivealtruism.org/posts/Pc3CFbYxPXgyjoDpB/seven-ways-to-become-unstoppably-agentic

it appears the author has retracted it? or some other notion of it being no longer readable. I'm curious for their take on why they did that. 

(in general when this happens to one of your posts, seems much better to edit the title from xyz to [retracted] xyz and leave a comment explaining why your mind changed) 

Load more