Scriptwriter for RationalAnimations! Interested in lots of EA topics, but especially ideas for new institutions like prediction markets, charter cities, georgism, etc. Also a big fan of EA / rationalist fiction!
The Christians in this story who lived relatively normal lives ended up looking wiser than the ones who went all-in on the imminent-return-of-Christ idea. But of course, if christianity had been true and Christ had in fact returned, maybe the crazy-seeming, all-in Christians would have had huge amounts of impact.
Here is my attempt at thinking up other historical examples of transformative change that went the other way:
Muhammad's early followers must have been a bit uncertain whether this guy was really the Final Prophet. Do you quit your day job in Mecca so that you can flee to Medina with a bunch of your fellow cultists? In this case, it probably would've been a good idea: seven years later you'd be helping lead an army of 100,000 holy warriors to capture the city of Mecca. And over the next thirty years, you'll help convert/conquer all the civilizations of the middle east and North Africa.
Less dramatic versions of the above story could probably be told about joining many fast-growing charismatic social movements (like joining a political movement or revolution). Or, more relevantly to AI, about joining a fast-growing bay-area startup whose technology might change the world (like early Microsoft, Google, Facebook, etc).
You're a physics professor in 1940s America. One day, a team of G-men knock on your door and ask you to join a top-secret project to design an impossible superweapon capable of ending the Nazi regime and stopping the war. Do you quit your day job and move to New Mexico?...
You're a "cypherpunk" hanging out on online forums in the mid-2000s. Despite the demoralizing collapse of the dot-com boom and the failure of many of the most promising projects, some of your forum buddies are still excited about the possibilities of creating an "anonymous, distributed electronic cash system", such as the proposal called B-money. Do you quit your day job to work on weird libertarian math problems?...
People who bet everything on transformative change will always look silly in retrospect if the change never comes. But the thing about transformative change is that it does sometimes occur.
(Also, fortunately our world today is quite wealthy -- AI safety researchers are pretty smart folks and will probably be able to earn a living for themselves to pay for retirement, even if all their predictions come up empty.)
Reposting here a recent comment of mine listing socialist-adjacent ideas that at least I personally am a lot more excited about than socialism itself.
* * *
FYI, if you have not yet heard of "Georgism" (see this series of blog posts on Astral Codex Ten), you might be in for a really fun time! It's a fascinating idea that aims to reform capitalism by reducing the amount of rent-seeking in the economy, thus making society fairer and more meritocratic (because we are doing a better job of rewarding real work, not just rewarding people who happen to be squatting on valuable assets) while also boosting economic dynamism (by directing investment towards building things and putting land to its most productive use, rather than just bidding up the price of land).
A few other weird optimal-governance schemes that have socialist-like egalitarian aims but are actually (or at least partially) validated by our modern understanding of economics:
Reposting here a recent comment of mine listing socialist-adjacent ideas that at least I personally am a lot more excited about than socialism itself.
* * *
FYI, if you have not yet heard of "Georgism" (see this series of blog posts on Astral Codex Ten), you might be in for a really fun time! It's a fascinating idea that aims to reform capitalism by reducing the amount of rent-seeking in the economy, thus making society fairer and more meritocratic (because we are doing a better job of rewarding real work, not just rewarding people who happen to be squatting on valuable assets) while also boosting economic dynamism (by directing investment towards building things and putting land to its most productive use, rather than just bidding up the price of land). Check it out; it might scratch an itch for "something like socialism, but that might actually work".
A few other weird optimal-governance schemes that have socialist-like egalitarian aims but are actually (or at least partially) validated by our modern understanding of economics:
Reposting a comment of mine from another user's similar post about "I used to be socialist, but now have seen the light"!
* * *
FYI, if you have not yet heard of "Georgism" (see this series of blog posts on Astral Codex Ten), you might be in for a really fun time! It's a fascinating idea that aims to reform capitalism by reducing the amount of rent-seeking in the economy, thus making society fairer and more meritocratic (because we are doing a better job of rewarding real work, not just rewarding people who happen to be squatting on valuable assets) while also boosting economic dynamism (by directing investment towards building things and putting land to its most productive use, rather than just bidding up the price of land). Check it out; it might scratch an itch for "something like socialism, but that might actually work".
A few other weird optimal-governance schemes that have socialist-like egalitarian aims but are actually (or at least partially) validated by our modern understanding of economics:
Left-libertarian EA here -- I'll always upvote posts along the lines of "I used to be socialist, but now have seen the light"!
FYI, if you have not yet heard of "Georgism" (see this series of blog posts on Astral Codex Ten), you might be in for a really fun time! It's a fascinating idea that aims to reform capitalism by reducing the amount of rent-seeking in the economy, thus making society fairer and more meritocratic (because we are doing a better job of rewarding real work, not just rewarding people who happen to be squatting on valuable assets) while also boosting economic dynamism (by directing investment towards building things and putting land to its most productive use, rather than just bidding up the price of land). Check it out; it might scratch an itch for "something like socialism, but that might actually work".
A few other weird optimal-governance schemes that have socialist-like egalitarian aims but are actually (or at least partially) validated by our modern understanding of economics:
Agreed that it's a weird mood, but perhaps inevitable.
In terms of the inequality between running PR campaigns but "not interesting cooprating with other people's altruistic PR campaigns": insofar as attention is ultimately a fixed resource, it's an intrinsically adversarial situation between different attempts to capture peoples' attention. (Although there are senses in which this is not true -- many causes are often bundled together in a political alliance. And there could even be a broader cultural shift towards people caring more about behaving ethically, which would perhaps "lift all boats" in the do-gooder PR-campaign space!) Nevertheless, given the mostly fixed supply of attention, it certainly seems fine to steal eyeballs for thoughtful, highly-effective causes that would otherwise be watching Tiktok, and it seems similarly fine to steal eyeballs for good causes that would otherwise have gone to dumb, counterproductive causes (like the great paper-straw crusade). After that, it seems increasingly lamentable to steal eyeballs from increasingly reasonably-worthy causes, until you get to the level of counterproductive infighting among people who are all trying hard to make the world a better place. Of course, this is complicated by the fact that everyone naturally thinks their own cause is worthier than others. Nevertheless, I think some causes are worthier than others, and fighting to direct attention towards the worthiest causes is a virtuous thing to do -- perhaps even doing one's civic duty as a participant in the "marketplace of ideas".
In terms of the inequality between organizers (who are being high-impact only because others are low impact) vs consumers whose behavior is affected:
Re: Nestle in particular, I get the spirit of what you're saying, although see my recent long comment where I try to think through the chocolate issue in more detail. As far as I can tell, the labor-exploitation problems are common to the entire industry, so switching from Nestle to another brand wouldn't do anything to help?? (If anything, possibly you should be switching TOWARDS nestle, and away from companies like Hershey's that get a much higher % of their total revenue from chocolate?)
I think this spot-check about Nestle vs cocoa child labor (and about Nestle vs drought, and so forth) illustrates my point that there are a lot of seemingly-altruistic PR campaigns that actually don't do much good. Perhaps those PR campaigns should feel bad for recruiting so much attention only to waste it on a poorly-thought-out theory of impact!
Hi; thanks for this thoughtful reply!
I agree that with chocolate and exploited labor, the situation is similar to veganism insofar as if you buy some chocolate, then (via the mechanisms of supply and demand) that means more chocolate is gonna be harvested (although not necessarily by harvested by that particular company, right? so I think the argument works best only if the entire field of chocolate production is shot through with exploited labor?). Although, as Toby Chrisford points out in his comment, not all boycott campaigns are like this.
Reading the wikipedia page for chocolate & child labor, I agree that this seems like a more legit cause than "water privatization" or some of the other things I picked on. But if you are aiming for a veganism-style impact through supply and demand, it makes more sense to boycott chocolate in general, not a specific company that happens to make chocolate. (Perplexity says that Nestle controls only a single-digit percentage of the world's chocolate market, "while the vast majority is produced by other companies such as Mars, Mondelez, Ferrero, and Hershey" -- nor is Nestle even properly described as a chocolate company, since only about 15% of their revenue comes from chocolate! More comes from coffee, other beverages, and random other foods.)
In general I just get the feeling that you are choosing what to focus on based on which companies have encountered "major controversies" (ie charismatic news stories), rather than making an attempt to be scope-sensitive or thinks strategically.
Challenge accepted!!! Here are some random fermi calculations that I did to help me get a sense of scale on various things:
This probably won't be a very helpful response, but for what it's worth:
I think your final paragraph is mixing up two things that are actually separate:
1. "I'm not denying [that x-risks are important] but these seem like issues far beyond the influence of any individual person. They are mainly the domain of governments, policymakers... [not] individual actions."
2. "By contrast, donating to save kids from malaria or starvation has clear, measurable, immediate effects on saving lives."
I agree with your second point that sadly, longtermism lacks clear, measurable, immediate effects. Even if you worked very hard and got very lucky and accomplished something that /seems/ like it should be obviously great from a longtermist perspective (like, say, establishing stronger "red phone"-style nuclear hotline links between the US and Chinese governments), there's still a lot of uncertainty about whether this thing you did (which maybe is great "in expectation") will actually end up being useful (maybe the US and China never get close to fighting a nuclear war, nobody ever uses the hotline, so all the effort was for naught)! Even in situations where we can say in retrospect that various actions were clearly very helpful, it's hard to say exactly HOW helpful. Everything feels much more mushy and inexact.
Longtermists do have some attempted comebacks to this philosophical objection, mostly along the lines of "well, your near-term charity, and indeed all your actions, also affect the far future in unpredictable ways, and the far future seems really important, so you can't really escape thinking about it". But also, on a much more practical level, I'm very sympathetic to your concern that it's much harder to figure out where to actually donate money to make AI safety go well than to improve the lives of people living in poor countries or help animals or whatever else -- the hoped-for paths to impact in AI are so much more abstract and complicated, one would have to do a lot more work to understand them well, and even after doing all that work you might STILL not feel very confident that you've made a good decision. This very situation is probably the reason why I myself (even though I know a ton about some of these areas!!) haven't made more donations to longtermist cause areas.
But I disagree with your first point, that it's beyond the power of individuals to influence x-risks or do other things to make the long-term future go well, rather it's up to governments. And I'm not just talking about individual crazy stories like that one time when Stanislav Petrov might possibly have saved the world from nuclear war. I think ordinary people can contribute in a variety of reasonably accessible ways:
Now, you might reasonably object: "Sure, those things sound like they could be helpful as opposed to harmful, but what happened to the focus on helping the MOST you possibly can! If you are so eager to criticize the idea of giving up chocolate in favor of the hugely more-effective tactic of just donating some money to givewell top charities, then why don't you also give up this speculative longtermist blogging and instead try to earn more money to donate to GiveWell?!" This is totally fair and sympathetic. In response I would say:
Overall, rather than the strong and precise claim that "you should definitely do longtermism, it's 10,000x more important than anything else", I'd rather make the weaker, broader claims that "you shouldn't just dismiss longtermism out of hand; there is plausibly some very good stuff here" and that "regardless of what you think of longermism, I think you should definitely try to adopt more of an EA-style mindset in terms of being scope-sensitive and seeking out what problems seem most important/tractable/neglected, rather than seeing things too much through a framework of moral obligations and personal sacrifice, or being unduly influenced by whatever controversies or moral outrages are popular / getting the most news coverage / etc."
That's an interesting way to think about it! Unfortunately this is where the limits of my knowledge about the animal-welfare side of EA kick in, but you could probably find more info about these progest campaigns by searching some animal-welfare-related tags here on the Forum, or going to the sites of groups like Animal Ask or Hive that do ongoing work coordinating the field of animal activists, or by finding articles / podcast interviews with Lewis Bollard, who is the head grantmaker for this stuff at Open Philanthropy / Coefficient Giving, and has been thinking about the strategy of cage-free campaigns and related efforts for a very long time.
I'm not an expert about this, but my impression (from articles like this: https://coefficientgiving.org/research/why-are-the-us-corporate-cage-free-campaigns-succeeding/ , and websites like Animal Ask) is that the standard EA-style corporate campaign involves:
My impression is that this works because the corporations decide that it's less costly for them to implement the specific, limited, welfare-enhancing "ask" than to endure the reputational damage caused by a big public protest campaign. The efficacy doesn't depend at all on a threat of boycott by the activists themselves. (After all, the activists are probably already 100% vegan, lol...)
You might reasonably say "okay, makes sense, but isn't this just a clever way for a small group of activists to LEVERAGE the power of boycotts? the only reason the corporation is afraid of the threatened protest campaign is because they're worried consumers will stop buying their products, right? so ultimately the activists' power is deriving from the power of the mass public to make individual personal-consumption decisions".
This might be sorta true, but I think there are some nuances:
To answer with a sequence of increasingly "systemic" ideas (naturally the following will be tinged by by own political beliefs about what's tractable or desirable):
There are lots of object-level lobbying groups that have strong EA endorsement. This includes organizations advocating for better pandemic preparedness (Guarding Against Pandemics), better climate policy (like CATF and others recommended by Giving Green), or beneficial policies in third-world countries like salt iodization or lead paint elimination.
Some EAs are also sympathetic to the "progress studies" movement and to the modern neoliberal movement connected to the Progressive Policy Institute and the Niskasen Center (which are both tax-deductible nonprofit think-tanks). This often includes enthusiasm for denser ("yimby") housing construction, reforming how science funding and academia work in order to speed up scientific progress (such as advocated by New Science), increasing high-skill immigration, and having good monetary policy. All of those cause areas appear on Open Philanthropy's list of "U.S. Policy Focus Areas".
Naturally, there are many ways to advocate for the above causes -- some are more object-level (like fighting to get an individual city to improve its zoning policy), while others are more systemic (like exploring the feasibility of "Georgism", a totally different way of valuing and taxing land which might do a lot to promote efficient land use and encourage fairer, faster economic development).
One big point of hesitancy is that, while some EAs have a general affinity for these cause areas, in many areas I've never heard any particular standout charities being recommended as super-effective in the EA sense... for example, some EAs might feel that we should do monetary policy via "nominal GDP targeting" rather than inflation-rate targeting, but I've never heard anyone recommend that I donate to some specific NGDP-targeting advocacy organization.
I wish there were more places like Center for Election Science, living purely on the meta level and trying to experiment with different ways of organizing people and designing democratic institutions to produce better outcomes. Personally, I'm excited about Charter Cities Institute and the potential for new cities to experiment with new policies and institutions, ideally putting competitive pressure on existing countries to better serve their citizens. As far as I know, there aren't any big organizations devoted to advocating for adopting prediction markets in more places, or adopting quadratic public goods funding, but I think those are some of the most promising areas for really big systemic change.