I guess the AI governance piece you link would be considered very pressing under longtermism. So I think that's a big answer to your question.
I guess the AI governance piece you link would be considered very pressing under longtermism. So I think that's a big answer to your question.
I also would be curious to see some Google Docs about longtermist strategy, as I've only ever seen whiteboard drawings at various conferences/events (and maybe a few other written ideas in various places).
However, I'm a bit confused by this:
But I also think there's many epistemic and accountability risks endemic to long-termism, such as how it's easy to pitch for results you'll (probably) never be around to see or be accountable for; I notice this thinking flaw in myself when I think about long-term interventions.
I may not be fully understanding your hesitance here, but if your point is saying something like "you may not be held accountable for your long-term impacts and thus are more likely to make mistakes/be biased," I feel like you're potentially really overweighting this issue:
Agree there's something to your 1-3 counterarguments but I find the fourth less convincing, maybe more because of semantics than actual substantive disagreement. Why? A difference in net effect of x-risk reduction of 0.01% Vs. 0.001% is pretty massive. These especially matter if the expected value is massive, because sometimes the same expected value holds across multiple areas. For example, preventing asteroid related X risk Vs. Ai Vs. Bio Vs. runaway climate change; (by definition) all same EV (if you take the arguments at face value). But plausibility of each approach and individual interventions within that would be pretty high variance.
A difference in net effect of x-risk reduction of 0.01% Vs. 0.001% is pretty massive. These especially matter if the expected value is massive, because sometimes the same expected value holds across multiple areas. For example, preventing asteroid related X risk Vs. Ai Vs. Bio Vs. runaway climate change; (by definition) all same EV (if you take the arguments at face value). But plausibility of each approach and individual interventions within that would be pretty high variance.
I'm a bit uncertain as to what you are arguing/disputing here. To clarify on my end, my 4th point was mainly just saying "when comparing long-termist vs. near-termist causes, the concern over 'epistemic and accountability risks endemic to long-termism' seems relatively unimportant given [my previous 3 points and/or] the orders of magnitude of difference in expected value between near-termism vs. long-termism."
Your new comment seems to be saying that an order-of-magnitude uncertainty factor is important when comparing cause areas within long-termism, rather than when comparing between overall long-termism and overall near-termism. I will briefly respond to that claim in the next paragraph, but if your new comment is actually still arguing your original point that the potential for bias is concerning enough that it makes the expected value of long-termism less than or just roughly equal to that of near-termism, I'm confused how you came to that conclusion. Could you clarify which argument you are now trying to make?
Regarding the inter-long-termism comparisons, I'll just say one thing for now: some cause areas still seem significantly less important than other areas. For example, it might make sense for you to focus on x-risks from asteroids or other cosmic events if you have decades of experience in astrophysics and the field is currently undersaturated (although if you are a talented scientist it might make sense for you to offer some intellectual support to AI, bio, or even climate). However, the x-risk from asteroids is many orders of magnitude smaller than that from AI and probably even biological threats. Thus, even an uncertainty factor that for some reason only reduces your estimate of expected x-risk reduction via AI or bio work by a factor of 10 (e.g., from 0.001% to 0.0001%) without also affecting your estimate of expected x-risk reduction via work on asteroid safety will probably not have much effect on the direction of the inequality (i.e., x > y; 0.1x > y).
Full question:
Where are the long-termist theories of victory / impact? If there are some loitering around behind private Google Docs but not shared more widely, what's driving this?
Why I'm asking this:
What we already have:
We've seen some theories of impact / victory written up in varying levels of detail...:
To clarify, are you asking for a theory of victory around advocating for longtermism (i.e., what is the path to impact for shifting minds around longtermism) or for causes that are currently considered good from a longtermist perspectives?
Three things:
1. I'm mostly asking for any theories of victory pertaining to causes which support a long-termist vision / end-goal, such as eliminating AI risk.
2. But also interested in a theory of victory / impact on long-termism itself, of which multiple causes interact. For example, if
then the composites of a theory of victory/ impact could be...:
3. Definitely not 'advocating for longtermism' as an ends in itself, but I can imagine that advocacy could be part of a wider theory of victory. For example, could postulate that reducing X-risk would require mobilising considerable private / public sector resources, requiring winnning hearts and minds around both how scarily probably X-risk is and the bigger goal of giving our descendants beautiful futures / leaving a legacy.