Sorted by New

Topic Contributions


"Long-Termism" vs. "Existential Risk"

I'd love to hear what you think we'd be doing differently. With JackM, I think if we thought that hinginess was pretty evenly distributed across centuries ex ante we'd be doing a lot of movement-building and saving, and then distributing some of our resources at the hingiest opportunities we come across at each time interval. And in fact that looks like what we're doing. Would you just expect a bigger focus on investment? I'm not sure I would, given how much EA is poised to grow and how comparably little we've spent so far. (Cf. Phil Trammell's disbursement tool https://www.philiptrammell.com/dpptool/)

The Bioethicists are (Mostly) Alright

Strong agree. All of the evidence cited in this post is about philosopher-bioethicists, and my experience working in bioethics (including at the NIH Department of Bioethics) says that philosopher-bioethicsts are much more progressive than bioethicists with a health background. And unfortunately, bioethicists with a health background have much stronger ties to the medical community and health care policy. One major piece of evidence for this is that none of the "bioethicists" mentioned in this post (other than Art Caplan) are members of the American Society of Bioethics and Humanities, the main professional organisation in bioethics which "represents nearly 1,800 physicians, nurses, social workers, members of the clergy, educators, researchers, and other healthcare professionals interested in the specialty of bioethics and the health humanities." (Evidence: I know most of them personally, have been to the ASBH conference three times, have a strong sense of who is there + what the conversations are like.) My experience attending the ASBH conference three times in the past suggests that most members of the ASBH see the philosophers mentioned as excessively radical, and they're routinely ignored by the core bioethics community.

Longtermist reasons to work for innovative governments

This is great and under-emphasized. I think it was @weeatquince who told me that the primary determinant of what gets implemented by governments is what has successfully been tried before, and while I haven't seen much empirical data on this it strikes me as plausible.

One counter-point comes from Michael Rose's book Zukünftige Generationen in der heutigen Demokratie, which finds that low institutional path-dependence (approximated by the rate of recent constitutional changes) had no effect on the institutionalization of powerful proxies for future generations in a (pretty small) fuzzy-set analysis.

On the other hand, former Welsh minister Jane Davidson says that Wales was able to implement their Well-being of Future Generations Act due to the innovativeness of the Welsh government in her new book #FutureGen.

In addition to seeing more EAs get into innovative governments to run policy experiments, it would be great to see further research on policy diffusion and on the importance and proper characterization of governmental innovativeness in the sense you outline here.

Link: Longtermist Institutional Reform

Thanks for posting this here as well as Jess's excellent questions! This seems like a nice place to continue the conversation around the paper, so I'll respond to what I take to be the most pertinent issues in the blog post here. As Jess notes, this is a relatively early attempt to formulate these ideas and the literature on longtermist institutional reform is extremely young, so the more conversation the better.

How will (short-term) vested interests try to capture these in-government research groups, and how will that be prevented? Why is this better done within the government rather than done in academia using grants from the government or philanthropists?

Most governments are swamped with expertise. It's not that they have too little of it, but that they are overwhelmed with it, can't absorb it, and don't know who to turn to as a reliable source of information. Governments need one or a small body of epistemically reliable and nonpartisan research groups that they can turn to which fill the function of synthesizing extant research into consumable reports for government. These research groups in turn need to have strong working relationships and good lines of communication with government. If an academic or privately-funded research institute could play that role, that would be fine, but it's harder to see how this would be possible, and in-government research groups and advisory boards have a good track record of playing this sort of role. (We use the OTA as one prominent example, but there are many others on smaller scale.) One additional benefit of research institutes that are set up by government is that when the government is perceived as legitimate, these institutes will also be seen as legitimate and reliable sources of information. It would be valuable for the described research institutes to have public legitimacy, so that if their publicly disseminated research were ignored by government this fact could precipitate public censure.

If public censure isn't enough to command the attention of government to the research, then a research institute with government authority could also have the "put-it-in-their-face-power" we suggest in the paper, forcing reading and a response by government.

Short-term interest capture is an important worry, and we see this already in privately-funded research groups as well as in academia. One mechanism we propose in the paper for preventing capture by interest groups and industry is to have researchers selected by professional associations or by lot. If the research body is large enough and its key members and leadership are shuffled frequently enough, this should prevent a great deal of corruption. But of course, we are open to other ideas depending on the additional concerns that arise.

What will incentivize the citizen assembly to actually benefit future citizens? Merely because they are “explicitly tasked with the sole mandate”, with no enforcement or feedback?

The citizens' assembly proposed doesn't have a strong mechanism for amplifying the concern of assembly members for future people. It is assumed that they already have some interest in doing this, as roughly all people do. The role of the citizens' assembly isn't to amplify personal motivation, but rather to i) reduce election and funding incentives that disincentivize the electorate from focusing on the long-term, ii) reduce the deleterious effects of polarization on long-term deliberation, and iii) create designated agenda time for long-term issues. All of these sources of short-termism hamper governmental motivation to focus on the long-term, so we should expect the citizens' assembly to be much more motivated to benefit future generations than existing government organs. The motivation comes from the citizens themselves, but it has far fewer obstacles to overcome than the motivation of the electorate.

That said, the literature on assemblies does suggest that participation in assemblies decreases citizen political apathy and increases empathy between deliberation participants, so there could be some salutary motivational effects of citizens' assemblies that we haven't considered here. Moreover, political decisions tend to operate with 2-5 year timelines, and the assembly members will in general live for much longer than this. Given that the citizens' assembly will be deliberative and better-informed than the general public, it is possible that it will function more rationally, seeking to promote the diverse interests of the diverse group of people within the assembly across their lifespans, rather than over the next 2-5 years, and this would significantly decrease short-termism. But this is rather speculative, and the central purpose of the assembly is not to increase this kind of motivation.

Does thinking that the citizen assembly would be effective imply that most government assemblies should be selected by sortition (which, right or wrong, has deployed pretty rarely worldwide)? Or is there something about the future and/or soft-power that makes sortition particularly well suited for this body? (Personally, I like sortition as a governing mechanism in general, but if we can’t get hardly anyone to use it generally, why might they here?)

Sortition has perhaps been deployed less rarely than you think! There have been at least 120 citizens' assemblies and citizen juries deployed worldwide, and sortition is regularly used for the selection of court juries. But it's true that they've rarely been used for the selection of long-lasting government positions.

The role of the citizens' assembly I mentioned above, I think, shows why sortition should be especially helpful here: it removes perverse election incentives to attend to the short-term, and it also reduces the effect of partisan forces, decreasing polarization. These seem especially important when considering long-term issues where our situation is epistemically precarious, but you're right to point out that they are generally very important. I am personally quite open to the idea that a very large proportion of political leaders should be selected randomly. My own dissertation supervisor, Alex Guerrero, is writing an excellent book defending this idea at this very moment.

On why we might be able to get government to use it here: citizens' assemblies have a relatively strong tradition of use for gathering information on the informed views of citizens, and have in the last decade become increasingly popular. As above, I would advocate for greater experimentation with sortition, but they have most popularly been used in citizens' assemblies that are similar to that which we describe, and we expect it to continue to be popular in these institutions.

Will prosperity impact statements obviously improve the long-term future more than it will be used to block/delay projects for near-term reasons? Certainly, environmental impact statements suffer from this problem, and EIS have the advantage that at least there is often some way to objectively check whether they were right or wrong in a reasonable amount of time.

This is the issue raised in the blog post that I find trickiest. It's certainly true that EIAs have frequently been used to block and delay projects on spurious grounds, and the point here that PIAs are less epistemically tractable is spot-on and important. One advantage of PIAs in the legislature is that many more resources can be put to ensuring that they are objective and accurate than can be put into, say, local jurisdictions, given the much greater resources of the federal government and the fewer number of items requiring assessment. An idea we considered but didn't include here is that an independent, non-partisan body such as the in-government research institutions we defend could perform the impact assessments, taking them out of the hands of politicians who might use them for more obstructionist ends. But I remain quite uncertain on the best mechanism for ensuring that PIAs fulfill their information-gathering and soft censure functions rather than becoming used primarily to fuel partisan obstructionism, and I'd certainly be interested in other ideas.

Representing future generations in the political process

Ah, it looks like I read your post to be a bit more committal than you meant it to be! Thanks for your reply! And sorry for the misnomer, I'll correct that in the top-level comment.

Representing future generations in the political process

Hi Tobias,

I'm glad to see CRS take something of an interest in this topic and I'm particularly happy to see some meta-level discussion of representing the interests of future generations which has been sorely missing from the longtermism space.

We are in full agreement that most extant proposals to represent future generations involve very weak institutions and often rely on tenuous political commitments. In fact, it's because political commitments are so tenuous that political institutions to represent future generations must at first be weak. Strong institutions for future generations have historically been repealed very rapidly, as Jones, O'Brien, and Ryan (2018) have argued from a couple case studies.

We are also in full agreement that there are problems of predicting the interests of future generations, and that getting more objective information about their interests is a key problem. This problem proliferates with increasingly longer timescales. This is why many of the solutions I am personally most favorable to are information interventions, such as creating research bodies like the now-defunct Office of Technology Assessment, which can distill and package extant expertise for legislative bodies, as well as posterity impact assessments, which can create strong incentives to gather more information about the future.

I find much less compelling the idea that "if there is the political will to seriously consider future generations, it’s unnecessary to set up additional institutions to do so," and "if people do not care about the long-term future," they would not agree to such measures. The main reason I find this uncompelling is just that it overgenerates in very implausible ways. Why should women have the vote? Why should discrimination be illegal?

The main long-term function that I see longtermist institutional reform, or any other kind of institutional reform playing is an institutional signalling role. There is compelling evidence that legal and political reform significantly shifts the norms and attitudes that people come to see as acceptable (Berkowitz and Walker 1967, Bilz and Nadler 2009, Flores and Barclay 2015, Tankard and Paluck 2016, 2017, Walker and Argyle 1964). Shifting laws and institutional norms credibly signals information about group attitudes to anyone who has access to information about those laws and norms. In this case, it signals that good, sensible, right-thinking people think that future generations are of great importance and that our political systems must be responsive to their interests. For this reason, there is a chicken and egg problem for institutional reform, but this chicken and egg problem is very friendly to supporters of institutional reform. Reforming institutions changes attitudes, which in turn creates the political will necessary to reform institutions further. Reformed institutions in turn create stable shelling points that prevent value drift away from core values.

For this reason, longtermist institutional reform is quite beneficial for information-gathering purposes. Representing future generations creates greater political and cultural will to gather objective information about the interests of future generations. It's an exercise in movement-building.

I don't know if you meant to narrow in on only those reforms I mention which attempt to create literal representation of future generations or if you meant to bring into focus all attempts to ameliorate political short-termism. In the latter case, it's worth noting that there are a large variety of likely causes of short-termism. Some of them are epistemic (we don't know what to do) and motivational (we lack the political will), but others are merely institutional. In these latter cases, the problem is not that we don't have enough information or will, but rather that the right information is not getting to the right people or that institutional mechanisms are preventing appropriately-motivated and informed actors from acting for the long term. These sorts of problems sometimes require different fixes, and they can sometimes be fixed simply by creating designated stakeholders who create relevant coordination points in government and have time allocated explicitly to considering the long-term. Political problems are often a problem of institutional incentives rather than of political will, and there are currently very strong incentives to focus on the short-term. I canvass many of the various causes of political short-termism in my (now rather lengthy) review on longtermist institutional design and policy.

As a classical utilitarian, I'm also not particularly bothered by the philosophical problems you set out above, but some of these problems are the subject of my dissertation and I hope that I have some solutions for you soon.

In short, I think there is reason for more optimism about longtermist institutional reform than you express here, but I am happy to have some further discussion of the problem and to see a call to consider more seriously the epistemic problems that plague such reform along with some possible solutions.

Applications are open for EAGxVirtual 2020

Thanks for clarifying all of this! Given that most questions are optional I no longer have this concern, and I'm glad that you've clarified this on the application.

Much looking forward to seeing you there as well!

Applications are open for EAGxVirtual 2020

Thanks so much to those involved in organizing! I wanted to share that I found the registration process (with its 40 or so questions, many requiring detailed information) quite onerous and I can imagine that it might deter some people from submitting completed applications. While this might sometimes be useful for a physical conference, to ration spots in part on the basis of the amount of effort put in, I can't as easily see how it would be useful for a virtual conference. But I may simply be insufficiently creative!

How should longtermists think about eating meat?

See also my 2018 EAG talk on shaping the long-term future through antispeciest legislative initiatives. Most of the relevant discussion starts at 8:40.


While I at the time thought the dominant beneficial effect would be through AGI alignment, I now think that we should think of these interventions as improving the value alignment of humanity and our descendents in general.

And cf. my and Jeff Sebo's paper on the indirect effects of eating meat and farming animals on human moral psychology and its importance for consequentialists:


In general, I'm with Michael in thinking that we should expect the dominant beneficial effects of vegetarianism and abolitionist efforts against animal agriculture to be their effects on human morality, which can positively shape the long-term future by better aligning the values of our descendents (and therefore their behavior) with our own values.

How good is The Humane League compared to the Against Malaria Foundation?

Thanks! I appreciate your wariness of overemphasizing precise numbers and I agree that it is important to hedge your estimates in this way.

However, none of the claims in the bullet you cite give us any indication of the expected value of each intervention. For two interventions A and B, all of the following is consistent with the expected value of A being astronomically higher than the expected value of B:

  • B is better than A in most of the most plausible scenarios
  • On most models the difference in cost-effectiveness is small (within 1 or 2 orders of magnitude)
  • One could reasonably believe that B is better than A or that B is better than A

Extremely little information is communicated about the relative expected value of A and B by the above points, and what information is communicated misleadingly suggests that both interventions are quite close in expected value. Because EAs are concerned with the expected value of interventions, I think you ought to communicate more about the relative expected value of the interventions and frame your summary of the interventions in a way that is less likely to mislead people about the relative expected value of each intervention.

I think the ideally informative way to both communicate the relative expected value of the interventions and hedge on your model uncertainty in the summary is to (1) provide your expected value estimate, (2) explain that you have high model uncertainty and one could arrive at a different expected value estimate with different assumptions, and (3) invite participants to adjust the Guesstimate and generate their own predictions.

Load More