This short post responds to some of the criticisms of longtermism in Torres’ minibook: Were the Great Tragedies of History “Mere Ripples”? The Case Against Longtermism, which I came across in this syllabus.
I argue that while many of the criticisms of Bostrom strike true, newer formulations of longtermism and existential risk – most prominently Ord’s The Precipice (but also Greaves, MacAskill, etc) – do not face the same challenges. I split the criticisms into two sections: the first on problematic ethical assumptions or commitments, the second on problematic policy proposals.
Note that I both respect and disagree with all three authors. Torres piece is insightful and thought-provoking, as well as polemical; Ord’s book is a great restatement of the ethical case, though I disagree with his prioritisation of climate change, nuclear weapons and collapse; and Bostrom is a groundbreaking visionary, though one can dispute many of his views.
Problematic ethical assumptions or commitments
Torres argues that longtermism rests on assumptions and makes commitments that are problematic and unusual/niche. He is correct that Bostrom has a number of unusual ethical views, and in his early writing he was perhaps overly fond of a contrarian ‘even given these incredibly conservative assumptions the argument goes through’ framing. But Torres does not sufficiently appreciate that these limitations and constraints have largely been acknowledged by longtermist philosophers, who have (re)formulated longtermism so as to not require these assumptions and commitments.
Total utilitarianism
Torres suggests that longtermism is based on an ethical assumption of total utilitarianism, a view in which we should maximise wellbeing based on adding together the wellbeing of all the individuals in a group. Such a ‘more is better’ ethical view accords significant weight to trillions of future individuals. He points out that total utilitarianism is not a majority opinion amongst moral philosophers.
However, although total utilitarianism strongly supports longtermism, longtermism doesn’t need to be based on total utilitarianism. One of the achievements of The Precipice is Ord’s arguments pointing out the affinities between longtermism with other ethical traditions, such as conservatism, obligations to the past, virtue ethics. One can be committed to a range of ethical views and endorse longtermism.
Trillions of simulations on computronium
Torres suggests that the scales are tilted towards longtermism by including in the calculation quadrillions of simulations of individuals living flourishing lives. The view that such simulations would be moral agents, or that this future is desirable, is certainly unusual.
But one doesn’t have to be committed to this view for the argument to work. The argument goes through if we assume that humanity never leaves Earth, and simply survives until the Earth is uninhabitable – or even more conservatively, survives the duration of an average mammalian species. There are still trillions of future individuals, whose interests and dignity matter.
‘Reducing risk from 0.001% to 0.0001% is not the same as saving thousands of lives’
Torres implies that longtermism is committed to a view of the form that reducing risk from 0.001% to 0.0001% is morally equivalent to saving e.g. thousands of present day lives. This a clear example of early Bostrom stating his argument in a philosophically robust, but very counterintuitive way. Worries about this framing have been common for over a decade, in the debate over ‘Pascal’s Mugging’.
However, longtermism does not have to be stated in such a way. The probabilities are unfortunately likely higher – for example Ord gives a 1/6 (~16%) probability of existential risk this century – and the reductions in risk are likely higher too. That is, with the right policies (e.g. robust arms control regimes) we could potentially reduce existential risk by 1-10%. Specifically on Pascal’s Mugging, a number of decision-theory responses have been proposed, which I will not discuss here.
Transhumanism and space settlement & ‘Not reaching technological maturity = existential risk’
Torres suggests that longtermism is committed to transhumanism and space settlement (in order to expand the number of future individuals), and argues that Bostrom bakes this commitment into existential risk through a negative definition of existential risk as any future that does not achieve technological maturity (through extinction, plateauing, etc).
However, while Bostrom certainly does think this future is ethically desirable, longtermism is not committed to it. Torres underplays the crucial changes Ord makes with his definition of existential risk as the “destruction of humanity’s potential” and the institution of the “Long Reflection” to decide what we should do with this potential. Long Reflection proponents specifically propose not engaging in transhumanist enhancement or substantial space settlement before the Long Reflection is completed. Longtermism is not committed to any particular outcome from the Long Reflection. For example, if after the Long Reflection humanity decided to never become post-humans, and never leave Earth, this would not necessarily be viewed by longtermists as a destruction of humanity’s potential, simply one choice as to how to spend that potential.
Problematic policy proposals
Torres argues that longtermists are required to endorse problematic policy proposals. I argue that they are not – I personally would not endorse these proposals.
‘Continue developing technology to reduce natural risk’
Torres argues that longtermists are commited to continued technological development for transhumanist/space settlement reasons – and to prevent natural risks – but that this is “nuts” because (as he fairly points out) longtermists themselves argue that natural risk is tiny compared to anthropogenic risk.
However, the more common longtermist policy proposal is differential technological development – to try to foster and speed up the development of risk-reducing (or more generally socially beneficial) technologies and to slow down the development of risk-increasing (or socially harmful) technologies. This is not a call to continue technological development in order to become post-humans or reduce asteroid/supervolcano risk – it is to differentially progress technology, assuming that overall technological development is hard/impossible to stop. I would agree with this assumption, but one may reasonably question it, especially when phrased as a form of strong ‘technological completism’ (any technology that can get invented will get invented).
Justifies surveillance
Torres argues against the “turnkey totalitarianism” (extensive and intrusive mass surveillance and control to prevent misuse of advanced technology) explored in Bostrom’s ‘Vulnerable World Hypothesis’, and implies that longtermism is committed to such a policy.
However, longtermism does not have to be committed to such a proposal. In particular, one can simply object that Bostrom has a mistaken threat model. The existential risks we have faced so far (nuclear and biological weapons, climate change) have largely come from state militaries and large companies, and the existential risks we may soon face (from new biotechnologies and transformative AI) will also come from the same threat sources. The focus of existential risk prevention should therefore be on states and companies. Risks from individuals and small groups are relatively much smaller. These small benefits from the kind of mass surveillance Bostrom explores means it is not justified by a cost-benefit analysis.
Nevertheless, in the contrived hypothetical of ‘anyone with a microwave could have a nuclear weapon’, would longtermism be committed to restrictions on liberty? I address this in the next heading.
Justifies mass murder
Torres argues that longtermists would have to be willing to commit horrendous acts (e.g. destroy Germany with nuclear weapons) if it would prevent extinction.
This is a classic objection to all forms of consequentialism and utilitarianism – from the Trolley Problem to the Colosseum objection. There are many classic responses, ranging from disputing the hypothetical to pointing out that other ethical views are also committed to such an action.
It is not a unique objection to longtermism, and loses some of its force as longtermism does not have to be based on utilitarianism (as I said above). I would also point out that it is an odd accusation to level, as longtermism places such high priority on peace, disarmament and avoiding catastrophes.
Justifies giving money to the rich rather than the extreme poor, which is a form of white supremacy
Torres suggests that longtermism is committed to donating to the rich rather than to those in extreme poverty (or indeed animals). He further argues that this reinforces “racial subordination and maintain[s] a normalized White privilege.”
However, longtermism is not committed to donating (much less transferring wealth from poor countries) to present rich people. Longtermists might in practice donate to NGOs or scientists in the developed world, but the ultimate beneficiaries are future generations. Indeed, the same might be true of other cause areas e.g. work on a malaria vaccine or clean meat. Torres does not seem to accord much weight to how much longtermists recognise this as a moral dilemma and feel very conflicted – most longtermists began as committed to ending the moral crimes of extreme poverty, or of factory farming. There are many huge tragedies, but one must unfortunately chose were to spend one’s limited time and resources.
Longtermism is committed to the view that future generations matter morally. They are moral equals. When someone is born is a morally irrelevant fact, like their race, gender, nationality or sexuality. Furthermore, present people are in a unjust, exploitative power imbalance with future generations. Future generations have no voice or vote in our political and economic systems. They can do nothing to affect us. Our current political and economic systems are set up to overwhelmingly benefit those currently alive, often at the cost of exploiting, and loading costs onto, future generations.
This lack of recognition of moral equality, lack of representation, power imbalance and exploitation shares many characteristics with white supremacy/racism/colonialism and other unjust power structures. It is ironic to accuse a movement arguing on behalf of the voiceless of being a form of white supremacy.
[disclaimer: I am co-Director at CSER. While much of what I will write intersects with professional responsibilities, it is primarily written from a personal perspective, as this is a deeply personal matter for me. Apologies in advance if that's confusing, this is a distressing and difficult topic for me, and I may come back and edit. I may also delete my comment, for professional or personal/emotional reasons].
I am sympathetic to Halstead's position here, and feel I need to write my own perspective. Clearly to the extent that CSER has - whether directly or indirectly - served to legitimise such attacks by Torres on colleagues in the field, I bear a portion of responsibility as someone in a leadership position. I do not feel it would be right or appropriate for me to speak for all colleagues, but I would like to emphasise that individually I do not, in any way, condone this conduct, and I apologise for it, and for any failings on my individual part that may have contributed.
My personal impression supports the case Halstead makes. Comments about my 'whiteness', and insinuations regarding my 'real' reasons for objecting to positions taken by Torres only came after I objected publicly to Torres's characterisations of Halstead, Olle Hagstrom, Nick Beckstead, Toby Ord and others. I have been informed by Torres that I owe him an apology for not siding with him [edit: to emphasise, this is my personal subjective impression/interpretation based on communications with me].
As well as the personal motivation, this mode of engagement reflects another aspect of this discourse I find deeply troubling: while I think there are valid arguments against longtermism, and alternative perspectives, it becomes impossible to discuss the issues, and in particular, the unfair characterisation of individuals, on the object level. Object level disagreement is met with an insinuation that this is the white supremacists closing ranks. I do believe there is a valid argument in some cases that one can be unaware of biases, and one can be unconsciously influenced by the 'background radiation' of a privileged society. Personally I have experienced this in unconscious, and sometimes deliberate, racism experienced as an Irish person living in Britain, and I have no doubt that non-white people have it much worse. However, this principle can also most certainly be overused uncharitably, or even 'weaponised' to shut down constructive intellectual engagement. And it is profoundly anti-intellectual to permit only those from outside a system of privilege to challenge scholarship.
There are other rhetorical moves I find deeply troubling. The common-society use of 'white supremacy' is something like "people who believe that white people are superior to other races and should dominate them; and are willing to act on that through violent means.". Torres has typically not defined the term, but when challenged, he has explained that he is using the term in the more narrowly-used way used in critical race theory; of "of white people benefiting from and maintaining a system where the legacy of colonial privilege is maintained". (note that he does define it in the mini-book, although as the 'academic' definition, which I think is overstatement). When challenged, Torres insults people for not automatically knowing he is using the more esoteric CRT definition rather than the common-use definition. This is not a reasonable position to take. And it is not reasonable to expect people not to be deeply hurt and offended by the language used.
Even accounting for the CRT definition, this is still an extremely serious and harmful accusation, and one that should not be made without extremely careful consideration and very strong evidence. In my own case, as someone from a culture overwhelmingly defined by the harms of colonialism, it is another way of shutting down any possible discussion; it is so violently upsetting that it renders me incapable of continuing to engage.
To the extent that scholars at CSER are still collaborating with Torres: I am not. I have spoken regarding my concerns to those who have let me know they are still collaborating with him, and have let them make their own choices. Most collaborations are the legacy of projects initiated during his visit 2 years ago (which I authorised, not knowing some of the more serious issue Halstead raises, but being aware of some more minor concerns). Papers take a long time to go through the academic system, and it would be a very unusual and hostile step to e.g. take an author's name off a paper against their wishes. In some instances, people wished to engage with some aspects of Torres' critique and collaborate with presenting them in a more constructive and less polemical way (e.g. see several examples of Beard+Torres). I have respected their choices. This may not be the case with all collaborations; at CSER's current size I am not always aware of every paper being written. But I think it is fair to say my view on this style of engagement are well-known.
I have not taken the step of banning colleagues at CSER from collaborating with Torres. This would be an extremely unusual step in academia, running contrary to some fundamental principles of academic freedom. Further, I am concerned that such steps would reinforce another set of attack lines: Torres has already publicly claimed that he 'has no doubt' that employees at CSER that disagreed with me would be fired for it. I value having scope for intellectual disagreement greatly, and I would not want this perspective to take hold.
I do not claim that my decisions have been correct.
I do think there is significant value in engaging with critics. I admire engagement of the sort that Haydn has just undertaken. As a committed longtermist, to 'turn the other cheek' and engage in good faith with a steelmanned, charitable interpretation of a polemical and hostile document is something I find admirable in itself. And as noted elsewhere in this discussion, enough people have found some value in the challenge Torres has presented to ideas within longtermism (even where presented uncharitably) that it seems reasonable for some to engage with it. However at the same time, I do worry that beyond some point, engaging so charitably may legitimise a mode of discourse that I find distressingly hostile and inimical to kind and constructive, and open discourse.
These are challenging, and sometimes controversial topics. There will very often be issues on which reasonable people will disagree. There will sometimes be positions taken that others will be profoundly uncomfortable with. This is not unique to Xrisk or longtermism; the same is true of global development and animal rights. I believe it is of paramount importance that we be able to interact with each other as thinkers and doers in a kind, constructive and charitable way; and above all to adopt these principles when we critique each other. After all, when we are wrong, this is nearly always the most effective way to change minds. While not everyone will agree with me on this, this is the view I have always put forward in the centres I have been a part of.