Hide table of contents

This article explores the multiple transhumanist views on AI: a promise of emancipation for some, an existential threat for others. Between enthusiasm, caution, and controversy, it sheds light on those who think about the future.


Transhumanists: Blind Tech Enthusiasts?

November 30, 2022, marked a turning point. On that day, OpenAI unveiled ChatGPT. Since then, artificial intelligence has received unprecedented media coverage, sparking both enthusiasm and concern. Yet, long before the general public took interest in it, one community already saw it as a major issue: transhumanists.
For decades, transhumanist thinkers have seen artificial intelligence as a key element of humanity’s future, and that is not by chance. Their fascination with AI stems from three main reasons :

  • First, its potential to transcend biological limits. By accelerating technological progress across all fields, it could revolutionize the human condition.
  • Second, the profound philosophical questions it raises: how do we redefine our place in relation to conscious machines? Will we be able to upload our minds into digital formats?
  • Finally, the threats it poses to humanity. From mass disinformation and global cyberattacks to the worsening of inequalities, the dangers are numerous and very real.

That third point might come as a surprise. After all, aren’t transhumanists just dreamy technophiles who believe all technical progress is inherently good?

In reality, many transhumanists, especially technoprogressives, are fully aware of the dangers associated with the technologies they support. For them, fully unlocking the potential of transhumanism first requires identifying and anticipating the risks so they can be better controlled.

When it comes to artificial intelligence, those risks are not just significant; they are existential. For several years now, leading experts have warned of the threat posed by an uncontrolled superhuman AI, even considering the possibility of human extinction. Faced with such a scenario, what exactly is the transhumanist stance?

 

The Diversity of Transhumanist Views on AI

If there is one thing that is clear, it is that there is no consensus. On one side, some believe there is no reason to worry, while others are calling for an immediate halt in development to avoid extinction. To better understand this contrasting landscape, we can distinguish several major schools of thought.
The first group believes existential risks from AI are low or nonexistent, and that it will bring major benefits. This is the position of Ben Goertzel, a pioneer of artificial general intelligence and president of Humanity+, the largest transhumanist association. Generally speaking, this downplaying of risks often stems from a lack of familiarity with, or outright rejection of, the scientific field of AI safety, where researchers estimate a 30 percent probability, on average, that AI could cause human extinction.

The second category acknowledges that existential risks are high but believes they are worth taking. Dario Amodei, CEO of Anthropic, estimates a 25 percent probability that AI could lead to human extinction within the next five years. Still, he sees the gamble as justified by the potential benefits. He believes AI could deliver “a century of discoveries in a decade,” leading to increased lifespan, morphological freedom, neuro-enhancement, and other transhumanist advancements. Convinced that superhuman AI is inevitable, he prefers his company to be the one behind it rather than leaving such a breakthrough to less ethical actors.

The third position, more radical, holds that the succession of humanity by machines is part of the natural order. If a more intelligent species emerges, it makes sense for it to take over civilization. Isaac Asimov shared this view, as did Larry Page, Google’s co-founder, who once accused Elon Musk of “speciesism” for favoring humanity over future digital intelligences. This view often relies on the assumption that AIs will eventually become conscious. But if that assumption turns out to be false, we could end up in a universe where every experience is replaced by electrical circuits and optimization functions. Nick Bostrom warns of the risk of creating a world full of technological marvels but with no one left to enjoy them: a “Disneyland without children.”

The fourth category advocates for a breakneck race toward technological progress. Followers of “effective accelerationism” aim to maximize energy consumption and push humanity up the Kardashev scale. This movement draws inspiration from Nick Land’s accelerationism, which called for a radical transformation of society by driving technological progress to its peak to bring capitalism to its natural conclusion. Convinced that technology will solve humanity’s problems, they are directly opposed to AI safety-focused approaches. Their most influential figure is Marc Andreessen, author of the Techno-Optimist Manifesto. However, the movement, born on Twitter through memes and provocations, is so chaotic that it is hard to take seriously.

Finally, the fifth category includes those calling for a slowdown, or even a halt, in the development of advanced AI to avoid an existential catastrophe. Among them, Nick Bostrom, co-founder of the World Transhumanist Association, stood out by publishing a foundational text on existential risks in 2002, after introducing the notion of superintelligence in 1997 with Hans Moravec in transhumanist journals. On his side, Eliezer Yudkowsky, a major figure in AI safety, began engaging in 1999, at just 20 years old, on the SL4 mailing list, a space for advanced discussions on transhumanism. Both show that transhumanism and caution about AI are not mutually exclusive.
 

The Links Between Transhumanism and AI Safety

At its core, transhumanism is about humanity’s future: what destiny do we wish for our species? Should we enhance our cognitive abilities? Explore space? The possibilities are vast. However, these ambitions would lose all meaning if humanity were to disappear. That realization is what led some transhumanists to focus on studying existential risks, especially those linked to artificial intelligence. This explains why it was primarily thinkers from the transhumanist world who initiated and popularized AI safety.

Furthermore, a shared mindset clearly connects the two fields. Accepting the conclusions of AI safety requires long-term thinking, acknowledging the transformative potential of technology, accepting logical arguments even when they defy intuition, and taking seriously scenarios often dismissed as science fiction. These are the same qualities needed to embrace transhumanist ideas. Looking toward the future and exploring technological advances through a particular lens almost inevitably leads to engagement with both.

It is often assumed that people working in AI safety are pessimists with a visceral fear of technology, but that is incorrect. AI safety was in fact developed by technophiles who wanted to build highly intelligent AIs while avoiding the immense risks that come with them. No one would call a civil engineer “anti-bridge” just because they make sure bridges do not collapse. Likewise, AI safety experts are not “anti-AI,” and certainly not “anti-tech”; they simply want to ensure we build safe systems that will not lead to humanity’s extinction.

Critics of both transhumanism and AI safety have also noticed the connection between the two. This is how computer scientist Timnit Gebru and philosopher Émile Torres came up with the acronym TESCREAL, encompassing transhumanism, extropianism, singularitarianism, cosmism, rationalism, effective altruism, and longtermism. In their view, these ideologies are interconnected, overlapping, and share common roots.

While that analysis is not entirely unfounded, it should be taken with a grain of salt. After all, grouping together figures as different as Eliezer Yudkowsky and Marc Andreessen raises questions about the validity of such classifications. In truth, this kind of grouping makes it easier to lump together diverse schools of thought under one label in order to deliver sweeping criticisms, without dwelling on the nuances of each argument. In other words, it becomes a caricature.

It is therefore important to note that while AI safety did emerge under the influence of transhumanist thinkers, it has since greatly diversified. Most AI safety experts today probably do not identify as transhumanists. Moreover, as we have seen, transhumanist opinions on AI existential risks vary widely. It would be wrong to assume the entire movement shares those concerns.
 

Enhancing Ourselves to Face AI?

There are three major transhumanist trends that argue for boosting human cognitive abilities in order to face artificial intelligence.

The first, supported by figures like Laurent Alexandre, advocates enhancing human capacities to stay competitive in the job market. But this strategy is doomed to fail. AI does not sleep, eat, take breaks, it thinks fifty times faster than us and can duplicate itself instantly. The war is lost before it even starts. Beyond being unrealistic, this approach is also undesirable. It fits into an ultra-capitalist logic where work is seen as an absolute necessity. But we could instead see the end of work as a good thing, liberating humanity from labor. When we invented the tractor, we did not try to give humans giant wheels to compete; we reorganized society so people no longer had to work fourteen-hour days in the fields. Why not apply the same logic with AI?

The second approach aims to merge humans with AI to avoid becoming obsolete. This is notably Elon Musk’s goal with Neuralink, which develops brain implants. But this idea runs into a timing problem: AI will likely surpass humans well before these chips become widespread. And even if they did arrive in time, they would not solve the issue. How could a brain implant protect us from a superhuman AI determined to wipe us out? On the contrary, it might even increase the risks. Getting an implant that AI could hack at will does not sound like the best strategy.

It is also important to point out that both of these first approaches run counter to a central principle of technoprogressive transhumanism: freedom of choice. They reject the idea of a society where those who do not seek self-enhancement are marginalized or left behind. Each individual should be able to choose freely whether or not to optimize their cognitive abilities, based on their own preferences. Technoprogressives do not want to impose transhumanism on everyone; they want to expand the horizon of possibilities.

The third approach, promoted by Eliezer Yudkowsky, aims to make humans smarter so they can secure AI before it becomes uncontrollable. For them, the technical and philosophical challenge is so great that baseline human intelligence might be insufficient. Again, timing is an issue. AI will likely surpass humanity well before we can produce a genetically enhanced generation or roll out revolutionary brain implants. Aware of this problem, Eliezer Yudkowsky has floated the idea of using CRISPR for genetic therapy in adults to increase intelligence, but he admits this is unlikely.

In the end, our goal should not be to enhance humans to compete with AI, but to design artificial intelligence that aligns with our values. That is, without a doubt, the greatest challenge in human history.

Comments1


Sorted by Click to highlight new comments since:

Executive summary: Transhumanist views on AI range from enthusiastic optimism to existential dread, with no unified stance; while some advocate accelerating progress, others emphasize the urgent need for AI safety and value alignment to prevent catastrophic outcomes.

Key points:

  1. Transhumanists see AI as both a tool to transcend human limitations and a potential existential risk, with significant internal disagreement on the balance of these aspects.
  2. Five major transhumanist stances on AI include: (1) optimism and risk denial, (2) risk acceptance for potential gains, (3) welcoming AI succession, (4) techno-accelerationism, and (5) caution and calls to halt development.
  3. Many AI safety pioneers emerged from transhumanist circles, but AI safety has since become a broader, more diverse field with varied affiliations.
  4. Efforts to cognitively enhance humans—via competition, merging with AI, or boosting intelligence to align AI—are likely infeasible or dangerous due to timing, ethical concerns, and practical limitations.
  5. The most viable transhumanist-aligned strategy is designing aligned AI systems, not enhancing humans to compete with or merge with them.
  6. Critics grouping transhumanism with adjacent ideologies (e.g., TESCREAL) risk oversimplifying a diverse and nuanced intellectual landscape.

 

 

This comment was auto-generated by the EA Forum Team. Feel free to point out issues with this summary by replying to the comment, and contact us if you have feedback.

Curated and popular this week
Paul Present
 ·  · 28m read
 · 
Note: I am not a malaria expert. This is my best-faith attempt at answering a question that was bothering me, but this field is a large and complex field, and I’ve almost certainly misunderstood something somewhere along the way. Summary While the world made incredible progress in reducing malaria cases from 2000 to 2015, the past 10 years have seen malaria cases stop declining and start rising. I investigated potential reasons behind this increase through reading the existing literature and looking at publicly available data, and I identified three key factors explaining the rise: 1. Population Growth: Africa's population has increased by approximately 75% since 2000. This alone explains most of the increase in absolute case numbers, while cases per capita have remained relatively flat since 2015. 2. Stagnant Funding: After rapid growth starting in 2000, funding for malaria prevention plateaued around 2010. 3. Insecticide Resistance: Mosquitoes have become increasingly resistant to the insecticides used in bednets over the past 20 years. This has made older models of bednets less effective, although they still have some effect. Newer models of bednets developed in response to insecticide resistance are more effective but still not widely deployed.  I very crudely estimate that without any of these factors, there would be 55% fewer malaria cases in the world than what we see today. I think all three of these factors are roughly equally important in explaining the difference.  Alternative explanations like removal of PFAS, climate change, or invasive mosquito species don't appear to be major contributors.  Overall this investigation made me more convinced that bednets are an effective global health intervention.  Introduction In 2015, malaria rates were down, and EAs were celebrating. Giving What We Can posted this incredible gif showing the decrease in malaria cases across Africa since 2000: Giving What We Can said that > The reduction in malaria has be
LewisBollard
 ·  · 8m read
 · 
> How the dismal science can help us end the dismal treatment of farm animals By Martin Gould ---------------------------------------- Note: This post was crossposted from the Open Philanthropy Farm Animal Welfare Research Newsletter by the Forum team, with the author's permission. The author may not see or respond to comments on this post. ---------------------------------------- This year we’ll be sharing a few notes from my colleagues on their areas of expertise. The first is from Martin. I’ll be back next month. - Lewis In 2024, Denmark announced plans to introduce the world’s first carbon tax on cow, sheep, and pig farming. Climate advocates celebrated, but animal advocates should be much more cautious. When Denmark’s Aarhus municipality tested a similar tax in 2022, beef purchases dropped by 40% while demand for chicken and pork increased. Beef is the most emissions-intensive meat, so carbon taxes hit it hardest — and Denmark’s policies don’t even cover chicken or fish. When the price of beef rises, consumers mostly shift to other meats like chicken. And replacing beef with chicken means more animals suffer in worse conditions — about 190 chickens are needed to match the meat from one cow, and chickens are raised in much worse conditions. It may be possible to design carbon taxes which avoid this outcome; a recent paper argues that a broad carbon tax would reduce all meat production (although it omits impacts on egg or dairy production). But with cows ten times more emissions-intensive than chicken per kilogram of meat, other governments may follow Denmark’s lead — focusing taxes on the highest emitters while ignoring the welfare implications. Beef is easily the most emissions-intensive meat, but also requires the fewest animals for a given amount. The graph shows climate emissions per tonne of meat on the right-hand side, and the number of animals needed to produce a kilogram of meat on the left. The fish “lives lost” number varies significantly by
Neel Nanda
 ·  · 1m read
 · 
TL;DR Having a good research track record is some evidence of good big-picture takes, but it's weak evidence. Strategic thinking is hard, and requires different skills. But people often conflate these skills, leading to excessive deference to researchers in the field, without evidence that that person is good at strategic thinking specifically. I certainly try to have good strategic takes, but it's hard, and you shouldn't assume I succeed! Introduction I often find myself giving talks or Q&As about mechanistic interpretability research. But inevitably, I'll get questions about the big picture: "What's the theory of change for interpretability?", "Is this really going to help with alignment?", "Does any of this matter if we can’t ensure all labs take alignment seriously?". And I think people take my answers to these way too seriously. These are great questions, and I'm happy to try answering them. But I've noticed a bit of a pathology: people seem to assume that because I'm (hopefully!) good at the research, I'm automatically well-qualified to answer these broader strategic questions. I think this is a mistake, a form of undue deference that is both incorrect and unhelpful. I certainly try to have good strategic takes, and I think this makes me better at my job, but this is far from sufficient. Being good at research and being good at high level strategic thinking are just fairly different skillsets! But isn’t someone being good at research strong evidence they’re also good at strategic thinking? I personally think it’s moderate evidence, but far from sufficient. One key factor is that a very hard part of strategic thinking is the lack of feedback. Your reasoning about confusing long-term factors need to extrapolate from past trends and make analogies from things you do understand better, and it can be quite hard to tell if what you're saying is complete bullshit or not. In an empirical science like mechanistic interpretability, however, you can get a lot more fe