All of Mahdi Complex's Comments + Replies

I have come to see the term 'religion' (as well as 'ideology') as unhelpful in these discussions. It might be helpful to taboo these words and start talking in terms of 'motivating world-views' instead.

Thanks for writing this. A similar observation lead me to write this post.

Reality has no requirement to conform to your heuristics of what is ‘normal’, but I think that we could use some more outside-view work on just how bizarre and unsettling this world-view is, even if it is true.

I believe the end-goal isn't a world ruled by a benevolent global elite that owns all the robots. The goal isn't to create a 'techno-leviathan' for people to ride. The goal is to find a benevolent God in mind design space. One we would be happy to give up sovereignty to. That's I think what AI alignment is about.

(A related discussion on LW.)

Either way, I think we're going to need some serious 'first principles' work at the intersection of AI alignment and political philosophy. "What is the nature of a just political and economic order when humans are econo... (read more)

I have read the book and the book review. They provide some great descriptive insights into what's going on, but I'm more interested in a historical perspective of where what might be viewed as "consensus reality" and the correct order of things came from.

Hi Tomer, I really appreciate the kind words! I think the piece turned out a little strange because I was trying to do too many things at once. I was trying to frame EA and the Singularity in terms that would lead religious people to take it seriously, while also making the largely atheistic EA crowd more appreciative of some compatibilist religious ideas.

I just published a post that expounds a bit on some of the ideas I mention in this piece.

I think that AGI might require us to dig a little deeper when it comes to governance and political philosophy. The ... (read more)

We can’t afford to wait for a “Long Reflection”.

Alternatively, the "Long Reflection" has already begun, it's just not very evenly distributed. And humanity has a lot of things to hash out.

The question I’m currently trying to answer is, how did we get to a point where the main actor concerning itself with humanity’s survival, the plight of those most in need, technological utopianism and humanity’s destiny in the cosmos is a small eclectic network of academics, young professionals and misfits. It’s not governments, it’s not international organizations, it’s not religious institutions. It’s a group of non-profits, primarily funded by a bunch of eccentric billionaires. Am I the only one who thinks that this is crazy and really calls for an exp... (read more)

1
Dave Cortright
2y
Check out the book “innovator’s dilemma” and subsequent works. Inertial is real, and big institutions get stuck and rarely can put themselves out of business (Netflix is a notable exception; they baked their vision into the name when they were simply mail order DVDs). Collapse by Jared Diamond is also worth checking out. The fundamental problem we run into is our innate desire to be part of the tribe makes us susceptible to going along with shared deceptions. See the Asch compliance experiments, and the great episode of Mind Field that replicated the results (it’s on YouTube). Connection > truth. History is littered with examples of a shared falsehood embraced by the masses until a small group of dissidents eventually forces the shared understanding past the inflection point; e.g. earth is flat, earth is the center of the universe, the ether, relativity, illness caused by microbes… Never doubt that a small group of thoughtful, committed citizens can change the world; indeed, it's the only thing that ever has. —Margaret Mead
2
Thomas Kwa
2y
The keyword is "civilizational inadequacy" and one cluster of failures here is Moloch. The best source is probably Inadequate Equilibria, but before reading the book you should read the book review.
1
Mahdi Complex
2y
What this turned into.