Comments
...
Greetings Earthlings,
I hope I am posting this in the correct place, and following proper guidelines, since even though I'm a long time lurker, I have never posted here before.
With that out of the way, I'd like to get right into the question at hand. Which, to be clear, isn't a question, but more of a topic of discussion where I'm interested in hearing different viewpoints.
For EAs who lean utilitarian, or are generally sympathetic to utilitarianism, if not outright self-identifying utilitarians themselves, I have a question:
If Peter Singer is right about moral rationalism and judgment internalism, then AGI is a self-solving problem. In a community where AI safety is of utmost importance, how do you square your commitment to moral rationalism if you accept the orthogonality thesis?
If you reject moral rationalism or judgment internalism, then why are you an Effective Altruist? And don't just give a simple answer like "Because doing more good is better than doing nothing!", because that's just re-affirming your belief in Singer's worldview, whether you're intending to or not.
(Full disclosure, I am assuming that rationality and capability are convergent properties, that something with high capability also will trend towards rationality.)
