TLDR: Take the population ethics quiz here: https://mdickens.me/pop-ethics/
Population ethics is an oft-overlooked subfield within ethics. Many people hold views that they don't realize contradict each other, or that have strange implications that they wouldn't endorse if they thought about it more.
Not just that—population ethics is a BIG DEAL. A lot of ethical decisions hinge on how you think about changes in future populations....
Headline finding: I audited 17 AI Safety Talent programmes. Zero of 17 have published any comparison group, rejected-applicant follow-up, matched control or randomisation. Not one. Every programme that mentions a counterfactual does it by asking participants to self-report.
Background
At least $70 million...
The swarm has made me feel AI risk in my bones for the first time
Until the Hugging Face / OpenAI swarm thing, I think I deep down felt pretty skeptical that extinction or serious loss of control scenarios were plausible in the next few years.
I’ve been lurking on LessWrong for years, and I remember being freaked out by Yudkowsky’s ‘List of Lethalities’ in 2022, and thinking that this did seem intellectually convincing, and maybe I should do something about it. But it didn...
I don't think McMahan would find what you call a 'solution' very appealing: McMahan doesn't think that morality is demanding in the way e.g. Singer does. Further, what you suggest ought to be the default position - morality is really demanding - is something only a small percentage of philosophers (although many EAs) believe is correct.
He doesn't indicate that there is a reason to consider it unappealing. It's not a matter of whether he agrees, it's a matter of whether it's a substantive view that ought to be addressed.
The literature on moral demandingness is fairly split. The proposition that morality is demanding is different from the proposition that demandingness is not a moral problem. The majority of philosophers believe in theories which happen to not turn out to be very demanding in our current world; that does not necessarily mean that they did so because those theories are less demanding, so their views don't really diminish the viability of positing demanding moral principles in response to a new moral problem.