TLDR: Take the population ethics quiz here: https://mdickens.me/pop-ethics/
Population ethics is an oft-overlooked subfield within ethics. Many people hold views that they don't realize contradict each other, or that have strange implications that they wouldn't endorse if they thought about it more.
Not just that—population ethics is a BIG DEAL. A lot of ethical decisions hinge on how you think about changes in future populations....
Headline finding: I audited 17 AI Safety Talent programmes. Zero of 17 have published any comparison group, rejected-applicant follow-up, matched control or randomisation. Not one. Every programme that mentions a counterfactual does it by asking participants to self-report.
Background
At least $70 million...
The swarm has made me feel AI risk in my bones for the first time
Until the Hugging Face / OpenAI swarm thing, I think I deep down felt pretty skeptical that extinction or serious loss of control scenarios were plausible in the next few years.
I’ve been lurking on LessWrong for years, and I remember being freaked out by Yudkowsky’s ‘List of Lethalities’ in 2022, and thinking that this did seem intellectually convincing, and maybe I should do something about it. But it didn...
Inspired by Jaime's charming rundown of his quarterly(!) output, I'll put something up:
In 2021, I
This seems overwhelmingly awesome, congrats and I hope you are doing great in the Bahamas.
As a small point, and a sincere question, I'm curious about the "personal framework" or beliefs that led you to stop consuming even low levels of caffeine and alchohol, but at the same time, start or try using the medications you indicated.
I'm curious because some people I met, who foreswear alcohol and caffeine, would also oppose the personal use of many medications too.
To be clear, I find any combination of abstinence/use of any of those 4 things fine (and not my business unless openly discussed).
Thanks Charles!
My reasoning about caffeine is here. For common genomes, I expect it to have no chronic cognitive benefit and to harm sleep quality for basically no gain. I think I'm one of those genomes. Nor do I get the pleasure or motivation others seem to. (The same reasoning probably applies to all stimulants.) Might get into fancy loose-leaf tea one day, but just for fun.
No particular reasoning about booze. Certainly not puritanism. The alleged health benefits fell apart (or rather the credibility of the field studying it did), I don't much like it, and luckily my social life doesn't need the help.
When reading up for Off Road I started to wonder if maybe I am mildly ADHD myself. I opted for the House MD method of diagnosis: suck it and see.
I should mention that some clever friends of mine try "stimulant cycling" instead of quitting caffeine entirely. This might avoid the downregulation trap.
Wow, sounds like an amazing year!
What's the standard for AI Safety Camp these days?
I should have said "median" (supply-side: participants just being really good) rather than "standard" (our setting a high bar).
Bunch of ML PhD students and people whose writing I seriously admired before they applied.
This year is interesting cos we tried hard to get non-ML people to join. We've got a pro Continental philosopher coming for instance!