Hide table of contents

I work on CEA’s Community Health and Special Projects Team. But these thoughts are my own (apart from question 6 which I inherited from Nicole Ross). 

 

I have an internal list of questions that I often go through when I’m making a decision (including when that decision is whether or what to communicate to others). 

I often bring these questions up when I’m trying to help others in the EA community make decisions, and some folks seem to find them helpful. I also sometimes see people making (what I believe to be) sub-optimal decisions and one or other of these questions may have helped things go better.  
 

Maybe you’ll find them helpful too, and maybe you have your own questions you ask yourself (please share them in the comments!).

I’m afraid they don’t tell you how to make a decision[1] (sorry - I haven’t worked that bit out!), and they aren’t exhaustive. They are just questions that seem to help when I am making decisions - either by nudging me to generate new options, or to become more aware of consequences.

1. “Is this really where the tradeoff bites?” 

Some decisions are framed as “A” or “B”. More decisions are framed as tradeoffs between amounts of A and amounts of B. Considering tradeoffs is very useful! But I often notice people assuming they’re making a decision under difficult tradeoffs between values A and B, when I see A and B as being values on two quite different axes. There are often alternatives where we can get more A without sacrificing B or vice versa, or we can get more A AND more B (i.e. there are Pareto improvements we can make). 

The A and B I’ve been thinking most about recently are (caricatured) “clearly stating what you believe” and “being sensitive to others”. I think Richard Chappell’s “Don’t be an Edgelord” explains this particular A and B well. But I’ve noticed the general pattern a lot. 

Stephane Boisvert on Twitter: "Why not both? https://t.co/fYucKQUFS6" /  Twitter
 

2. “What does my shoulder X think?”  or… (higher cost) “what does X think?” 

You’re not always going to please everyone. That’s the way things are. But plenty of people seem to be surprised by the negative reaction they get from their decisions or words. This problem seems tractable.

It would be nice if people could ask lots of people their opinion before making a decision, but that is costly (and choosing to ask is a decision in itself). So I’ve been trying to develop a range of people/groups that metaphorically pop up on my shoulder to help me think:

  • Some individuals whose thinking I respect - some who I usually agree with, some who I regularly disagree with. 
  • Individuals or groups who would be affected by my decisions

I’m sure my shoulder people OFTEN don’t match the real person’s thoughts. But I still find them helpful to create new perspectives. 


Some tips for developing or using shoulder people:  

  • If the stakes are high - don’t rely on your shoulder person. Talk to the real people, the real stakeholders, people who have a different background or a different way of thinking to you. This especially goes if you’ve noticed you are frequently surprised by people’s reactions to your actions or communications, or if you don’t know the stakeholders well.  
  • You don’t have to know the person/group to make a shoulder person - just read a bunch of what they’ve written. Some examples: I’ve often found insight from Julia Wise, so through reading her blog I created a shoulder Julia long before I started working with her. I’ve only met Habryka once or twice, but I often get new perspectives from reading their contributions on the Forum. This seems helpful, so I’d like to improve my shoulder Habryka.
  • Before publishing something, read your writing several times with several different shoulder people in mind. 
  • Practice! One way to develop shoulder people is to read something (Forum post, tweet, whatever) and predict what the comments will be, then read the real comments.
  • Your shoulder person shouldn’t make the final decision - you should!
I don’t actually recommend using angels and devils as shoulder people. 

3. “What incentives am I creating?”

If this decision won’t be seen by many people, or really is a once off situation, then maybe you don’t have to worry about this one. But many decisions aren’t like that. Rob Bensinger explains a related idea about norms.  

 

My attempt to use DALL E to create an image of a donkey being incentivised by a carrot.

4. “Can (and should) this wait a bit?” 

Holden explains the benefits of “cold takes” well.

 

5. “Are emotions telling me something?” or “Feelings are data”.

Sometimes I feel frustrated or worried or smug about something, but I can’t clearly explain why. This often means there are real and important considerations that I haven’t fully brained through. So if I, or other people, are feeling unexplained emotions or vague senses of unease, I try to create some space so the considerations can be teased out. I originally learnt this idea from Julia Galef many years ago in a Rationally Speaking podcast and it stuck with me, but I can’t find the episode, quote her, or give any examples she gave. If anyone knows what I’m talking about please let me know! 

 

This is surprisingly  close to what I look like a lot of the time. 

6. “Do I stand by this?” / Integrity check

This is a final check to make me ask whether deep down I think this is the right decision. This might trigger me to think

  • Am I feeling pressure to act in a certain way?
  • Am I deferring to others, and if so, am I okay with that?
  • Am I feeling particularly tired, angry or upset and is that affecting my decision?
  • If I'm not being fully transparent (which is often justified), am I misleading people about the nature of the unstated information (see the onion test for integrity)? 
  • Do I feel uncomfortable about this? (see Question 5). 

This check doesn’t guarantee I’ll stand by my actions, but it has helped prevent me from making some mistakes.

 

If you have questions you ask yourself when making decisions, please share them in the comments!

 

  1. ^

     I like using Clearer Thinking’s decision making tool for big life decisions.

Comments6


Sorted by Click to highlight new comments since:
[anonymous]15
4
0

Pre-mortem i.e. "Imagine I make this decision and end up regretting it. What went wrong?"

Ooh, that is a good one!

I like "Is this going to mislead people?" or "Am I communicating as honestly as I can?" for communications, in the spirit of Chana's onion test post for personal integrity (which I think about often).

(Edit: really like this list! :) )

Oh, how could I have forgotten the onion test! I'll add that in. Thanks 

Thanks for sharing, Catherine! I apply many of your tips and agree that they are super useful. Additional questions I ask myself quite often:

  1. What is the goal I want to achieve? This is the question which helps me to structure my thinking and approach the most 
  2. Am I asking the right question? Next to regularly not thinking through all the options I have, I also realize often that I am not asking the question I really care about in the first place
    1. Can I make a prediction about my decision? This helps me a lot to keep track of my decisions e.g., at cFactual we have a "prediction of the week" to calibrate ourselves on outcomes we expect to see,  identify differences in reasoning about important topics among team members, ...
  3. Do I weigh all arguments/considerations equally or do I believe one argument is 10x more relevant than others?

Some tools for group decision-making we use:

  1. Our google doc company template has as default drop-downs to always indicate the status of the document, time spent, what the stage of the document is (Strawmen, key arguments or flashed out document) and a section for a few words on epistemic status ("braindump/ 5min of desk research/ I am an expert/..."). This helped us a lot to remain focused and have higher quality discussions with a time investment of 20sec
  2. We try to quantify our preferences, e.g., Instead of saying: I am in favour of option A, we aim to write: I am 55% in favour of A. This helps us quite often to make a judgement call without forward and backward writing of comments

If there are larger decisions I want to think through more rigorously, I quite often use this mental structure as a starting point (and then adapt it): Recommendation/conclusion incl. my certainty in the conclusion, alternative options, my arguments for the recommendation, my arguments against, key uncertainties, key assumptions, downside risks and predictions

Probably stating the obvious for many here: I think the CFAR handbook also has great prompts for people who are interested in the topic

Upvote just for the memes / images!  And great content and comments; wish I had seen something like this 35 years ago.
https://www.losingmyreligions.net/ 

Curated and popular this week
 ·  · 38m read
 · 
In recent months, the CEOs of leading AI companies have grown increasingly confident about rapid progress: * OpenAI's Sam Altman: Shifted from saying in November "the rate of progress continues" to declaring in January "we are now confident we know how to build AGI" * Anthropic's Dario Amodei: Stated in January "I'm more confident than I've ever been that we're close to powerful capabilities... in the next 2-3 years" * Google DeepMind's Demis Hassabis: Changed from "as soon as 10 years" in autumn to "probably three to five years away" by January. What explains the shift? Is it just hype? Or could we really have Artificial General Intelligence (AGI)[1] by 2028? In this article, I look at what's driven recent progress, estimate how far those drivers can continue, and explain why they're likely to continue for at least four more years. In particular, while in 2024 progress in LLM chatbots seemed to slow, a new approach started to work: teaching the models to reason using reinforcement learning. In just a year, this let them surpass human PhDs at answering difficult scientific reasoning questions, and achieve expert-level performance on one-hour coding tasks. We don't know how capable AGI will become, but extrapolating the recent rate of progress suggests that, by 2028, we could reach AI models with beyond-human reasoning abilities, expert-level knowledge in every domain, and that can autonomously complete multi-week projects, and progress would likely continue from there.  On this set of software engineering & computer use tasks, in 2020 AI was only able to do tasks that would typically take a human expert a couple of seconds. By 2024, that had risen to almost an hour. If the trend continues, by 2028 it'll reach several weeks.  No longer mere chatbots, these 'agent' models might soon satisfy many people's definitions of AGI — roughly, AI systems that match human performance at most knowledge work (see definition in footnote). This means that, while the compa
 ·  · 4m read
 · 
SUMMARY:  ALLFED is launching an emergency appeal on the EA Forum due to a serious funding shortfall. Without new support, ALLFED will be forced to cut half our budget in the coming months, drastically reducing our capacity to help build global food system resilience for catastrophic scenarios like nuclear winter, a severe pandemic, or infrastructure breakdown. ALLFED is seeking $800,000 over the course of 2025 to sustain its team, continue policy-relevant research, and move forward with pilot projects that could save lives in a catastrophe. As funding priorities shift toward AI safety, we believe resilient food solutions remain a highly cost-effective way to protect the future. If you’re able to support or share this appeal, please visit allfed.info/donate. Donate to ALLFED FULL ARTICLE: I (David Denkenberger) am writing alongside two of my team-mates, as ALLFED’s co-founder, to ask for your support. This is the first time in Alliance to Feed the Earth in Disaster’s (ALLFED’s) 8 year existence that we have reached out on the EA Forum with a direct funding appeal outside of Marginal Funding Week/our annual updates. I am doing so because ALLFED’s funding situation is serious, and because so much of ALLFED’s progress to date has been made possible through the support, feedback, and collaboration of the EA community.  Read our funding appeal At ALLFED, we are deeply grateful to all our supporters, including the Survival and Flourishing Fund, which has provided the majority of our funding for years. At the end of 2024, we learned we would be receiving far less support than expected due to a shift in SFF’s strategic priorities toward AI safety. Without additional funding, ALLFED will need to shrink. I believe the marginal cost effectiveness for improving the future and saving lives of resilience is competitive with AI Safety, even if timelines are short, because of potential AI-induced catastrophes. That is why we are asking people to donate to this emergency appeal
 ·  · 23m read
 · 
Or on the types of prioritization, their strengths, pitfalls, and how EA should balance them   The cause prioritization landscape in EA is changing. Prominent groups have shut down, others have been founded, and everyone is trying to figure out how to prepare for AI. This is the first in a series of posts examining the state of cause prioritization and proposing strategies for moving forward.   Executive Summary * Performing prioritization work has been one of the main tasks, and arguably achievements, of EA. * We highlight three types of prioritization: Cause Prioritization, Within-Cause (Intervention) Prioritization, and Cross-Cause (Intervention) Prioritization. * We ask how much of EA prioritization work falls in each of these categories: * Our estimates suggest that, for the organizations we investigated, the current split is 89% within-cause work, 2% cross-cause, and 9% cause prioritization. * We then explore strengths and potential pitfalls of each level: * Cause prioritization offers a big-picture view for identifying pressing problems but can fail to capture the practical nuances that often determine real-world success. * Within-cause prioritization focuses on a narrower set of interventions with deeper more specialised analysis but risks missing higher-impact alternatives elsewhere. * Cross-cause prioritization broadens the scope to find synergies and the potential for greater impact, yet demands complex assumptions and compromises on measurement. * See the Summary Table below to view the considerations. * We encourage reflection and future work on what the best ways of prioritizing are and how EA should allocate resources between the three types. * With this in mind, we outline eight cruxes that sketch what factors could favor some types over others. * We also suggest some potential next steps aimed at refining our approach to prioritization by exploring variance, value of information, tractability, and the
Relevant opportunities
23
· · 3m read