Progress report on CEA’s search for a new CEO

I^[1] wanted to give an update on the Centre for Effective Altruism (CEA)’s search for a new CEO.

We (Claire Zabel, Max Dalton, and Michelle Hutchinson) were appointed by the Effective Ventures boards to lead this search and make a recommendation to the boards. The committee is advised by James Snowden, Caitlin Elizondo, and one experienced executive working outside EA. 

We previously announced the search and asked for community input in this post.

Note, we set out searching for an Executive Director, and during the process have changed the role title to CEO because it was more legible to candidates not familiar with CEA or EV. The role scope remains unchanged.

In summary, we received over 400 nominations, reached out to over 150 people, spoke to about 60, and received over 25 applications. We’re still considering around 15 candidates, and are currently more deeply assessing <5 candidates who seem especially promising.

Process

• Over 400 people were nominated for the role
  • We invited recommendations from CEA staff, stakeholders, and the EA community via the Forum.
  • We selected candidates for outreach according to their profile and experience, the strength of recommendation we received, and (in some cases) our pre-existing knowledge about them.
    • We decided this approach (rather than reaching out to all nominees or having an open call for applications) because
      • Many nominations were fairly speculative (for instance one person nominated over 30 people, many of whom did not have management experience: this was helpful because it generated some useful names we would otherwise not have known about, but it probably would not have been a good use of our/candidates’ time to reach out to all of these people).
      • More generally, we wanted to be careful about our time and applicants’ time.
      • We thought (based on advice from professional recruiters) that a narrower outreach process would be more likely to be attractive to our most promising candidates (who matter disproportionately).
    • Overall our sense from talking to people with experience of this is that this selective, non-public process is fairly standard practice in executive recruitment. I think that the main reason for this is that in executive recruitment your top candidates (who are the most important ones) have a very high opportunity cost for their time, and personalized non-public outreach is a much stronger signal that it will be worth their time engaging in the process.
      • My guess is that some of our top candidates would not have proactively submitted an application, but did engage when we reached out to them.
  • We had a lower bar for reaching out to candidates we were less familiar with (because a small chance that they would be our top candidate justified the effort).
• In the end, we reached out to over 150 potential candidates
  • We shared a document containing information on CEA and the role, and  invited them to meet a member of the search committee (typically Max).
    • We sometimes asked people to consider booking a call even if they weren’t interested in the role, because we wanted to get their advice on our hiring process.
  • In many cases, we tried to personalize outreach messages somewhat and use our network:
    • When we knew the candidates, this was easy
    • Sometimes we asked for introductions from mutual connections
    • However there were some cases where we didn’t personalize (e.g. if we couldn’t find a good mutual connection).
  • To give a sense of the range of candidates we reached out to, according to our very rough assessment they had:
    • EA context
      • ~50% high (e.g. they’ve been working at an EA org or otherwise have lots of signs of engagement with EA ideas).
      • ~40% medium (e.g. they attended an EAG once or did 80k coaching, but nothing else)
      • ~10% low (very few signs of EA engagement)
    • Management experience
      • ~15% leadership of a large organization (roughly, an organization equal to or larger than CEA’s current size)
      • ~30% leadership of a small org or comparable
      • ~35% senior management experience
      • ~15% some (non-senior) management experience
      • <5% little to no obvious management experience (but some other reason why they seemed promising)
  • We have so far heard back from more than 80% of people reached out to.
  • We deliberately chose to reach out to people who we thought would probably not be interested in the role, but might be. So we were not surprised that a majority of the people we reached out to were not interested. We think that this was the right decision: some of our top candidates were people who we thought would probably not be interested (but who actually were).
• We (mostly Max) had calls with many of these people: probably significantly more than 50 people in total.
  • Very roughly 60% of these calls were with people who were seriously considering the role, in which case the call focused on getting to know each other a bit better, and then answering any questions or addressing any concerns that they had about the role or the process.
  • The remainder were with people who were not considering the role, but who wanted to give input into the process.
    • Overall, we found these fairly useful: we got a lot of tips on outreach and assessment from people with a lot of executive hiring experience, and we also got some useful feedback from community members.
• Over 25 people ended up applying.
  • Because we had been selective in who we reached out to, the applicant pool was fairly strong in terms of prior management experience.
  • We tailored assessment around our uncertainties for applicants (in order to make good use of their and our time).
  • Around 20 of these candidates ended up doing a task where they began to develop a strategic vision for CEA (based on additional context that we shared with them).
    • We were aware that different candidates would have different levels of context, and that candidates’ thinking would likely change as they learned more, so we paid less attention to whether we agreed with the specifics of the plan, and more to the reasoning and communication skills displayed in these documents.
    • We shared with them that we were open to a fairly wide range of potential visions for CEA, and gave some guidance on the types of visions we were most open to, and what we were looking for from them. Some candidates proposed fairly radical departures, but around half focused on ideas closer to the status quo.
  • We have so far gathered reference calls for around 15 of these candidates.
    • This was based on advice we had from people with a lot of recruitment experience that reference calls would be a way to get a fair amount of information quickly. These people also gave tips (e.g. for our script) that helped us to make reference calls somewhat more informative.
      • At their best, reference calls can help you to very quickly understand a candidate’s performance in similar past roles. They also help identify uncertainties or concerns that can be evaluated during the process.
      • However, we are also aware that reference calls can be noisy: we tried to do multiple calls where possible, and they were only a part of our evaluation.
    • Overall I (Max) found reference calls really informative, and I’m glad that we did them earlier in the process (rather than at the end, which is more common).
  • A smaller number of candidates did a management trial task, or a structured interview.
• We’re now engaging more deeply with <5 candidates, doing more in-depth reference checks, and giving them time to talk with stakeholders and develop their visions for CEA. This process is tailored around our uncertainties about these candidates, and these candidates’ uncertainties about the CEO role.
  • We've decided to prioritise clarifying our uncertainties about these candidates in the coming couple of weeks, in part because we think they are most likely to be the right fit and in part because we have limited capacity to engage intensively with more than a handful candidates simultaneously. However, there are around 10 additional candidates who we have not rejected and whose applications are effectively paused
    • In our efforts to eliminate enough candidates to achieve a manageable shortlist of top candidates, we didn’t feel confident ruling these people out, so we've offered them the opportunity to remain under consideration (so far, all have opted to remain a candidate-on-pause)
  • To protect candidate privacy and to avoid locking in our options too much, we’re not currently saying too much about these top candidates or their visions.
  • We’re still fairly unsure about how long it’ll take before we can announce an appointment: if things go well, we hope to make a recommendation to the board by early October, but it might take time for the board to consider their decision and negotiate with the candidate, etc. There might also be some delay between someone agreeing to join and them starting or the decision being announced.

Commentary/reflections

1. Overall I think that I learned a lot from feedback from people with more experience of executive recruitment. (Though the feedback was sometimes contradictory, and I’m not sure if I acted on the best advice throughout.)
2. Compared to other projects, I’ve been surprised at how frequently my previous way of thinking about things broke down, and I needed to re-conceptualize what I was doing.
   1. Examples of things I needed to re-conceptualize:
      1. How much to treat this as a standard recruitment funnel versus a highly-customized search for our top candidates.
      2. How much to be “ruling candidates out”, versus “ruling in” the few candidates we were most excited about.
   2. This generally materialized as feeling stuck or unable to make progress within the current paradigm (e.g. feeling like I needed to reject candidates but not being sure who to reject), and then talking to advisors or thinking things through for a while before I found a new way of thinking about things (e.g. “rule people in, not out”) that allowed me/us to make progress.
   3. I’m not sure how avoidable this was, but I expect that if I had done this type of executive search many times in the past I would have found this easier to navigate.
   4. Sometimes we switched between these different paradigms, and I worry that this sometimes resulted in a slightly disjointed process, whereas it would have been better to more consistently pick one approach (e.g. more totally pick an approach where we just reached out to about 3 people from the start and then shaped assessment around them). (But I’m not sure here – I don’t feel confident in any of the more decisive approaches, and maybe we had a decent balance.)
   5. Overall I felt more frequently confused working on this project than I have in most prior pieces of work I’ve done. It felt fairly different from running a standard recruitment round.
3. Things I wish I’d done differently:
   1. We asked several candidates to do a particular trial task early in the process, but this task didn’t give us as much information as I’d hoped, partly because our candidates tended to have a lot more experience than the people that we’d beta-tested the task with. In the future, I should make sure that trial task beta testers are more similar to the actual applicant pool.
   2. Partly because of getting “conceptually stuck” in some ways, I think that we began outreach to candidates about 2 weeks later than might have been realistically possible (and this matters because a 2 week delay means, in expectation, 2 weeks longer before finding a new CEO for CEA, which I think is important). I think that it would have helped if I’d asked advisors for help here more quickly.
   3. In a couple of cases, I sent emails or requests that were too standardized to some of our top candidates. I think that this made them feel less valued, and more worried that I’d waste their time during the process. I updated somewhat in the direction of personalization and optimizing for the experience of our top candidates based on this feedback.
4. Things I’m glad we did:
   1. I think that personalized outreach helped us reach people we otherwise wouldn’t have reached.
   2. As mentioned above, I got a lot out of doing reference checks early, and I think our approach to reference checks is getting us much more useful information than the default approach.
   3. I think the process has generally been well organized and project managed.
   4. I think that we were fairly transparent with potential candidates about what the role looked like, including important risks and downsides. For instance, we shared a lot of this in the role description, and I shared more on calls. I think that this allowed people to rule themselves out more quickly which saved time, and it also built trust with potential candidates.
   5. I think it’s good that we have been open to big changes in vision: some of our top candidates want this, and I think this might help us to recruit a much better leader for CEA (and possibly switch to a better strategy).
5. One thing that has been generally challenging has been how to assess candidates who have very different profiles (in terms of prior management experience, or prior engagement with EA). I think that we’ve been appropriately cognisant of this, and I don’t think there’s anything particular that I’d change here, but I’m also not confident that we handled this well.

You can share anonymous feedback about our process here.

1. ^{^}

   I drafted this post with some help from Oscar Howie. Other search committee members commented and approved of my posting, but didn’t author the post. Thanks to Oscar Howie, Lizka Vaintrob, Claire Zabel, Michelle Hutchinson, and Amy Labenz for feedback.