Purpose of post
As part of the EA Strategy Fortnight, we want to compile some survey results addressing how FTX has impacted the EA brand—particularly people’s sentiments towards EA. From the research we have on attitudes toward EA from the EA community, the general public, and university students, it seems that the FTX crash hasn’t, overall, impacted sentiments toward EA very much.
This is not to say that FTX has not significantly impacted people in many ways, including mental and emotional health, levels of trust in EA leadership, and increased uncertainty in EA as a movement. We hope compiling these survey results will help contextualize our individual experiences and improve our understanding of general attitudes toward EA.
The EA Community
In December 2022, Rethink Priorities ran a survey to gauge how the FTX crisis affected EA community members’ attitudes toward the EA movement, organizations, and leadership (fuller results of that survey from Rethink are here).[1]
Data points:
- Results demonstrated that FTX had decreased satisfaction by 0.5-1 points on a 10-point scale within the EA community, but overall community sentiment remained positive at ~7.5/10.
- Around half of the respondents reported that the FTX crisis gave them concerns with EA meta-organizations, the EA community and its norms, and the leaders of EA meta-organizations.
- More respondents agreed that the EA community had responded well to the crisis so far (47%) than disagreed (21%), though roughly a third of respondents neither agreed nor disagreed with this.
- Most respondents reported continuing to trust EA organizations, though over 30% said they had substantially lost trust in EA public figures or leadership.
University Students
The CEA groups team surveyed some university group organizers regarding the states of their individual groups in May 2023. From November 2022 to February 2023, Rethink commissioned a survey to measure campus awareness of EA and whether students’ awareness of EA was because of FTX.[2]
Data points:
- When CEA polled university group organizers, they gave an average response of 3.8/10 to “How worried are you about how your group is perceived on campus?” Only two organizers mentioned FTX, and both of them only did so to state that they haven’t seen impacts from FTX—though one said that this might change in the fall.
- The vast majority of students interviewed on campuses did not mention FTX when asked where and when they heard about EA, and only 13/233 (5.6%) respondents who had encountered EA found FTX or SBF salient enough to mention when interviewed.
- Most respondents to Rethink's survey hadn't encountered EA. Of those who had (233), only 13 (1.1% of total respondents) referred to FTX/SBF explicitly or obliquely when asked what they think effective altruism means or where and when they first heard of it.
General Public
Rethink ran surveys pre- and post-FTX assessing awareness of and feelings towards EA in the US general public and later in more elite (educated and informed) US groups in February-March (post-FTX).
Data points:
- Awareness of EA remains low, and ~99% of people who were aware of EA did not mention FTX.
- Among those aware of EA, attitudes remain positive and actually maybe increased post-FTX —though they were lower (d = -1.5, with large uncertainty) among those who were additionally aware of FTX.
- This does not suggest that there has not been a worsening in attitudes towards EA among those highly familiar with EA and FTX, only that most people are not familiar with both EA and FTX.
Major Donor Impacts
While not a formal survey, we thought it might be useful to include some info about how major EA donors have responded. This is primarily anecdotal information from people fundraising for EV-related entities.
- By far the biggest impact is just that FTX Foundation isn’t donating money anymore,
- A couple of significant donors are more cautious about funding EA movement-building because of FTX, a few others are consciously stepping up their funding to compensate for the funding drop, most are largely unchanged.
- One organization reported that interest in donating has actually increased (possibly due to increased general interest in longtermist causes and/or their organization having more of a track record)
- My best guess is that cause-specific fundraising has been almost not impacted at all and EA community building has been be mildly to moderately impacted (beyond the obviously major impact of FTX not donating anymore)
Factors not tested in these surveys
- Other recent community situations on sentiment toward EA
- General continued perception of EA as “weird”
- EA’s emphasis on STEM work, particularly in AI
- Most people in the general population not knowing about EA
- Continued interest in EA principles and philosophy
- The EA brand being “punchable” and whether it attracts people toward key causes
Commentary
- The fact that most people don't really care much about EA is both a blessing and a curse. But either way, it's a fact of life; and even as we internally try to learn what lessons we can from FTX, we should keep in mind that people outside EA mostly can't be bothered to pay attention.
- An incident rate in the single digit percents means that most community builders will have at least one example of someone raising FTX-related concerns—but our guess is that negative brand-related reactions are more likely to come from things like EA's perceived affiliation with tech or earning to give than FTX.
- We have some uncertainty about how well these results generalize outside the sample populations. E.g. we have heard claims that people who work in policy were unusually spooked by FTX. That seems plausible to us, though Ben would guess that policy EAs similarly overestimate the extent to which people outside EA care about EA drama.
This post is part of EA Strategy Fortnight. You can see other Strategy Fortnight posts here.
- ^
Rethink plans on conducting a followup survey to this survey, as referenced here.
- ^
Our understanding is that Rethink is planning to publish more information about this and the next survey soon
We can get a better intimation of the magnitude of the effect here with some further calculations. If we take all the people who have pre and post FTX satisfaction responses (n = 951), we see that 4% of them have a satisfaction score that went up, 53% remained the same, and 43% went down. That’s quite a striking negative impact. For those people whose scores went down, 67% had a reduction of only 1 point, 22% of 2 points, and then 7%, 3%, and 1% each for -3, -4, and -5 points.
We can also try to translate this effect into some more commonly used effect size metrics. Firstly, we can utilise a nice summary effect size metric for these ratings known as probability of superiority (PSup), which makes relatively few assumptions about the data - mainly that higher ratings are higher and lower ratings are lower, within the same respondent. This metric summarises the difference over time by taking the proportion of cases in which a score was higher pre-FTX (42.7%), and assigning a 50% weight to cases in which the score was the same from pre to post FTX (.5 * 53.2% = 26.6%), and adding these quantities together (69.3%). This metric is taken as an approximation of the proportion of people who would report being more satisfied before vs. after in a forced choice of being more or less satisfied. If everyone was more satisfied before, PSup would be 100%, if everyone was more satisfied after, PSup would be 0, and if it were just as likely for people to be more or less satisfied before or after, PSup would be 50%. In this case, we get a PSup of 69.3%. This corresponds to an effect size in standard deviation units (like Cohen’s d), of approximately .7.
We would encourage people not to just look up whether these are small or large effects in a table that would say e.g, from wikipedia, that .7 is in the ‘medium’ effect size bin. Think about how you would respond on this kind of question, what a difference of 1 or more points would mean in your head, and what precisely you think the proportions of people giving different responses substantively might mean to them. How one can best interpret effect sizes varies greatly with context