Thanks a lot Robert!
On 1) great point, I agree.
On 2) I think this shouldn't be a barrier, since the first step in impact evaluation is establishing a theory of change, and any individual organisation of a given maturity should have a clear picture of this, and consensus on their goals. (I'm not advocating for a singular ToC across the whole EA movement, just for individual organisations)
On 3) I agree this is a factor for evaluations for funders. But I think organisations should carry out internal impact evaluation according to their theory of change, so I ...
Thanks David!
I agree independence has advantages. OTOH I think there are also important advantages to internal impact evaluation: the results are more likely to be bought into internally, and important context or nuance is less likely to be missed. For making a theory of change specifically, I think it's quite important this is done internally, usually. Overall I think the ideal setup would quite often be for organisations to have their own internal impact evaluation function.
And that's interesting on funder interest. In a few cases, organisations I've spo...
This year I'm planning to meet with a friend to make a shared donation decision.
Before meeting up I want to create a longlist of potential places to donate to. I'm open to charities in any of the main EA cause areas, as well as evaluators / funds, and smaller projects that aren't yet established.
What are good places to crowdsource a list from?
Yeah I agree, I just mean that $1bn in funds lost to customers across the world is plausibly comparable in welfare terms to other wins on that list. E.g. dividing by 10 to account for differences in income of those affected, it would be around the amount attributed to GiveDirectly on the EA impact page.
(without wanting to make a very direct crude comparison, or getting into the details of that)
The role of the EA movement in the case of FTX seems surely to meet the level of influence for some of the impact win's that EA has had so far here.
Perhaps most prominently, the movement:
For example, when comparing to the case of Sendwave, the influence seems at least comparable and if not larger e.g. played a motivational role in founding a company, for the purpose of improving the world. (I'm not familiar with Wave's founders motiva...
I think that an honest impact evaluation of the EA movement would include the harm caused to customers through FTX's collapse.
Agreed. However:
In welfare terms alone, the impact of FTX's collapse on it's customers seems plausibly comparable to some of the impact win's of the movement to date. I.e. of the order of $1bn in lost funds.
Are you talking about welfare terms or financial terms? Because $1bn in lost savings of FTX customers seems very different in welfare terms to $1bn spent on bed-nets etc. I think there are strong reasons FTX shouldn't have acted ...
Thanks for writing this.
On EA Grants: Will you allow individuals to fund EA Grants in the future? This could either be letting individuals add to CEA's pot of funding for grants, publishing the rejected grants so that individuals can fund them independently or putting the applications on EA funds.
On EA Funds:
"Potential expansion of EA Funds on offer and investigation of different models for running and >using funds"
What types of funds and models might this investigation include?
I actually think it could be quite reasonable for an org to trust or place more weight on an internal evaluation more than an external one, but apart from that fully agree with all you say!