Interesting article from Anthony Kalulu from Uganda.
It argues that EA recommended charities have very little impact in the average poor in Uganda.
if you randomly asked one of the people who themselves live in abject poverty, there is no chance that they will mention one of EA’s supported “effective” charities, as having impacted their lives more than the work of traditional global antipoverty agencies. No. That’s out of question.
Anthony argues too that EA solutions are not persistent
If you visited a truly impoverished country like Uganda, you will quickly notice that many of the things that effective altruists call “effective” — from mosquito nets, to $100 business grants that are provided to groups of 3 people — are the same short-term, disposable solutions that have not only kept their recipients in abject poverty, but also, they are the very kind of solutions that often disappear the same day their proponents exit.
And that the solutions implemented do not match the communities needs:
In my region of Busoga, Uganda’s most impoverished region, we have one [well-funded] international charity which is among those described by the EA movement as being “effective”. That charity is also working with rural poor farmers here, principally on maize.
[...]
But the thing is: every household in our region that depends on maize, lives in chronic extreme poverty, and has lived in chronic poverty for eternity. Neither the effective charity nor the other big antipoverty agencies that came before it, have changed this.
By contrast, those farmers who are growing crops like sugarcane, no charity or antipoverty agency has ever supported them. But today, every village in our region that you visit, is covered with sugarcane. It is also the same with many other crops (rice, tomatoes, water melon etc) that are at least providing rural farmers with some tangible income.
The solution advocated by Anthony through the article are grassroots organizations:
In the name of being “effective”, EA has instead indoctrinated its followers to strictly support a small, select list of charities that have been labelled “most effective” by the movement’s own charity raters like GiveWell, Giving What We Can, The Life You Can Save etc, of which the named charities, right now, are all western.
But that is the very ingredient that makes traditional philanthropy a sector that keeps the world’s extreme poor on the sidelines. And by consolidating itself as a movement that completely never supports grassroots organizations directly, EA has proved to be more of a blockade to those of us who live in ultra poverty, even more than traditional philanthropy.
What can we do to help improve this situation?
Here is a brainstorming of some ideas:
-
Seek feedback and listen to local though leaders, and invite them to participate in the global conversation about eradicating poverty
-
Conduct third-party surveys of the intended beneficiaries of poverty relief. So far the only instrument of this kind I've seen is GiveDirectly's program.
-
If you are a charity working in eg Uganda, try promoting your hiring rounds among your beneficiaries and their surrounding communities
-
Lead, together with local EA organizers, incubation programs of grassroot and effective efforts
-
Try to identify the best local grassroot efforts to support. This might be tricky because these efforts are usually not scalable, so spending $100k on a study might be pointless when the org only has capacity to absorb $50k. Maybe we could study better the effects of a grassroot support foundation.
-
Train and support local EA organizers to run talent identification and nurturing programs, like localized versions of Carreras con Impacto
Which of these seem better? What other things could be done? Do you have capacity to run a minimal version of any of the ideas above?
I read that critique with hope, but ultimately I found it largely unconvincing.
I'm very surprised by the claim that mosquito nets keep their beneficiaries in poverty. Mosquito nets are not trying to lift people out of poverty, and yet there is some evidence that they do help lift people out of poverty to some extent. I really don't understand how distributing nets can keep people in poverty.
Kalulu says:
To be honest, if you asked someone who had received $1000 from GiveDirectly whether it impacted their lives, I'm pretty confident they would say a hearty yes. It also allows the lived experiences of the poor to dictate what happens to the money -- something which Kalulu demands.
GiveWell believes that all of the GiveWell Top Charities outperform GiveDirectly, and I think this is correct, unless you place an unusually low amount of value on saving a life. Again, GiveWell have validated whether they are imposing a Western perspective when it comes to this moral weight judgement -- they have surveyed people in Africa on this question.
One area where I do agree to some extent: I think it would be good if more people from the populations which benefit from these interventions actually worked at GiveWell. I have certainly had conversations with GiveWell where we have discussed the details of models and I have invoked lived experience of spending time among the global poor, and I got the impression that GiveWell could have benefited from having more of this perspective.
Overall I still don't feel we need to galvanise actions to improve the situation.
Some might be sceptical of a critique which could be paraphrased as: "EA is getting it wrong because it should be funding NGOs which are run by people who have lived experience of being ultra poor. By the way I have lived experience of being ultra poor and I run an NGO." I don't think you need to invoke this scepticism in order to find this critique unconvincing.
People bring this up a lot, and I think it's inaccurate. Although GiveWell has discussed the IDinsight survey as factoring into their moral weights, they do not actually incorporate its results, and the vast majority of their moral weights comes from surveys of donor preferences. From their 2020 update:
They discuss their issues with the IDinsight survey:
And conclude:
So it's not accurate to say that GiveWell's moral weights have been "validated" by beneficiary preferences. GiveWell claims to be quite skeptical of the beneficiary preferences survey, so they just added a bit more weight on years of life lost (YLLs) to capture the rough idea of people valuing life more than they expected. In practice, this amounts to valuing the lives of under-5 children a bit more than valuing the lives of other people (since they have more YLLs):
Given how much more people valued averting death over increasing consumption in the IDinsight survey, the fact that this relationship was unchanged makes it difficult to argue that GiveWell has really incorporated beneficiary preferences into their moral weights.
I know this wasn't the main point of your comment, but it's important to clarify because it comes up a lot as a defense when EA is criticized for being paternalistic, and I just don't think that represents reality. GiveWell is absolutely imposing a Western perspective by having 70% of their weights be from donors and staff.
This is a good point.
My understanding is that the IDinsight study had about 35 percent of beneficiaries choosing saving lives over any presented amount of cash transfers, while the respondents who switched based on the # of transfers per life saved expressed preferences that were (on the median) roughly similar to preexisting GiveWell weights.
So I think a model that gives about 35 percent weight to a lives-saved-only calculus and about 65 percent weight to a tradeoff calculus would accurately reflect the beneficiary preferences in the survey. That isn't too far off from the 60/10/30 model.
Going solely by the preferences in this one survey might affect some GiveWell decisions on the margin, but the bulk of their top charities' rated effectiveness already comes from saving lives under five.
That's still not accurate because the YLLs adjustment mostly matters on the intensive margin (saving kids vs adults), and as GiveWell states, their lives vs income tradeoff was essentially unchanged compared to their previous moral weights.
There is one paper from 2009 suggesting that, in the short run, eradicating malaria can lower income per capita slightly but only by a few percentage points and in the longer run it raises income. This is because it doesn't affect prime age workers so much.
Oh wow, I really didn't think anyone would have an answer to that question. Nice one!
Agree with all of this nice one! As a quick note (as I've noted in more detail in a comment) it's important to note that evidence around charity is rarely discussed here in Uganda. You can notice this especially when you see that his claims about mosquito nets are not backed up by any evidence. Also there is evidence that people funded by Givedirectly in Uganda have appreciated it, but unfortuately. he won't have considered this evidence.
Another point is we'd expect EA not to be able to help a random poor person by chance.
Assuming EA is actually effective, but not having magic, it means billions of dollars will go to millions of people. Problem is, hundreds of millions are poor, so behind the veil of anthropics, we should mostly expect not to be in the helped group by pure chance.
"What can we do to help improve this situation?"
Before we assume there is a situation that needs to be improved, it is important to make clear that there is a problem. The existence of an article from someone in an extremely poor place saying that EA has not helped his community is not compelling evidence that there is a problem with how EA is using its resources.
The total cash flow through from AMF, the deworming programs and Give Directly through their whole history is probably in the area of 1-2 billion dollars. Or something like 2-4 dollars per extremely poor person.
Obviously this hasn't made a big direct impact on the day to day life of a random poor person in a random poor country . It isn't enough money.
So the question that we actually want to answer is: Given the actual quantity of resources we have available to put towards extremely poor countries, would that tiny amount of resources do more good per dollar if we adopted the proposals put forward here? Alternatively, would these proposals allow us to mobilize more rich Western person money, until there is enough being donated to actually fill the holes?
deleted because Karthik clarified what the OP meant.
I charitably read "random" as "randomly drawn" i.e. if you look at any poor community, the odds that they have been helped by EA is small because EA's money flow is very small. This is also likely because of the quote from Anthony's article.
I believe Tim was responding to this part.
Thanks, I deleted my comment. I appreciate your clarification.
Thanks so much for this - am loving the development focused discussions on the forum at the moment!
I'm a New Zealander who has lived in Northern Uganda for 10 years and this is exactly the kind of response I often get from Ugandan development workers. I think his argument is well intentioned but flawed, while raising a bunch of important points we can work on. Here are a few thoughts on his arguments
"If you visited a truly impoverished country like Uganda, you will quickly notice that many of the things that effective altruists call “effective” — from mosquito nets, to $100 business grants that are provided to groups of 3 people — are the same short-term, disposable solutions that have not only kept their recipients in abject poverty, but also, they are the very kind of solutions that often disappear the same day their proponents exit."
His explanation for why he doesn't believe the interventions are effective is based on theory not evidence. I'm yet to meet a Ugandan development worker here in Gulu, Northern Uganda at least who has quoted evidence about development - and that's after 10 years working here. Unfortunately the education system here focuses heavily on theory and barely at all on evidence. Part of the reason for this is lack of resources - university students here often don't have access to databases because their universities can't afford it which is pretty tragic. Also many older lecturers who are 20-30 years behind on development theory.
On this point I think before and after surveys are deeply flawed for a number of reasons but this is an interesting debate. Both sides of the argument play out a bit in the discussion about Wellbys especially in the comments here.
https://forum.effectivealtruism.org/posts/uY5SwjHTXgTaWC85f/don-t-just-give-well-give-wellbys-hli-s-2022-charity
"But the thing is: every household in our region that depends on maize, lives in chronic extreme poverty, and has lived in chronic poverty for eternity. Neither the effective charity nor the other big antipoverty agencies that came before it, have changed this. By contrast, those farmers who are growing crops like sugarcane, no charity or antipoverty agency has ever supported them. But today, every village in our region that you visit, is covered with sugarcane. It is also the same with many other crops (rice, tomatoes, water melon etc) that are at least providing rural farmers with some tangible income."
Unfortunately I don't think there's much hope of EA theory taking off here for a long time unfortunately, due to lack of focus on evidence locally and the lack of ability for people to have critical discussion about charity. Unfortunately there's too much self interest at stake. For social and political reasons people are VERY hesitant to criticise other charities here. It might cause you to not get a job in future or worse annoy a political establishment. As a expat here I have the white privilege of being able to speak critically without threatening my livelihood.
As a brief note, hiring locally already happens most of the time as it is a core part of mainstream development theory. Most charities mostly people from the local (ish) community."If you are a charity working in eg Uganda, try promoting your hiring rounds among your beneficiaries and their surrounding communities" -
Maybe one thing EA could do to address some of these issues and build bridges with local development workers is to package and deliver the latest empirical evidence to university students and lecturers in places like Uganda.
Let's talk about two ways of granting money to small, hard-to-evaluate projects to help people in extreme poverty.
One rebuttal to Kalulu's argument about the superior persistence of local, grassroots organizations is that UCF did have to stop its operations for about two years due to COVID-19. Certainly, that's not UCF's fault, and I feel sympathy for their hardship. I also admire Kalulu's work to lift himself and his neighboring farmers out of extreme poverty.
But by contrast, GiveDirectly not only maintained its operations during COVID-19, but created a new program for COVID-19 support that distributed $76 million to 342,000 African families. They can do this because they can wire money directly to recipients. GiveDirectly is also experimenting with 2-year and 12-year basic incomes for 40 villages.
Kalulu's article is hard to interpret because he doesn't name the "one [well-funded] international charity which is among those described by the EA movement as being 'effective'." He says they're also working with local farmers on maize, which he thinks is a bad choice relative to sugarcane and other cash crops. I don't know what charity he's referring to, but perhaps they should hire Kalulu for some kind of local consulting role?
But I don't think his descriptions of EA charities are accurate. GiveDirectly is giving people money to do with as they choose, and is experimenting with long-term commitments to UBI. Their operations are continuous. That does not strike me as the transient, passive charity Kalulu's critiquing. AMF has existed since 2004, GiveDirectly since 2008, and both have maintained continuous operations since then. It's not at all a fair comparison, but UCF is 5-9 years younger as an organization, and has faced ~two years of stoppped or slowed operations due to COVID-19. I'm sure their situation would have been different, had they been better funded, but I think it's important to respond to the specific arguments Kalulu is making in his article.
Overall, I would not support donating to local, little-vetted grassroots charities with a modest track record of success to the tune of millions of dollars. I would be open to an experiment with donating to local grassroots charities in smaller amounts. For example, each of the ~6,000 recipients of GiveDirectly's long-term basic income experiment will receive a total of $3285 over the lifetime of the experiment. Donating about $3,000 to a set of 6,000 randomly-selected local grassroots charities in impoverished regions (perhaps focusing on ones that have already existed for at least 3-5 years) seems like a reasonable way to experiment with spending $18 million.
The only EA aligned charity I can find doing anyrhing in Africa with maize is the food fortification initiative, although they don't really fit Anthony's description, so he may be referring to a different EA aligned charity
Not sure, but I would bet Anthony is referring to One Acre Fund.
That would make sense, they're on The Live You Can Save's list of charities. I note on the article for One Acre Fund that "In 2018, 78% of One Acre’s higher-skilled Africa-based roles were filled by African nationals — including the CEO. By the end of 2020, One Acre Fund will recruit, manage, and deliver professional development services to over 10,000 African national employees." That doesn't necessarily make it grassroots and local on the same level of granularity or comprehensiveness of UCF, but it's also a much bigger organization serving a much wider area.
One Acre Fund also works with a huge variety of crops in different countries. They don't seem to bring some Western doctrinaire attachment to maize. I wouldn't be surprised if they could do better with another crop but that seems like a technical question more than anything.
Thanks for linking to this article and providing highlights. I tend to take this kind of criticism very seriously, and despite my pushback in the next paragraph, I still think we should pay attention to it.
On the other hand, it appears to me that very clearly many global health NGOs supported by GiveWell would have results mostly unfelt by those in poverty, not because they're ineffective, but because they're preventative. If AMF succeeded in its mission, all you got from it was a mosquito net. You can't know that your own child would've otherwise been the one to die from malaria. The same goes for deworming and food fortification (the latter might even be entirely unfelt by a consumer).
100% great point!. Because preventative effects are spread out over such long time periods, it's almost impossible for someone t associate the cause (mosquito net, deworming and fortification) with the effect (longer, healthier life for their kids)..
Although I'm not sold on Kalulu's argument (and didn't see enough information about his charity on its website to assess whether I think it is effective), I think this is a good time to remember and acknowledge the weaknesses and limitations of current EA measurement of effectiveness in the global health/development area. It seems quite likely to me that there are grassroots organizations that are more effective at the margin than the current GiveWell four (and many that are significantly less effective). EA simply lacks the resources to evaluate them all, and evaluating them up to the GiveWell gold standard would not be cost-effective even if it did. So the message we have with confidence is something like: "We are very confident that EA's recommended charities are very effective at doing good, and we believe they are the best known use for your marginal dollar."
I share Jaime's view that we should "[t]ry to identify the best local grassroot efforts to support." I'd add that this should be done by people from the countries (or at least subcontinents) in question to the maximum extent practicable, both for cost-effectiveness and other reasons.
I wonder if the most effective (in a EA sense) way to help these organizations would be some sort of meta support. If we believe that a dollar in meta support could help move a number of Western charitable dollars away from less effective charities, we do not need to believe these organizations are as effective as AMF et al for meta support to be potentially effective.
Taking Kalulu's organization as an example, I could find no indication of tax-deductibility status in any country (although references to Donorbox and Benevity suggest there might be). If the organization has a fiscal sponsor offering tax deductibility, not advertising that fact is a major error (which suggests that training for "the best" grassroots organizations on how to effectively seek money for Westerners could be cost-effective). If it does not, then it may be cost-effective to set up an organization to serve as a fiscal sponsor for grassroots organizations that have been identified as "the best local grassroot efforts to support." For better or worse, many donors use that status as a marker for some limited amount of vetting/oversight in addition to the obvious advantages. Of course, for the smallest organizations, the most effective meta might be to set up a fund for "the best tiny local grassroots efforts to support" rather than provide assistance with individual-org fundraising.
This is fantastic. I speak just from Ugandan experience here again.
I'm sure there are grassroots orgs that are more effective at the margins than GiveWell's orgs. Even just from a probability perspective with thousands of small orgs, the chances of a handful being super-effective in their context seems pretty high. I know we are obsessed with scale, but if a small org is effective and it would only take 100k a year to max out what they could do in a local context, why not give them that? As an example there is a great education org here that runs on a shoestring (maybe 60k a year) called Read4Life that has good evidence over a number of years of operation that their interventions have greatly sped up learning of reading and writing for thousands of kids. It's wild how hard it is for orgs like this to get funding.
I don't know enough about Givewell to say this with any confidence, butit might not be shard for Givewell to loosely assess say 1000 small orgs and select a handful that might be effective. Obviously with a less rigorous assessment, Givewell couldn't be confident that the orgs were effective but they could at least offer some smaller orgs as options for donation. I would love like you say for this to be done in-country, but in places like here in Uganda I'm not sure the expertise is really around to do solid Givewell style assessments - but I could be wrong maybe there are people out there who could do it!
There are a some orgs already which can help serve as fiscal sponsors for grassroots organisations, but it's not straightforward to get connected to them. I'm also not sure just being tax deductable to help people donate though would make a huge difference unless the money coming in was huge - Big Local NGOs here have better ways of getting large amounts of money.
Big local NGOs here in Uganda get the vast majority of their money through grant applications not individuals as well. The biggest 5 or so local NGOs here in Gulu have enormous budgets funded by DANIDA (danish aid), USAID, GIZ etc. This is a bad situation as these donors give close to zero weight to actual effectiveness - instead what mostly matters is the relationships that they build with the donor organisations and their grant writing skills. Also these NGOs just tailor their programs to whichever wind the donor funds are blowing in. Today it's "Gender based violence", tomorrow it's "climate friendly agriculture". And the programs they roll out when they get the funding I think often do close to zero good or even harm.
My point is that the way to get a lot of money jere as a local NGO isn't to connect with a personal donor base in another country, but through getting big grants through big donor organisation, either philanthropies or National Aid organisatns.. Maybe EA incentives could help turn this tide, but it would take a LOT of EA money to push local NGOs away from this model of growth and towards more effective programs.
Despite that limitation I LOVE your idea of setting up an EA based fiscal sponsor for potential high impact small local organisations. I don't particularly like the word "grass roots" though, because I'm never quite sure what it means.
Yeah, I'm not holding out much hope right now for the governmental funders and the large NGOs that rely upon them. The vision was much more modest -- finding ways to provide "small" (e.g., high-4 to low-6 figures) funding for smaller nonprofits who have been effectively doing what they have been doing (rather than pivoting to what the politicals want this year).
I was thinking more about the private dollars (e.g., people who give to World Vision, which IIRC you do not rate highly). In particular, I speculate that there is a donor "market" for supporting efforts that come authentically out of the areas whose populations they serve, rather than being dreamt up by and run by Westerners. That is a market the big EA charities cannot compete in. (For my part, I don't care whether a charity is being run by Westerners or not, but some donors do.) EA is not going to convince everyone of the EA way of thinking, but funneling non-EA dollars into better charities is still a win.
It may be challenging to make cost-effectiveness work out for having paid Western evaluators evaluating microsized charities in Africa. Let's say we were looking at 1000 charities, 20 of which would clear whatever bar we set, and this could optimistically be done in 1500 hours (because most organizations could be non-selected quickly). Let's say the 20 have on average $100K in room for funding. At an organization like GiveWell's cost/overhead rates, that is probably something like a $150K or so project to select the 20 programs.
That level of analysis is not likely to persuade us that it is more likely than not that the bucket of microcharities is more effective than the big charities GiveWell would otherwise recommend. So we'd want to find funders for these 20 that wouldn't displace (any, or much) funding that would have otherwise gone to a standard GiveWell charity. That sounds plausibly cost-effective by EA standards to me, but it's a whole lot easier to justify if the bulk of the evaluation work could be done in the lower-income country/region with a final check of the proposed approvals by high-income country sources. The cost for that might be more on the $15K-$25K level? Some of that could potentially be justified by the informational value of having done the survey alone (e.g., we might find an idea that could scale or at least would learn about what local solutions are and aren't working in a semi-effective manner).
I totally hear that that capacity may not exist in many lower-income countries right now. So I guess one initial pitch would be to find some recent college grads sympahetic to EA ideas, hire them at private-sector local salaries (is that on the order of a few thousand USD in Uganda a year?), and teach them how to do shallow EA-style investigations. Frankly, I think a few programs of that nature would also be an inexpensive way to lay the groundwork for mitigating the reputational issue of EA being viewed as largely a movement of people from certain countries, races, and educational backgrounds.
The less ambitious approach would be to solicit nominations for microcharities to evaluate from people with both EA sympathies and on-the-ground experience, like yourself. That would keep the evaluation time at a much more manageable level, but it would miss a lot of organizations. I'd be willing to consider making donations to small groups on the recommendation of a trusted source vouching for their cost-effectiveness, but I may not be representative of others.
I have assisted, in a non-lawyer capacity, with setting up a US fiscal sponsor for a foreign non-profit entity before . . . in Uganda, curiously! It is fairly easy (and a few hundred dollars) if you're not expecting to bring in more than $50K in donations routed through the US non-profit in the first three years. Multiple non-profits can share the same fiscal sponsor...although the tax filing gets more complex at 50K and considerably more complex at 100K. (It seems that Read4Life has fiscal-sponsor relationships with an organization having like 200 projects. They have US, UK, and AUS tax deductibility.)
I love this this idea here a lot
"So I guess one initial pitch would be to find some recent college grads sympahetic to EA ideas, hire them at private-sector local salaries (is that on the order of a few thousand USD in Uganda a year?), and teach them how to do shallow EA-style investigations. Frankly, I think a few programs of that nature would also be an inexpensive way to lay the groundwork for mitigating the reputational issue of EA being viewed as largely a movement of people from certain countries, races, and educational backgrounds."
My only addition is that you would probably need someone more versed in EA evaluations out here supervising this. Also you'd need really good grads, because this would be a very new concept and would need a lot of learning.
I don't love the soliciting idea, because like you say it would still favour bigger organisations and would miss a lot of potentially great really small ones.
I parse the argument as "EA interventions don't have lasting impact. They might prevent some bad things, but they don't fundamentally improve the conditions that cause poverty. People are not kept in poverty because of bad public health in their community, but because of economic factors that disempower them."
And this might well be true. Bednets save the lives of their recipients, but I'm unsure if this leads to a more productive next generation or a more stable political situation.
Basically, live-saved measures are too short-sighted.
It's very hard to get clear evidence on this as it's so difficult to assess what actually leads to a more productive next generation, but there is some evidence focusing on health and education might make a big difference. For example there is evidence that if you have malaria a lot you get iron deficient or anemic and do worse at school. I know this is a lame anecdote, but I can tell you our nurses get malaria a lot and it's bad for productivity!
There are some interventions like family planning measures which have even better evidence behind them - smaller family size is associated with higher income on a household level and also faster development on a country measure.
Obviously it's not the be all and end all, but there is a decent amount of evidence out there that life-saving and health-improving measures can help assist development.
I'd like to comment not on Kalulu's criticism itself, but mention a specific solution he proposed here - http://dear-humanity.org/my-intended-solution/ .
I think Kalulu's proposal can be described more broadly as improving market access for farmers. Here are some other sources mentioning similar strategies:
https://www.rockefellerfoundation.org/blog/smallholder-farmers-food-loss-hits/
https://agra.org/markets-post-harvest-management/
Do you know if interventions focusing on improving market access for farmers were considered and evaluated by any of the EA organizations?
An interesting piece. I live and work in Nigeria. I have always argued that what is effective and good is relative.causes that are considered “effective” by the west may not make meaning to us. What I have observed, I have worked as a consultant to some international NGOs working in Nigeria. You see figures sent to the donors so that money will keep coming. No real impact.
I suggest that even when considering grant applications, EA should consider having someone from LMIC look at grant applications and charities. For example, the level of poverty and hunger in Nigeria is so high that any animal and welfare charity will be resisted to a stop.