Effective Altruism Forum
EA Forum

Hide table of contents

Comment Permalink

It’s also good to have some independent evaluation and peer-review of Givewell's research, even in the case of highly transparent organisations such as Givewell

In the past, where has this led? Has your peer review uncovered any errors GiveWell has made? Or has it been more conceptual disagreements like the one over GiveDirectly?

Michelle_Hutchinson10y7

Hauke Hillebrandt

10y

When we report on our recommended charities such as the Against Malaria Foundation, we try to add to what Givewell has already researched and believe that they'll hopefully take this into account in their future reports. For instance, here's our new report on AMF: https://drive.google.com/file/d/0B-ky1zIxhwx_QVBBb3ZuaVR5dEU/view?usp=sharing a lot of the research cited in this report has not been taken into account by Givewell I believe. Also look at our recent report on SCI here: https://www.givingwhatwecan.org/blog/2015-03-31/charity-update-ii-schistosomiasis-control-initiative-sci where we cite research that hasn't been taken into account by Givewell as of yet. We're also in contact with Givewell about their reports when we uncover errors (conceptual and factual). So far I've only had one email conversation with Givewell's Jake Marcus about what I perceived as a misinterpretation about the decline in worm burden with age - but we ended up agreeing that we have different interpretation of the statistics.

See in context

Please support Giving What We Can this Spring

by Michelle_Hutchinson

Apr 24 20152 min read 44

10

Giving What We Can

Frontpage

Please support Giving What We Can this Spring

Donate now to get your donations matched!

44 comments

Donate now to get your donations matched!

Giving What We Can is an international community of people donating at least 10% of their income to the organisations which can most effectively use it to help others.

We believe that if people are to do this, it is important that they know that there are many others out there doing the same and that there is information readily available about the best places and ways to donate. We therefore encourage people to make a long-term commitment through the Pledge to Give, put members in contact with each other, support people to set up in person meet-up groups and run the Giving What We Can Trust, which provides an easy and cost-effective way for people to donate. Using the data we’ve gathered over the five years since we started, we estimate that we have already moved around $6 to effective charities for every $1 we have spent, and that a realistic estimate of our impact in the long term is closer to $60 going to effective charities for every $1 coming to us.

This year is going to be an amazing year for effective altruism. The publication of four books on the topic mean that more people than ever before will hear about effective giving. It is crucial that that awareness leads to long-term impact. This will be our focus over 2015. We will be capitalising on the increased awareness to set-up and support chapters across the English speaking world and Europe (the main markets of the books). We will increase our one-on-one outreach to encourage people to take the Pledge and continue to keep in close contact with our members to ensure member retention. For more information on our activities and team over 2015, see our latest Fundraising Prospectus.

We would like to raise our 2015 budget this spring, in order that we can focus without distractions on our core activities over the rest of the year. In order to have our full budget for 2015, and end the year with 12 months of reserves, we need to raise £150,000. If you’ve previously donated less than £1,000 to Giving What We Can, this is a fantastic time to give because right now donations over £1,000 from new donors are being matched (up to £5,000 per person and with a total cap of £50,000). Our stretch goal is to raise enough so that we don’t have to do another fundraising round for a year - in order to do that we would need to raise an extra 6 months or reserves, meaning we want to raise a total of £280,000. You can donate now at our CauseVox page. If you have any questions please get in touch!

10 Reactions

Comments44

Sorted by

New & upvoted

Click to highlight new comments since: Today at 6:07 PM

Amanda_Jane10y7

This looks brilliant Michelle!

So pleased with the growth of the group and everything looks so professional.

Just donated £100 (a decent chunk of my donations as a student)

Michelle_Hutchinson10y2

Thank you very much! I'm glad you're happy with how it's going, and the information we've provided.

Peter Wildeford10y7

Hi Michelle, congrats on undertaking such an impact. I always love it when people look critically at themselves. I also have to say that I'm amazed at how beautiful a lot of the visuals are! I love the graphic with the money ratio and I found the downloadable spreadsheet where I can put my own numbers in very useful and very well formatted. Thanks for going above and beyond to provide that. The Fundraising Prospectus also has a crisp layout, great pictures, and does a good job of going into more detail.

One question I had, though, was it seemed like this current assessment focused a lot on what Giving What We Can has done throughout time to date to get members. However, GWWC has expanded a lot in the past year, and the budget represents holding that expansion and continuing to expand. Has GWWC done any sort of assessment to track the impact of the expansion funding on the margin? I'd be concerned that it might be lower than the overall figure for all funding.

Michelle_Hutchinson10y5

Thanks very much Peter! I'm really glad you've found it useful. Rob had just the same reaction, so he did a calculation on the margin - you can find it on p28 of the Fundraising Prospectus. Interestingly, the impact on the margin actually seemed higher than overall - it seems like there are some economies of scale now that we have enough people on the team to specialise, and we've been at it a bit longer so have more of an idea what we're doing.

Robert_Wiblin10y5

Hi Peter I would be interested to hear your reaction to my section on the value of marginal funding, and whether you can think of any other clever ways to infer it.

The main uncertainty in my mind is figuring out how long people will continue to give. While we have five years of data - and three years of higher quality data since we stopped relying just on volunteers - that isn't enough to pin down the loss rate of members very well. We also only have one year of data since online-only sign-ups become easy, so we can't yet determine the impact that will have.

mhpage10y4

Unless I'm missing something, it seems like we all should be giving to EA advocacy groups until the amount of resources available to those groups reaches the threshold at which the donation is no longer leveraged. What's the counter-argument? Has there been any analysis on what that threshold level is? In other words, if we take the total resources currently available to groups like Giving What We Can and The Life You Can Save, how many times those resources must we have before I should start donating to the Against Malaria Foundation?

Ben Kuhn10y7

The point at which you hit diminishing returns to funding an org may actually be pretty low. I'd be skeptical about the marginal value of budget increases of much more than a factor of 2 per year unless the org had demonstrated really impressive traction.
There are also signaling issues with only donating to metacharities, so if you're public about your giving it might not be a great idea ("guys, look at how much I donate to these organizations that promote donating to themselves!").
The error bars around these estimates are extremely high. The confidence interval for GWWC's leverage ratio plausibly already includes numbers below 1 (in addition to numbers above 300). For instance, this is one reason GiveWell doesn't recommend any metacharities--which, IIRC, someone said at one point that they would if they could find one with a robust enough case for impact. Donors with preferences similar to GiveWell's may reject metacharities entirely for that reason.

(Disclosure: I donate mostly to metacharities...)

impala10y4

The point at which you hit diminishing returns to funding an org may actually be pretty low. I'd be skeptical about the marginal value of budget increases of much more than a factor of 2 per year unless the org had demonstrated really impressive traction.

This isn't incompatible with what you're saying, but they may diminish well before that also. Taking the present example of Giving What We Can, the people who worked there or are involved with it thought that applied to it. They thought most of the value came from the existence of the organisation and a pledge people could sign if they wanted to commit to giving 10%, and other things which were done even before they started paying staff. So that would be diminish returns right at the $ 0 mark!

There are also signaling issues with only donating to metacharities, so if you're public about your giving it might not be a great idea ("guys, look at how much I donate to these organizations that promote donating to themselves!").

There are even less positive ways to frame that also, like giving to one another, and having organisations which heavily focus on promoting themselves (including by promoting the idea of metacharity, and making it a central concept in the movement). Even aside from signalling, we should see others' discomfort with that as a reason to be wary of it ourselves.

The confidence interval for GWWC's leverage ratio plausibly already includes numbers below 1

This is what those people I talked to from GWWC thought, due to their various experiences and observations. And GiveWell too as you say; they had had conversations with people at GiveWell who thought that GWWC's future fundraising ratio was below 1.

mhpage10y0

Doesn't every organization/social movement that efficiently allocates resources have diminishing returns beginning with the first dollar? One reason why this could theoretically not be true is if efficient use of capital requires upfront investment in infrastructure, but I don't know if that applies here. The concept of diminishing returns seems distinct from leverage (though obviously not unrelated).

The signalling issue is complicated, and I'm open to suggestions. As I'm a consequentialist, I'm open simply to lying.

Ben Kuhn10y0

" hits diminishing returns" is usually used as a shorthand for "investment in hits the point where returns have diminished enough that additional investment is no longer optimal."

impala10y0

duplicate comment

[This comment is no longer endorsed by its author]Reply

impala10y0

Doesn't every organization/social movement that efficiently allocates resources have diminishing returns beginning with the first dollar?

That will be the case very often, except in cases like that which you have mentioned. In these comments Michelle Hutchinson came up with a few other possibilities, like economies of scale.

The signalling issue is complicated, and I'm open to suggestions. As I'm a consequentialist, I'm open simply to lying.

This wouldn't address the non-signalling concern that I raised though (as I'm sure you're aware of course).

Benjamin_Todd10y1

I think you may be being too pessimistic about the confidence intervals. I'd be very surprised if GWWC turned out to have a leverage ratio less than 1. In fact, I'd be less surprised than if someone handed me a report making a completely knock down case that AMF has no impact, or that GiveDirectly turned out to be harmful.

To think the ratio is less than 1, you'd need basically all of GWWC's pledgers to drop out immediately (or for it to be true that all of them would have donated otherwise), and you'd need a reason why over 80% of historical attributed donations weren't in fact due to GWWC.

And the leverage ratio is a conservative measure of GWWC's impact e.g. it doesn't include additional donations to non-recommended charities, or the value of GWWC's role growing the EA movement.

Disclosure: I work at CEA, the parent organisation of GWWC.

Peter Wildeford10y2

I agree that GWWC's ratio is probably above 1 with a good deal of confidence (though I haven't done the formal math to evaluate how extreme that statement is). But I think the more compelling argument is that expansion funding on the margin may not have a ratio above 1.

jayd10y3

Yes, there's a huge, huge difference between the impact of GWWC existing as a place where people who wanted to pledge 10% of their income to help those living in global poverty could join others in publicly doing so, and the impact of its marginal funded activities now. GWWC existed as that place before The Centre for Effective Altruism was founded around it as an organisation with donors and a budget supporting paid employees. If minimal resources were spent on creating the basic infrastructure, and I don't know if that's so, but if so, then it had a mega high impact ratio. But it seems wrong to use that to justify keeping on spending more money on more employees doing more marginal projects until the impact from the original resource gets "used up."

Benjamin_Todd10y3

Ok this is all fair. I think, however, that a big fraction of the historical impact is due to on-going activity, of the kind that could continue, rather than being all due to the 'set up' generating the stream. And that would mean the historical ratio is a reasonable guide to the future.

This can be hard to see from the outside, but if you look at where new pledgers are coming from, it's often new press coverage or student group activity. Many also only take the pledge after being nudged by someone in person, even if they had heard about GWWC some time before, so there's an important role just talking to lots of people about the pledge. These kinds of activities can be scaled much further.

Moreover, GWWC tries to monitor the number of new pledges generated by new activities and will quit on anything that's not generating enough. You can see some estimates by Rob of marginal returns above.

Overall, you'd still have to be very pessimistic. Suppose GWWC's historical leverage ratio is 60. For the future leverage ratio to be less than one, you'd (roughly) need to think there was a 98% chance that marginal activities produced zero returns rather than historical rates of return.

Finally, I think it's helpful to bear in mind how tiny GWWC is. Suppose taking the GWWC pledge is as ethically demanding as vegetarianism, then it could one day reach 1% of the developed world. Since GWWC only has 1000 members, it has only reached 0.01% of its addressable market. Given such limited penetration, I think it would be surprising if there were no further returns to be had. It's not as if students at Cambridge (where ~100 people have taken the pledge recently) are radically different from those at other prestigious universities, so we should expect similar efforts to work elsewhere, so GWWC could already be 10x bigger even if just expanded among prestigious universities. If anything you might expect marginal costs per pledge to be dropping at this stage in GWWC's growth as you benefit from economies of scale and critical mass effects (and there's some evidence this is happening). Finally, given the chance that 99.99% of the value still lies in the future, it seems well worth spending a sizeable amount of resources now figuring out whether further growth is possible and how best to do it. In some ways, GWWC's marginal leverage ratio is besides the point: it's like looking at Google in its early days and deciding whether to invest or not based on whether it's already profitable.

Ben Kuhn10y2

Hi Michelle, I'm afraid I'm a bit confused about the 2015 budget on page 17 in the prospectus. Your projected budget (excluding the 10% contingency) looks like $203,420, but when I add up all the non-contingency numbers I only get $135,122 (a discrepancy of $68,298). Have I missed an item or something?

SamDeere10y3

Hi Ben - good pickup. I've uploaded the latest version of the prospectus with the amended numbers here

Michelle_Hutchinson10y3

You're quite right. I'm so sorry, I accidentally put in 6 months for half of it and then a year for the rest. We'll fix it. The correct figures are: Employees/interns £123,452; Communications and chapters £7,660; Administration £15,123; Research £3,200. I apologise, I don't know how I could have made such a blunder. By the way, the figures in the budget are all in £s. (Sorry about the difference with the impact evaluation, which is in $s.)

Jon_Behar10y1

I think you could strengthen your model for calculating your multiplier quite a bit by adjusting for the fact that people will earn, and give, more over time. As you note in your writeup, assuming people will give an equal amount each year is an aggressive assumption, but I doubt people have good intuition for how much this matters (and its effects interact a great deal with assumptions about discount/attrition rates).

If you'd like, you can borrow the calcs to model this dynamic simplistically from the spreadsheet found in this blog post.

You'll probably find this cuts your realistic estimate by at least half, though of course that still leaves a substantial multiplier :)

SamDeere10y3

Thanks for the question Jon.

With regard to the pledged amount, this comes from members' predictions of their future annual salary, which we think are likely to be underestimates. We also use median wage as a stand-in if we're missing future salary data, which (given our members are in general likely to earn more than median wage) we also think is conservative. Accordingly, it's likely that the amount donated will be higher in reality.

We address this in more detail in our fundraising prospectus – see Appendix 2 for the full working.

From page 23 of the prospectus:

This methodology obviously relies on the accuracy of members’ predictions about their future income. In general we have found that these predictions seem conservative, as most people underestimate their future earning potential (1). If members do not estimate their future salary, we use the median salary for their country. We think that is a fairly pessimistic assumption, as our median member has an expected earning potential higher than the median wage (2).

And the footnotes to the above:

(1) For example, many members estimate their future income will be the same as their current income, even though they are at the beginning of their careers - in reality, income typically increases throughout a person’s career (2) For example, many members attend prestigious universities and/or are pursuing careers that have an average salary much higher than the median wage

The final $146m figure is arrived at by multiplying members' estimates of future salary by the number of years they have left in their careers. It therefore doesn't take into account any of this growth that you'd expect in reality. As such, it wouldn't make sense to go back and try to model growth based on the $146 million figure (say, $1.7 million in year one, growing to around $5.6 million/year by year 40, rather than a flat $3.7m per year)*.

Instead, you'd need to apply your model (say, fast wage growth in the first 10-20 years of a career, then slower growth until retirement) to the member estimates first to derive the final figure, and use the yearly amounts in your calculation. Given our assumption that member estimates of future salary err on the low side, this means that both the final pledged amount, and the per-year amounts are likely to be higher, and therefore our effectiveness would in fact be higher, notwithstanding that the discounting/attrition rate would affect the final number more aggressively.

* I've tried this calculation, assuming a 4% growth rate for years 1-20 and a 2% growth rate in years 21-40. With a year one pledge of $1.7 million, this grows to $5.6 million by year 40, for a total of ~$147 million donated. This drops the effectiveness estimate down to 44-1 - a significant drop, but still excellent return for a donation to Giving What We Can. To reiterate, I think this would be a significant underestimate of peoples' future incomes.

SamDeere10y0

Also, sorry if this reply doesn't exactly address your rephrased question – I wrote it in response to your first comment :)

Here's a copy of the spreadsheet with the calculations added in as above if you want to play around with it.

Thanks again for the question, let me know if there's anything else you want clarified.

Jon_Behar10y0

Thanks Sam! Very helpful, I hadn't realized how much conservatism was built into the income estimates.

Ben Kuhn10y1

Thanks for posting this here, and congrats on your great growth so far! I got a chance to read the prospectus more thoroughly and now I have some other questions about GWWC's activities:

How was staff time allocated between projects over the past year? How do you anticipate allocating it next year? If you didn't raise as much funds as you wanted, which projects would get cut first?
Just to check that I understand the numbers properly, your actual cash spent in 2014 was £120,000 and your actual cash spent in 2015 is expected to be £220,000, correct? How was the budget divided up last year? What's the source of the increase? If it's more staff, what will they be doing? Your description of planned operations for 2015 only included one statement of intent to hire someone (and one recent hire who presumably will cost more next year as they're employed for the full year), so it's hard to figure out exactly where capacity/expenses are being added here.
Why does GWWC continue to do charity evaluation research? This seems to have very high overlap with GiveWell's operations, while GiveWell has a much larger staff, more organizational focus on it, and moves more money to their recommendations. Obviously GWWC and GiveWell's recommendations differ somewhat, but is it really worth maintaining a separate research team and splitting the focus of GWWC between outreach and research?
Which of the people on the "our team" page is paid by GWWC and how much time do the team members spend on it? Presumably Toby Ord and Andreas Morgensen do not work full time on GWWC if they're both professors, and Luke Ilott hasn't started yet; does that mean that GWWC is five full-time people right now?
I notice that you budgeted for volunteer interns as if you were paying them a standard hourly rate, which is great. However, I also notice that a lot of your growth strategy for next year involves leveraging local volunteers who aren't employed by GWWC per se. What would your estimated budget be like if these people's time was also included? And what is the reasoning behind omitting it?
Out of curiosity, is there a timeline of how many full-time equivalent people were working at GWWC at any one time? It would be interesting to compare that to the growth data (which, by the way, it's super awesome that you make available!)

Thanks again for answering everyone's questions! I'm sure you're probably tired of fielding them by now, but I really appreciate that we get to have these conversations publicly when EA orgs fundraise!

Michelle_Hutchinson10y4

Thanks for your questions – great to know what people would like to hear more about. Hauke and Rob have very kindly already answered most of the questions – the main thing left as far as I can see is what our activities have been over 2014 and what they will be over 2015. I’ll give a very brief summary, mostly for others who were also wondering, since I sent you our reviews and plans which have more detail in.

For most of 2014 we had one full-time person on Communications (Steph Crampin, who was staff) and one on Community (Ben Clifford (intern), followed by Lloyd Chapman (intern) and then Jon (staff)). Steph’s main focus for the first half of the year was a major overhaul of the website, aiming to update its look and feel, make it easier to navigate and use, cut down a bunch of our admin by automating a lot of the pledging process, and make individual dashboards for people to make it easier for members to let us know about their donations. In the second half of the year she was more focused on the September internship and running events. The idea behind the events strategy was to work out the best ways to run events, aiming to then scale those through our chapters. Ben and Jon worked on inducting new members and administration linked to that (more so early on in the year, before the website changes), ran our chapters and did individual outreach and follow-up – encouraging people who had had some contact with effective altruism to join GWWC. We planned to hire a staff member to be our community director over the year (hence Jon), because the turn-over of interns meant loss of information, and in particular of relationships with members and chapters (although each individually did a very good job!). Over this period, we didn’t have a full-time researcher – Rob, Andreas and Owen all pitched in to varying degrees. To a large extent we were drawing from the research we had previously done. The reason we didn’t hire a researcher was simply that we didn’t find someone we were happy with for the role.

At the beginning of 2015, we had a bit of a change in strategy. Rather than focusing on running events ourselves, we shifted to focusing on chapters. Chapters have seemed to be most effective when carrying out their own initiatives, so we decided it would work best to play a mentoring role for chapter presidents, rather than taking a top down approach. Since chapters play a larger role in our new strategy, and since it involves conversation with each individual chapter, it made sense to have one person focusing solely on chapters, so Jon moved to doing that. We had also found that following up with people individually – offering to answer questions and address concerns about donating to effective charities, prompting them to start etc seemed pretty effective. So we planned for our communications person to do more of that (that will be a large part of what Luke focuses on). We finally found a great candidate for research – Hauke. Over 2014, our membership doubled. Yet if anything, we want to have more rather than less contact with our members than we have in the past – we want to get a good sense of the path people take to actually deciding to give away 10% of their income to the most effective charities, and support our members to reach out to others. Therefore, we decided to hire someone dedicated to our members – Alison. In terms of if we don’t find the funds we want - we will not be able to hire Sam Deere long-term. His role going forward is still flexible, but it would include maintaining the GWWC website, since he is great at webdevelopment, and PR (which he has experience in from working in politics). It will likely include public speaking, and connecting with people in CSR departments. I think it would be a very bad outcome if we aren’t able to employ Sam long-term. He has a wide variety of extremely useful experience (webdevelopment, PR, social media, graphic design, writing and public speaking), and fits very well into the team. He very much increases our capacity to experiment in terms of time, skills and ideas.

Hauke Hillebrandt10y4

Thanks everyone for your interesting in GWWC research.

The purpose of GWWC doing research is fourfold:

Find very effective charities/interventions and add to Givewell’s research. In the past we might have influenced Givewell’s recommendations - see: https://drive.google.com/file/d/0B-ky1zIxhwx_aUZiY3ZfOWplTXd2ODF5aEt2aUJOU2dKWTFV/view?usp=sharing Our niche is to specialize on global poverty charities / interventions and we hope to continue to add to the knowledge base in this area. For instance, this means that we likely will not do much in-depth research on Marijuana legalization in Vermont. We also focus more on intervention effectiveness than operations and the financials of charities (even though we do shallow investigations on this). Givewell now has 18 Full-time staff (and is expanding), but many work on the Open Philanthropy project and not that many on their top charities. There are still relatively few independent evaluators in world working on the intersection of effectiveness under ideal trial conditions (efﬁcacy) and the effectiveness under large-scale programme conditions (effectiveness), and so I think it’s good to have more people working on this.
It’s also good to have some independent evaluation and peer-review of Givewell's research, even in the case of highly transparent organisations such as Givewell
Provide supervision for global poverty / effectiveness research projects to highly motivated students, in order to deeply involve them with EA.
Finally, if we want to scale and grow roughly exponentially to eventually consistently move many millions to effective charities every year, it’s important to have in-house expertise to inform and fact-check our outreach and marketing, and make us credible when recommending charities to our members.

Ben Kuhn10y2

It’s also good to have some independent evaluation and peer-review of Givewell's research, even in the case of highly transparent organisations such as Givewell

In the past, where has this led? Has your peer review uncovered any errors GiveWell has made? Or has it been more conceptual disagreements like the one over GiveDirectly?

Michelle_Hutchinson10y7

I don’t think there’s a clear cut-off between conceptual and empirical disagreements, and I think it’s really important for us to highlight agreement rather than disagreement. That’s partly because it’s easy to give yourself a pretext for not donating / not donating to charities you aren’t personally connected with, so we don’t want to give people the impression of argument where there isn’t any (think of people citing disagreements over vaccines causing autism, or over climate change, when really scientists all basically agree). And it’s partly because actually we do agree over all the fundamentals, and I’d really like to foster a friendly more collaborate atmosphere in effective altruism. For those reasons, while I’ll briefly mention a couple of examples where we’ve disagreed, please read them in the spirit of us being fundamentally very much on the same page and extremely grateful for the brilliant work GW do. These are simply my impression, and a reason we think our doing research is likely to have value despite GW’s excellent work. Times we’ve disagreed – GWWC didn’t recommend VillageReach (subsequently dropped by GW); GWWC continued recommending AMF over 2014 because we thought it was important AMF had continuity in donations in order to have leverage for making larger distribution agreements (GW has now stated they will recommend AMF for at least 2 years, for a similar reason); GWWC recommended both DWI and SCI earlier on than GW did.

Hauke Hillebrandt10y3

https://drive.google.com/file/d/0B-ky1zIxhwx_QVBBb3ZuaVR5dEU/view?usp=sharing

a lot of the research cited in this report has not been taken into account by Givewell I believe.

Also look at our recent report on SCI here:

https://www.givingwhatwecan.org/blog/2015-03-31/charity-update-ii-schistosomiasis-control-initiative-sci

where we cite research that hasn't been taken into account by Givewell as of yet.

We're also in contact with Givewell about their reports when we uncover errors (conceptual and factual). So far I've only had one email conversation with Givewell's Jake Marcus about what I perceived as a misinterpretation about the decline in worm burden with age - but we ended up agreeing that we have different interpretation of the statistics.

Ben Kuhn10y2

Hi Hauke, thanks for answering! I'm going to split up sub-questions into multiple comments so the threads don't get too tangled.

Our niche is to specialize on global poverty charities / interventions and we hope to continue to add to the knowledge base in this area. For instance, this means that we likely will not do much in-depth research on Marijuana legalization in Vermont. ... Givewell now has 18 Full-time staff (and is expanding), but many work on the Open Philanthropy project and not that many on their top charities.

It sounds like you think GiveWell isn't very focused on global poverty charities, but that's not true. Compared to GWWC, they devote both a larger absolute number of staff, and a larger fraction of their staff, to researching global poverty charities (they attribute about half of their costs to their traditional work here, which implies ~9 full-time-equivalent people working on the traditional work.)

Hauke Hillebrandt10y1

Oh sorry, I think I was not clear enough on this issue. I absolutely agree with you. Givewell is quite focused on global poverty issues. I do think that Givewell spends significantly more resources on research than we do. But as you said it's only ~9 full-time staff instead of 18 full time staff as one might think just looking at the staff page.

Ben Kuhn10y0

Provide supervision for global poverty / effectiveness research projects to highly motivated students, in order to deeply involve them with EA.

Cool, I hadn't thought about this one. What's the scope of this? How many students do you typically have working on the research? What's a typical student project?

Hauke Hillebrandt10y1

This year we'll have 3 summer interns for GWWC coming for 2-3 months and potentially a bit longer. Two of them will likely be substantially involved in research. I think this is somewhat representative of a typical GWWC summer internship cohort (Michelle might be able to add to this?). We also have students from the UK doing research projects with us part-time. Some are at Oxford and come in to talk in person and some we talk to over skype. I estimate that I have about 2-3 hours of meetings with them a week and then spend some time to give feedback on their research (or sometimes on their essays). We're currently trying to scale this up and get more volunteers.

Here's a recent report from one of our student volunteers Max on TB (which is still in manuscript form and is not published yet):

https://docs.google.com/document/d/1lEy4PuJHWVD0JQufb8FPyYm1bN5JYAiA6Ivoko5ROGY/edit?usp=sharing

you can find more of our students writing on our blog:

https://www.givingwhatwecan.org/blog

DavidNash10y4

"Why does GWWC continue to do charity evaluation research?"

I think it could be useful to have more than one organisation evaluating interventions, rather than having all our eggs in one basket. That doesn't mean it should be GWWC but I'm happy for there to be overlap, it will add verification to GiveWell's recommendations as well as potentially uncovering new ones.

GabrielEhrnstGrundin10y2

It is true that redundancy typically adds resilience to complex systems. But how much is this added resilience worth if you try to put a dollar amount on it? I think that what GWWC is doing overall is great, but I concur with Ben, it is a bit unclear at the moment what value GWWC adds in this regard.

Hauke Hillebrandt10y6

Thanks everyone for your interesting in GWWC research.

The purpose of GWWC doing research is fourfold:

Find very effective charities/interventions and add to Givewell’s research. In the past we might have influenced Givewell’s recommendations - see: https://drive.google.com/file/d/0B-ky1zIxhwx_aUZiY3ZfOWplTXd2ODF5aEt2aUJOU2dKWTFV/view?usp=sharing Our niche is to specialize on global poverty charities / interventions and we hope to continue to add to the knowledge base in this area. For instance, this means that we likely will not do much in-depth research on Marijuana legalization in Vermont. We also focus more on intervention effectiveness than operations and the financials of charities (even though we do shallow investigations on this). Givewell now has 18 Full-time staff (and is expanding), but many work on the Open Philanthropy project and not that many on their top charities. There are still relatively few independent evaluators in world working on the intersection of effectiveness under ideal trial conditions (efﬁcacy) and the effectiveness under large-scale programme conditions (effectiveness), and so I think it’s good to have more people working on this.
It’s also good to have some independent evaluation and peer-review of Givewell's research, even in the case of highly transparent organisations such as Givewell
Provide supervision for global poverty / effectiveness research projects to highly motivated students, in order to deeply involve them with EA.
Finally, if we want to scale and grow roughly exponentially to eventually consistently move many millions to effective charities every year, it’s important to have in-house expertise to inform and fact-check our outreach and marketing, and make us credible when recommending charities to our members.

Robert_Wiblin10y5

Michelle or Hauke can add more, but part of the answer is that being across the best research out there is crucial to our outreach.

People are willing to take our recommendations seriously because we show that we understand why these charities are excellent and are keeping tabs on them. We also need to be able to explain how these cost effectiveness estimates are arrived at, and generally say other smart things to be taken seriously. That isn't possible without someone working almost full time understanding the research that GiveWell and others are producing.

As a result, even if the research had no value in discovering new knowledge (which isn't true of course) and we were only focussed on outreach, we would probably want to have a researcher on our team (especially as we now have six people working on GWWC so can afford some specialisation).

Of course Hauke is actually turning up new points and looking into approaches for reducing poverty that we haven't looked at properly before and should be able to say something intelligent about.

Robert_Wiblin10y3

Hi Ben, thanks for these questions. I'll just field those that I'm well placed to answer.

"Which of the people on the "our team" page is paid by GWWC and how much time do the team members spend on it? Presumably Toby Ord and Andreas Morgensen do not work full time on GWWC if they're both professors, and Luke Ilott hasn't started yet; does that mean that GWWC is five full-time people right now?"

Toby and Andreas don't receive any income from GWWC and indeed are more part-time advisors than staff, though very valuable ones. You are right that Luke hasn't started yet, so there are five staff: Michelle, Jon, Alison, and the recent recruits Hauke and Sam.

"Out of curiosity, is there a timeline of how many full-time equivalent people were working at GWWC at any one time? It would be interesting to compare that to the growth data (which, by the way, it's super awesome that you make available!)"

Hmmm, I don't think we have a close record easily accessible, but going from my memory and averaging over people coming and going month-to-month:

Mid 2012- mid 2013 - 2 staff

Mid 2013- mid 2014 - 3 staff

Late 2014 - still 3 staff

2015 - Have gone from 3 to 5 staff

Late 2015 - 6 staff

GWWC, being an outreach organisation, has historically had a lot of interns and volunteers staying for 1-10 months. However, it would take me some time to get averages for those (because the lengths of stay and amounts of work are so irregular)! If anything that has been stable or somewhat decreasing over the last 3 years.

"I notice that you budgeted for volunteer interns as if you were paying them a standard hourly rate, which is great. However, I also notice that a lot of your growth strategy for next year involves leveraging local volunteers who aren't employed by GWWC per se. What would your estimated budget be like if these people's time was also included? And what is the reasoning behind omitting it?"

We reimburse interns (some) of their living expenses when they are here if they need it. As a result it actually costs money. Volunteers or interns working in chapters around the world don't get paid anything by us (or if they are, only very rarely). So there is no direct financial cost. In most cases we don't think those volunteers would be doing something similar to Giving What We Can (like say, earning a lot of money to donate) if they weren't on campuses encouraging people to give to effective charities, so we haven't counted it as having a significant opportunity cost that would interest donors.

"Why does GWWC continue to do charity evaluation research? This seems to have very high overlap with GiveWell's operations, while GiveWell has a much larger staff, more organizational focus on it, and moves more money to their recommendations. Obviously GWWC and GiveWell's recommendations differ somewhat, but is it really worth maintaining a separate research team and splitting the focus of GWWC between outreach and research?"

I've given one possible answer to this in the thread below.

"Just to check that I understand the numbers properly, your actual cash spent in 2014 was £120,000 and your actual cash spent in 2015 is expected to be £220,000, correct? How was the budget divided up last year? "

That's roughly right, yes.

"How was the budget divided up last year?"

I haven't done that breakdown for 2014 yet, but it will be very similar to 2013, which was 80-85% salaries and intern expenses support, 10% office rent, and 5-10% materials.

"What's the source of the increase?"

It's overwhelmingly new staff. Salaries/office rent has also increased about 10% in the last year (reflecting inflation and older/more experienced hires).

"If it's more staff, what will they be doing?"

I'll leave this one for Michelle as she can give the clearest answer.

"If you didn't raise as much funds as you wanted, which projects would get cut first?"

We would have to have one less staff member, very likely cutting back our media, talk and support for chapters. Again I'll leave Michelle to give a more precise answer.

Ben Kuhn10y0

Thanks Rob!

Toby and Andreas don't receive any income from GWWC and indeed are more part-time advisors than staff, though very valuable ones.

Cool. I think it would have been less confusing if the prospectus had explicitly noted this, since I only realized it because I read the bios closely and know some of what Toby has been up to.

We would have to have one less staff member, very likely cutting back our media, talk and support for chapters. Again I'll leave Michelle to give a more precise answer.

Can you give any more detail about what these operations looked like last year and what they accomplished? I can't find very much information about that in the prospectus.

Larks10y1

Hey, thanks for putting this out! Very attractive prospectus. I like the clear presentation of all the data in the appendices.

One question:

Historically, one concern people have had with GWWC is that its finances are mixed up with CEA, which has many other projects. As such, it's hard to be sure that our donations would actually benefit GWWC, as opposed to funding other projects that CEA wishes to support. CEA could reduce the amount of unrestricted funding it gives GWWC, thereby in effect diverting the donations away from GWWC. This seems like it would be pretty easy to do - CEA could simply alter the allocation of shared costs, if nothing else, or borrow GWWC staff. What sort of guarantees can you offer donors that their funding will actually benefit GWWC, even if CEA would prefer it to be allocated elsewhere?

Robert_Wiblin10y5

Hi Lark - until this year this hasn't been an issue. In the past unrestricted funds have been committed to projects ahead of time either as a fixed share of the total, or in proportion to restricted funding (which actually provides a sort of 'matching' of restricted donations).

This year unrestricted funds are going into a 'Trustees' Discretionary Fund'. This fund:

Can be used to ‘bail out’ projects in emergencies, though ideally it won’t be;
To kickstart new experiments with e.g. a six month runway;
To make grants to external and internal projects we think are awesome.

So it is possible that giving to GWWC will make it less likely that GWWC will draw money out of this TDF. However, I think it's fairly unlikely that GWWC will be so starved for cash that we will take that option; it's more likely that we would have 1 or 2 fewer staff than pull money out of the TDF. I also think that making sure CEA has money for new projects and grants is quite valuable. However if you thought i) GWWC was the only useful thing we were doing and ii) you thought GWWC's fundraising was likely to go very badly, then the issue you describe would be a consideration against giving.

Larks10y0

Thanks for your response. I have two follow up questions if that's ok.

Suppose GWWC successfully completes it's fundraiser, but then identifies some very attractive new projects, that the CEA Trustees agree are exceptionally high value. Would the Trustees be willing/able to use the discretionary fund to help support them?
At the moment part of GWWC's budget goes towards shared CEA central expenses, like rent and HR. Is this likely to increase in future? (i.e. is CEA central likely to hire anyone else, or GWWC's share increase ? )

Michelle_Hutchinson10y2

Yes - that would fall under 'grants to things we think are awesome'.
The budget in the document includes our portion of hiring a new staff for central, because CEA has been expanding and we expect to need that capacity next year. The office is unlikely to get much more expensive - we're hoping to sign another contract for 3 years soon. GWWC's share of central is likely if anything to fall, because it's becoming a smaller proportion of CEA given other new projects (early in 2014 we were paying 50% of central, but now GPP and EAO each pay a share). We're very happy to answer questions!

SamDeere10y0

Deleted, responded to Jon's new comment above

Curated and popular this week

Relevant opportunities