TLYCS has wrapped up the grass-roots, university focused pamphleting pilot that we posted about earlier this year. The entire writeup can be viewed here, but the major results (taken from the introduction) are given below. I'm happy to answer any questions in the comments, and if anyone wants to view the full data set we collected, I can talk with the folks at TLYCS about getting it to you. Thanks again for the helpful comments and critique you all provided at the outset of this pilot, and hopefully these results will be useful to someone down the line.

The Life You Can Save (TLYCS) ran a test-pilot for a grass roots pamphleting program during Spring of 2015. On five separate outings during May and June, roughly 3500 pamphlets were handed out to students on Los Angeles area university campuses. The metrics of interest for the pilot were the number of visitors to the TLYCS website generated by the pamphlets, and the associated cost per visitor.

In post-pilot analysis, the estimated acquisition rate of website visitors per-pamphlet for these outings was between 0.6 % and 1.1 %. This translates to a $125 to $70 cost per-website visitor at the $0.75 price-per-unit TLYCS paid for the pamphlets. However, this cost could be straightforwardly reduced to between $12 to $6 per-website visitor by more economically sourcing the pamphlets.

There is reason to believe that a more focused, strategic pamphlet design, along with offering an incentive in the pamphlet, could have driven up the acquisition rate. However, even a doubling of the rate would not have produced a per-visitor cost on par with TLYCS’s online advertising efforts. Therefore a decision was made in the wake of the pilot to discontinue the program.

 

FYI, the previous posts on this topic are:

http://effective-altruism.com/ea/dg/tlycs_pamphleting_pilot_program/

http://effective-altruism.com/ea/eh/tlycs_pamphleting_pilot_plan/

 

13

0
0

Reactions

0
0
Mentioned in
Comments7


Sorted by Click to highlight new comments since:

Thanks for writing this up, very interesting!

The cost presumably doesn't include the volunteer time to hand out the pamphlets? I would guess the time cost associated with pamphleting is much more than the time cost associated with online advertising, and that the difference there is even more significant than the pure monetary difference. (Particularly given that it sounds like there was quite a lot of coordination effort, as well as the actual handing out leaflets.)

On the other hand, if someone takes the trouble to go on the website from having been handed a leaflet, they seem plausibly much more likely to take further action than if they just clicked on a link online. Looking into the donations to top charities, as Zach suggests, could be indicative here (though I guess it would be very hard!).

Yeah, one of the main "unmeasurables" of the pilot was how much more of an impression a pamphlet, handed out by a real volunteer, can have on someone over an online add. This goes into the "touchpoint" theory, where it may take multiple exposures to an idea before someone bites; and maybe getting a pamphlet is a much stronger "touchpoint" than seeing an online add. I personally think that getting handed a pamphlet by a non-paid volunteer is a really powerful thing; and that's the reason that (again personally) I think that it would be great to see someone in the EA movement give a pamphleting program another shot, along the lines I sketched in the lessons learned (branded on EA, including multiple organizations, with a stronger, repeated ask).

We ran cost numbers including volunteer time and pamphlet development expenses, but I decided to ignore those for the final writeup, mainly because; the way we envisioned the program, the leaflets would be handed out on a volunteer basis by college students not paid TLYCS staff; and the cost of developing the pamphlets would amortize to a minimal effect over the lifetime of an ongoing pamphleting program. It's definitely a debatable decision though.

Any data on the effect of visiting the website on donations to highly-effective charities? I'm wondering what the return was. Also curious about the return to website ads to get a sense of the overall effectiveness of such outreach measures.

The difficulty of actually getting people to hand out pamphlets is interesting and, I think, an underrated reason why it's a difficult way to spread a cause.

Unfortunately, we could only track website visitors as far as clicking a "donate" button on TLYCS "Where To Donate" page (http://www.thelifeyoucansave.org/Where-to-Donate). After clicking the button they are directed to the individual charity website, so we don't have visibility into if they actually followed through with making a donation, or how much that donation was.

That being said, we only had one visitor that plausibly came from the pamphlets that clicked a donate button; if we had paid closer to Vegan Outreach prices for the pamphlets ($0.07), the cost of the 3500 pamphlets would have been about $245, and so the donation would have had to be on that level to get parity. Would definitely have been an interesting data point to see if / how much our clicker actually donated.

Unfortunately, we could only track website visitors as far as clicking a "donate" button on TLYCS "Where To Donate" page (http://www.thelifeyoucansave.org/Where-to-Donate). After clicking the button they are directed to the individual charity website, so we don't have visibility into if they actually followed through with making a donation, or how much that donation was.

Does LYCS have any estimates which speak to that, even tangentially, for instance for it's general impact evaluations?

They must have some visibility into how many people are donating via their website, because they release yearly estimates for money moved. I'm not sure exactly how they go about doing this; it can't be via TLYCS website analytics though, so maybe they work with the charities themselves to track donations originating from TYLCS. I only partnered up with them for this study, so unfortunately I don't have any details.

TLYCS's (very) rough estimate is that on average each "donate click" equates to ~$100 in donations. However, that's on overall average for our site, so my guess for a new visitor, currently enrolled in college, would be significantly lower.

As a reminder, TLYCS also expects to generate a multiplier on its expenditures, so the true breakeven cost would have to be <33% or so of the expected donations.

Sorry to take so long to respond to this!

Curated and popular this week
 ·  · 23m read
 · 
Or on the types of prioritization, their strengths, pitfalls, and how EA should balance them   The cause prioritization landscape in EA is changing. Prominent groups have shut down, others have been founded, and everyone is trying to figure out how to prepare for AI. This is the first in a series of posts examining the state of cause prioritization and proposing strategies for moving forward.   Executive Summary * Performing prioritization work has been one of the main tasks, and arguably achievements, of EA. * We highlight three types of prioritization: Cause Prioritization, Within-Cause (Intervention) Prioritization, and Cross-Cause (Intervention) Prioritization. * We ask how much of EA prioritization work falls in each of these categories: * Our estimates suggest that, for the organizations we investigated, the current split is 89% within-cause work, 2% cross-cause, and 9% cause prioritization. * We then explore strengths and potential pitfalls of each level: * Cause prioritization offers a big-picture view for identifying pressing problems but can fail to capture the practical nuances that often determine real-world success. * Within-cause prioritization focuses on a narrower set of interventions with deeper more specialised analysis but risks missing higher-impact alternatives elsewhere. * Cross-cause prioritization broadens the scope to find synergies and the potential for greater impact, yet demands complex assumptions and compromises on measurement. * See the Summary Table below to view the considerations. * We encourage reflection and future work on what the best ways of prioritizing are and how EA should allocate resources between the three types. * With this in mind, we outline eight cruxes that sketch what factors could favor some types over others. * We also suggest some potential next steps aimed at refining our approach to prioritization by exploring variance, value of information, tractability, and the
 ·  · 5m read
 · 
[Cross-posted from my Substack here] If you spend time with people trying to change the world, you’ll come to an interesting conundrum: Various advocacy groups reference previous successful social movements as to why their chosen strategy is the most important one. Yet, these groups often follow wildly different strategies from each other to achieve social change. So, which one of them is right? The answer is all of them and none of them. This is because many people use research and historical movements to justify their pre-existing beliefs about how social change happens. Simply, you can find a case study to fit most plausible theories of how social change happens. For example, the groups might say: * Repeated nonviolent disruption is the key to social change, citing the Freedom Riders from the civil rights Movement or Act Up! from the gay rights movement. * Technological progress is what drives improvements in the human condition if you consider the development of the contraceptive pill funded by Katharine McCormick. * Organising and base-building is how change happens, as inspired by Ella Baker, the NAACP or Cesar Chavez from the United Workers Movement. * Insider advocacy is the real secret of social movements – look no further than how influential the Leadership Conference on Civil Rights was in passing the Civil Rights Acts of 1960 & 1964. * Democratic participation is the backbone of social change – just look at how Ireland lifted a ban on abortion via a Citizen’s Assembly. * And so on… To paint this picture, we can see this in action below: Source: Just Stop Oil which focuses on…civil resistance and disruption Source: The Civic Power Fund which focuses on… local organising What do we take away from all this? In my mind, a few key things: 1. Many different approaches have worked in changing the world so we should be humble and not assume we are doing The Most Important Thing 2. The case studies we focus on are likely confirmation bias, where
 ·  · 1m read
 · 
I wanted to share a small but important challenge I've encountered as a student engaging with Effective Altruism from a lower-income country (Nigeria), and invite thoughts or suggestions from the community. Recently, I tried to make a one-time donation to one of the EA-aligned charities listed on the Giving What We Can platform. However, I discovered that I could not donate an amount less than $5. While this might seem like a minor limit for many, for someone like me — a student without a steady income or job, $5 is a significant amount. To provide some context: According to Numbeo, the average monthly income of a Nigerian worker is around $130–$150, and students often rely on even less — sometimes just $20–$50 per month for all expenses. For many students here, having $5 "lying around" isn't common at all; it could represent a week's worth of meals or transportation. I personally want to make small, one-time donations whenever I can, rather than commit to a recurring pledge like the 10% Giving What We Can pledge, which isn't feasible for me right now. I also want to encourage members of my local EA group, who are in similar financial situations, to practice giving through small but meaningful donations. In light of this, I would like to: * Recommend that Giving What We Can (and similar platforms) consider allowing smaller minimum donation amounts to make giving more accessible to students and people in lower-income countries. * Suggest that more organizations be added to the platform, to give donors a wider range of causes they can support with their small contributions. Uncertainties: * Are there alternative platforms or methods that allow very small one-time donations to EA-aligned charities? * Is there a reason behind the $5 minimum that I'm unaware of, and could it be adjusted to be more inclusive? I strongly believe that cultivating a habit of giving, even with small amounts, helps build a long-term culture of altruism — and it would