All of salonium's Comments + Replies

Yeah, these are great!

As head of the WHO for a day, what is the first concrete action you would take?

I feel like it would be a cop out to say that my first concrete action would be to spend a lot of time working out what's actually happening on the inside at different levels and how the teams are working together.

But maybe one idea would be to have some independent organisation evaluate some of the WHO's recent & historical programs — e.g. How did they manage to eradicate smallpox? Why did their other eradication programs fail? and similarly for t... (read more)

3
Angelina Li
That's really interesting, thanks! I don't have a great idea of what editors for journals do, and it's interesting to me that you're involved so early in the writing journey vs receiving a mostly complete piece. Thanks for the answer!

To me, the big thing that feels missing is a clear sense of what, concretely, individuals can do about global health and foreign aid. There’s so much (often depressing) news right now, and I think journalism tends to cover global health and foreign aid as distant problems that feel hard to relate to. From my experience, what motivates people is the sense of connection: knowing that their actions can actually make a real difference to people. I think it helps to frame this more as a shared societal problem — things that anyone could face if they were in tha... (read more)

Thanks for the question!

In a way, it's quite to really understand and imagine - my life would probably be very different if that was the case, and I doubt that I'd have the same education, qualifications, and sometimes also skills if that was the case. 

But I'd probably still be interested in something quantitative - maybe I'd apply to work at Data For India (which feels like a very close alternative to OWID), or try to work as an economist, data journalist or researcher in some way.

Maybe the most helpful thing to do, though, would be to explain some o... (read more)

I've often thought that innovation and policy were underrated.

With innovation I'm often thinking: rather than choosing from existing tools that are already cost-effective, can we make new tools that are cheaper, more effective, or easier to scale up? And if that's the case, we should be investing more in them.

With global health policy as well, market-shaping, regulation, and other incentives often seem like they can make a much larger impact than traditional EA targets. I think about this less often these days though, after knowing more EAs. Maybe I just didn't know people who were already thinking about these issues? Or they've shifted focus?

Answering Seb's question: 'Is AI for science underrated or overrated?'

Can I cheat by saying both?

Say we’re thinking about AI and protein structure prediction for drug discovery, for example. I’m quite excited about what that could make possible - it could help narrow down potential drug targets, improve our understanding of protein structure and function, and also give us a better sense of which drugs might fit particular protein structures. Protein design is also really exciting, including improving proteins or enzymes that are used as drugs or in industr... (read more)

Great question! I think there are two ways to answer this — one is whether we can predict completed cohort fertility rates in advance, and the other is whether we should rely on other metrics instead.

On predicting cohort fertility rates:

To some degree, I think we can. One way is with tempo-adjusted fertility rates, where you look at the average age of mothers giving birth in a given year and how that has changed over time, then adjust the total fertility rates accordingly. I’m slightly skeptical of this though, because the average age isn’t always that inf... (read more)

I think the biggest ones are being able to put studies into context and convey accurately how much confidence people should have in them. 

I often see people hype up early-stage drug candidates as breakthroughs without conveying that they'll go through much more testing to confirm their efficacy & safety. 

I think that's a shame because it gives people a misleading picture of what's actually likely to work, might lead to disappointment later on & pessimism in science more broadly, and also means hearing about the wrong things - there often ... (read more)

Great question!

There are currently three or four areas I'm really looking out for at the moment:

  1. The Demographic and Health Surveys, which were collecting various types of data from many lower- and middle-income countries on population sizes, maternal and child health, urban living, income, water & sanitation, etc. and were terminated earlier this year. It costs around $40M per year. I think that's modest for such a large program, but also because it feeds into a very wide range of datasets used by researchers on many topics. Some of the data it collect
... (read more)

Nice question!

Oh I started responding to this with a list of three but then re-read the question and you only asked for one. But here are two of my favourites:

... (read more)
3
Angelina Li
<3 just read the post and I found it a fun read! Man, successful public health initiatives are so great :') Definitely one of the more inspiring things about humanity. True, it's cool that we have large scale data on this -- nice graphs! Thanks for sharing :)

Thanks so much!

Great questions. Just for context, the Demographic and Health Surveys were primarily funded by USAID but that funding was terminated by the Trump administration in February. It involved surveys roughly every five years per country, for over 90 low- and middle-income countries worldwide since it started in 1985.

I think there are two parts to this: one is about the surveys that had started and were meant to be completed this year or next (that was in ~23 countries) and the other is about the longer-term future of the program.

I'm hopeful that t... (read more)

Very tough question... perhaps the toughest one here. Pistachio, honeycomb, and dulce de leche are probably my favourites, but maybe there are other exotic flavours out there I haven't tried yet. (I did try 'beer flavoured gelato' once and it was terrible.)

Re: Bad Data Takes's question:

This takes me back! I guess I've always enjoyed writing and explaining things I was learning about, but I started writing freelance pieces during my masters degree and PhD, including writing about the Covid response in the UK. 

Roughly then, Sam Bowman and I had the idea to start a magazine together for long-form writing on science and economics, which turned into Works in Progress magazine. 

For one of our early issues, I reached out to Hannah Ritchie at Our World in Data to ask if she was interested in writing a piec... (read more)

I think that's a fair point, but I had already found several other reasons to pledge persuasive and this tipped the case over the edge.

Thank you, that's really helpful – will share it with friends since I'm not American. I wonder if this is something we could coordinate on as a community, with people from different states, if that could be more impactful?

4
Vilfredo's Ghost
It would be helpful to know who the key members of Congress to persuade are. The value of contacting your rep/senators likely varies a lot depending on where you live. 

I'm also unsure about how much substance there is to it, but what I've read so far agrees with your impression. From this Foreign Policy article last month:


In a statement, Rep. Chris Smith, chair of the House global health subcommittee, cited a letter signed by 131 African religious leaders and lawmakers in countries with some of the harshest laws around abortion including Nigeria and Uganda. Quoting the letter, he urged that PEPFAR “not cross over into promoting divisive ideas and practices that are not consistent with those of Africa.”

Yet there is no con

... (read more)
3
Ming Ong
FWIW, the WH after some delay put out a policy position on the Ugandan legislation, with specific language around PEPFAR.

Great post!

You gave lots of good examples of low-cost high-impact interventions like water chlorination, vaccines and lead removal. I agree that there are far more examples like that, particularly in health & medicine, which we already know about but where the scale of the benefits is underestimated. Water chlorination is a particularly good example because it's one where the large benefits were expected by experts but were surprising to others.

And thank you for linking to my article on RCTs, the arguments you made above were actually a big part of the reason that I wrote that!

I think my phrasing might have been unclear earlier – I'm Nick's colleague at Works in Progress, but not on the blog prize and don't have any involvement there.

1. I think that blogs fill a different purpose to many other formats you mention, but are also more feasible than writing long-form: for people who have other commitments, for writing short commentaries, for responding to topical events or stories, for publishing independent parts of a series in a way that makes each part more shareable. I'm sure you can think of many examples of each of these. I th... (read more)

This is an interesting critique! I think it misses a lot, though, so would like to push back on it. 
Full disclosure/conflict of interest – I'm one of Nick's colleagues – we're both editors at Works in Progress.

1) Blogs are short content. – I think a lot of your critiques here (that they become outdated quickly, don't provide much long-term value, fall prey to replication crises) actually apply to all forms of published, static content – newspapers, tweet threads, newsletters, books, etc. We've all heard of books and news content that have aged badly –... (read more)

-3
niplav
Thanks for the detailed answer :-) 1. I list this ageing as a drawback of blogs because it is in practice, if not in theory (and the structure of blogs encourages this). Safe some exceptions (SSC for minor stylistic edits, Nintil) blogs are usually not maintained in any way. I guess my complaint is that it would be entirely possible for this maintenance to occur (unlike with tweets/newspapers/books), but it usually doesn't happen. The structure of blogs doesn't encourage this either: usually arranged chronologically, not by topic, with a focus on novelty. As for reading archives, there is certainly a style of blog that is in practice not linked very often in the long term (I'm thinking of Overcoming Bias or Marginal Revolution or Econlog). 1. I don't object to the posts being unfinished! That would be quite hypocritical of me :-) My argument is that here, the incentives are structured such that it's much more likely that people will start a blog because of the prize, and once it's over, they abandon it. I admit to the point that the prize will probably push marginal not-yet-bloggers over the edge. Interesting! I thought I was absolutely making that point, especially in this section and especially especially in this section. 1. Maybe I wasn't as clear here as I could have been, but I didn't want to discourage the bloggers on your site. But to be absolutely clear: 1. Yeah, you're probably right about this one. Maybe it's that I think that a prize is not the perfect way to approach this: Prizes seem to be useful for very discrete problems that have a very clear solution criterion, and less useful for very long-term, open-ended endeavours (where something like certificates of impact or retroactive funding are more suited). 1. I should have been clearer about this: I think blogs are in an odd position in the discourse—there is much more discourse going on on Twitter/YouTube/Discord (?) than on blogs, and I believe that this will not change much (newsletters

Hey Stephen, thanks very much!

I completely agree with you on the differences between clinical RCTs and development/public policy RCTs. 

Part of the reason for that is that it was originally meant to be a longer piece, with some policy RCT examples, how clustering works, etc. but it was already fairly long, and those were harder to explain concisely. And secondly simply because I have a background in health/medicine, which meant it was easy to draw examples from the field.

Hopefully I signposted this a little by saying that the procedures I mention are t... (read more)

Oh, I remember reading this paper now! It's great, thanks for sharing.

And thank you very much :) I will be here more often for sure.

Thank you very much! 

Is there a paper by him you would recommend reading on the topic? I've seen this one, which I agree with in parts – with good theory and evidence from other research on which policies work, there's less need for RCTs, but I think there's a role for both to answer different questions.

3[anonymous]
most of his blogs for centre for global development are relevant. His recent paper on "randomizing development: method or madness?" contains most of his main arguments. He also has a blog called Lantrant where he frequently criticises the use of RCTs in economics. In my view, almost all of his critiques are correct.

Great post! I thought this was a very clear and useful summary of the literature, and all the links and references are very helpful.

You mention the difficulties in comparing happiness between countries towards the end, do you have a view on how big of a problem these issues are for measuring happiness across the lifespan? Or views on the age-happiness curve more generally?

Also, in case you hadn't seen it already, I found this post by Pew Research Centre a very useful summary of various problems in questionnaire design (some of which you mention, e.g. acquiscence bias), and how they try to get around them.

3
Alexander de Vries
Thanks! Glad this works well as a summary. I haven't looked into the age-happiness curve all that much, but from the studies I have read, I think it's a bit suspicious that none of them seem to control for ERS. If ERS really is U-shaped (seems like a slight majority opinion), then a lot or even all of the age-happiness curve could be explained by that. Then again, surely someone  in the field would have found that out by now if it were true, right? Might look into it further in a future post Thanks for the link! I hadn't seen it before, definitely useful information.

If you do find it, I'd be interested to read that. 

I would guess that  it's difficult for people to intuitively understand precisely why randomization is so useful, although other aspects of RCTs are probably easier to grasp – particularly, the experimental part of giving treatment A to one group and treatment B to another group and following up their outcomes. But overall I think I would agree with you; people need less understanding of confounders and selection bias to read an RCT than they'd need to read an observational study.

2
So-Low Growth
I think it's this paper http://evavivalt.com/wp-content/uploads/Weighing-the-Evidence.pdf. Fwiw, all of Eva's papers are worth reading! Sidenote - love your work and WiP (I'm also part of the PS community). Hope to see you on the EAF again!

Hey Marius, thank you!

I wish I could answer this better, but I don't know enough to have a good answer to how to scale policy RCTs, especially since they're quite different from clinical RCTs (they often can't administer the treatment in a standardised way, there's usually no way to blind participants to what they're receiving, they usually don't track/measure participants as regularly, etc.) Though those are also factors that make them messier in larger projects. 

I've read this blog post by Michael Clemens, which I found was a useful summary of two b... (read more)

3[anonymous]
I enjoyed your post a lot. Lant Pritchett is a prominent critic of using RCTs for large scale social interventions - he might be worth reading.