Mjreard

Programs team @ LawAI
747 karmaJoined Working (6-15 years)Seoul, South Korea
bit.ly/mattreardon

Bio

Building out LawAI's research fellowships and public-facing educational programming

How others can help me

Apply to our summer research fellowship. Have you or the lawyer/law student in your life flag their existence to me.

Follow me on Twitter and listen to my podcast (search for "actually after hours" on YouTube or podcast apps)

Comments
52

Not thinking very hard. I think it's more likely to be an overestimate of the necessary disparity than an underestimate. 

There are about 500m humans in tractably dire straits, so if there were 500t animals in an equivalently bad situation, you might be very naïvely indifferent between intervening on one vs the other at a million to one. 500t is probably an oom too high if we're not counting insects and several ooms too low if we are. 

I think the delta for helping animals (life of intense suffering -> non-existence) is probably higher (they are in a worse situation), tractability is lower, but neglectedness is way higher such that careful interventions might create compounding benefits in the future in a way I don't think is very likely in global health given how established the field is. 

You'd have to value animals at ~millionths of humans for scale and neglectedness not to be dispositive. Only countervailing considerations are things around cooperativeness, positive feedback loops, and civilizational stability, all of which are speculative and even sign uncertain

Quoted Zvi here seems to fail at some combination of thinking on the margin and distinguishing means and ends. GiveWell_USA is also not what Zvi's take implies you should do.

Quoted Zvi emphasizes that functioning, long-run-sustainable groups/societies are necessary for achieving big things in the world. If you wholly neglect in-group beneficence, your group will fail, and you'll fail at whatever big thing you were trying to do. This is true and I think any sensible EA acknowledges it. 

What is not true and potentially down-right-silly, is saying that in-group beneficence must therefore become your terminal goal. I fear that's what this post suggests. 

If your terminal goal is global well-being, you should do whatever amount of in-group beneficence maximizes global well-being. And crucially, it is extremely implausible this amount is 100% of your effort or anything close to that. People watch Netflix and buy Range Rovers – these do nothing for their communities, yet no one worries the communities where people do these things are at risk of failure. In fact, the leisure hours and number of nice cars are often how community success is measured. That's because these consumer goods are treated as terminal goods. Other things can fill that role with similarly low risk to group sustainability. 

I think quoted Zvi is attacking a strawman EA who neglects all his relationships and investments to give his last scrap of food to the poor right now. Yes, that strawman EA's movement won't last long. EAs with good jobs getting promotions donating 10% or building highly-functional, well-paying non-profits are not that straw man though. They just notice that the marginal income/effort others put towards nicer cars and bigger houses can be applied to something more meaningful.

Separately, I don't think GiveWell_USA is what Zvi's quote has in mind. Neighbors and co-nationals are arbitrary groupings in more ways than just morally. I think Zvi's suggestion is to invest in especially reciprocal and compounding relationships for you and your people defined by some measure you care about. For most people this is a cluster of family and close friends, for rationalists, I think it's other rationalists, maybe churches, I don't know. I suppose you could choose the US as your tribe, but reciprocity is going to be a lot weaker than in the previous examples and will thereby suffer from Zvi's critique. An American Patriots Union building lots of tiny homes for the American homeless [1] might well see it's coffers and membership run dry after a few decades of none of the people they housed feeling particularly inclined to join or otherwise help the APU in particular. Nothing about the beneficiaries being American made this inherently more reciprocal than bednets for foreigners. 

If what you want is a guide on how to build a group that endlessly accumulates social capital and never deploys that capital to any end in particular, I think the partnership of major law/consulting/finance firms or the major political parties are the right models to work with. I just don't think those groups' practice of self-interest is worthwhile compared to saving lives.    

  1. ^

    let's say hypothetically this is the most QALYs/$ you can do in the US

All fair points. My biggest point of disagreement is (2). As a true example, only around a third of EAG(x) attendees have applied for advising. That's a much more expensive program for both the org and the participant. Tons of relevant people effectively don't know advising exists (e.g. maybe they've heard of it once, but if it didn't make it to the top of their stack that day, they forget about it). Importantly, our highest counterfactual comes from talking to only modestly engaged people, so maybe people who've done some reading but only know 1-2 other EAs – I see this program being aimed at these not-highly-engaged people makes the call more worthwhile, not less. "You were up for a call if someone leaned on you a bit," seems roughly ideal to me.

I would guess that thinking more about the value of high impact career plan changes and accelerations would make a $50,000 experiment in scaling them seem not-excessive.

For example, it's not unusual that hiring manager will say the first-best candidate for a role is 25% better than a second-best candidate. If the role pays $100,000/yr, naïvely, a single plan change coming from these calls pays for half the program. A bit less naïvely, people at top orgs are often paid multiples less than a grantmaker's willingness to forgo donations, so perhaps one year of work from one change pays back the whole investment. 

Now of course advising can't claim full credit for the change, this is always divided among many sources/investments, but careers are 20+ years long post-change too. So accelerations will count for less and of course we're hoping to drive multiple changes here.

A summary frame is that getting the right people into the right roles is high stakes and the cost of missing the best people is extremely high. 

This all turns on the ability of the program to generate calls and calls to generate changes of course, so for some number of calls, this program will look bad. FWIW, we're currently near the worst case scenario (10 qualified referrers with 2 calls each), but still within ~7x of average call cost. I'm hoping we can bring that down to 2-3x this month. I think the question then becomes whether you think advising overall is excessive, which is a separate conversation. Though it's worth noting that everyone who's looked at the program would ~emphatically disagree. 

I take responsibility for the current situation. I substantially overestimated my ability to get this program in as many minds as I'd hoped to. Please help me remedy this!

One last thing I'll highlight is that I expect people who qualify for and win the grants to be pretty engaged and agentic EAs who will use $5,000 very well to advance their careers and create good down the line. I think this is very substantially different from a cash reward. 

Have you listened to 80k Actually After Hours/Off the Clock? This is close to what I was aiming for, though I think we still skew a bit more abstract. 

The bar for contributing is low. I think the high bar you contrast this with is the bar for being hired or paid to contribute, which is indeed high in the conventional sense. 

This is an important distinction because people should not equate contributing with being hired/paid as I think they often do. If you think AI risk is the most important problem, you should strive to move further on the continuum of contribution regardless of whether you cross the threshold of being hired. 

I also got the sense that some kind of averaging consideration (or inverse prioritarianism, where the flourishing of the ~90th percentile along some dimension) was the essential thing for vitalists. Helping the weakest be stronger doesn't count when your concern is the peak strength of the strongest. 

It's very much an aesthetically grounded, rather than experientially- or scale-grounded ethics.  

This is 80k's first in-person HQ video pod too! I (and I imagine the podcast team) are very interested in feedback on this. 

The argument for Adequate temporal horizon is somewhat hazier

 

I read you suggesting we'd be explicit about the time horizons AIs would or should consider, but it seems to me we'd want them to think very flexibly about the value of what can be accomplished over different time horizons. I agree it'd be weird if we baked "over the whole lightcone" into all the goals we had, but I think we'd want smarter-than-us AIs to consider whether the coffee they could get us in 5 minutes and one second was potentially way better than the coffee they could get in five minutes, or they could make much more money in 13 months vs a year. 

Less constrained decision-making seems more desirable here, especially if we can just have the AIs report the projected trade offs to us before they move to execution. We don't know our own utility functions that well and it's something we'd want AIs to help with, right? 

Load more