I work on AI Governance at Open Philanthropy. Comments here are posted in a personal capacity.
I'm not officially part of the AMA but I'm one of the disagreevotes so I'll chime in.
As someone who's only recently started, the vibe this post gives of it being hard for me to disagree with established wisdom and/or push the org to do things differently, meaning my only role is to 'just push out more money along the OP party line', is just miles away from what I've experienced.If anything, I think how much ownership I've needed to take for the projects I'm working on has been the biggest challenge of starting the role. It's one that (I hope) I'm rising to, but it's hard!In terms of how open OP is to steering from within, it seems worth distinguishing 'how likely is a random junior person to substantially shift the worldview of the org', and 'what would the experience of that person be like if they tried to'. Luke has, from before I had an offer, repeatedly demonstrated that he wants and values my disagreement in how he reacts to it and acts on it, and it's something I really appreciate about his management.
I think 1 unfortunately ends up not being true in the intensive farming case. Lots of things are spread by close enough contact that even intense uvc wouldn't do much (and it would be really expensive)
I wouldn't expect the attitude of the team to have shifted much in my absence. I learned a huge amount from Michelle, who's still leading the team, especially about management. To the extent you were impressed with my answers, I think she should take a large amount of the credit.
On feedback specifically, I've retained a small (voluntary) advisory role at 80k, and continue to give feedback as part of that, though I also think that the advisors have been deliberately giving more to each other.
The work I mentioned on how we make introductions to others and track the effects of those, including collaborating with CH, was passed on to someone else a couple of months before I left, and in my view the robustness of those processes has improved substantially as a result.
This seems extremely uncharitable. It's impossible for every good thing to be the top priority, and I really dislike the rhetorical move of criticising someone who says their top priority is X for not caring at all about Y. In the post you're replying to Chana makes the (in my view) virtuous move of actually being transparent about what CH's top priorities are, a move which I think is unfortunately rare because of dynamics like this. You've chosen to interpret this as 'a decision not to have' [other nice things that you want], apparently realised that it's possible the thinking here isn't actually extremely shallow, but then dismissed the possibility of anyone on the team being capable of non-shallow thinking anyway for currently unspecified reasons.
editing this in rather than continuing a thread as I don't feel able to do protracted discussion at the moment:
I'm fairly disappointed with how much discussion I've seen recently that either doesn't bother to engage with ways in which the poster might be wrong, or only engages with weak versions. It's possible that the "debate" format of the last week has made this worse, though not all of the things I've seen were directly part of that.
I think that not engaging at all, and merely presenting one side while saying that's what you're doing, seems better than presenting and responding to counterarguments (but only the weak ones), which still seems better than strawmanning arguments that someone else has presented.
Thank you for all of your work organizing the event, communicating about it, and answering people's questions. None of these seem like easy tasks!
I'm no longer on the team but my hot take here is that a good bet is just going to be trying really hard to work out which tools you can use to accelerate/automate/improve your work. This interview with Riley Goodside might be interesting to listen to, not only for tips on how to get more out of AI tools, but also to hear about how the work he does in prompting those tools has rapidly changed, but that he's stayed on the frontier because the things he learned have transferred.
Hey, it's not a direct answer but various parts of my recent discussion with Luisa cover aspects of this concern (it's one that frequently came up in some form or other when I was advising), in particular, I'd recommend skimming the sections on 'trying to have an impact right now', 'needing to work on AI immediately', and 'ignoring conventional career wisdom'.
It's not a full answer but I think the section of my discussion with Luisa Rodriguez on 'not trying hard enough to fail' might be interesting to read/listen to if you're wondering about this.
Responding here to parts of the third point not covered by "yep, not everyone needs identical advice, writing for a big audience is hard" (same caveats as the other reply):
"And for years it just meant I ended up being in a role for a bit, and someone suggested I apply for another one. In some cases, I got those roles, and then I’d switch because of a bunch of these biases, and then spent very little time getting actually very good at one thing because I’ve done it for years or something." - are you sure this is actually bad? If each time you moved to something 10x more effective, and then at some point (even if years later) settled into learning your job and doing it really well, it might still be.. good?
No, I don't think it's always bad to switch a lot. The scenario you described, where the person in question gets a 1 OOM impact bump per job switch and then also happens to end up in a role with excellent personal fit is obviously good, though I'm not sure there's any scenario discussed in the podcast that wouldn't look good if you made assumptions that generous about it.
Alex, regarding "The next time I’m looking at options is in a couple of years." - would you endorse this sort of thing for yourself? I mean, I'm guessing it would be a big loss if you weren't in 80k, and if (now) you weren't in OP. I do think it would be reasonable to have you take even a whole day of vacation each week in order to make sure you get to OP 1-2 years sooner. [not as a realistic suggestion, I don't think you could consider career options for a whole day per week, but I'm saying that the value of you doing exploration seems pretty high and would probably even justify that. no? or maybe the OP job had nothing to do with your proactive exploration]
The thing I describe as being my policy in the episode isn't a hypothetical example, it's an actual policy (including the fact that the bounds are soft in my case, i.e. I don't actively look before the time commitment is through, and have a strong default but not an unbreakable rule to turn down other opportunities in the meantime. I think that taking a 20% time hit to look for other things would have been a huge mistake in my case. The OP job had nothing to do with proactive exploration, as I wasn't looking at the time (though having got through part of the process, I brought the period of exploration I'd planned for winter 2023 forward by a few months, so by the time I got the OP offer I'd already done some assessment of whether other things might be competitive).
My own opinion here is that people are often just pretty bad at considering alternatives. Time spent in considering alternatives just isn't so effective, so deciding to "only spend X time" doesn't seem to solve the problem, I think.I do think that talking to someone like an 80k advisor is a pretty good magic pill for many people. 80k does have a sense of what careers a certain person might get, and also has a sense of "yeah that is actually super useful", plus 100 other considerations that it's pretty hard to figure out alone imo. It also overcomes impostor syndrome (people not even considering jobs that seem to senior regardless of how long they spend thinking) and so on.I acknowledge this doesn't scale well
My own opinion here is that people are often just pretty bad at considering alternatives. Time spent in considering alternatives just isn't so effective, so deciding to "only spend X time" doesn't seem to solve the problem, I think.
Not 100% sure I followed this but if what you're saying is "don't just sit and think on your own when you decide to do the career exploration thing, get advice from others (including 80k)", then yes, I think that's excellent advice. In making my own decision I, among other things: