I quit trying to have direct impact and took a zero-impact tech job instead.
I expected to have a hard time with this transition, but I found a really good fit position and I'm having a lot of fun.
I'm not sure yet where to donate extra money. Probably MIRI/LTFF/OpenPhil/RethinkPriorities.
I also find myself considering using money to try fixing things in Israel. Or maybe to run away first and take care things and people that are close to me. I admit, focusing on taking care of myself for a month was (is) nice, and I do feel like I can make a difference with E2G.
Congrats Yonatan! Good luck deciding where to donate! Seems like there are a lot of good options now.
5
Dawn Drescher
Yeah, ETG seems really strong to me at the moment! What do you think is a good threshold for the average EA in terms of annual USD donations that they can make at which they should seriously consider ETG?
4
Yonatan Cale
TL;DR: The orgs know best if they'd rather hire you or get the amount you'd donate. You can ask them.
I'd apply sometimes, and ask if they prefer me or the next best candidate plus however much I'd donate. They have skin in the game and an incentive to answer honestly. I don't think it's a good idea to try guessing this alone
I wrote more about this here, some orgs also replied (but note this was some time ago)
(If you're asking for yourself and not theoretically - then I'd ask you if you applied to all (or some?) of the positions that you think are really high impact. because if not - then I think once you know which ones would accept you, and once you can ask the hiring managers things like this, then your dillema will become much easier, almost trivial)
6
Dawn Drescher
Thanks! Yeah, I've included that in the application form in one or two cases in the hope it'll save time (well, not only time – I find interview processes super stressful, so if I'm going to get rejected or decline, I'd like (emotionally) for that to happen as early as possible) but I suppose that's too early. I'll ask about it later like you do. I haven't gotten so far yet with any impact-focused org.
6
Yonatan Cale
Seems to me from your questions that your bottle neck is specifically finding the interview process stressful.
I think there's stuff to do about that, and it would potentially help with lots of other tradeoffs (for example, you'd happily interview in more places, get more offers, know what your alternatives are, ..)
wdyt?
4
Dawn Drescher
That makes a lot of sense! I've been working on that, and maybe my therapist can help me too. It's gotten better over the years, but I used to feel intense shame over mistakes I made or might've made for years after such situations, so that I'm still afraid of my inner critic. Plus I feel rather sick on interview days, which is probably the stress.
I have thoughts on how to deal with this. My priors are this won't work if I communicate it through text (but I have no idea why). Still, seems like the friendly thing would be to write it down
My recommendation on how to read this:
If this advice fits you, it should read as "ah obviously, how didn't I think of that?". If it reads as "this is annoying, I guess I'll do it, okay...." - then something doesn't fit you well, I missed some preference of yours. Please don't make me a source of annoying social pressure
Again, for some reason this works better when speaking than in writing. So, eh, ... idk.. imagine me speaking?? get a friend to read this to you?
(whatever you chose, consider telling me how it went? this part is a mystery to me)
So,
TL;DR:
The goal of interviews is not to pass them (that's the wrong goal, I claim). The goals I recommend are:
Reducing uncertainty regarding what places will accept you. (so you should get many rejections, it's by-design, otherwise you're not searching well)
Practicing interviews. Interviews are different than actual work, and there's skill to build there. So after interviews, I'll review stuff I didn't know, and I'll ask for feedback about
1.a. and b.: Reframing it like that sounds nice! :-D Seems like you solved your problem by getting shoes that are so cool, you never want to take them off! (I so wouldn't have expected someone to have a problem with that though…) I usually ask for feedback, and often it's something like “Idk, the vibe seemed off somehow. I can't really explain it.” Do you know what that could be?
2. I'm super noncompetitive… When it comes to EA jobs, I find it reassuring that I'm probably not good at making a good first impression because it reduces the risk that I replace someone better than me. But in non-EA jobs I'm also afraid that I might not live up to some expectations in the first several weeks when I'm still new to everything.
3. Haha! Excellent! I should do that more. ^.^
4. You mean as positive reinforcement? I could meet with a friend or go climbing. :-3
5. Aw, yes, spot on. I spent a significant fraction of my time over the course of 3–4 months practicing for Google interviews, and then never dared to apply anyway (well, one recruiter stood me up and I didn't try again with another). Some of the riddles in Cracking the Coding Interview were so hard for me that I could never solve them in 30 minutes, and that scared me even more. Maybe I should practice minimally next time to avoid that.
Thank you so much for all the tips! I think written communication works perfectly for me. I don't actually remember your voice well enough to imagine you speaking the text, but I think you've gotten everything across perfectly? :-D
I'll only pounce on amazing opportunities for now and continue GoodX fulltime, but in the median future I'll double down on the interviewing later in 2024 when our funds run out fully. Then I'll let you know how it went! (Or I hope I'll remember to!) For now I have a bunch more entrepreneurial ideas that I want to have at least tried. :-3
2
Yonatan Cale
1.a and b.
This sounds like someone who doesn't want to actually give you feedback, my guess is they're scared of insulting you, or being liable to something legal, or something like that.
My focus wouldn't be on trying to interpret the literal words (like "what vibe") but rather making them comfortable to give you actual real feedback. This is a skill in itself which you can practice. Here's a draft to maybe start from: "Hey, I think I have some kind of blind spot in interviews where I'm doing something wrong, but I don't know what it is and a friend told me I probably won't notice it myself and I better get feedback from someone else. Any chance you'd tell me more about what didn't work for you? I promise not to be insulted or complain for not passing or anything like that"
2.
This is super common. Like, I'm not making this up, I had dozens of conversations and this is a common thing to worry about, and it's probably true to many other people interviewing to the same position.
My own approach to this is to tell the interviewer what I'm worried about, and also the reasons that I might not be a good match for whatever this is. For example, "I never worked with some-tech-you-use". If after hearing my worries they still want to hire me, that's great, and I don't need to pretend to know anything. I also think this somewhat filters for hiring managers that appreciate transparency (and not pretending everything is perfect), which is pretty important to me personally.
(also, reasonable managers understand you will need onboarding time, and if they don't understand that - then I prefer they don't hire me)
This all totally might be a Yonatan-thing, idk.
4.
Yeah
I think (?) I'd aim for something short that I could do right-after, so my brain will understand this is a positive reinforcement and not just an unrelated fun evening? This is just my own intuition. I guess it would work if I'd meet a friend and they'd keep saying "good job for interviewing! now let'
5
Dawn Drescher
Oh, interesting… I'm autistic and I've heard that autistic people give off subtly weird “uncanny valley”–type vibes even if they mask well. So I mostly just assume it's that. Close friends of mine who surely felt perfectly free to tell me anything were also at a loss to describe it. They said the vibes were less when I made a ponytail rather than had open hair, but they couldn't describe it. (Once I transition more, I hope people will just attribute the vibes to my probably-unfortunately-slightly-imperfect femininity and not worry about it. ^.^ I just need to plant enough weirdness lightning rods. xD)
But he was US-based at the time, and I've heard employers in the US are much more careful with giving feedback than around here, so maybe it was just guardedness in that case.
I like your template! I remember another series of interviews where I easily figured out what the problems were (unless they were pretenses). I think I'm quite attuned (by dint of social anxiety) to subtle indications of disappointment and such. When I first mentioned earning to give in an interview, I noticed a certain hesitancy and found out that it's because the person was looking for someone who has an intrinsic motivation for building hardware for supply chain optimization rather than someone who does it for the money. But in other cases I'm clueless, so the template can come into action!
Oh yes, I love this! I think I've done this in virtually every interview simply because I actually didn't know something. One interviewer even asked me whether I know the so-and-so design pattern. I asked what that is, and then concluded that I had never heard of it. Good call too, because that thing turned out to be ungoogleable. Idk whether he made it up or whether it was an invention of his CS professor, but being transparent about such things has served me well. :-D
I think for me it's mostly about what the other people in the room will think about me, not about consequences for me. I'm also afraid
1
Richard_Leyba_Tejada
I find your comments fun and authentic. I like your approach to voicing your concern that you don't know something and it helps filter good managers.
3
Richard_Leyba_Tejada
"The goal of interviews is not to pass them (that's the wrong goal, I claim). The goals I recommend are:
1. Reducing uncertainty regarding what places will accept you. (so you should get many rejections, it's by-design, otherwise you're not searching well)"
I get very anxious the closer I am to interview day. I started doing mock interviews to practice.
Shifting to reducing uncertainty/research vs passing seems helpful.
2
jknowak
What were the main reasons for this decision?
Was this motivated by how much you could earn in a typical zero-impact tech job? I mean - would you still "quit trying to have direct impact" if your zero-impact tech job wouldn't leave you with much extra money to donate?
9
Yonatan Cale
The main reason for this decision is that I failed to have (enough) direct impact.
Also, I was working on vague projects (like attempting AI Safety research), almost alone (I'm very social), with unclear progress, during covid, this was bad for my mental health.
Also, a friend invited me to join working with him, I asked if I could do a two week trial period first, everyone said yes, it was really great, and the rest is (last month's) history
2
Linch
Congrats Yonatan! Good luck with your work and I hope you stay safe out there!
2
ChrisSmith
Thanks for sharing! I occasionally worry that I'd struggle emotionally to go back to E2G/most of my impact being via donations, so this is a helpful anecdatum.
6
Dawn Drescher
Same… Anna Riedl recommended working for something that is at least clearly net positive, a product that solves some important problem like scaling Ethereum or whatever. Emotionally, the exact order of magnitude of the impact probably doesn't make a proportional difference so that the motivation will be there, and the actual impact can flow from the donations. Haven't tried it yet, but I will if I go back to ETG.
6
Yonatan Cale
I might disagree with this. I know, this is controversial, but hear me out (and only then disagree-vote :P )
So,
1. Some jobs are 1000x+ more effective than the "typical" job. Like charities
2. So picking one of the super-impactful ones matters, compared to the rest. Like charities
3. But picking something that is 1x or 3x or 9x doesn't really matter, compared to the 1000x option. (like charities)
4. Sometimes people go for a 9x job, and they sacrifice things like "having fun" or "making money" or "learning" (or something else that is very important to them). This is the main thing I'm against, so if you can avoid this, great. For example, if you're also excited to work on ethereum, and they have a great dev community that mentors you and so on
5. I do think it's important to work on something that you enjoy
1. So I do think you should have a bar of "do enough good to have a good time", but this is a super subjective bar, and I wouldn't lose track of the ball that is "your motivation" (super under rated btw)
2. I'll also note that (imo) most (though not all) companies are net positive. So having a bar of "net positive", if it works for you emotionally, won't reduce many options and I think it's great
6. (and I recommend sometimes checking if there's a high impact job that could use your skillset and applying)
1. (I'm also not against doing high-risk high-reward things, or projects that aren't "recognized" by EA orgs. Such as open source stuff)
7. I do personally think I have a bar of not taking harmful jobs, not ruining coordination, things like that.
8. Oh, and: While you're working on something fun, learning and making money, I do think (in the typical case) you could see yourself as "preparing" for a potential very high impact job you might have in the future, and I think our community would be better off if people would take this path happily and without guilt. Just don't forget to check for the high impact jobs sometimes.
I have many m
2
Dawn Drescher
Haha! Where exactly do you disagree with me? My mind autocompleted that you'd proffer this objection:
If you work for a 9x job, chances are that you're in an environment where most employees are there for altruistic reasons but prioritize differently so that they believe that the job is one of the best things you can do. Then you'll be constantly exposed to social pressure to accept a lower salary, less time off, more overtime, etc., which will cut into the donations, risks burnout, and reduces opportunities to learn new skills.
What do you think?
I'm a bit worried about this too and would avoid 9x jobs where I suspect this could happen. But having a bunch of altruistic colleagues sounds great otherwise. :-D
I think I will need to aim for something a bit above background economic growth levels of good to pacify my S1 in the long run. ^.^
2
Yonatan Cale
Yeah, I think maybe seeing a post like this would have helped me transition earlier too, now that you say so
I want an easy/polite/non-offensive way to say "sorry, this reply is way too long, so I'm not going to read it, so I prefer that you know explicitly that I won't reply rather than feeling like I'm maybe ignoring you and maybe will get to it, and also this doesn't mean that you're wrong, or that a long-reply is the wrong choice, it mainly means I'm trying to prioritize my own life tasks and will be dropping some balls and this is one thing that I think would be healthy for me to drop, and I wish this didn't have negative social implications for our relationship or for your feeling about yourself, because I was also raised in a culture where a reply like this would be rude and make me feel bad about myself, and I really wish it wasn't like that [and I have no idea what to do about it, so I thought I'd raise the meta-problem explicitly in a forum-quick-take. [I wonder if anyone will notice me or if this, too, will be too long]]"
“Thank you for the comment. There’s a lot here. Could you highlight what you think the main takeaway is? I don’t have time to dig into this at present, so any condensing would be appreciated. Thanks again for the time and effort.” ??
To push back a bit, I feel like unless a reply is reeeeeeeeeeeeeally long I think its good practise to make the effort to read it and respond. Part of putting a post up I think implicitly means we should make the effort to engage with people who engage with us (within reason of course)
To answer the question though, I think a short reply which thanks someone for the comment and perhaps mentions one of their points without comprehensively responding is also completely finr!
I wouldn't want someone to do that to me (I can try to explain why if it's unintuitive)
2
Yonatan Cale
(I'm not thinking about replies to posts that I write, but rather - me joining some other conversation and commenting something)
2
Kirsten
So like you're on Twitter or Facebook, you comment on someone's post, and in response you get a wall of text?
I think that's normally considered a faux pas on the part of the person posting a long response, and the polite thing for you to do is ignore it
2
Yonatan Cale
I mean on the EA forum / lesswrong
6
Linch
Depending on how long it takes you to read things normally, and how long the texts you're thinking about actually are, it might be reasonably efficient to ask GPT-4 or something to summarize for you.
2
Yonatan Cale
Interesting!
I don't think it would work for the case I'm thinking about, but useful idea, and I better also try it on some cases that I intuitively wouldn't expect to work
Thanks!
5
richardiporter
TL;DR but I appreciate you 🙂
2
Nathan Young
"I generally reply with about a paragraph/tweet, but you've written too much for me to do that, is there a specific point I can respond to that's most important to you? Thanks for your time"
2
dan.pandori
Thank them for the comment, and then link to this thread?
2
Yonatan Cale
You, sir, get meta points
1
John Salter
With all due respect, TL;DR
3
Raemon
TL;DR;BNOB
("but not obviously bad")
1
mako yass
Btw, I'd generally recommend always at least skimreading a thing before you put it down, IME it leads to much better outcomes than just not reading it at all.
1. The amount I work out is not constrained by willpower anymore, it is constrained by how much my body can handle and how much free time I have 2. The best workout game I found is "thrill of the fight", I have some tips before you try it. Also, not everyone will like it 3. Trying a game for ~10 minutes isn't enough to "get it". Most games in VR aren't polished enough, don't have a good tutorial, it will take more time to decide if you like them 4. I wish someone would have told me this sooner 5. Still unclear: Can I build muscles using VR? So far seems promising, but I'm less certain about this part 6. I only have it for 2 weeks, so maybe you'll think I'm going to grow out of it, but I don't think so myself. It's literally playing games
Update: Still addicted.
Yesterday I was feeling a bit bad (headache) but still tried to play as much as I can.
Avoid this failure mode:
I recommend not downloading games that are not workouts. I downloaded such a game and got addicted to it instead, spent a long time on it (it didn't make me tired, so I could play for a long time), and I didn't get the health benefits from it.
(Why doesn't anyone give this warning?)
8
Charles He
So I did end up getting a Quest 2 based on this advice.
The game, “Thrill of the Fight”, as you recommended, is exactly everything you say! It is fantastic for fitness and many other VR games seem promising.
Not exactly scientific, but my sense is that this is a general sentiment (maybe there’s some subgroup that doesn't benefit and this is hard to see).
It’s not obvious you could get such fitness benefits from VR.
I think the information here is an incredible signal to noise, and really generous and transparent for you to share it.
4
Charles He
Off topic, but Ian Fitz, the dev who built "Thrill of the Fight" seems like a great guy.
He is focused on a great product and seems to embody a lot of virtues (transparency, technical detail, being present in their community).
Here’s some tidbits from him:
* Controller physics and limitations (interesting technical detail)
* Game scaling mechanics
* The “official guide”
At least in my limited experience, this is an huge amount of engagement and attention to detail.
2
Charles He
Can you give a little more information on the games/apps you found problematic?
As you know, some games such as "Thrill of the Fight" are great exercise. Other games in this "healthy" class might include "Beat Saber" or "Pistol Whip". These might provide great exercise too, but I'm unsure. Was the above one of the problematic games, or was it something else?
Also, have you tried "Supernatural" or other fitness apps?
7
Yonatan Cale
Beat Saber & Pistol Whip:
See here.
FitXR
This one is unusual: It's price is a subscription ($10/month, w a free trial).
I like this because it gives the developers a strong incentive to keep me addicted for long.
I played it a few times (the FitXR boxing mode specifically) and I like it.
Intensity:
I'd rate the workout as "medium to hard" and I wouldn't be surprised if it will become "as hard as I can take"
Problematic games
These were not fitness games, just some other non-fitness game that got me addicted. I assume that telling you its name would be a small info hazard because you'll be curious to try it, but if you message me, I'll give you the name
Supernatural
Didn't try it
5
BrianTan
Interesting! How often and for how many hours per week do you work out now in VR (and how many hrs not in VR per week now)? And how often and for how many hours did you work out per week before?
9
Yonatan Cale
Trying to answer your question: I estimate I do 30-60 minutes per day in VR, plus about 5 minutes without VR (doing TRX or pullups once in a while)
Before VR: There is a ton of variance. At good weeks I'd do 2-3 rollerblade trips per week (each is several hours) plus ~10 minutes per day of something like pullups (which is also something I can say more about) [I haven't been in a "good week" for at least 3 months]
----------------------------------------
This questions seems a bit "wrong" because:
1. The intensity of the workout can be extremely high
1. 2-3 minutes in this specific VR game were enough to get my brother extremely exhausted for about half a day
2. My activity tracker (Oura ring [note it is optimized for sleep tracking, not workout tracking]) rates many VR sessions as "exceeds the hight of our chart", it is literally off the charts . Note this is higher than the hardest parts of rollerblade trips that I do with groups that are better than me and really like going up hills, followed by going up even more hills
3. My subjective experience matches this. I recognize when my body goes into extremely high pulse levels, and I can say more about sore muscles and so on
1. I am already able to do 3-5 rounds of this crazy game (3 minutes each), which would be unimaginable a few weeks ago
2. This means (A) I'm getting more fit, but also (B) the workouts are really short. I can currently tire myself out completely in about 15 minutes, which makes asking about "how much time I spend working out" like the wrong metric, I think
4. [Note you don't have to play this crazy game, or you can play it more calmly, if all of this sounds too extreme. But to me it is exciting]
2. The only reason I'm not working out right now is in order to be productive. I literally need willpower in order to not-work-out, this is crazy. I'm saying this in case you're trying to figure out if I'm ABLE to get enough sports out of VR
5
BrianTan
Thanks for the info! Yeah intensities of workouts matter too.
3
Charles He
This is really compelling.
I'm pretty sold, more than from any product ad I can think of! (also thinking $FB might be undervalued?)
Can you elaborate a bit more (in a few sentences) on the setup, e.g:
* What headset or specific electronic gear do you use or recommend?
* How much computing power is needed?
* What physical space or equipment do you need (can you do it in an empty room or do you need a treadmill or something)?
7
Yonatan Cale
My setup is "oculus quest 2" (amazon link) (I have the 128GB version though it doesn't seem like an important decision) with only the gear that comes out of the box, no need to even connect it to a computer.
I think I might get some extra items like a fancy head strap, but for now I'm using the default one and I'm pretty happy with it.
physical space: You need a room with space.
How much space: The game that requires most space that I saw so far is "thrill of the fight" which strongly recommends at least 1.5*2 meters (and I'd add a bit more in all directions to make sure you're not too close to punching a wall by mistake).
Treadmill or something: I don't use anything like that, but also remember that there is an element of personal fit here, some people like treadmills, I don't.
I'd like to add a few more things:
* If I were you, I'd consider this "a promising direction to explore" and not "problem solved", because
* I only have this for 2 weeks, I'm not an "expert". (But I'd hope that my friends would recommend this to me without waiting to be "experts", so here I am)
* Lots of VR games are not polished, you might have to look for some that you like
* This is an important mindset to keep in mind. As I like to say, "keep your expectations low and you'll be positively surprised"
* Does boxing in VR ("thrill of the fight") sound like something you could potentially enjoy? This game is an outlier in how much of a good workout it is, as far as I can tell.
* You could also try playing at a friend's place for a few hours before buying (or if none have it, then you'll find yourself showing it to them. :) )
* You'll have to spend some more money on games. Each game costs about $8 to $40
* For reviews, my friend recommends: https://uploadvr.com/
* A Telegram bot to tell you when game prices drop: https://t.me/questStoreWatch
* I recommend buying a few games at full price of course
I'm pretty happy this is useful to someone, feel free to ask t
3
Charles He
Thanks! This is really informative.
2
aphenix
Stronger By Science is my go-to for the technical & academic questions on muscle-building. I think they would probably say no to building muscles with VR. They would still think working out using VR is a good idea though, if: 1) it helped you build an exercise habit; 2) you develop proficiency with specific movements ; and, 3) you become more body aware--all without getting injured. This is always a huge problem in the gym, especially for new people--there's a lot of learning the hard way and the resulting injuries set people back sometimes months or years.
Here's their summary on strength-training:
https://www.strongerbyscience.com/complete-strength-training-guide/
1
Yonatan Cale
Thank you very much! Even just having a go-to for this topic is helpful for me
2
Lukas Finnveden
What are your tips?
3
Yonatan Cale
Tips for Thrill Of The Fight
Safety
1. Configure the game (the "guardian") to keep some space from things like walls, so you won't punch them by accident
2. Don't straighten your elbow completely when you punch (keep it a bit bent), otherwise you might damage it in real life
1. For the same reason, don't do strange bad things with your posture, such as bending your spine sideways
2. Generally bad pain is bad, you know.
3. I can say more about this if it would help
End your first round early, maybe
Consider doing the first round for only 20 seconds or so to avoid becoming overly exhausted without noticing (this has happened to one person I saw).
How to stop?
* You can just take your headset off. If you're like me, you're totally going to forget this, but you can.
* You can also "hug" your opponent for ~5 seconds to end the fight.
Tips that would appear in a Tutorial, if it would exist, I think
Consider skipping this if you want to investigate the game's mechanics completely by yourself, hpmor style, but here goes:
* I'd start by fighting the "dummy". You can see your stats on the right of the dummy, including how much damage your last punch did. Then go to "fight"
* The game cares a lot about how strong you punch
* Many punches you do will be too weak and do 0 damage
* To see how much damage you did, check the color the punch when it hits (you'll see)
* blue = zero damage
* yellow = nice damage
* red = a ton of damage
* You can doge, including by ducking (great workout if you ask me)
* You can block. If your opponent's punch hits your glove before it hits you, it will do zero damage to you
* Professional boxers on Youtube say that this game is reasonably realistic (even if not perfect), I'd take that as a prior for most uncertainties that I have (mainly around what technique to use)
* Consider starting at "easy"
There are even more tips in Youtube tutorials, but I would personally prefer to only be told about th
1
Yonatan Cale
Other recommendations for games for workouts
Beat Saber
This is the most polished everyone-likes-it game as far as I can tell.
The harder difficulties are not only cognitively harder, they are also better workouts.
I recommend starting from the tutorial (and if you show the game to anyone: Don't explain it to them, just show them the Tutorial)
Intensity: I rate it as "medium workout"
Pistol Whip
Similar to Beat Saber, but with guns (and less overall polished).
As most games, it doesn't have a reasonably good tutorial (though I'd do what it has (nobody understands the "armor", don't worry)), and if a friend would start playing it, I'd give them a few pointers. Tell me if you want those
Intensity: I rate it as "medium workout"
See external recommendations
Like this one:
https://uploadvr.com/best-quest-2-fitness-exercise-apps/
I haven't tried almost any of them
It probably helps people feel welcome to the community.
For myself:
I've been mostly a lurker around international EA activities for about 5 years, feeling that all the orgs have some wow factor that I could never touch. I think this mostly changed because (A) I met some people in EAG (they were actually real people, which really surprised my brain), and (B) I got brave and posted something, and it got 70+ upvotes pretty quickly.
I know, this is stupid, I'm supposed to pretend not to care about upvotes, whatever. Looking back, I think this might have been pivotal for past-Yonatan's sense of being accepted into a community, of having someone in the important EA community care at all for.. I don't know, my attempts at helping? about me? And it lead me to, well, behave differently.
Looking at myself now, I am posting and commenting a lot, I have two more drafts almost ready to go (one for CEA! They asked me for something! Unimaginable if you'd ask me 6 months ago. I tried acting cool and said I'd be happy to help, if you're curious. Hey Ben if you're reading this! Ok I'm off topic).
Anyway if you're reading my shortform, you now know my "dark s... (read more)
Things I'd say to people who are starting out with AI Safety
Intro:
I'm imagining someone "with a profession"
(a mathematician / developer / product manager / researcher / something else) who's been following AI Safety through Scott Alexander or LW or so, and want to do something more seriously now
To be clear, I am absolutely unqualified to give any advice here, and everyone is invited to point out disagreements.
I did this for ~3 months.
This is not my normal "software career" advice (of which I'm much more confident)
I'm going to prefer to be opinionated and wrong than to put so many disclaimers here that my words mean nothing. You'll get my opinion
So, some things which I wish I'd known when I started all this, or other stuff that seems useful:
There is no clear "this is the way to solve AI Safety, just learn X and then do Y".
Similar to how, maybe, there's no "this is the way to solve cancer, just learn X and then do Y", just much worse. With cancer we have I guess 1000 ideas or so, and many of them have already cured/detected/reduced cancer, at least with cancer there are clear things we want to learn (I think?). with AI Safety we have about 5-20 serious (whatever that means) ide
Epistemic status: I've been to 2 EAGs, both were pretty life changing, and I think my preparation was a big factor in this.
My tips:
Have some kind of vision
Take ~5 minutes to try to imagine positive (maybe impossible) outcomes. Consider brainstorming with someone.
For example "org X hires me" or "I find a co-founder" or "I get funded" (these sound ambitious to me, but pick whatever's ambitious to you).
Bad visions in my opinion: "meet people", "make friends", "talk to interesting people". Be more specific, for example, if you'd meet your new best friend at EAG, what exactly would you do together? What exactly would you talk about? Better would be "Looking for someone to co-work in VR 3 times a week", if that's what friendship means to you.
Is anyone having trouble with the vision section? Let me know, I'll try to help
Swapcard #1 most important part
"how can I help people" + "how can people help me".
Just like you wouldn't schedule a meeting to ask someone what are the names of the U.S states (because you can check wikipedia), I'm against scheduling meetings to ask something you can check in the EA Forum (or lesswrong).
For example, if you're curious what's new in global health and wellbeing, check the "global health and wellbeing" tag, and sort by "new".
(Maybe after checking the tag you'll still want a meeting for some reason, but I'd at least check the tag first).
Examples:
* I wouldn't do: Ask an org if they're hiring without checking the 80k job board (and/or the org's website, and/or the org's tag).
* Seems ok: Reaching out to someone from an org, saying "I see you're hiring, I'm considering studying for 3 months and then applying, do you think it would be better for me to apply now and if I don't pass then study and apply again in 3 months?"
* Seems great: Asking this in Swapcard, maybe they can just reply in 5 seconds with "yeah sure apply, no problem to repeat after 3 months"? Or maybe they'll say it's better to meet.
4
Yonatan Cale
My story from my first EAG:
https://forum.effectivealtruism.org/posts/QM4QgbbL5bFMMgLmh/please-post-reflections-on-ea-global-london-usd500-bounty?commentId=JX8WYJ3LASRFSJNjN#JX8WYJ3LASRFSJNjN
2
Yonatan Cale
Before/after EAG(x)
Usually there are small events 1 (2?) days before, and bigger events up to ~3 days after.
But that's just my vague rule of thumb. It's better to try to find the groups where these events are organized
2
Yonatan Cale
More (smaller/technical stuff) :
1. Swapcard data may be available in Google Sheets, which is way more comfortable to filter over (ask the EAG team)
2. You can manage your availability in swapcard, for people scheduling with you
1. You can narrow down your availability to your preferred slots and only then, if they get taken (or if someone doesn't find a good slot), open more slots.
2. How to manage your availability: "My Schedule" --> "My meetings" --> "MANAGE AVAILABILITY"
3. Probably schedule first to earlier-in-the-event, because you might discover you want to meet more people (or people will discover you) and it's better if you still have availability then
3. Swapcard will let you schedule 1-on-1s at the same time that you have events (boo)
4. Don't go partying at the evening if there's EAG the next day - these events are surprisingly exhausting, and sleeping well seems to be key, at least for me
1. Also, sleep really well before the event, and get flight tickets that will let you do that (if you're anything like me regarding sleep)
5. After EAG, there will usually be an after party, plan your schedule accordingly
2
Yonatan Cale
Busy EA's and their preferences for small talk if you have a question for them:
3
Yonatan Cale
Also:
3
yuyu
Amazing! Things I would add for newcomers:
1. (If corrolated with your goals) Reach out to speakers/filter 10+ years of exp beacuse it is usually a good filter for people who you can learn from the most
2. Ask friends/EA staff who have already been to conferences if they can reccomend who to talk to
3. Order a motel close to the conference is usually very comfortable (use on booking filters: less than 1 mile + over 8 rating + best price to rating ratio)
4. Sleeping together with other members of your community is fun for feeling comfortable at the conferences, and having someone from 'back home' to share you experinces with (however, this might make it a comfort zone to not get to know other people)
At least one person (from the overqualified team I worked with) is a person who'd probably pick up an EA software project if they'd know which one.
This is one of the reasons I asked people to pitch ideas to EA CTOs (a post that I wish got a lot more attention)
A leading career option for me is joining them, and among other things rebuilding their tech (which is originally from 1991).
Thoughts? (consider forwarding this question to people involved in meta-science, that would help me!)
I specifically think:
My professional interests and skillset are very well fitted for this kind of thing.
I have some vision for improving arxiv, for example "let people tag an article as your-code-doesn't-run" (and upvote existing tags). I hope to disincentivize people from publishing nonsense (knowing that others will see whatever tag becomes most upvoted on their article).
The dream would be to create a mature karma system like stackoverflow, where people could get reputation by things that help the community, and not only from publishing. Of course this is a very complicated thing to do, but arxiv are in a perfect position to do it.
I'm not an academic, maybe I have no idea what I'm talking about
Having EA run arxiv sounds potentially useful, maybe?
Is advancing science bad because it will help get AGI sooner?
Paul Graham about getting good at technology (bold is mine):
How do you get good at technology? And how do you choose which technology to get good at? Both of those questions turn out to have the same answer: work on your own projects. Don't try to guess whether gene editing or LLMs or rockets will turn out to be the most valuable technology to know about. No one can predict that. Just work on whatever interests you the most. You'll work much harder on something you're interested in than something you're doing because you think you're supposed to.
From a software engineering point of view there are a couple of things that would potentially put me off applying to an EA-org:
* Lack of mentorship (this is somewhat covered by your small teams point but this is the specific part that I think of). I'm sure this isn't true for all EA orgs but the appeal of ie FAANG is that I am very confident that I'll be able to get mentored by engineers at the top of the field, who likely already have a lot of experience mentoring, having good structures for mentors and are generally empowered to be great at that.
* Small scope/scale for projects, particularly for frontend work. In SWE a big part of your career capital comes from being able to say you've worked on projects that are really big and/or really fast. There are plenty of fullstack jobs at EA orgs around at the moment but a lot of them are basically look after a website or build an app which will serve a niche community.
I think there has been discussion before about SWEs feeling like EA orgs don't offer them enough career capital, but I can't remember where and it doesn't appear to have updated me much in favour of the EA orgs.
Applicants to ACX grants were almost by definition not working on problems with well-established solutions (in EA or otherwise), eg nobody was applying for an ACX grant to distribute bednets. That made the grants more difficult to evaluate than many popular EA causes, and also made it hard to rely on previous work.
1. Totally agree
2. The concern I'm raising is something like "our articles only help for [something like] well established solutions". Or in other words, there is no situation where [someone is able to vet an org and this was only true because of reading the article]
The other example I have in mind is trying to help people in Israel find an impactful job, especially in tech. We can offer them 100 pages of theory on how to vet companies, but almost no concrete companies to recommend
8
NegativeNuno
If only someone was working on how to evaluate hard to evaluate projects
4
Yonatan Cale
Ref for others:
https://forum.effectivealtruism.org/posts/3hH9NRqzGam65mgPG/five-steps-for-quantifying-speculative-interventions
From my limited experience, it really helps to get recommendations.
If you think I am useful to EA, or if you have something similar to say that I may share with grantmakers, please comment here, or email yonatan@effectivedevelopers.org, or DM, or something.
Having worked with Yonatan on various community-building efforts, and discussing many technical and nontechnical projects with him, I'm very optimistic about the value he can give if he has the resources and freedom to do so. Happy to serve as a reference.
Main impressions:
1. He is very aligned and happy to sacrifice his time, money, and credit to do more good.
2. Very helpful to EA community members and organizations, and makes sure to be very pleasant and accessible.
3. Thinks clearer than most about ways of doing good, and acts based on the resulting logical conclusions, even if controversial.
4. Evidently, very open, honest, and direct.
5. Great quick-and-dirty approach to starting new projects.
6. Very independent, and knows how to solicit design requirements and quick feedback.
7. He may not be the most ridiculous EA in Israel, but he is close 🐱🚀⛸🥽
8. To work with him effectively long-term, one should have very open communication and give him the freedom to pursue the goals and directions he believes in.
(Yonatan, I'm curious as to whether/how much you agree with these 😊)
7
Ben_West🔸
Grantmakers are welcome to ask me for a reference. Yonatan is aligned and very dedicated, and is both knowledgeable about and helpful to many software engineers (see reviews here). He's also been directly helpful to us with recruiting, and I've referred him to multiple EA org's who are trying to hire software engineers.
Hiring managers are probably not reading through all profiles, they are probably running searches. If someone wants a backend dev, they're probably running a search for "developer", "software", "python", "backend", or whatever.
If you don't have the buzzwords that [your target employer is going to search for], add them!
2: Separate your [skills+experience] from [what you want to do]
If you want to do something that you have no experience in - that's ok! But if you don't write it ... (read more)
Meta: This feels like something emotional where if somebody would look at my plan from the outside, they'd have obvious and good feedback, but my own social circle is not worried or knowledgable about AGI, and so I hope someone will read this.
Best bet: Meta software projects
It would be my best personal fit, running one or multiple software projects that require product work such as understanding what the users actually want.
My bottle neck: Talking to actual users with pain points (researchers? meta orgs with software proble... (read more)
It sounds like you’re a fairly senior software engineer, so my first thought is to look at engineering roles at AI safety orgs. There are a bunch of them! You’ve probably already seen this post, but just in case: AI Safety Needs Great Engineers.
It sounds to me like you’re concerned about a gap between the type of engineering work you’re good at, and the type of engineering work that AI safety orgs need. This is something I’ve also been thinking about a lot recently. I’m a full stack developer for a consumer product, which means I spend a lot of time discussing plans with product managers, writing React code, and sometimes working on backend APIs. Whereas it seems like AI safety orgs mostly need great backend engineers who are very comfortable setting up infrastructure and working with distributed systems, and/or machine learning engineers.
This suggests 2 options to me, if you want to stay focused on software engineering rather than research or something else:
1. Find a way that you can help using your existing skills. This sounds like your option A above, but to me option A reads like you want to work independently as a contractor or something? Idk, it sounds like you’re not too sure what it would look like in practice. But there are AI safety orgs that have job postings for full-stack or frontend/UX engineers. If this lines up with your skillset and personal fit, this could be a really good option. One example is Ought. They’re unusual in the AI safety space in that they’re building a user-facing product, so all of the frontend skills that apply at any other startup would apply here. I know other AI safety orgs have frontend roles too, but I think they’re more focused on building internal tooling.
2. Build up your backend/infrastructure/ML skills enough that you could fill one of the more common AI safety engineering roles, like this one. I don’t know how easy it is for a great frontend engineer to become a great backend/infra engineer. I expect it’s MUC
3
Yonatan Cale
What I'm good at:
I think my experience is probably sufficient to apply to Anthropic or Redwood or any other place that doesn't need an ML background. Including my background in backend/infra. I did many "tech lead" roles where I was basically in charge of everything, so I'm up for that.
What I enjoy:
The thing I would be missing, I imagine, is the social interaction or something like that.
I don't think I'd enjoy sitting on a hard problem for weeks/months alone, I imagine I'd be sad.
Location:
I don't want to relocate (at least not a fulltime relocation), so Anthropic is off the table
1
Dan Valentine
Why do you think that Anthropic or Redwood etc would be missing social interaction? I wouldn’t have assumed that… on the Anthropic post I linked they mention that they love pair programming.
2
Yonatan Cale
Anthropic and Redwood will hire you with zero ML experience so please don't spend time learning ML before applying
[I think this deserves its own comment]
1
Dan Valentine
Yes, good point, I shouldn’t have included ML in the list of things to learn in option 2.
1
Lorenzo Buonanno🔸
> Give me the obvious stuff
I expect that people that read shortforms on the EA forum are not those that would give useful advice, and I think there are a lot of people that would be happy to give advice to someone with your skills
Related, "my own social circle is not worried or knowledgable about AGI", might it make sense to spend time networking with people working on AI Safety and getting a feel for needs and opportunities in the area e.g. joining discussion groups?
Still, random questions on plan A as someone not knowledgable but worried about AI
1. Why product work only for meta orgs? Random examples that I know you know about: Senior Software Engineer at Anthropic, and they were looking for someone to help with some dev tooling. They seem to require product skills / understanding what the users actually need. (Not asking about Anthropic in particular, but non-meta in general)
2. What would make it easier to clear the bottleneck of talking to actual users with pain points?
3. What happened to the idea of internal prediction markets for EA orgs? I think it has potential and an MVP could be simple enough, e.g. I received this proposal for a freelance project a few days ago from a longtermist (non AI safety) EA org that made me update positively towards the general idea
Not sure if any of this helps, but I am really excited to see whatever you will end up choosing!
2
Yonatan Cale
I don't think it will help with the social aspect which I'm trying to point at
----------------------------------------
I think it's best if one person goes do the user research instead of each person like me bothering the AGI researchers (?)
I'm happy to talk to any such person who'll talk to me and summarize whatever there is for others to follow, if I don't pick it up myself
----------------------------------------
Could be nice actually
----------------------------------------
I mean "figure out what AGI researchers need" [which is a "product" task] and help do that [which helps the community, rather than helping the research directly]
----------------------------------------
I'm in touch with them and basically said "yes", but they want full time and by default I don't think I'll be available, but I'm advancing and checking it
I am talking about the situation where, for example, EA-1 will talk to EA-2 (for 30 minutes or so) with no goal other than "being able" to ask EA-2 for help in the future.
Nobody is acknowledging the cost here, to the entire community, of having lots of people going around doing this kind of networking and/or suggesting that others do it.
What I suggest instead: If you are an EA-1 and want help from an EA-2, directly ask the EA-2 for the specific help you need. If for some reason this kind of outreach didn't wor... (read more)
+1 karma but disagree.
As I see it, the purpose of networking is to tell someone, "Hey, you seem cool. It looks like we share a non-zero amount of goals / values. No promises, but maybe I'll find out about a cool opportunity later that I'll share with you - although I don't have one at the moment."
Supposedly, you're more likely to get introduced to a career opportunity by a casual acquaintance - maybe someone you had a college class with and are now friends with on LinkedIn - than a close friend. (Although of course this is weighting all of your acquaintances against just a handful of friends, but the implication is still that more acquaintances = more opportunities.)
2
Yonatan Cale
Making sure we're on the same page:
I'm talking about, for example, a student who is actively networking with senior people, hoping that one of the senior people will offer the student a job or something, without applying to these jobs. Do you agree this situation is negative?
Someone asked me "you already know the EA community, no? how come do you still get value from EAG?"
Well - I live in Israel. Contacting people from the international EA community is really hard. I need to discover they exist, email them, hope they reply, and at best - set up a 30 minute call or so. This is such high friction.
At EAG, I can run my project plans by.. everyone. easily. I even had productive Uber rides.
I'm sorry for your experience, I tried to compensate for it a bit:
I think your comment is modest and conscientious about it.
So my guess with that happened is that people didn't like this statement:
First off, I guess one reason people disagreed with this statement, is that in some views, it's very unlikely to be true. Myself, I have an aesthetic that the best things in the best instantiation of EA are really great and hard to see. So defining the frontier of EA by any one list doesn't make sense.
Secondly, there are principled longtime EAs who have focuses that differ from the underlying priorities/worldview that drives interest in the FTX contest. So for these people, canonizing the list as the frontier of EA projects is objectionable. This objection is heightened by what they might see as the indirect way of going about it (note that the FTX leaders are careful not to do this). At the same time, these very views makes it hard to comment. My guess is that this sentiment drove your downvote, but I don't really know.
EA Orgs: Not enough people filling out your form? Maybe it has too many mandatory fields
TL;DR Philosophy: Adding mandatory fields means [saving time in calls you have with applicants] at the expense of [reducing the amount of applicants]. Is this a tradeoff you are interested in?
TL;DR recommendation: Make all the fields optional except for (1) CV/linkedin, and (2) email. Then, in the first call, ask whatever's missing
Q: But the fields help us filter
A: Yep, you'll get more bad applicants if you do this
A lot of form builders record this automatically, as well. Typeform does, for example.
(In case you are interested: the "Why are you a good candidate for the role(s) of ___" question you alluded to above causes a bit less than 1% of applicants to drop out of the CEA application form.)
1
Yonatan Cale
Ok, I stand convinced!
4
Yonatan Cale
Update: Somebody at EAGx told me that they didn't contact me virtually because I have too many fields in my Calendly
(While I'm ranting about other people having too many fields in their forms)
Brainstorm: How can I talk to EAs who are very senior software developers?
I'm working on understanding and solving problems around EA orgs having trouble hiring strong engineers, and for this I'd like to do some "user research".
I believe I already made progress in this area for EA, but I don't want to elaborate too much in case some developer will read this and it will bias my user research.
Could someone help me contact such people / suggest ideas on how I could do it?
It will be a ~15 minutes conversation (I'm flexible if you prefer interacting in some other way)
Instead, I recommend: "My prior is [something], here's why".
I'm even more against "the burden of proof for [some policy] is on X" - I mean, what does "burden of proof" even mean in the context of policy? but hold that thought.
An example that I'm against:
"The burden of proof for vaccines helping should be on people who want to vaccinate, because it's unusual to put something in your body"
I'm against it because
It implicitly assumes that vaccines should be judged as part of the group "putting something in your
I've always viewed burden of proof as a dialectical tool. To say one has the burden proof is to say that if they meet the following set of necessary and jointly sufficient conditions:
1. You've made a claim
2. You're attempting to convince another of the claim.
They have the obligation in the discussion to provide justification for the claim. If (1) isn't the case, then of course you don't have any burden to provide justification. If (2) isn't the case (Say, everyone already agrees with the claim or someone just wants your opinion on something) it's not clear to me you have some obligation to provide justification either.
On this account, it's not like burden of proof talk favors a side. And I'm not sure it implicitly assumes anything or is a conversation stopper. So maybe we can "keep burden of proof talk" by using this construal while also focusing more on explicit discussion of priors. Idk, just a thought I had while reading this.
1
titotal
So, I'll give two more examples of how burden of proof gets used typically:
1. You claim that you just saw a unicorn ride past. I say that the burden of proof is on you to prove it, as unicorns do not exist (as far as we know).
2. As prime minister, you try and combat obesity by taxing people in proportion to their weight. I say that the burden of proof is on you to prove that such a policy would do more good than harm.
I think in both these cases, the statements made are quite reasonable. Let me try to translate the objections into your language:
1. my prior of you seeing a unicorn is extremely low, because unicorns do not exist (as far as we know)
2. My prior of this policy being a good idea is low, because most potential interventions are not helpful.
These are fine, but I'm not sure I prefer either of these. It seems like the other party can just say "well my priors are high, so I guess both our beliefs are equally valid".
I think "burden of proof" translates to "you should provide a lot of proof for your position in order for me or anyone else to believe you". It's a statement of what peoples priors should be.
1
Gerald Monroe
Why doesn't this translate to AI risk.
"We should avoid building more powerful AI because it might kill us all" breaks to
1. No prior AI system has tried to kill us all
2. We are not sure how powerful a system we can really make scaling known techniques and adjacent to known techniques in the next 10-20 years. A system 20 years from now might not actually be "AGI" we don't know.
This sounds like someone should have the burden of proof of showing near future AI systems are (1) lethal (2) powerful in a utility way, not just a trick but actually effective at real world tasks
And like the absence of unicorns caught on film someone could argue that 1/2 are unlikely by prior due to AI hype that did not pan out.
The counter argument seems to be "we should pause now, I don't have to prove anything because an AI system might be so smart it can defeat any obstacles even though I don't know how it could do that, it will be so smart it finds a way". Or "by the time there is proof we will be about to die".
How is nobody stressed out about countries freezing the assets of an entire country, practically changing the records of the banks to something else? Are we confident this will only happen in situations that we think are good and moral?
Of course we can't be, but sanctions are also nothing new. And rogue countries like Russia also understand how sanctions work and would already use them if it could.
Loved it, set up the Hebrew crowed sourced translation project, we translated everything and printed it. I estimate over 1000 people bought a copy, not counting online readers, and the number is probably way higher, which I'm really proud of :)
The sequences / Rationality A to Z (effected me a lot)
One of the most influential things I've read. While reading it:
I noticed I'm not happy in an important partnership and broke up. Main technique: slowly changing my mind
I decided that the meat industry is indeed bad, yep
Opening a startup is harder than most non-founders think
Specifically, raising money from for-profit investors and being accountable to them - this is something I wouldn't do lightly.
I think most people under rated how hard it is. I'm surrounded by founders, I feel it.
My recommendation: Ask ~3 founders how hard it actually is to open a startup, before you decide it's probably exciting and fun.
I think maybe this could be solved by raising money from EA and not from for-profit investors, but I don't know.
3
Yonatan Cale
If you want to solve a problem for certain people, talk to those people
This is a big part of modern startup advice
3
Yonatan Cale
Your idea isn't monitizable? That's good!
It might be the reason that nobody solved the problem you found so far.
Specifically, solving tragedy of the commons situations, and other inadequate equilibria seem like promising situations to me.
Where will the money come from? From EA funding. (Assuming you found something cost effective and so on)
This is the first time in the world's history where people can get paid for solving problems that aren't monitizable, and I think this is exciting.
2
Yonatan Cale
Almost nobody "knows what they need to know before opening their first startup"
Many many founders have impostor syndrome.
Trying to know everything, or "only" "everything that people tell you is basic knowledge" seems pointless, you'll never get there, especially if you plan on asking more people what they think you "definitely need to know" and keeping a list of topics to learn. It will never end.
You've got to do Something Else Which Is Not That.
My top recommendation would be "learn to ask for help"
Rant: How to make new employees sad they joined your company
TL;DR: To avoid predictably-sad employees, advertise your company honestly, including the bad parts.
Longer and more sarcastic:
How to make new employees sad:
Advertise your company as being perfect, including: Your culture, best practices, and team. Use vague sentences like "of course not everything is perfect", but hide the concrete negative things that could give new hires an accurate picture in advance
Let them discover the real situation a few months after joining
Personal Assistants provide more value than the time they save
Handling bureaucracy not only takes time: For some of us, it's stressful and icky and aversive.
I'd happily spend an extra hour building software (fun!) instead of spending that hour on paperwork (which would deplete my willpower for the rest of the day).
The Neglected Consideration When Planning a Social Network:... Network Effects
Lots of people dream about better social networks that promote higher quality discussions, evenme! Some challenges, like "which logo to pick", are things that can be solved along the way. Others, like "why would anybody join a social network if almost nobody is there?" are (I claim) a core part of the plan and need to be addressed in advance.
"If you give the same answer 5 times, write a post"
This isn't meant as discouragement, it is meant as "this is an important thing-not-to-ig
Thanks for insights. Now I am working a smaller idea - "EA directory of ideas" to address previous flaws from social network idea. It is many times simpler idea (than a social network) and solves many specific problems that exist right now. I am searching for feedback, wrote you a PM.
TL;DR: Get others to predict the grant maker's answer. But not with a prediction market.
Longer:
Today an EA told me their funding request got rejected and they got no feedback about it. (Frustrating!)
They asked me to help them guess why they were rejected, and I offered some different ideas (one was "this specific fund doesn't know how to vet [some aspect of your idea]".
Wouldn't it be great if the original grant maker could review what I wrote, and respond with correct/incorrect, or maybe mark the part that was most correct if any?
A few quick things:
- I agree that many grantmakers don't have enough time to give much feedback, and that this leads to suboptimal outcomes.
- I think it's pretty difficult for people outside these organizations to help much with what are basically internal processes. People outside have very little context, so I would expect them to have a tough time suggesting many ideas.
- In this specific proposal, I think it would be tricky for it to help much. A lot of what I've seen (which isn't all too much) around grant applications is about people sharing the negative information they have about applicants. I imagine this would be exceedingly awkward to show publicly.
If people want to help with the larger grantmaking process, some things they could do include:
* Advise groups requesting money. See if you could provide useful feedback (I think many groups could use a bigger team of advisors)
* Help newish people to write more content on the EA Forum and similar. This can be a proving ground for some grant organizations.
2
Vincent van der Holst
I'm the person Yonatan is referring to. His feedback and your general feedback are very helpful, so thank you for that! I have been a lurker within EA for years and will write more content on the EA forum, including requesting feedback on the idea (soon). Hopefully that will help, although I don't know because I didn't get feedback.
Before I move into why I think grant makers should provide short feedback I want to be clear: I'm completely comfortable with being rejected and I completely understand that grant makers are very busy.
Having said that, I think grant makers should feedback the applications they reject. It doesn't have to be more than 1-2 lines and one minute to write. I have applied to EA 6 months ago and got rejected and applied again last month and got rejected again. I had a lot of encouraging talks with EA's (although criticism as well) and was more convinced this was going to get funding. I have no idea if they hated the idea and they think it will never work, or if they think it doesn't fit them, they are not able to evaluate properly, etc. The potential impact of knowing why is very large. It might help me improve the idea, maximize the impact or pursue other paths that are more impactful and effective. I think that one minute feedback has a high expected value. Knowing why will also help me decide whether to reapply or not, either saving the grant makers future time if I don't or improving the idea so it has more impact if I do. Feedback might help EA get less reapplications of higher quality, increasing overall impact and reducing the time to review. Win-win?
3
Yonatan Cale
If I could ask EA Infra Fund one binary question about your grant, it would be "did you reject me because this idea is not in your domain?"
2
Yonatan Cale
Here's the full idea:
https://forum.effectivealtruism.org/posts/A4hEM9ipq5aMeB7js/ea-startup-non-profit-sustainable-marketplace
7
Ozzie Gooen
Here's my super quick take, if I were evaluating this for funding:
Startups are pretty competitive. For me to put money into a business venture, I'd want quite a bit of faith that the team is very strong. This would be pretty high bar.
From looking at this, it's not clear to me promising the team is at this point.
Generally, the bar for many sorts of projects is fairly high.
1
Yonatan Cale
Ok, for the record this is very far from my guess.
The closest thing I said was "Intra Fund don't know how to evaluate startups, and specifically market places"
1
Yonatan Cale
Update: A grant maker [Edit: They said this is a bad description of them] told me why this wouldn't work
1
Cillian_
Are you able to relay what they said about why it wouldn't work?
I quit trying to have direct impact and took a zero-impact tech job instead.
I expected to have a hard time with this transition, but I found a really good fit position and I'm having a lot of fun.
I'm not sure yet where to donate extra money. Probably MIRI/LTFF/OpenPhil/RethinkPriorities.
I also find myself considering using money to try fixing things in Israel. Or maybe to run away first and take care things and people that are close to me. I admit, focusing on taking care of myself for a month was (is) nice, and I do feel like I can make a difference with E2G.
(AMA)
I have thoughts on how to deal with this. My priors are this won't work if I communicate it through text (but I have no idea why). Still, seems like the friendly thing would be to write it down
My recommendation on how to read this:
So,
TL;DR:
- The goal of interviews is not to pass them (that's the wrong goal, I claim). The goals I recommend are:
- Reducing uncertainty regarding what places will accept you. (so you should get many rejections, it's by-design, otherwise you're not searching well)
- Practicing interviews. Interviews are different than actual work, and there's skill to build there. So after interviews, I'll review stuff I didn't know, and I'll ask for feedback about
... (read more)I want an easy/polite/non-offensive way to say "sorry, this reply is way too long, so I'm not going to read it, so I prefer that you know explicitly that I won't reply rather than feeling like I'm maybe ignoring you and maybe will get to it, and also this doesn't mean that you're wrong, or that a long-reply is the wrong choice, it mainly means I'm trying to prioritize my own life tasks and will be dropping some balls and this is one thing that I think would be healthy for me to drop, and I wish this didn't have negative social implications for our relationship or for your feeling about yourself, because I was also raised in a culture where a reply like this would be rude and make me feel bad about myself, and I really wish it wasn't like that [and I have no idea what to do about it, so I thought I'd raise the meta-problem explicitly in a forum-quick-take. [I wonder if anyone will notice me or if this, too, will be too long]]"
“Thank you for the comment. There’s a lot here. Could you highlight what you think the main takeaway is? I don’t have time to dig into this at present, so any condensing would be appreciated. Thanks again for the time and effort.” ??
To push back a bit, I feel like unless a reply is reeeeeeeeeeeeeally long I think its good practise to make the effort to read it and respond. Part of putting a post up I think implicitly means we should make the effort to engage with people who engage with us (within reason of course)
To answer the question though, I think a short reply which thanks someone for the comment and perhaps mentions one of their points without comprehensively responding is also completely finr!
Working out using VR really works
1. The amount I work out is not constrained by willpower anymore, it is constrained by how much my body can handle and how much free time I have
2. The best workout game I found is "thrill of the fight", I have some tips before you try it. Also, not everyone will like it
3. Trying a game for ~10 minutes isn't enough to "get it". Most games in VR aren't polished enough, don't have a good tutorial, it will take more time to decide if you like them
4. I wish someone would have told me this sooner
5. Still unclear: Can I build muscles using VR? So far seems promising, but I'm less certain about this part
6. I only have it for 2 weeks, so maybe you'll think I'm going to grow out of it, but I don't think so myself. It's literally playing games
AMA
Upvoting Is an Act of Community Building
It probably helps people feel welcome to the community.
For myself:
I've been mostly a lurker around international EA activities for about 5 years, feeling that all the orgs have some wow factor that I could never touch. I think this mostly changed because (A) I met some people in EAG (they were actually real people, which really surprised my brain), and (B) I got brave and posted something, and it got 70+ upvotes pretty quickly.
I know, this is stupid, I'm supposed to pretend not to care about upvotes, whatever. Looking back, I think this might have been pivotal for past-Yonatan's sense of being accepted into a community, of having someone in the important EA community care at all for.. I don't know, my attempts at helping? about me? And it lead me to, well, behave differently.
Looking at myself now, I am posting and commenting a lot, I have two more drafts almost ready to go (one for CEA! They asked me for something! Unimaginable if you'd ask me 6 months ago. I tried acting cool and said I'd be happy to help, if you're curious. Hey Ben if you're reading this! Ok I'm off topic).
Anyway if you're reading my shortform, you now know my "dark s... (read more)
Things I'd say to people who are starting out with AI Safety
Intro:
So, some things which I wish I'd known when I started all this, or other stuff that seems useful:
- There is no clear "this is the way to solve AI Safety, just learn X and then do Y".
- Similar to how, maybe, there's no "this is the way to solve cancer, just learn X and then do Y", just much worse. With cancer we have I guess 1000 ideas or so, and many of them have already cured/detected/reduced cancer, at least with cancer there are clear things we want to learn (I think?). with AI Safety we have about 5-20 serious (whatever that means) ide
... (read more)EAG(x) tips
Epistemic status: I've been to 2 EAGs, both were pretty life changing, and I think my preparation was a big factor in this.
My tips:
Have some kind of vision
Take ~5 minutes to try to imagine positive (maybe impossible) outcomes. Consider brainstorming with someone.
For example "org X hires me" or "I find a co-founder" or "I get funded" (these sound ambitious to me, but pick whatever's ambitious to you).
Bad visions in my opinion: "meet people", "make friends", "talk to interesting people". Be more specific, for example, if you'd meet your new best friend at EAG, what exactly would you do together? What exactly would you talk about? Better would be "Looking for someone to co-work in VR 3 times a week", if that's what friendship means to you.
Is anyone having trouble with the vision section? Let me know, I'll try to help
Swapcard #1 most important part
"how can I help people" + "how can people help me".
Be specific.
"I want to hire senior backend developers" is specific.
"I want to meet people" is pretty bad.
This is where your vision goes.
If you write your wish here, someone might make it come true! (aka Playa Provides)
Swapcard #2 most important part
Tags.
Mark based on how you ... (read more)
Software for Ukraine
We just set up a tiny production system that helps coordinate busses for refugees from Ukraine using Whatsapp, with a UI in Google Sheets.
We built it on Tuesday, and already on Wednesday it was used to coordinate several busses.
:)
Working at arxiv.org - what do you think?
A leading career option for me is joining them, and among other things rebuilding their tech (which is originally from 1991).
Thoughts? (consider forwarding this question to people involved in meta-science, that would help me!)
I specifically think:
[#meta-science]
Paul Graham about getting good at technology (bold is mine):
... (read more)If you're not applying to EA orgs because of too-low-salaries, tell them
Or anonymously:
Why tell them?
Because they don't know. "Why don't people apply?" - they ask. But this is basically a blind spot: If nobody gives them feedback, they won't know.
Are you not applying because of something else?
This is valuable information.
If enough people share this, it will save doing a user research project. Please be one of the people that shares, help understanding what's going on!
AMA about Israel here:
https://www.lesswrong.com/posts/zJCKn4TSXcCXzc6fi/i-m-a-former-israeli-officer-ama
What's going on?
Should we stop writing these guides?
Do we need better guides?
Do we need some measure like "would this guide make Scott Alexander's work easier"?
Applicants to ACX grants were almost by definition not working on problems with well-established solutions (in EA or otherwise), eg nobody was applying for an ACX grant to distribute bednets. That made the grants more difficult to evaluate than many popular EA causes, and also made it hard to rely on previous work.
I'm going to ask for funding
From my limited experience, it really helps to get recommendations.
If you think I am useful to EA, or if you have something similar to say that I may share with grantmakers, please comment here, or email yonatan@effectivedevelopers.org, or DM, or something.
Thx ♥️ 🫣🐈
Use the "Who wants to be hired" post more effectively
1: Use buzzwords
Hiring managers are probably not reading through all profiles, they are probably running searches. If someone wants a backend dev, they're probably running a search for "developer", "software", "python", "backend", or whatever.
If you don't have the buzzwords that [your target employer is going to search for], add them!
2: Separate your [skills+experience] from [what you want to do]
If you want to do something that you have no experience in - that's ok! But if you don't write it ... (read more)
My attempt to help with AI Safety
Meta: This feels like something emotional where if somebody would look at my plan from the outside, they'd have obvious and good feedback, but my own social circle is not worried or knowledgable about AGI, and so I hope someone will read this.
Best bet: Meta software projects
It would be my best personal fit, running one or multiple software projects that require product work such as understanding what the users actually want.
My bottle neck: Talking to actual users with pain points (researchers? meta orgs with software proble... (read more)
Against "networking for the sake of networking"
I am talking about the situation where, for example, EA-1 will talk to EA-2 (for 30 minutes or so) with no goal other than "being able" to ask EA-2 for help in the future.
Nobody is acknowledging the cost here, to the entire community, of having lots of people going around doing this kind of networking and/or suggesting that others do it.
What I suggest instead: If you are an EA-1 and want help from an EA-2, directly ask the EA-2 for the specific help you need. If for some reason this kind of outreach didn't wor... (read more)
4 EAG(x) events - and I still get a lot of value
Someone asked me "you already know the EA community, no? how come do you still get value from EAG?"
Well - I live in Israel. Contacting people from the international EA community is really hard. I need to discover they exist, email them, hope they reply, and at best - set up a 30 minute call or so. This is such high friction.
At EAG, I can run my project plans by.. everyone. easily. I even had productive Uber rides.
That's the value of EAG for me.
The "Better Twitter that promotes high quality discussions" that everyone dreams about - might start from this shortform feature
Especially given the critical mass of people who have high quality discussions around here.
What do you think?
Are there important missing features that would make you transition your social network activity here?
Downvoting without explaining: An act of anti-community-building?
:(
https://forum.effectivealtruism.org/posts/MBDHjwDvhDnqisyW2/awards-for-the-future-fund-s-project-ideas-competition?commentId=GHnzmGogQq6p5mjxc#RprmhhxJgJt4FhtHB
Remember the illusion of transparency. Whatever is bothering you might not be as obvious to others as it is to you.
You can still downvote, just remember it has emotional consequences
EA Orgs: Not enough people filling out your form? Maybe it has too many mandatory fields
TL;DR Philosophy: Adding mandatory fields means [saving time in calls you have with applicants] at the expense of [reducing the amount of applicants]. Is this a tradeoff you are interested in?
TL;DR recommendation: Make all the fields optional except for (1) CV/linkedin, and (2) email. Then, in the first call, ask whatever's missing
Q: But the fields help us filter
A: Yep, you'll get more bad applicants if you do this
Q: What if we get too many applicants?
A: Then stop... (read more)
EA Forum under rated feature: Subscribing to posts, either by author, or by tag
Brainstorm: How can I talk to EAs who are very senior software developers?
I'm working on understanding and solving problems around EA orgs having trouble hiring strong engineers, and for this I'd like to do some "user research".
I believe I already made progress in this area for EA, but I don't want to elaborate too much in case some developer will read this and it will bias my user research.
Could someone help me contact such people / suggest ideas on how I could do it?
It will be a ~15 minutes conversation (I'm flexible if you prefer interacting in some other way)
Against "the burden of proof is on X"
Instead, I recommend: "My prior is [something], here's why".
I'm even more against "the burden of proof for [some policy] is on X" - I mean, what does "burden of proof" even mean in the context of policy? but hold that thought.
An example that I'm against:
"The burden of proof for vaccines helping should be on people who want to vaccinate, because it's unusual to put something in your body"
I'm against it because
- It implicitly assumes that vaccines should be judged as part of the group "putting something in your
... (read more)Open Philanthropy emailed me - I passed some screening for a position I am totally unqualified for
April Fools? X_X
How is nobody stressed out about countries freezing the assets of an entire country, practically changing the records of the banks to something else? Are we confident this will only happen in situations that we think are good and moral?
[I'm not an economist]
My EA origin story
hpmor (read, translated)
Loved it, set up the Hebrew crowed sourced translation project, we translated everything and printed it. I estimate over 1000 people bought a copy, not counting online readers, and the number is probably way higher, which I'm really proud of :)
The sequences / Rationality A to Z (effected me a lot)
One of the most influential things I've read. While reading it:
Not... (read more)
Thoughts about opening an EA startup
I'm doing this Twitter Style >>
Rant: How to make new employees sad they joined your company
TL;DR: To avoid predictably-sad employees, advertise your company honestly, including the bad parts.
Longer and more sarcastic:
How to make new employees sad:
For me persona... (read more)
Personal Assistants provide more value than the time they save
Handling bureaucracy not only takes time: For some of us, it's stressful and icky and aversive.
I'd happily spend an extra hour building software (fun!) instead of spending that hour on paperwork (which would deplete my willpower for the rest of the day).
-Written in appreciation to all the PAs out there
The Neglected Consideration When Planning a Social Network:... Network Effects
Lots of people dream about better social networks that promote higher quality discussions, even me! Some challenges, like "which logo to pick", are things that can be solved along the way. Others, like "why would anybody join a social network if almost nobody is there?" are (I claim) a core part of the plan and need to be addressed in advance.
"If you give the same answer 5 times, write a post"
This isn't meant as discouragement, it is meant as "this is an important thing-not-to-ig
... (read more)Edit: Solved
Anybody from Prague coming to EAGxOxford?
There's a product (an Oura Ring) that I ordered to Prague and I really want to pick up at Oxford if I can, but it's unclear how to make the delivery
Help?
Meta Grant Making Idea
TL;DR: Get others to predict the grant maker's answer. But not with a prediction market.
Longer:
Today an EA told me their funding request got rejected and they got no feedback about it. (Frustrating!)
They asked me to help them guess why they were rejected, and I offered some different ideas (one was "this specific fund doesn't know how to vet [some aspect of your idea]".
Wouldn't it be great if the original grant maker could review what I wrote, and respond with correct/incorrect, or maybe mark the part that was most correct if any?
This... (read more)
[Personal fit within software] is neglected in EA. Need to write about that sometime
TL;DR:
https://forum.effectivealtruism.org/posts/gbPthwLw3NovHAJdp/new-80-000-hours-career-review-software-engineering?commentId=tb9xwBTymmpS8QuqF