All of Richard Möhn's Comments + Replies

I think Yanni isn't writing about personal favourites. Assuming there is such a thing as objective truth, it makes sense to discuss cause prioritization as an objective question.

The outline structure makes this easy to skim. Thank you!

I like this. The actionable points are a bit buried in the prose, but you describe two ways of going astray that I hadn't thought about. Thank you!

One thing I would always mention is that false negatives are less costly in hiring than false positives. But I guess the article is written for an intermediate level of hiring skill, so that point is taken for granted.

2
Cait_Lion
7mo
Fully agree about false negatives vs. false positives! As you say, I was indeed taking that for granted. I was aiming to encourage people to think more carefully about tradeoffs between false negatives and other factors like speed.

It's long, but it looks like Rethink Priorities have put a lot of thought into this job posting: https://careers.rethinkpriorities.org/en/postings/8588ecc5-3e26-4086-bdb2-fe9a2eb43252

Sounds good!

By the way, another thing one might try: Adding salt during the soaking and again during the cooking. Perhaps one teaspoon per kg of beans. In my experience, it also reduces cooking times. I haven't evaluated it rigorously, though.

Perhaps it's because of farts? I hope I don't get downvoted for bringing this up – it's serious and, I suspect, a major inconvenience for people who cook beans from scratch.

It could be that cooking beans for a long time (maybe combined with regular skimming or whatever other techniques we don't know about) makes them cause way less flatulence than soaking them in little water and cooking for a short time. People recommend soaking for reducing beans' gas-generation potential, but in my experience (yes, I've used a tally counter to count my farts under diffe... (read more)

6
NickLaing
8mo
Hey Richard thanks so much for the comments. We are doing a bit of research, and your fermenting comment is a definite fear here, be and I'm going to test how long we can leave them before they start to ferment soon. This might be the biggest single concern issue people have raised so far The beans here are usually quite big, I don't think draining is a major issue. The water issues are good ideas, but my impression is at the moment they are not a major issue. 7 liters per 500g is quite a lot to be sure, but I'm not sure would be a major barrier, I could be wrong I'm about to make a quickpost with some initial results from our quick community survey, which will address a couple of these at least

Thanks for writing this analysis! I agree with a most of it. One other argument I've heard for not providing feedback after job applications is that it carries legal risk. What the risk is specifically, I don't know – perhaps a candidate could sue you for discrimination if you inadvertently choose the wrong words? A way to mitigate this risk is the phrase ‘You didn't demonstrate… [mastery of Python, facility in calming down angry customers, whatever]’. It avoids making statements about the candidate in general and instead focuses on their behaviour during ... (read more)

Another important skill for supervising translators:

  • Management of production processes. (In contrast to classic project management.)

And if the translators are semi-professionals drawn from the community:

  • Leadership/management

I've seen problems from a lack of these in one translation project.

Thanks for taking the initiative on this!

Thanks! I appreciate your comment. (Not so sure about the magnanimity. I spent a lot of time thinking about how to get my revenge.) But Harold Godsoe gave me some good advice.)

It happens often on this forum. 🤷‍♂️ (This is meant seriously, not as a reference to the mass-downvoting my article experienced.)

2
Un Wobbly Panda
1y
I'm mostly annoyed by the downvote because it makes the content invisible—I don't mind losing a lot of "karma" or being proven wrong or disagreed with. As an aside, I thought you, Richard Mohn, were one of the most thoughtful, diligent people on the forum. I thought your post was great. Maybe it was clunky, but in a way I think I understand and emphasize with—the way a busy, technically competent person would produce a forum post. There was a lot of substance to it. You were also impressively magnanimous about the abusive action taken against you. The vibe is sort of like a Michael Aird (who also commented), but with a different style.

This whole affair has cost me way more time than anyone else, I suspect. I just wanted to have some closure. And it's not like I ‘pressured’ someone to engage on the front page. (Although for some reason, more people appear to be looking at this than I expected.)

Thanks for not deleting my comment outright, though.

Ben_West
1yModerator Comment10
0
0

Mod here. Please don't try to munchkin our rules to find a way to deanonymize someone from a ban that was intended to be anonymous. (It's fine to give other evidence that you might have.)  People may choose to reply or not to reply to things for a bunch of different reasons. We really don't endorse pressuring people to engage on a given Forum thread. (See also: You don't have to respond to every comment.)

I'm glad it's helping!

Great reminder! This podcast episode has some actionable ideas for how to reach out to people who were laid off: https://www.manager-tools.com/2009/02/bench-development-downturn

2
mlc
1y
Thanks for the great source, Richard! I intentionally didn't include a description of how to best go about contacting people, as this post was more or less directed at more established orgs that have direct access to recruiters. However, after posting this and receiving messages from interested individuals/smaller orgs,  your contribution comes in really handy! If anyone is interested in more detailed information about contacting and/or being connected, please reach out!

Good to know, thanks!

For completeness, my idea of a rejection phone call (derived from https://www.manager-tools.com/2014/11/how-turn-down-job-candidate-part-1) is:

  • You call, greet the person, say in the first sentence that you won't be making an offer, say a few more short sentences, react to any responses, then hang up. You don't make it a conversation. The important thing is that they hear your voice.
  • It's fine to speak on voicemail and for the other person not to call back. This avoids phone tag.

Note that Manager Tools doesn't always have to most ai... (read more)

What share of people took you up on that?/Did anyone comment on the offer?

5
Linch
1y
I don't have statistics off the top of my head, but I want to say more than half. I think people were positive about it, but it's hard to get accurate takes when there are such strong incentives for people to just generally seem positive here, so I wouldn't take the positive sentiment there too seriously.

Because with email it's easy to read in a tone of ‘you suck, we're sending you boilerplate niceties to get rid of you’, which is not possible with a phone call. (Unless the caller makes it sound like boilerplate niceties. I'm not saying such calls are easy. Email is the easy cop-out.) Something like that. Have you had the experience where you keep communicating with someone by text and get more and more annoyed with them, then you get on a call and all annoyance melts away because hearing a voice reminds you of the other person's humanity? Perhaps it's just me who thinks strange things.

Ultimately it's an empirical question and my prediction is that on balance, a phone call has more value.

I agree that a rejection email isn't evidence that GiveWell is worse than other places. At the same time, even though it's standard practice, an organization can do better. A two-minute phone call to each of the few remaining candidates at later stages isn't that burdensome and has several benefits:

  • It makes the organization stand out as one that cares about applicants. Which is good because organizations compete for talent.
  • It maintains the relationship with the rejected candidate. Which is good because a candidate who got to the later stages might be fi
... (read more)
3
Linch
1y
Why would rejection hurt less in a call than an email?
4
dan.pandori
1y
Phone calls for me are socially awkward and I generally want some time to privately process rejection rather than immediately need to have a conversation about it. Also I generally keep my phone at home during business hours so it's quite likely I'd need to spend half an hour playing phone tag.

Thanks for explaining your vote! I agree, more promptness in the process is a good takeaway. Also, looking into how applications are rejected: At the later stages, a phone call is a much better choice than an email, I would say. (NB again: I didn't write the original post, but I'm interested in hiring processes and in keeping the forum civil.)

5
Will Bradshaw
1y
This might be a nice thing to do, but I definitely don't think it's required, and I don't think a lack of it is evidence that GiveWell's hiring is unprofessional or in need of reform. I don't have all that much sympathy for a candidate who gets angry because they got a boilerplate-ish rejection email; this is widespread standard practice. Getting rejected sucks, obviously, and I have sympathy for that, but I don't think pressuring orgs to take on burdensome practices to mitigate that is likely to be a good use of resources.

Thanks for explaining! (NB. I didn't write the original post, but I'm interested in hiring processes and in keeping the forum civil.)

Meta comment: There are many downvotes, but barely any comments. Feels a little uncivil. Certainly, the post has disagreeable points. But it's useful input, too.

People and organizations figure out things much harder than hiring well. Compare running one of the most used search engines on the planet with laying out a couple of assessments, a couple of people looking at them, a bit of communication by email and phone, and all run with reasonable promptness, much less than what one would expect from everyday postal services.

My experience: I’ve been living in the south of Japan for six years. It’s far from the most effective place to be. I gave up on being an independent researcher. I wanted financial stability and got a permanent work contract. If things go well, I’m going to have children soon. (Will MacAskill encourages people to have children in What We Owe the Future, by the way.) I don’t feel that guilty because I’m still a lot more effectively altruistic than the vast majority of people who would have the means.

According to https://finance.yahoo.com/news/ftx-japan-unit-drafts-plan-124544036.html, FTX Japan has about $150 M in assets, which isn't much compared to what the whole FTX conglomerate owes.

Nitpick: Localizing a largish number of texts looks more like a manufacturing or product development process to me. A classic ‘project manager’, as you mention in Roles, would have to keep this in mind and manage things differently (thinking about queues, batch size, work-in-process constraints, cycle time, throughput etc.).

Thank you, moderators! I didn't notice any trolls or spam, which I guess is evidence of your good work. :-)

Thanks for your concern about my karma! ;-) The difference between my comment and the reply is indeed surprising. I wouldn't have noticed it if you hadn't pointed it out. Here are other, more or less plausible, explanations:

  • Most likely: My comment was a quick, abstract throwaway. I even avoided the word ‘suicide’ because I didn't feel good about bringing it up explicitly. NeoMohist's reply is more concrete, emotional and caring. I guess people resonate with that more and want to say with their upvote: ‘Yes, me worried too. Please keep an eye on him.’
  • It
... (read more)

Some corrections of the Sequoia info:

  • I've never been a grad student.
  • I'm neither Japanese nor a Japanese citizen.
  • I ‘volunteered’ in the sense that people at Alameda reached out to me, I said ok and then got paid by the hour for my help.
  • ‘(obscure, rural)’ is an exaggeration. ‘provincial’ would be a more apt adjective for the location. The main bank we used was SMBC, the second-largest bank in Japan.
  • ‘for a fee’ sounds as if it was some sort of bribe to get them to do what we wanted. But we only paid the usual transaction fees and margin that any bank wo
... (read more)

I have 2 weeks to raise $8b

that's basically all that matters for the rest of my life

Two weeks to live? I'm slightly worried. But only slightly.

[To clarify: I wrote ‘slightly’ because it appears that Sam writes a lot of things that aren't very reliable and well thought-out. So I didn't want to put too much stock in a particular phrasing.]

5
WilliamKiely
1y
I had the same thought from the same two lines, as did a few other EAs when I asked on a Facebook thread. Re: Karma (because I've been noticing unexpected karma things recently and this is another unexpected karma thing): I'm not sure why your comment has been downvoted (6 karma, 9 votes) whereas the reply to you got a lot of upvotes (62 karma, 30 votes). Some hypotheses (even though others are better suited to answer!): 1. Perhaps it's a subtly with the wording? 1. The hypothesis that it's just a bad comment doesn't seem like a good hypothesis because I made essentially the same comment on a Facebook thread earlier and got positive engagement. So maybe it's something about the wording? 1. I know you and had the same thought as you, which is affecting my interpretation of the comment and making it hard for me to speculate what about the wording could make some people downvote it. I'd be interested in someone sharing why they'd downvote it if any of those people are reading this. 2. Maybe it's something to do with a top-level comment versus a reply? E.g. People could be voting differently on top-level comments to help sort which ones appear first on this top, and the fact that your comment is noting a speculative concern that SBF may be suicidal may seem less important for other users to see than other top-level comments. 3. NeoMohist is a new user; their reply to you was their first comment. Maybe that has something to do with why their comment got a lot of upvotes? But I'm not sure how it would.

In all seriousness, I hope he is on some sort of suicide watch. If anyone in his orbit is reading this, you need to keep an eye on him or have his dad or whoever keep an eye on him. 

Thanks for explaining! I'm happy to read that you're discussing this with other people, too.

Please forgive the insensitivity of the following question. I've been wondering about this for a while and now I'm (ab)using your post about your troubles and ambitions as a place to ask it: What is your thinking on charging money for the tech support part of your work?

The EA ecosystem appears to consist of organizations supporting each other for free, while being funded by a third party. How about third-parties funding only those organizations that do direct work and can't have paying customers, and having the rest be semi-commercial, organized by market... (read more)

7
Markus Amalthea Magnuson
1y
I've spent a lot of time this year looking into this exact scenario and discussing various models with many people with different views. Most other EA agencies are trying to figure it out as well. What is most likely is that I'll move to a hybrid model where the first X hours are free, and after that, most would pay some (below market rate) fee that is offset by larger clients that can afford market rate. The main reason for this is that my data suggests around 70% of clients would have tried to solve the issues themselves otherwise, which is a huge time waste. Another reason is that there is a significant transaction cost, especially given that the funding for services like these often comes from the same sources (in the EA funding landscape) in the end. In any case, I expect this part of the agency's activities to be relatively small in the future, as creating public goods and services is immensely more valuable.

Thanks for including my post here. Your summary is shockingly good! It captures the essence of my article very well.

For the record I'll note that not all the ‘bad’ things the hiring consultants had planned actually happened. Because the manager at the org that was hiring did some reading and then took over the process.

2
Zoe Williams
1y
Great to hear, and thanks for the clarification.

Thanks for taking the time to write up balanced feedback! I was surprised.

I'm starting to understand the message from your and other comments that the tone of the article is distracting from the content and even causing people to misunderstand it. When I write another article, I will take more time to work on the tone.

I knew that the introduction is written in a choppy way, but I didn't expect that it would be hard to read. Thanks for telling me that. Good point also that I should introduce key terms more explicitly. You pointing this out made me see it as... (read more)

I appreciate your questions and can't comment on them right now, I'm afraid. Sorry. I hope to be able to answer in a few weeks' or months' time. Please have patience.

(Thanks also for your other comment. I'll respond to that later today or tomorrow.)

It turns out that the article was mass-downvoted by throwaway accounts. So there weren't many downvotes to find a reason for after all. Thanks for your comment anyway. It allowed me to partially address some weaknesses of my article.

It turns out that the article was mass-downvoted by throwaway accounts. So there weren't many downvotes to find a reason for after all. Your comment helped me clarify some points, though.

Okay, you convince me. I've rewritten that item.

The reason why I wasn't noting that the table is inconsistent with ‘not predictive’ is that I was unconsciously equating ‘not predictive’ with ‘not sufficiently predictive to be worth the candidate's time’. Only your insisting made me think about it more carefully. Given that unconscious semantics, it's not a strong misrepresentation of the source either. But of course it's sloppy and you were right to point it out.

I hope this somewhat restores your expectation of my epistemic integrity. Also, I think there i... (read more)

It would be nice if you moved your last paragraph first. Recommending (in bold) based on a casual listening not to read a post feels unfair. (Speaking about fairness, there are other posts about hiring (eg. https://forum.effectivealtruism.org/posts/XpnJKvr5BKEKcgvdD/perhaps-the-highest-leverage-meta-skill-an-ea-guide-to#comments) that are argued more thinly than my post and have gotten much less criticism.) I agree with your alternative recommendation to read the post with skepticism. That's the case with any post.

I agree with some of your points. Especia... (read more)

They are the third and fourth row in the table, but the rows aren't ordered by the validity column. When you order by the validity column, integrity tests are 8th and conscientiousness tests are 12th unless I've miscounted.

I admit that I cherry-picked this article, basically only looked at the validity numbers in the table, and don't know anything else from that literature. This post has a wider view for those interested: https://forum.effectivealtruism.org/posts/j9JnmEZtgKcpPj8kz/hiring-how-to-do-it-better On the other hand, the validity table was excerpt... (read more)

7
MichaelA
1y
Oh crap, my bad, should've looked closer! (And that's ironic given my comment, although at least I'd say the epistemic standards for comments can/should be lower than for posts.) Sorry about that.  Though still I think "not predictive" seems like a strong misrepresentation of that source. I think correlations of .41 and .31 would typically be regarded as moderate/weak and definitely not "approximately zero". (And then also the apparently high incremental validity is interesting, though not as immediately easy to figure out the implications of.) I agree that "the points of [your] post rely only lightly on this article". But I still think this is a sufficiently strong & (in my view, seemingly) obvious* misrepresentation of the source that it would make sense to see this issue as a reason for readers to be skeptical of any other parts of the post that they haven't closely checked.  (I also find it surprising that in your two replies in this thread you didn't note that the table indeed seems inconsistent with "not predictive".) *I.e., it doesn't seem like it requires a very close/careful reading of the source to determine that it's saying something very different to "not predictive". (Though I may be wrong - I only jumped to the table, and I guess it's possible other parts of the paper are very misleadingly written.)

Thanks for pointing that out. I had only looked at the validity of each method on its own and not at the validity gain numbers. Don't the results indicate, though, that you would have to also subject the candidate to a GMA test if you want to get validity from conscientiousness and integrity tests? And GMA tests are rarely performed in hiring processes.

Pulling up an addendum from below (added 2022-10-19):

I would explain the high incremental validity by the fact that a GMA test barely measures conscientiousness and integrity. In fact, footnote ‘c,d’ menti

... (read more)
2
MichaelA
1y
[Update: This comment of mine was wrong, but I still think the claim in the post is contradicted by the source cited; see below.] It looks like integrity and conscientiousness tests were also the 3rd and 4th highest rated things for the "Validity" column itself, out of a large list? And they appear to have ranked above interviews and some CV-like things (e.g., reference checks and job experience (years)), yet your post recommends interviews and CVs.  I'm pretty confused by this apparent misreading of the source. I think readers should treat that as a reason for being more skeptical of the rest of the post. My guess is it'd be worth you "moving a bit slower" (to check sources more carefully etc.) and stating things less confidently in future posts. 

I agree. Thanks for taking the time to hash this out with me!

Addendum – from https://www.manager-tools.com/2019/01/manager-tools-data-one-ones-part-1-hall-fame-guidance:

Going back to company size, we've done 3 studies comparing the effect of WO3s in small, medium, and large organizations. We have never been able to find any significant difference in R&R improvements based on organization size. We have measured statistically similar improvements in companies of less than 50, and companies greater than 100,000 employees.

WO3s … weekly one-on-ones, R&R … results and retention

This is not directly relevant to ... (read more)

Makes sense. I'm a bit worried that people reading this will take away: ‘We're a small shop, therefore MT doesn't apply at all.’ This is not the case and I think Howie would agree. I've never worked at a big organization and MT still has helped me a lot. I've also read and listened to a ton of non-MT material on leadership, doing work, business, processes etc. So I could well be putting MT guidance in its proper context without being aware of it.

3
Howie_Lempel
2y
I definitely agree that takeaway would be a mistake. I think my view is more like "if the specifics of what MT says on a particular topic don't feel like they really fit your organisation, you should not feel bound to them. Especially if you're a small organisation with an unusual culture or if their advice seems to clash with conventional wisdom from other sources, especially in silicon valley. I'd endorse their book as useful for managers at any org. A lot of the basic takeaways (especially having consistent one on ones) seem pretty robust and it would be surprising if you shouldn't do them at all.

Good point, thanks! Manager Tools usually explain their guidance in detail, which makes it adaptable to all kinds of organizations. And since MT itself is a small company with, I guess, an unusual amount of trust among staff, I don't think they would put out material that fails to apply to them.

But I do agree that wider reading is necessary. Paul Graham's essays, for example, are a good counterpoint to MT's corporate emphasis, too.

7
Howie_Lempel
2y
"I don't think they would put out material that fails to apply to them." I think we mostly agree but I don't think that's necessarily true. My impression is that they mainly study what's useful to their clients and from what I can glean from their book, those clients are mostly big and corporate. I think they might fall outside of their main target audience. +1 to Paul grahams essays.

Thank you, too, for explaining your reservations! And sorry about the word ‘stud’ – I didn't know the connotations. I've now replaced it with ‘ace’.

I'll try to explain the general assertions and my disdain for scenario questions. This is not arguing against the points you made. It's just a clarification, which I should work into the article.

  • General assertions – I wasn't aware of this as a problem of my article. Thanks for pointing it out! – There are so many claims in the article that I don't have space and time to argue them all properly. That's why I

... (read more)
Load more