All of Raemon's Comments + Replies

I work for Habryka, so my opinion here should be discounted. (for what it's worth I think I have disagreed with some of his other comments this week, and I think your post did update me on some other things, which I'm planning to write up). But re:

incorrectly predicted what journalists would think of your investigative process, after which we collaborated on a hypothetical to ask journalists, all of whom disagreed with your decision.

this seems egregiously inaccurate to me. Two of the three journalists said some flavor of "it's complicated" on the topic of ... (read more)

I think it's worth pointing to the specifics of each, because I really don't think it's unreasonable to gloss as "all of whom disagreed."

I would delay publication.

This goes without saying.

I think it depends a lot on the group's ability to provide evidence the investigators' claims are wrong. In a situation like that I would really press them on the specifics. They should be able to provide evidence fairly quickly. You don't want a libel suit but you also don't want to let them indefinitely delay the publication of an article that will be damaging to

... (read more)

What’s wrong with “make a specific targeted suggestion for a specific person to do the thing, with an argument for why this is better than whatever else the person is doing?”, like Linch suggests?

This can still be hard, but I think the difficulty lives in the territory, and is an achievable goal for someone who follows EA Forum and pays attention to what organizations do what.

3
Brad West
6mo
Nothing is wrong with that. In fact it is a good thing to do. But this post seemed to discourage people from providing their thoughts regarding things that they think should be done unless they want to take personal responsibility for either personally doing it (which could entail a full-time job or multiple full-time jobs) or personally take responsibility for finding another person who they are confident will take up the task.  It would be great if the proponent of an idea or opinion had the resources and willingness to act on every idea and opinion they have, but it is helpful for people to share their thoughts even if that is not something they are able or willing to do. I would agree with a framing of the Quick take that encouraged people to act on their should or personally find another person who they think will reliably act on it, without denigrating someone who makes an observation about a gap or need. Speaking as someone who had an idea and acted upon it to start an organization while maintaining a full-time job to pay my own bills and for the needs of the organization, it is neither easy for most people to do a lot of things that "should be done" nor is it easy to persuade others to give up what they are doing to "own" that responsibility. In my view there is nothing wrong with making an observation of a gap or need that you think it would be cost-effective to fill, if that is all that you are able or willing to do.

It seemed useful to dig into "what actually are the useful takeaways here?", to try an prompt some more action-oriented discussion.

The particular problems Elizabeth is arguing for avoiding:

  • Active suppression of inconvenient questions
  • Ignore the arguments people are actually making
  • Frame control / strong implications not defended / fuzziness
  • Sound and fury, signifying no substantial disagreement
  • Bad sources, badly handled
  • Ignoring known falsehoods until they're a PR problem

I left off "Taxing Facebook" because it feels like the wrong name (since it's not really p... (read more)

Is your concrete suggestion/ask "get rid of the karma requirement?"

6
Gemma Paterson
7mo
Hmmm I'm not being as prescriptive as that. Maybe there is a better solution to this specific problem - maybe requiring someone with higher karma to confirm the suggestion? (original person gets the credit)

Quick note: I don't think there's anything wrong with asking "are you an english speaker" for this reason, I'm just kinda surprised that that seemed like a crux in this particular case. Their argument seemed cogent, even if you disagreed with it.

The comments/arguments about the community health team mostly make me think something more like "it should change its name" than be disbanded. I think it's good to have a default whisper network to report things to and surreptitiously check in with, even if they don't really enforce/police things. If the problem is that people have a false sense of security, I think there are better ways to avoid that problem.

Just maintaining the network is probably a fair chunk of work.

That said – I think one problem is that the comm-health team has multiple roles. I'm ho... (read more)

But a glum aphorism comes to mind: the frame control you can expose is not the true frame control.

I think it's true that frame control (or, manipulation in general) tends to be designed to make it hard to expose, but, I think the actual issue here is more like "manipulation is generally harder to expose than it is to execute, so, people trying to expose manipulation have to do a lot of disproportionate work."

Part of the reason I think it was worth Ben/Lightcone prioritizing this investigation is as a retro-active version of "evaluations."

Like, it is pretty expensive to "vet" things. 

But, if your org has practices that lead to people getting hurt (whether intentionally or not), and it's reasonably likely that those will eventually come to light, orgs are more likely to proactively put more effort into avoiding this sort of outcome.

2
Ozzie Gooen
7mo
That sounds a lot like what I picture as an "evaluation"? I agree that spending time on evaluations/investigations like this is valuable.  Generally, I agree that - the more (competent) evaluations/investigations are done, the less orgs will feel incentivized to do things that would look bad if revealed.  (I think we mainly agree, it's just terminology here)
Raemon
7mo59
18
1
1
2

(crossposted from LessWrong)

This is a pretty complex epistemic/social situation. I care a lot about our community having some kind of good process of aggregating information, allowing individuals to integrate it, and update, and decide what to do with it.

I think a lot of disagreements in the comments here and on LW stem from people having an implicit assumption that the conversation here is about "should [any particular person in this article] be socially punished?". In my preferred world, before you get to that phase there should be at least some period f... (read more)

0
Morpheus_Trinity
7mo
I don't think the initial goal of this discussion was to punish anyone socially. In my view, the author shared their findings because they were worried about our community's safety. Then, people in our community formed their own opinions based on what they read. In the comments, you can see a mix of things happening. Some people asked questions and wanted more information from both the author and the person being accused. Others defended the person being accused, and some just wanted to understand what was going on. I didn't see this conversation starting with most people wanting to punish someone. Instead, it seemed like most of us were trying to find out the truth. People may have strong feelings, as shown by their upvotes and downvotes, but I think it's important to be optimistic about our community's intentions. Some people are worried that if we stay impartial for too long, wrongdoers might not face any consequences, which is like letting them "get away with murder," so to speak. On the other hand, some are concerned about the idea of "cancel culture." But overall, it seems like most people just want to keep our community safe, prevent future scandals, and uncover the truth.

I don't know about Jonas, but I like this more from the self-directed perspective of "I am less likely to confuse myself about my own goals if I call it talent development." 

3
Jonas V
7mo
Yes, this.
4
James Herbert
8mo
Thanks! So, to check I understand you, do you think when we engage in what we've traditionally called 'community building' we should basically just be doing talent development?  In other words, your theory of change for EA is talent development + direct work = arrival at our ultimate vision of a radically better world?[1] Personally, I think we need a far more comprehensive social change portfolio. 1. ^ E.g., a waypoint described by MacAskill as something like the below: "(i) ending all obvious grievous contemporary harms, like war, violence and unnecessary suffering; (ii) reducing existential risk down to a very low level; (iii) securing a deliberative process for humanity as a whole, so that we make sufficient moral progress before embarking on potentially-irreversible actions like space settlement." 

I do wanna note, I thought the experience of using the google campus was much worse than many other EAGs I've been at – having to walk 5-10 minutes over to another part of the campus, hope that anyone else had shown up to the event I wanted to go to (which they often hadn't) eventually left me with a learned helpnessness about trying to do anything.

2
Rebecca
8mo
I experienced this at EAG London 2022 as well, as that event was spread out over multiple buildings and streets.

TL;DR;BNOB 

("but not obviously bad")

Hmm, have there been applications that are like "what's your 50th percentile expected outcome?" and "what's your 95th percentile outcome?"

3
NickLaing
10mo
Such a great idea love it - never seen that. I think for EA style applications that could work well, for other applications it might be hard for many people to grasp.

I listed those on an SFF application last year, although I can't remember if they asked for it explicitly. I think it's a good idea.

Note: the automatic audio for this starts with what sounds like some weird artifacts around the image title.

I think there's a reasonable case that, from a health perspective, many people should eat less meat. But "less meat" !== "no meat". 

Elizabeth was pretty clear on her take being:

Most people’s optimal diet includes small amounts of animal products, but people eat sub-optimally for lots of reasons and that’s their right.

i.e. yes, the optimal diet is small amounts of meat (which is less than most people eat, but more than vegans eat).

The article notes:

It’s true that I am paying more attention to veganism than I am to, say, the trad carnivore idiots, even

... (read more)

The argument isn’t about that at all, and I think most people would agree that nutrition is important.

It sounds like you're misreading the point of the article.

The entire point of this article is that there are vegan EA leaders who downplay or dismiss the idea that veganism requires extra attention and effort. It doesn't at all say "there are some tradeoffs, therefore don't be vegan."  (it goes out of the way to say almost the opposite)

Whether costs are worth discussing doesn't depend on how large one cost is vs the other – it depends on whether the h... (read more)

Is there a word in the rest-of-the-world that means "everything that supports the core work and allows other people to focus on the core work?"

6
Joseph Lemien
4mo
I have an answer for this now: line functions and staff functions. Line functions do the core work on the organization, while staff function "supports the organization with specialized advisory and support functions." My vague impression is that this labelling/terminology is fairly common among high-level management types, but that people in general likely wouldn't be familiar with it.
5
Linda Linsefors
1y
I took a minute to think about what sort of org has a natural distinction between "core work" and "non-core-work". A non-EA example would be a Uni research lab. There are usually a clear distinction between * research (core work) * teaching (possibly core work, depending on who you ask) * and admin (everting else) Where the role of admin seems similar to EA ops. 
3
Grayden
1y
Most organizations do not divide tasks between core and non-core. The ones that do (and are probably most similar to a lot of EA orgs) are professional services ones
2
Joseph Lemien
1y
I think there isn't a single term (although I'm certainly not an expert, so maybe someone with a PhD in business or a few decades of experience can come and correct me). Finance, Marketing, Legal, Payroll, Compliance, and so on could all be departments, divisions, or teams within an organization, but I don't know of any term used to cover all of them with the meaning of "supporting the core work." I'm not aware of any label that is used outside of EA analogous to how "operations" is used within in EA.
2
Vaidehi Agarwalla
1y
"administration" ? but that sounds quite unappealing, which is why I think the EA movement has used operations. 

I hadn't looked into the details of Windfall Clause proposed execution and assumed it was prescribing something closer to GiveDirectly than "CEO gets to direct it personally." CEO gets to direct it personally does seem obviously bad.

The "disadvantaged background" thing does turn out to show up in the top several google results, so, does seem like a real thing, although I also had no idea until this moment and would have naively used the term "talent search" in the way you describe.

Another angle on this (I think this is implied by the OP but didn't quite state outright?)

All the community-norm posts are an input into effective altruism. The gritty technical posts are an output. If you sit around having really good community norms, but you never push forward the frontier of human knowledge relevant to optimizing the world, I think you're not really succeeding at effective altruism. 

It is possible that frontier-of-human-knowledge posts should be paid for with money rather than karma, since karma just isn't well suited for rewarding it. But, yeah it seems like it distorts the onboarding experience of what people learn to do on the forum.

A related, important consideration when Lightcone arranged to buy the Rose Garden Inn (for similar reasons as Wytham Abbey), is that the Inn can also be resold if it turns out not to be as valuable. So thinking of this as "15 million spent" isn't really right here.

The Rose Garden Inn is even something at a comparable price point to pressure test against. As in it is the same ballpark general distance to most of the potential users, roughly the same price, within a factor of 2 in room count, etc. but way more run down, and as recent breakins have shown, though perhaps way more vulnerable to people just walking on premises and stealing construction materials as they work to fix it up.

I do think the Lightcone example is a large part of why I'm not up in arms about this. They've demonstrated in their existing somewhat s... (read more)

(it'd be handy to have a link in the opening paragraph so if I wanna avoid spoilers I can go do that easily)

I'm not sure what your imagining, in terms of overall infrastructural update here. But, here's a post that is in some sense a followup post to this:

https://www.lesswrong.com/posts/FT9Lkoyd5DcCoPMYQ/partial-summary-of-debate-with-benquo-and-jessicata-pt-1 

Where are you expecting to find your audience? (I feel surprisingly ignorant on how journal projects like this bootstrap their way into wider readership)

Answer by RaemonMay 27, 202213
0
0

You probably have set your user to use Markdown, specifically. Go to your user settings, open "site customizations", and check that you don't have "use markdown" set.

5
Evan_Gaensbauer
2y
Thank you for providing this information as a public service. This comment will be the last one I ever post with markdown as the default setting for formatting.

While I agree with Vaidehi's comments on whether "value drift" is the right descriptor, I think it's true that proportion of in-practice-priorities has probably shifted.

As someone who endorses the overall shift towards longtermist priorities, I still do agree with this post. I think it's important people be thinking for themselves and not getting tugged along with social consensus.

9
Vaidehi Agarwalla
2y
I think the challenge is that the recent changes can be described in a number of different ways: * Object level changes to fields, disciplines or industries that we focus on which is priorities shift * Changes in (attitudes and behaviors) regarding spending which maybe could be described as lifestyle shift (and relatedly, increasing importance ascribed to EA time, which could be a bit of a values shift) * A more ambitious and less risk averse attitude, which maybe is a culture shift I'm not quite sure how I'd summarise these changes with 1 phrase or word, but these things in combination does create a certain... "aesthetic" that feels coherent - I could create a "2022 EA starter pack" meme that would probably capture the above pretty accurately. 

My answer is that you should primarily be focused on saving, so that you have the financial freedom to pivot, change jobs, learn more, or found an organization. Previously, I recommended new EAs (esp. college students) give 1%, save at least 10% (so that they were building at least some concrete altruistic habits, while mostly focusing on building up slack).

I think this remains good practice in the current environment. (Giving 1% is somewhat a symbolic gift in the first place, and I think it's still a useful forcing function to think about which organizati... (read more)

I'd fine it helpful with the spreadsheet to also have people's usernames listed beside the post.

I agree with this, and think maybe this should just be a top-level post

2
Greg_Colbourn
2y
Done :)

(LW Developer here: there's a code update ready-to-ship that updates the /reviewVoting page to show the outcome. It's been a bit delayed in merging roughly because JP and I are in different timezones)

I definitely still stand by the overall thrust of this post, which I'd summarize as:

"The default Recommended EA Action should include saving up runway. It's more important to be able to easily switch jobs, or pivot into a new career, or absorb shocks while you try risky endeavors, than to donate 10%, especially early in your career. This seems true to me regardless of whether you're primarily earning to give, or hoping to do direct work, or aren't sure."

I'm not particularly attached to my numbers here. I think people need more runway than they think, and I... (read more)

I wrote a fairly detailed self-review of this post on the LessWrong 2019 Review last year. Here are some highlights:

  • I've since changed the title to "You have about Five Words" on LessWrong. I just changed it here to keep it consistent. 
  • I didn't really argue for why "about 5". My actual guess for the number of words you have is "between 2 and 7." IConcepts will, in the limit, end up getting compressed into a form that one person can easily/clumsily pass on to another person who's only kinda paying attention or only reads the headline. It'll hit some ev
... (read more)

Oh man, this is pretty cool. I actually like the fact that it's sort of jagged and crazy.

This was among the most important things I read recently, thanks! (Mostly via reminding me "geez holy hell it's really hard to know things.")

That is helpful, thanks. I've been sitting on this post for years and published it yesterday while thinking generally about "okay, but what do we do about the mentorship bottleneck? how much free energy is there?", and "make sure that starting-mentorship is frictionless" seems like an obvious mechanism to improve things.

https://forum.effectivealtruism.org/posts/JJuEKwRm3oDC3qce7/mentorship-management-and-mysterious-old-wizards

In another comment you mention:

(One example would be the high levels of self-censorship required.)

I'm curious what the mechanism underlying the "required-ness" is. i.e. which of the following, or others, are most at play:

  • you'd get voted out of office
  • you'd lose support from your political allies that you need to accomplish anything
  • there are costs imposed directly on you/people-close-to-you (i.e. stress)

A related thing I'm wondering is whether you considered anything like "going out with a bang", where you tried... just not self-censoring, and... probably lo... (read more)

  • you'd get voted out of office

No, not this one. I don't think there was anything I wanted to say that would have been harmful enough to turn the Eye of Sauron(*) upon me.

  • there are costs imposed directly on you/people-close-to-you (i.e. stress)

Nah, any stress would have been a tertiary effect from...

  • you'd lose support from your political allies that you need to accomplish anything

This was the big one. I was already a black sheep when I got voted into office; I had negative amounts of political capital within my party. I had to focus a ton of... (read more)

The issue isn't just the conflation, but missing a gear about how the two relate.

The mistake I was making, that I think many EAs are making, is to conflate different pieces of the moral model that have specifically different purposes.

Singer-ian ethics pushes you to take the entire world into your circle of concern. And this is quite important. But, it's also quite important that the way that the entire world is in your circle of concern is different from the way your friends and government and company and tribal groups are in your circle of concern.

In part... (read more)

Just wanted to throw up my previous exploration of a similar topic. (I think I had a fairly different motivation than you – namely I want young EAs to mostly focus on financial runway so they can do risky career moves once they're better oriented).

tl;dr – I think the actual Default Action for young EAs should not be giving 10%, but giving 1% (for self-signalling), and saving 10%. 

2
Benjamin_Todd
4y
It's a good point there could also be good cultural effects from encouraging people to save more as well as the negatives I mention.

I recently chatted with someone who said they've been part of ~5 communities over their life, and that all but one of them was more "real community" like than the rationalists. So maybe there's plenty of good stuff out there and I've just somehow filtered it out of my life.

1
Richard_Leyba_Tejada
4mo
I saw what seemed like potential communities over the years "soccer club, improv comedy club, local toastmasters" but I was afraid... to be myself, being judged, making a fool of me, worried about being liked... so I passed. Here I am now in EA giving it a shot. I may go to the improv comedy mtgs soon. According to Hari's "Lost connections" finding a community is very important; we social animals and don't do well in loneliness.

The "real communities" I've been part of are mostly longer-established, intergenerational ones. I think starting a community with almost entirely 20-somethings is a hard place to start from. Of course most communities started like that, but not all of them make it to being intergenerational.

Alas, I started writing it and then was like "geez, I should really do any research at all before just writing up a pet armchair theory about human motivation."

I wrote this Question Post to try to get a sense of the landscape of research. It didn't really work out, and since then I... just didn't get around to it.

Currently, there's only so many people who are looking to make friends, or hire at organizations, or start small-scrappy-projects together.

I think most EA orgs started out as a small scrappy project that initially hired people they knew well. (I think early-stage Givewell, 80k, CEA, AI Impacts, MIRI, CFAR and others almost all started out that way – some of them still mostly hire people they know well within the network, some may have standardized hiring practices by now)

I personally moved to the Bay about 2 years ago and shortly thereaft... (read more)

1
agent18
4y
Very much appreciate the detailed response. I think you have answered both my questions. Very much appreciate the clear example. If there are only 100 jobs in EA per year, it seems unlikely to support 1000s in the way you have suggested (rate limited). How does a "median EA" look? 1. he (the median EA) is within the 60-90th percentile (I am unsure of what, IQ?) 2. In the case with LW, he was able to talk about rationality and the "surrounding ecosystem". If you can, I would really like an example for this? P.S I am trying to judge if I could be a potential "median-EA". Hence the questions. Thanks.

I expect to want to link this periodically. One thing I could use is clearer survey data about how often volunteering is useful, and when it is useful almost-entirely-for-PR reasons. People often are quite reluctant to think volunteering isn't useful will say "My [favorite org] says they like volunteers!". (My background assumption is that their favorite org probably likes volunteers and needs to say so publicly, but primarily because of long-term-keeping-people-engaged reasons. But, I haven't actually seen reliable data here)

I just donated to the first lottery, but FYI I found it surprisingly hard to navigate back to it, or link others to it. It doesn't look like the lottery is linked from anywhere on the site and I had to search for this post to find the link again.

The book The Culture Map explores these sorts of problems, comparing many cultures' norms and advising on how to bridge the differences.

In Senegal people seem less comfortable by default expressing disagreement with someone above them in the hierarchy. (As a funny example, I've had a few colleagues who I would ask yes-or-no questions and they would answer "Yes" followed by an explanation of why the answer is no.)

Some advice it gives for this particular example (at least in several 'strong hierarchy' cultures), is instead of a ... (read more)

Tying in a bit with Healthy Competition:

I think it makes sense (given my understanding of the folk at 80k's views) for them to focus the way they are. I expect research to go best when it follows the interests and assumptions of the researchers.

But, it seems quite reasonable if people want advice for different background assumptions to... just start doing that research, and publishing. I think career advice is a domain that can definitely benefit from having multiple people or orgs involved, just needs someone to actually step up and do it.

Load more