Quick takes

Which interesting EA-related bluesky accounts do you know of?

I'm not using Twitter anymore since it's being used to promote hateful views, but Bluesky is quite a cool online space in my opinion.

I'm making a list of Bluesky accounts of EA-related organisations and key people. If you're active on Bluesky or some of your favourite EA orgs or key people are, please leave a comment with a link to their profile!

I've also made an EA (GHD+AW+CC) Starter Pack in case you're interested. Let me know who I should add! Effective Environmentalism also has a pack with ef... (read more)

Oh this is great, thanks for putting it together!

EA Forum feature request: Can we get a bluesky profile link button for profile pages?

3
Sarah Cheng
Thanks for the suggestion! This should be relatively quick to add so I'll see if we can do it soon. :) I was also thinking of setting up a bluesky bot account similar to our twitter account. Do you know how active the EA-ish bluesky community is?

High-variance. Most people seem to have created an account and then gone back to being mostly on (eX)twitter. However, there are some quite active accounts. I'm not the best to ask this question to, since I'm not that active either. Still, having the bluesky account post as a mirror of the twitter acccount maybe isn't hard to set up?

Quick take on Burnout

Note: I am obviously not an expert here nor do I have much first hand experience but I thought it could be useful for people I work with to know how I currently conceptualize burnout. I was then encouraged to post on the forum. This is based off around 4 cases of burnout that I have seen (at varying levels of proximity) and conversations with people who have seen significantly more.

  • Different Conceptions of Burnout
    • Basic conception that people often have: working too hard until energy is depleted.
    • Yes, working too hard can lead to exhaust
... (read more)

Relatedly, I think in many cases burnout is better conceptualised as depression (perhaps with a specific work-related etiology). 

Whether burnout is distinct from depression at all is a controversy within the literature:

I think that this has the practical implications that people suffering from bu... (read more)

From some expressions on extinction risks as I have observed - extinction risks might actually be suffering risks. It could be the expectation of death is torturing.  All risks might be suffering risks.

Offer subject to be arbitrarily stopping at some point (not sure exactly how many I'm willing to do)

Give me chatGPT Deep Research queries and I'll run them. My asks are that:

  1. You write out exactly what you want the prompt to be so I can just copy and paste something in
  2. Feel free to request a specific model (I think the options are o1, o1-pro, o3-mini, and o3-mini-high) but be ok with me downgrading to o3-mini
  3. Be cool with me very hastily answering the inevitable set of follow-up questions that always get asked (seems unavoidable for whatever reason). I might say something like "all details are specified above; please use your best judgement"
4
Neel Nanda
Note that the UI is atrocious. You're not using o1/o3-mini/o1-pro etc. It's all the same model, a variant of o3, and the model in the bar at the top is completely irrelevant once you click the deep research button. I am very confused why they did it like this https://openai.com/index/introducing-deep-research/

I did not know that, thanks!

It's the first official day of the AI Safety Action Summit, and thus it's also the day that the Seoul Commitments (made by sixteen companies last year to adopt an RSP/safety framework) have come due.

I've made a tracker/report card for each of these policies at www.seoul-tracker.org.

I'll plan to keep this updated for the foreseeable future as policies get released/modified. Don't take the grades too seriously — think of it as one opinionated take on the quality of the commitments as written, and in cases where there is evidence, implemented. Do feel free to... (read more)

Hi! I’m looking for help with a project. If you’re interested or know someone who might be, it would be really great if you let me know/share. I'll check the forum forum for dms.

  1. Help with acausal research and get mentoring to learn about decision theory
  • Motivation: Caspar Oesterheld (inventor/discoverer of ECL/MSR), Emery Cooper and I are doing a project where we try to get LLMs to help us with our acausal research.
    • Our research is ultimately aimed at making future AIs acausally safe.
  • Project: In a first step, we are trying to train an LLM classifier that eva
... (read more)

I have a weird amount of experience with the second thing (dealing with formatted PDFs) and may be able to help - feel free to DM!

One of the alleged Zizian murderers has released a statement from prison, and it's a direct plea for Eliezer Yudkowsky specifically to become a vegan

This case is getting a lot of press attention and will likely spawn a lot of further attention in the form of true crime, etc. The effect of this will be likely to cement Rationalism in the public imagination as a group of crazy people (regardless of whether the group in general opposes extremism), and groups and individuals connected to rationalism, including EA, will be reputationally damaged by association. 

ChatGPT deep-research users: What type of stuff does it perform well on? How good is it overall? 

Bit the bullet and paid them $200. So far, it's astonishingly good. If you're in the UK/EU, you can get a refund no questions asked within 14 days so if you're on the fence I'd definitely suggest giving it a go

Disclaimer: I think the instant USAID cuts are very harmful, they directly affect our organisation's wonderful nurses and our patients. I'm not endorsing the cuts, I just think exaggurating numbers when  communicating for dramatic effect (or out of ignorance) is unhelpful and doesn't build trust in institutions like the WHO.

Sometimes the lack of understanding, or care in calulations from leading public health bodies befuddles me.

"The head of the United Nations' programme for tackling HIV/AIDS told the BBC the cuts would have dire impacts across the gl... (read more)

Showing 3 of 4 replies (Click to show all)
18
Jason
This is a quote from a BBC news article, mainly about US political and legal developments. We don't know what the actual statement from the ED said, but I don't think there's enough here to infer fault on her part.  For all we know, the original quote could have been something like predicting that deaths will increase by 6.3 million if we can't get this work funded -- which sounds like a reasonable position to take. Space considerations being what they are, I could easily see a somewhat more nuanced quote being turned into something that sounded unaware of counterfactual considerations. There's also an inherent limit to how much fidelity can be communicated through a one-sentence channel to a general audience. We can communicate somewhat more in a single sentence here on the Forum, but the ability to make assumptions about what the reader knows helps. For example, in the specific context here, I'd be concerned that many generalist readers would implicitly adjust for other funders picking up some of the slack, which could lead to double-counting of those effects. And in a world that often doesn't think counterfactually, other readers' points of comparison will be with counterfactually-unadjusted numbers. Finally, a fair assessment of counterfactual impact would require the reader to understand DALYs or something similar, because at least a fair portion of the mitigation is likely to come from pulling public-health resources away from conditions that do not kill so much as they disable. So while I would disagree with a statement from UNAIDS that actually said if the U.S. doesn't fund PEPFAR, 6.3MM more will die, I think there would be significant drawbacks and/or limitations to other ways of quantifying the problem in this context, and think using the 6.3MM number in a public statement could be appropriate if the actual statement were worded appropriately. 

Thanks Jason - those are really good points. In general maybe this wasn't such a useful thing to bring up at this point in time, and in general its good that she is campaigning for funding to be restored. I do think the large exaggeration though means this a bit more than a nitpick.

I've been looking for her saying the actual quote, and have struggled to find it. A lot of news agencies have used the same quote I used above with similar context.  Mrs. Byanyima even reposted on her twitter the exact quote above...

"AIDS-related deaths in the next 5 years ... (read more)

4
NickLaing
The idea that no (or even few) Sub-Saharan African countres would stand in the gap for their most vulnerable people with HIV, abandoning them to  horrendous sickness and death from HIV that would overwhelm their health systems shows lack of insight. Countries simply can't afford to leave people with HIV completely high and dry, economically and politcally. HIV medication would be a priority for most African countries - either extra fundng would be allocated or money switched from other funds to HIV treatment. As much as governments aren't utilitarian, they know the disaster that would ensue if HIV medications were not given and their heallth systems were overwhelmed. AIDS is a horrible condition which lasts a long time and robs individuals and families of their productivity. Granted care might be far worse. Funding for tests like viral load cold be cut, there might be disastrous medicaion stockouts. Hundreds of thousands or even more could die because of these USAID cuts. Funding for malaria, tuberculosis and other treatments might fall by the wayside but I believe for most countries HIV care would be a top priority. There would be some countries that are either too poor or unstable where this might not happen. Countrie like South Sudan, DRC, Somalia - but I strongly believe that most countries would provide most people with HIV most of their treatment for free. Besides this, given it is life saving I would estimate maybe half (uncertain) of peopl ewith HIV would buy their own medication if there was no other option - if the alternative is death their family would pool money to keep them alive. Another minor point is that I think drug companies would likely hugely drop the cost of medication as well - otherwise they wouldn't be able to sell much of it.

I think there's a nice hidden theme in the EAG Bay Area content, which is about how EA is still important in the age of AI (disclaimer: I lead the EAG team, so I'm biased). It's not just a technical AI safety conference, but it's also not ignoring the importance of AI. Instead, it's showing how the EA framework can help prioritise AI issues, and bring attention to neglected topics.

For example, our sessions on digital minds with Jeff Sebo and the Rethink team, and our fireside chat with Forethought on post-AGI futures, demonstrate how there's important AI r... (read more)

I don't seem to see the fireside chat with forethought on the agenda, will it be added later? I'd love to attend!

Lizka
82
10
0
16
1

When I try to think about how much better the world could be, it helps me to sometimes pay attention to the less obvious ways that my life is (much) better than it would have been, had I been born in basically any other time (even if I was born among the elite!).

So I wanted to make a quick list of some “inconspicuous miracles” of my world. This isn’t meant to be remotely exhaustive, and is just what I thought of as I was writing this up. The order is arbitrary.

1. Washing machines

It’s amazing that I can just put dirty clothing (or dishes, etc.) into a ... (read more)

I love this write up. Re point 2 — I sincerely think we are in the golden age of media, at least in ~developed nations. There has never been a time where any random person could make music, write up their ideas, or shoot an independent film and make a living out of it! The barrier to entry is so much lower, and there are typically no unreasonable restrictions on the type of media we can create (I am sure medieval churches wouldn't be fans of heavy metal). If we don't mess up our shared future, all this will only get better.

Also, I feel this should have been a full post and not a quick note.

9
Mo Putera
I like this; feels like a more EA-flavored version of Gwern's My Ordinary Life: Improvements Since the 1990s. 
4
yanni kyriacos
Great image selection!

TLDR: Notes on confusions about what we should do about digital minds, even if our assessments of their moral relevance are correct[1]

I often feel quite lost when I try to think about how we can “get digital minds right.” It feels like there’s a variety of major pitfalls involved, whether or not we’re right about the moral relevance of some digital minds.

Digital-minds-related pitfalls in different situations

Reality ➡️

Our perception ⬇️

These digital minds are (non-trivially) morally relevant[2]These digital minds are not morally relevant
We see thes
... (read more)

@Lucius Caviola has also written about this topic, e.g. Will disagreement about AI rights lead to societal conflict?

And my two cents on why I don't think we should worry about digital sentience (plus the slicing problem). :)

2
Toby Tremlett🔹
Thanks for writing this! I often think about this question with almost that exact numbered grid. And now I can cite your quick take :) I'm especially interested in outcome (2) (see this old post).  PS- this outcome is also known as "Disneyland with no children".

Part of me thinks we should spend years reflecting on lifelong decisions before making them; hence, we ought not encourage young people (e.g., university students) to sign the GWWC pledge.

However, a bigger part of me thinks locking in altruistic desires to mitigate future selfishness is *exactly* what we should be doing. Some argue that we shouldn't make life-long decisions as young people because our preferences and values may change. Yet, to me, this is all the more reason to take the GWWC pledge; it is precisely because our altruistic tendencies might w... (read more)

Showing 3 of 5 replies (Click to show all)
30
Michael Townsend🔸
It seems pretty hard to argue with the idea that: * You're more informed about what you're giving up if you take the 10% Pledge after having worked for 1–5 years, * and it's generally a good thing to be informed before you make life-long commitments!  But even still, I think being an undergrad at university is a pretty great time to take the 10% Pledge. Curious what you/others think of the arguments here. One thought is: why should the default be to keep 100% of your income? The world seems on fire, money seems like it can do a lot of good, and the people we're talking about pledging are likely  pretty rich. I think in almost all cases, if you're among the richest few percent of the world, it's the right thing to do to give 10% (or more) of your income to effective charities. And I think that, even while you're an undergrad, there's a good chance you can know with very high confidence you're going to end up being among the richest few percent — assuming you're not there already.  An analogy could be raising children as vegetarians/vegans. I think this is a totally justified thing to do, and I personally wish I was raised vegetarian/vegan, so that I never craved meat. Some think that it's not fair to impose this dietary restriction on a child who can't make an informed choice, and it'd be better to only suggest they stop eating meat after they know what it tastes like. But given that eating meat is wrong (and it's also an imposition on the child to make them eat meat before they know that it is wrong!) I don't think being an omnivore should be the default.  There's admittedly an important disanalogy here: the parent isn't making a lifelong commitment on behalf of the child. But I think it still gets at something. At least in from my own experience, I feel like I benefited a lot from taking the 10% Pledge while at uni. If I hadn't, I think there's a good chance my commitment to my values could have drifted, and on top of that, every time I did give, it'd have f

I guess my issue is that this all seems strictly worse than "pledge to give 10% for the first 1-2 years after graduation, and then decide whether to commit for life". Even "you commit for life, but with the option to withdraw 1-2 years after graduation", ie with the default to continue. Your arguments about not getting used to a full salary apply just as well to those imo

More broadly, I think it's bad to justify getting young people without much life experience to make a lifetime pledge, based on a controversial belief (that it should be normal to give 10%... (read more)

12
GraceAdams🔸
Currently at GWWC in our materials for EA Groups, we suggest that a Trial Pledge is a good starting point for people who are interested in effective giving, but are just learning about it. My personal POV: I think it's generally a good idea for people to try out giving 10% or take a Trial Pledge before committing to the 10% Pledge. I think it's important that people feel comfortable with giving that amount and think seriously about what tradeoffs they might need to make if they take a 10% Pledge. But I think introducing people to the idea of the 10% Pledge at university is a good idea. We see people end up taking pledges even 10+ years after learning about it at university!

Notes on some of my AI-related confusions[1]

It’s hard for me to get a sense for stuff like “how quickly are we moving towards the kind of AI that I’m really worried about?” I think this stems partly from (1) a conflation of different types of “crazy powerful AI”, and (2) the way that benchmarks and other measures of “AI progress” de-couple from actual progress towards the relevant things. Trying to represent these things graphically helps me orient/think. 

First, it seems useful to distinguish the breadth or generality of state-of-the-art AI ... (read more)

Showing 3 of 5 replies (Click to show all)

I found these visualizations very helpful! I think of AGI as the top of your HLAI section: human level in all tasks. Life 3.0 claimed that just being superhuman at AI coding would become super risky (recursive self improvement (RSI)). But it seems to me it would need to be ~human level at some other tasks as well like planning and deception to be super risky. Still, that could be relatively narrow overall.

4
Lizka
Follow-up:  Quick list of some ways benchmarks might be (accidentally) misleading[1] 1. Poor "construct validity"[2]( & systems that are optimized for the metric) 1. The connection between what the benchmark is measuring and what it's trying to measure (or what people think it's measuring) is broken. In particular: 2. Missing critical steps 1. When benchmarks are trying to evaluate progress on some broad capability (like "engineering" or "math ability" or "planning"), they're often testing specific performance on meaningfully simpler tasks. Performance on those tasks might be missing key aspects of true/real-world/relevant progress on that capability. 3. Besides the inherent difficulty of measuring the right thing, it's important to keep in mind that systems might have been trained specifically to perform well on a given benchmark. 1. This is probably a bigger problem for benchmarks that have gotten more coverage. 4. And some benchmarks have been designed specifically to be challenging for existing leading models, which can make new/other AI systems appear to have made more progress on these capabilities (relative to the older models) than they actually are. 1. We're seeing this with the "Humanity's Last Exam" benchmark. 5. ...and sometimes some of the apparent limitations are random or kinda fake, such that a minor improvement appears to lead to radical progress 2. Discontinuous metrics: (partial) progress on a given benchmark might be misleading. 1. The difficulty of tasks/tests in a benchmark often varies significantly (often for good reason), and reporting of results might explain the benchmark by focusing on its most difficult tests instead of the ones that the model actually completed. 1. I think this was an issue for Frontier Math, although I'm not sure how much strongly to discount some of the results as a result. 2. -> This (along with issues like 1b above, which can lead to saturation) is part of
3
NickLaing
Love it! I like that idea, and if its a lower bar psychologically to post in quicktakes that makes sense :).

How about grantmaking to support investigatory journalism on USAID recipients and USAID workers in the developing world? Anyone already doing this?

3
bruce
Don't have a lot of details to share right now but there are a bunch of folks coordinating on things to this effect - though if you have ideas or suggestions or people to put forward feel free to DM!
1
Alex319
I don't have any particular ideas for projects to start in this area, but if there are any projects that are already going on, I might be interested in supporting them. You can contact me to DM if/when you have anything to share!

Appreciate this! There are a decent amount happening; can you DM me with a bit more info about yourself / what you'd be willing to help with?

EA Forum Question posts with 50+ karma that seemed promising for finding 'Pivotal Questions'

RE: https://forum.effectivealtruism.org/posts/dPsgWav4Tryb4BrYv/pivotal-questions-an-unjournal-trial-initiative

David R: In general I don’t think all of these questions/question posts themselves contain pivotal questions. But some of them seem promising, and in others the responses seem to generate potential pivotal questions.

Should we push for a rapid malaria vaccine rollout? — EA Forum Bots

What EA projects could grow to become megaprojects, eventually spending $10... (read more)

AI Safety Monthly Meetup - Brief Impact Analysis 

For the past 8 months, we've (AIS ANZ) been running consistent community meetups across 5 cities (Sydney, Melbourne, Brisbane, Wellington and Canberra). Each meetup averages about 10 attendees with about 50% new participant rate, driven primarily through LinkedIn and email outreach. I estimate we're driving unique AI Safety related connections for around $6.

Volunteer Meetup Coordinators organise the bookings, pay for the Food & Beverage (I reimburse them after the fact) and greet attendees. This ini... (read more)

Load more