
I'm the Founder and Co-director of The Unjournal; We organize and fund public journal-independent feedback, rating, and evaluation of hosted papers and dynamically-presented research projects. We will focus on work that is highly relevant to global priorities (especially in economics, social science, and impact evaluation). We will encourage better research by making it easier for researchers to get feedback and credible ratings on their work.
Previously I was a Senior Economist at Rethink Priorities, and before that n Economics lecturer/professor for 15 years.
I'm working to impact EA fundraising and marketing; see https://bit.ly/eamtt
And projects bridging EA, academia, and open science.. see bit.ly/eaprojects
My previous and ongoing research focuses on determinants and motivators of charitable giving (propensity, amounts, and 'to which cause?'), and drivers of/barriers to effective giving, as well as the impact of pro-social behavior and social preferences on market contexts.
Podcasts: "Found in the Struce" https://anchor.fm/david-reinstein
and the EA Forum podcast: https://anchor.fm/ea-forum-podcast (co-founder, regular reader)
Twitter: @givingtools
Thanks Bob. I agree this would be high value. I've been mainly thinking about human/LLM agreement, but it would be useful to know how consistent each model is, how sensiitive it is to the prompts, whether the models differ in systematic ways, etc.
Actionable takeaways from doing this? Is a 'more stable setup' (one that e.g., has fairly consistent rank orderings) better all else equal, and thus something we should work towards? Probably, as the alternative seems like just 'adding noise'.
Knowing the stability also may tells us how much effort to put into designing and building consensus around a 'reasonable prompt'; if the results are insensitive to this, we shouldn't waste too much time.
Working on implementing something now, at least a first step. I hope to report back on some legible measures of prompt stability (or lack thereof).
Project Idea: 'Cost to save a life' interactive calculator promotion
What about making and promoting a ‘how much does it cost to save a life’ quiz and calculator.
This could be adjustable/customizable (in my country, around the world, of an infant/child/adult, counting ‘value added life years’ etc.) … and trying to make it go viral (or at least bacterial) as in the ‘how rich am I’ calculator?
The case
While GiveWell has a page with a lot of tech details, but it’s not compelling or interactive in the way I suggest above, and I doubt they market it heavily.
GWWC probably doesn't have the design/engineering time for this (not to mention refining this for accuracy and communication). But if someone else (UX design, research support, IT) could do the legwork I think they might be very happy to host it.
It could also mesh well with academic-linked research so I may have some ‘Meta academic support ads’ funds that could work with this.
Tags/backlinks (~testing out this new feature)
@GiveWell @Giving What We Can
Projects I'd like to see
EA Projects I'd Like to See
Idea: Curated database of quick-win tangible, attributable projects
I like the donor compass (https://donorcompass.rethinkpriorities.org/) , but I see a lot of room for improvement - some comments here, and I'll put some others as public comments using the Hypothes.is tool within that page. I hope they're helpful.
Simple mode
I slightly suspect that the basic mode is not as appealing as it could be to the sort of intellectually rigorous people who would be using this tool in the first place.
I don't recall being asked anything about discounting long term future payoffs or population ethics (discounting payoffs resulting from 'creating more people than are alive today/would be alive counterfactually'). OK , you did ask about my discounting people alive 100 years from now, 500 years from now in 'notched' ways. That did seem arbitrary, but fairly easy to understand.
Wanted a better mapping from answers to results: The answer at the end gives a breakdown but no explanation of why that was reached as a result of my answers. Which makes me less likely to put faith in it.
Questions were hard to interpret and guage:
"How much should animal welfare factor into funding decisions?" This one was decent because I could unfold and the weightings I was giving to animals below it, and make some choices. -- But it would be nice to see an explanation of how the defaults were chosen, perhaps as a tooltip. Also, I was surprised to see the "humans with disability" buried there in a question that was otherwise about humans versus nonhuman animals.
This one baffled me and confused a colleague I went through it with.
i. Intuitively, one might suspect 0% means "I'm not putting any value on mitigating existential risk from AI". That's what you might think if you answer quickly,
ii. But then, if you read it, you'd see that it was about applying some sort of extra prioritization to AI intervention. It's unclear why I would want to do this. The model should already be taking these things into account.
But now there's then a decent way to interpret what 0% and 100% mean here. But I have no way of understanding what 20% or 50% would mean in this context - I don't know what the units are.
A folding space explaining this and allowing you to choose the parameters more precisely here would help.
iii. Again, it's very unclear to me what the units are here and how my response here affects the outcomes. In a strictly logical sense, I'd imagine that putting zero would mean that I couldn't really donate to anything, because you can never avoid a possibility of doing any harm. And again, the units here are very unclear to me.
Advanced mode
OK, I can move to 'advanced mode'; if it was something usable, I'd probably want to see that option at the start? I only see that after I've completed the simple one.
However, it doesn't seem particularly usable unless you're already deep in the weeds on this stuff. You basically give access to a raw spreadsheet with some unexplained technical terms and computations ("Lexicographic Maximin" etc). This would benefit, of course, from tooltips, explanations, and folds, or at least a link to a full explainer of how this advanced mode works. At least there should be some sort of signposting here explaining that this is just an experimental version.
Quick take only for now because this is basically a social media post:
Updates on the Animal Futures tournament in progress: https://uj-animal-futures-update.netlify.app/
Some highlights: Solid participation, one cultivated-meat approval question already resolved, and a mixed bag of forecasts for animals.
Some good "news" for advocates: Forecasters give the Save Our Bacon Act 3% and the Canary Islands octopus farm 1%, expect about half of Europe's top 20 grocers to have shrimp welfare commitments, and see in-ovo sexing spreading in the EU (~44% of layers) (but barely in the US ~3%).
Less good, especially for the US: ~80% for at least one more state cultivated-meat ban, 2% for plant-based reaching 10% of US retail by 2031, and low expected fulfillment of 2026 corporate chicken pledges.
But I think predicting the future doesn't help much unless it informs decisions.
Help us: Who should we be sharing this with? What forecast would change a grant, campaign, or policy decision? Decisionmakers: what threshold matters, and what evidence would you need? Add your comments here, on that page, or DM.
And you can still play: https://www.metaculus.com/tournament/33016/
Metaculus Sentient Futures
Help The Unjournal prioritize AI economics and governance research
(https://uj-prioritization-dashboard.netlify.app/ai-governance/)
The Unjournal (https://info.unjournal.org/) is prioritizing research on AI economics, governance, social and economic impacts, and risks from increasingly capable AI. (NB: We're not covering technical/CS/ML/AI-safety research.). We want to commission expert public evaluations and help synthesize, disseminate, and curate this work.
Much of this research seems 1) important/impactful/influential, (2) involves considerable 'firepower' from prominent researchers and practitioners, (3) not 'obviously true', and (4) time-sensitive: relevant for funding, policy, and research-steering now, but not after the "six months to six years" required for the traditional (economics) journal process
Our preliminary shortlist page (https://uj-prioritization-dashboard.netlify.app/ai-governance/) includes paper summaries, AI-generated audio walkthroughs, and an interface for giving feedback. We also invite suggestions fr other research (please check the broader list/interface to avoid duplication).
Especially looking for your input on:
Timing and next steps (our plan)
If it this works well, we hope to scale up and continue in the following months.
Alongside the evaluations, we want to help people find and use this research, and to help shape its direction. I hope the prioritization itself will be useful to students, researchers, practitioners, and other stakeholders. (NB: the "prioritization" here is mainly about "potential for impact and value for evaluation"; assessing the research credibility is for the evaluation part).
I wanted to share this quickly; planning a fuller post soon. (Feedback on this post itself is helpful too.)
Related: We’re also exploring sponsorship of evaluations/themes/questions (https://uj-prioritization-dashboard.netlify.app/sponsor/). Looking for feedback: Would this be useful, would you sponsor or recommend others to do so? Would sponsorship affect your trust in the evaluations (given the rules and safeguards mentioned in the link)?
And an (AI generated, at my prompting) comparison of the models here https://uj-ai-wealth-philanthropy-steelman.netlify.app/model-comparison/ ... I'll try to dig in more on this soon.
https://uj-ai-wealth-philanthropy-steelman.netlify.app/model-comparison/ comparing this to others' models and work (I'll try to dig in more on that later)
https://uj-ai-wealth-philanthropy-steelman.netlify.app/model-comparison/ comparing these (I'll try to dig in more on that later)
Proposing an improvement to otols like this -- suggestionh bounties w external judgment and/or 'enforcement' -- https://forum.effectivealtruism.org/posts/oxFncTiAaHBJCgBZP/anonymous-suggestion-boxes-with-a-committed-reward-pool-and?sharePopup=true
Also please see the model that I created, forking into a specific fork for development economics. Would be good to compare and potentially collaborate on these soon. Interesting to see what semi-independent modeling exercises come up with, how much they converge and diverge, etc.
https://forum.effectivealtruism.org/posts/RLWpq2oXPsunoqTEW/live-models-and-dashboards-of-anticipated-ai-wealth-going-to
https://uj-ai-wealth-philanthropy-steelman.netlify.app/global-development/
https://uj-ai-wealth-philanthropy-steelman.netlify.app/