Comments
A little strange that a post's karma isn't part of the prize evaluation process.
(I guess it is implicitly, would be interesting to see an explicit karma component.)
EA Forum Prize: Winners for November 2018
3 min read · Dec 14, 2018
A little strange that a post's karma isn't part of the prize evaluation process.
(I guess it is implicitly, would be interesting to see an explicit karma component.)
I can't speak for any of the voters, but they can use any criteria they want (taking our goals for the Forum as a set of suggestions that, in practice, they broadly agree with). I'd guess that karma is something that voters consider, because it's a reasonable measure of how helpful people actually found a post.
...followed by a runoff vote to resolve ties.
Is the runoff vote also approval voting?
Thanks for splitting your questions into different comments! Good policy for threads that aren't too crowded. The runoff vote was plurality-wins, because we didn't want a tie to further delay the announcement (our voters have a lot of other things on their plates). We'll keep iterating on the process as we move forward.
CEA is pleased to announce the winners of the November 2018 EA Forum Prize!
In first place (for a prize of $999*): stefan.torges, "Takeaways from EAF's Hiring Round".
In second place (for a prize of $500): Sanjay, "Why we have over-rated Cool Earth".
In third place (for a prize of $250): AdamGleave, "2017 Donor Lottery Report".
*As it turns out, a prize of $1000 makes the accounting more difficult. Who knew?
Certain posts exemplify the kind of content we most want to see on the EA Forum. They are well-researched and well-organized; they care about informing readers, not just persuading them.
The Prize is an incentive to create posts like this, but more importantly, we see it as an opportunity to showcase excellent content as an example and inspiration to the Forum's users.
That said, the winning posts weren't "exclusively" great. Our users published dozens of excellent posts in the month of November, and we had a hard time narrowing down to three winners. (There was even a three-way tie for third place this month, so we had to have a runoff vote!)
While this wasn't our express intent, November's winners wound up representing an interesting cross-section of the ways the EA community creates content.
"Takeaways from EAF's Hiring Round" uses the experience of an established EA organization to draw lessons that could be useful to many other organizations and projects. The hiring process is documented so thoroughly that another person could follow it almost to the letter, from initial recruitment to a final decision. The author shares abundant data, and explains how EAF’s findings changed their own views on an important topic.
"Why we have over-rated Cool Earth" is a classic example of independent EA research. The author consults public data, runs his own statistical analyses, and reaches out to a charity with direct questions, bringing light to a subject on which the EA community doesn't have much knowledge or experience. He also offers alternative suggestions to fight climate change, all while providing enough numbers that any reader could double-check his work with their own assumptions.
To quote one comment on the post:
This sort of evaluation, which has the potential to radically change the consensus view on a charity, seems significantly under-supplied in our community, even though individual instances are tractable for a lone individual to produce.
"2017 Donor Lottery Report" is a different kind of research post, from an individual who briefly had resources comparable to an entire organization -- and used his fortunate position to collect information and share it with the community. He explains his philosophical background and search process to clarify the limits of his analysis, and shares the metrics he plans to use to evaluate his grants (which adds to the potential value of the post, since it opens the door for a follow-up post examining his results).
Qualities shared by all three winners:
All posts made in the month of November, save for those made by CEA staff, qualified for voting.
Prizes were chosen by seven people. Four of them are the Forum's moderators (Max Dalton, Howie Lempel, Denise Melchin, and Julia Wise). The other three are the EA Forum users who had the most karma at the time the new Forum was launched (Peter Hurford, Joey Savoie, and Rob Wiblin).
All voters abstained from voting for content written by themselves or by organizations they worked with. Otherwise, they used their own individual criteria for choosing posts, though they broadly agree with the goals outlined above.
Winners were chosen by an initial round of approval voting, followed by a runoff vote to resolve ties.
The Prize will continue with rounds for December and January! After that, we’ll evaluate whether we plan to keep running it (or perhaps change it in some way).
We hope that the Forum’s many excellent November posts will provide inspiration for more great material in the coming months.
We'd love to hear any feedback you have about the EA Forum Prize. Leave a comment or contact Aaron Gertler with questions or suggestions.
I really like the prize idea as a method of content curation – I wasn't planning to read Sanjay's Cool Earth post (because I didn't understand what it was about & it didn't seem relevant to my interests at first brush), but now I will.
Thanks all for making this happen :-)