Hide table of contents

Introduction

On Saturday 11th February, we ran a day-long EA hackathon in London, modeled off a similar event in Berkeley late last year. This post follows a similar format to the retrospective linked above. You can see some of the basic information about the event, as well as notes on some of the projects that people were working on in this Google doc.

We are incredibly grateful to @NicoleJaneway and @Zac Hatfield-Dodds for their advice before the event, and to Edward Saperia for his advice and assistance on the day itself.

TL:DR;

  • We ran a pilot hackathon in London, and were surprised by the success of the event.
  • Around 50 people turned up, they gave mostly positive feedback, there were several impressive projects which have plausible impact.
  • The event helped build the EA London tech community and generated opportunities for community members to work on impactful software projects on an ongoing, long-term basis.
  • We're excited to continue running these kinds of events and want to produce a blueprint for others to run similar hackathons in other places.

Goals of the event

While we hoped that this event would produce artifacts that had legible impact, it was mainly a community-building exercise. Our primary goal was to validate the concept - could we run a successful hackathon?[1] If so, would running similar events in the future lead to greater tangible impact, even if this one didn't necessarily do so?

What went well

  • Approximately 50 people attended, which was more than we'd expected.
  • The average skill level was high.[2]
  • The majority of teams had a strong lead or mentor, in most cases an existing maintainer or the person who had the original idea for the project.
  • Asking people if they'd like to be put in groups and then doing so generally worked well - I would estimate this was beneficial for 80% of the people who selected this option. See related potential improvement below.
  • Dedicating one of the monthly EA London tech meetups to brainstorming ideas for hackathon projects both yielded good ideas and got people engaged.
  • Having a show & tell section encouraged attendees to optimize for having something concrete, and gave groups the chance to learn about what other groups had worked on.
  • The venue was excellent.
  • The average overall rating for the event on our feedback form was 4.36/5 .[3]

What we could do better next time

  • We had a limited budget, and more people showed up then we could provide food for on said budget, meaning we didn't provide lunch after we'd originally said we would. We weren't transparent about this, which was a mistake.
  • We didn't do enough to accommodate those who were less experienced coders. In future, we'll use a different question on the sign-up form, along the lines of "how much guidance would you need in order to complete an issue in a project that required coding?". [4] We can then organise our groups/projects/activities accordingly, including having more ways to contribute to projects through means other than coding.[5]
  • We underestimated the ratio of people with jobs in the "data" family relative to the "software" family, and so our suggested projects were almost entirely software-focused. 
  • We could've had a better shared digital space. This ended up being a bit of an afterthought for us, and we ended up asking people to join a WhatsApp group when they signed in, but it wasn't used much during the day. A different platform[6] could facilitate more collaboration/visibility between groups, allow people to ask for help more easily, and generally give more of a community feel to the event.

Outputs and resources

What next

We feel strongly motivated by the outcomes from this event, and think there are a number of ways to build on the momentum from this event, including;

  • Similar events run every 2-3 months
  • Regular informal "hack nights"
  • Themed hackathons, eg one focused on forecasting tools, or an alignment jam
  • Helping other organisers run similar events in other places
  • Fostering a community of EA software engineers collaborating on EA-related OSS projects

We're keen to define a Theory of Change in order to keep these events value-aligned and impactful. After that, we expect to do more experimentation with event format, frequency etc, as well as ways to encourage community members to work on projects on an ongoing basis, rather than for a single day. 

If you would be interested in organizing a similar event then please reach out as we're happy to share as much knowledge as we can!

  1. ^

    Admittedly "success" was poorly defined here. Our version of success was primarily about getting attendees to collaborate on projects in groups, and making progress with said projects.

  2. ^

    On our expression of interest form, we asked attendees to subjectively rank their familiarity with programming on a scale of 1-5, with the mean answer being 3.275

  3. ^

    n=14

  1. ^

    Options would be something like: "a lot", "a little", and "none".

    The actual question we used was "what is your level of familiarity with software engineering on a scale of 1-5?", which in retrospect was too vague. There were only 2 respondents out of 42 that selected '1', which led to the only accommodations being made for folks who put '1' or '2' being placed in groups with people who selected '4' or '5', and all being expected to work on the same project. This left some less experienced attendees feeling like they didn't achieve very much during the day, which was something we were trying to avoid.

  2. ^

    Depending on skillsets, it seems best to not be prescriptive about how people contribute to projects, but there are some options for things likely anybody could do, for example QA work or documentation.

  3. ^

    Discord seems like a solid alternative. Having multiple channels on the same server would allow people to keep their team's communications in one place, see what other teams are up to, and ask general questions/post memes etc, while keeping each stream of communication focused.

Show all footnotes
Comments7


Sorted by Click to highlight new comments since:

Thanks for organising! I had a great time, I'd love to see more of these events. Maybe you could circulate a Google Doc beforehand to help people brainstorm ideas, comment on each other's ideas, and indicate interest in working on ideas. You could prepopulate it with ideas you've generated as the organisers. That way when people show up they can get started faster - I think we spent the first hour or so choosing our idea.

(Btw - our BOTEC calculator's first page is at this URL.)

I think this is a great idea, thanks for the feedback - I completely agree we want people to be able to hit the ground running on the day. I would imagine groups are most effective when they're formed around strong coders, perhaps there's a way we can work that into the doc.

One thing we're considering is an ongoing Discord server, where people could see ideas/projects/who's working on what, etc. The idea would be that the server would persist between events, and move more towards having ongoing projects as above. I think this could potentially solve some of the cold start issues, but I am also hesitant to ask people to join yet another Discord server, and it'd probably need to reach a critical mass of people in order to be valuable. Having written out this comment, I think we will likely start it and push to get it to a good size, and if not we can re-evaluate.

Thanks for pointing out the bad link, I've corrected it now!

Sounds fun! I think we can set up a few teams in Israel, and run such an event in parallel, if that makes sense. 

@Yonatan Cale 

Great work! Thanks for organising. Also neither of you have formal organising roles right? You just came in and did this (which is great and worth emulating)

Thanks :)

Yes that's correct, I'm a software engineer and Sam's a product manager. I think we both felt pretty comfortable with our roles despite of our lack of experience, and would recommend others who are interested in organizing not to be put off by not having done it before. I'm very happy to chat with anyone who feels this way and can hopefully offer more advice than I laid out in the post.

GPT-Automator, a voice-controlled Mac assistant capable of completing various complex tasks based off speech input. See the blog posts by Luke and Chidi.

This seems super useful and something I’ve been waiting for. But what is the EA or AI safety connection)

So cool to see this! 
We are organizing our first hackathon as EAUC Chile and this posts “what we could do better” as well as your resources will be useful for ours :)

 

Update: https://forum.effectivealtruism.org/posts/x9pcT6dvaGKox4PT5/chilean-ais-hackathon-retrospective

😁

Curated and popular this week
trammell
 ·  · 25m read
 · 
Introduction When a system is made safer, its users may be willing to offset at least some of the safety improvement by using it more dangerously. A seminal example is that, according to Peltzman (1975), drivers largely compensated for improvements in car safety at the time by driving more dangerously. The phenomenon in general is therefore sometimes known as the “Peltzman Effect”, though it is more often known as “risk compensation”.[1] One domain in which risk compensation has been studied relatively carefully is NASCAR (Sobel and Nesbit, 2007; Pope and Tollison, 2010), where, apparently, the evidence for a large compensation effect is especially strong.[2] In principle, more dangerous usage can partially, fully, or more than fully offset the extent to which the system has been made safer holding usage fixed. Making a system safer thus has an ambiguous effect on the probability of an accident, after its users change their behavior. There’s no reason why risk compensation shouldn’t apply in the existential risk domain, and we arguably have examples in which it has. For example, reinforcement learning from human feedback (RLHF) makes AI more reliable, all else equal; so it may be making some AI labs comfortable releasing more capable, and so maybe more dangerous, models than they would release otherwise.[3] Yet risk compensation per se appears to have gotten relatively little formal, public attention in the existential risk community so far. There has been informal discussion of the issue: e.g. risk compensation in the AI risk domain is discussed by Guest et al. (2023), who call it “the dangerous valley problem”. There is also a cluster of papers and works in progress by Robert Trager, Allan Dafoe, Nick Emery-Xu, Mckay Jensen, and others, including these two and some not yet public but largely summarized here, exploring the issue formally in models with multiple competing firms. In a sense what they do goes well beyond this post, but as far as I’m aware none of t
LewisBollard
 ·  · 6m read
 · 
> Despite the setbacks, I'm hopeful about the technology's future ---------------------------------------- It wasn’t meant to go like this. Alternative protein startups that were once soaring are now struggling. Impact investors who were once everywhere are now absent. Banks that confidently predicted 31% annual growth (UBS) and a 2030 global market worth $88-263B (Credit Suisse) have quietly taken down their predictions. This sucks. For many founders and staff this wasn’t just a job, but a calling — an opportunity to work toward a world free of factory farming. For many investors, it wasn’t just an investment, but a bet on a better future. It’s easy to feel frustrated, disillusioned, and even hopeless. It’s also wrong. There’s still plenty of hope for alternative proteins — just on a longer timeline than the unrealistic ones that were once touted. Here are three trends I’m particularly excited about. Better products People are eating less plant-based meat for many reasons, but the simplest one may just be that they don’t like how they taste. “Taste/texture” was the top reason chosen by Brits for reducing their plant-based meat consumption in a recent survey by Bryant Research. US consumers most disliked the “consistency and texture” of plant-based foods in a survey of shoppers at retailer Kroger.  They’ve got a point. In 2018-21, every food giant, meat company, and two-person startup rushed new products to market with minimal product testing. Indeed, the meat companies’ plant-based offerings were bad enough to inspire conspiracy theories that this was a case of the car companies buying up the streetcars.  Consumers noticed. The Bryant Research survey found that two thirds of Brits agreed with the statement “some plant based meat products or brands taste much worse than others.” In a 2021 taste test, 100 consumers rated all five brands of plant-based nuggets as much worse than chicken-based nuggets on taste, texture, and “overall liking.” One silver lining
 ·  · 1m read
 ·