What are the concrete use cases you guys have in mind? I can think of two:
Someone who's new to EA wants to get up to speed on EA thinking. They start at the top and either read systematically or click on whatever seems interesting.
People are having a discussion about EA online, and someone wants to explain an EA concept, so they link to the relevant page.
There are other hypothetical use cases for a tool such as this. If the pages were much more comprehensive, they could be useful to veteran EAs who wanted to get up to speed with regard to the latest thinking on a particular topic. But a tool like this would be different--it would probably have a wiki structure, and the content would be more speculative. It might be a sort of hybrid wiki and discussion forum, similar to how the original wiki was used. (I think this is plausibly a superior structure relative to a straight discussion forum like effective-altruism.com, because it increases the odds that discussions will be useful long after the discussion is finished.)
Both of the use cases with bullet points seem primarily targeted at people who are new to EA. EA forum users tend to be veteran EAs, so it might be worthwhile to usability test new EAs separately. For the first use case, you could simply present them with the top-level page and time how long it takes to lose interest. You'd probably want to concentrate on people who are dissatisfied with existing resources like Will MacAskill's book For the second use case, maybe you could have a conversation with a new EA, but try to use the tool to explain topics whenever possible? You could observe both how the person you were talking to responded and also how easy it was for you to find pages relevant to your conversation. It might also be useful to survey new EAs about their frustrations re: getting up to speed with EA, in case that gives you ideas for new features or approaches.
Hi Owen,
Thanks for producing all of this content. I agree that it is a highly leveraged activity to make important ideas known to more effective altruists, and that making an online repository of such materials to link to ought to be a scalable solution to this problem. Thanks also for launching the site in an early stage of development, and without promotion, in order to allow criticism!
I’ll pitch in on three issues: i) the strategy of EA Concepts ii) its user interface, and iii) possible alternative approaches. I discuss the user interface here because it relates to my overall thinking.
###Strategy The main challenges, to paraphrase, are 1) to provide a reference, 2) to convey basic information, and 3) to connections and relationships within EA. It's hard for a simple reference (1) to also compellingly convey knowledge (2,3). Conveying knowlege is in large part a process of figuring out what to leave out. An obvious way to improve the pedagogical value would be to leave out the abstract decision-making topics whose research isn't shaping altruistic decisions much. Another major part of conveying knowledge (or getting people to read the content at all) is communicating some clear answer to the overarching question: “Why do I care?”.
First, the issue of leaving things out. Where research rarely shapes EA activities, such as in the ‘idealized decision-making’ section, such topics should probably be budded off into a glossary. Then, what is left would be a well-organized discussion of why effective altruists find certain activities compelling. One could even add info about how effective altruists are in fact organizing and spending their time. Then, one would have a shareable repository of strategic thinking. The question of why the reader might care would then answer itself.
The need for readable strategy content is clear. When one runs an EA chapter, one of the commonest questions from promising participants is what EAs are supposed to do, other than attending meetings and reading canonical texts. (These days, it surely is not just donating, either.) Useful answers would discuss what similar attendees are doing, and why, and what person-sized holes still exist in EA efforts. Such online material would convince people that EA is executing on some (combination of) overall plan(s). The EA plan(s) of course have arisen partly from historical circumstance.
This brings me to a final reason for including more general strategic thinking. If the EA community was started again today, we would - from the outset - include people from industry and government, rather than just from the academic sector. There would be researchers from a range of fields, such as tech policy, synthetic biology, machine learning, and productivity enhancement rather than just from philosophy and decision theory. So we have an awesome opportunity to re-center the map of EA concepts, that I think has so far been missed.
To summarize, I think the map would be better if it: selected and emphasized action-related topics, re-centered the EA community on useful concrete domains of knowledge, not just abstract ones, and conveyed the connections between action and theory, in order to make the material readable and learnable.
###User interface Currently, the site lacks usability. There are lots and lots of issues, so I wonder why some existing technical solution was not used, like Workflowy or Medium. Obviously, it is a prototype, but this gives all the more reason to start with existing software.
To begin with:
So there is a ton of UI improvement to be done, that would seem to be a high priority, if one is to continue piloting the site.
###Alternatives So how else might a project like EA Concepts be built? I have already said that (1) might best be achieved by moving some of the drier topics into a glossary. (2,3) would be best achieved by whatever modality will reach a moderately large expected audience who will engage deeply with the content. In light of the fact that the current page has poor user interface, this could instead be done with blog posts, a book, an improved version of the current site, or the explanations platform Arbital. Arbital, a group of three ex-Google EAs have already made a crisp and useable site, and in order to attract more users, they are pivoting toward discussion of a range of consequential topics, rather than just mathematics. On the face of it, their mission is your mission, and it would be worth looking hard for synergies.
Overall, I think there's something useful to be done in this space, but I'm fairly unconvinced that the site is currently on track to capture (much of) that value.
UI is not really my area, so I'll leave that to others except to say:
On strategy, the general idea is not that everyone reads the whole thing, but that people can explore local areas they're interested in. This should avoid the need to cut anything off into a glossary (although the guidance for how to start engaging could improve; I agree that idealized ethical decision making content is irrelevant for most users so should probably be less prominent). This should let people engage with and become experts on aspects of EA-relevant research and have a rough idea of how it fits in with other areas, without needing to be expert on those other areas. One of the important reasons for laying it out in an approximately-logical tree was that we think this could help people to spot where there are gaps in the research that haven't been noticed.
I feel like one of the key advantages of the tree structure is that it's already not too prominent. I can see the motivations for demoting it even further, but it does feel like it's in the right place with respect to the overall structure of the concepts, and it's hard to see how to de-emphasise it without losing that.
Despite the treelike structure, omitting boring or esoteric topics still seems key for keeping the reader's trust and attention.
Wanting to lay things out logically also shouldn't prevent focusing more on areas that are more important.
I am not an expert in design but from a personal point of view I like the user-interface.
I found the concept tree with the numbers in brackets and links that are different from the "+" etc, to be intuitive and easy to navigate.
To provide another perspective on UI issues (in descending order of importance in my eyes):
That's what I already secretly had in mind.
I feel like even once it has been made true that clicking on the text or the 'plus' next to it do the same thing, there will still be some work to do to make the user 'closer' to the content. Basically, good and popular websites tend to give the user a payoff with one-ish click. Currently, I doubt that the EA Concepts site would be used, except for when people are linked to specific ideas. But I recognize that this is at least a somewhat subtle point.
Your bulleted list is not formatted correctly which makes it really hard to read; can you fix it by putting two newlines before it?