I spoke to someone today who was planning to write a critique of this paper, so I won't steal her thunder — but I still have a few thoughts on the paper/the points of the paper as paraphrased.
Epistemic status: Just rambling a bit because the post made me think.
In spite of consequentialism, it's difficult to deny at least some particularistic moral obligations that individuals have - the duty to care for one's own children; the duty to repay monetary or social debts owed; the duty to treat others with equity and fairness.
This critique would have more teeth for me if it mapped onto anything I recognized from the actual EA community.
Many people don't have strong moral theories at all; they'd answer questions about morality if you asked them, but they don't go about their days wondering about what the best thing to do is in a given situation. And yet, I think that most people in this category are basically "good people": they care about their children, repay their debts, treat other people decently in most cases, etc.
Most people in EA don't have their "maximize impact" mode on at all times. There are lots of parents in the community; they didn't decide not to have kids because it would let them donate more, and (as far as I know) they don't neglect their children now to have more time for work. That's because we can have more than one goal; it's entirely possible to endorse a moral theory but not attempt to maximize the extent to which you fulfill that theory in your every action.
If you asked basically anyone in EA whether parents have an obligation to care for their children, I think they'd say "yes". But EA isn't really focused on personal lives and relationships — for the most part, it aims to help people use spare resources that aren't already allotted for other obligations. You aren't obligated to pursue a particular career, so choosing one with EA in mind may not violate any obligations. You aren't obligated to support a particular charity... and so on.
I always like to refer back to Holden Karnofsky when I hear arguments of this type:
"In general, I try to behave as I would like others to behave: I try to perform very well on “standard” generosity and ethics, and overlay my more personal, debatable, potentially-biased agenda on top of that rather than in replacement of it. I wouldn’t steal money to give it to our top charities; I wouldn’t skip an important family event (even one that had little meaning for me) in order to save time for GiveWell work."
Right action also includes acting, when appropriate, in ways reflective of the broad virtue of justice, which aims at an end—giving people what they are owed—that can conflict with the end of benevolence. If we are responsive to circumstances, sometimes we will act with an eye to others’ well-being, and sometimes with an eye to other ends.
I'd be very interested in seeing what someone's approach to maximizing (justice times X) + (benevolence times Y) would look like. I see EA as the project of "trying to get as much good as possible under certain definitions of 'good'", and I could be convinced that justice is something that can be part of a reasonable definition (unlike, say, the glorification of a deity).
That said, if the argument here is that justice needs to be part of any moral theory that isn't "confused" or "empty", it seems like Crary is picking a fight with many different branches of philosophy that are perfectly capable of defending themselves (so, as a non-philosopher who doesn't speak this language well, I'll bow out on this point).
For EA to make space for these individuals, it would have to acknowledge that their moral and political beliefs pose threats to its guiding principles and that these principles themselves are contestable. To acknowledge this would be to concede that EA, as it is currently conceived, might need to be given up.
At this point, I realized I was really confused and perhaps misinterpreting Crary. EA's principles are certainly contestable, just as any set of moral principles is contestable — this is an area of debate as old as the concept of debate. Does Crary believe that the moral theories she favors don't exclude any views of values? Is she arguing that a valid moral theory will necessarily be a big-tent sort of thing that gives everyone a say? (Will MacAskill's work on moral uncertainty + putting some weight on a wide range of moral theories might align with this, though I haven't read it closely.)
This has been previously discussed at some length here.