This isn't a substantive answer like those above - but I think you can get a lot of Effective Altruism off the ground with 2 premises that are widely agreed by most moral philosophies but are generally under-attended:
1) Consequences matter (which any moral philosophy worth its salt agrees, although to varying extent on what else matters)
2) Pay attention to scope, i.e. 100X lives saved is way, way better than saving one life.
There's a lot more complexity and nuance to views in Effective Altruism, but I think this is a common core (in addition to lives having equal moral value etc.) that is robust for almost all plausible ethical approaches.
The following paper is relevant: Pummer & Crisp (2020). Effective Justice, Journal of Moral Philosophy, 17(4):398-415.
From the abstract:
"Effective Justice, a possible social movement that would encourage promoting justice most effectively, given limited resources. The latter minimal view reflects an insight about justice, and our non-diminishing moral reason to promote more of it, that surprisingly has gone largely unnoticed and undiscussed. The Effective Altruism movement has led many to reconsider how best to help others, but relatively little attention has been paid to the differences in degrees of cost-effectiveness of activities designed to [in]crease injustice."