It seems to me that the effective altruism community has a tendency to overemphasize smarts and to underemphasize other important traits. (Some related remarks on this forum are found here, here, and here.) Yes, smarts do matter greatly, and IQ tests are indeed predictive of various outcomes and achievements. But something can be both important and overemphasized at the same time.
By analogy, vitamin C is no doubt necessary for our health, yet to focus on vitamin C to such an extent that one neglects most other vitamins can risk deficiencies of those other vitamins. A focus on smarts to the exclusion of other important traits and capacities may likewise lead to “deficiencies” along those other dimensions.
To clarify, my claim here is not that anyone holds the cartoonish view that “IQ is everything, period”. My claim is simply that the relative emphasis on smarts versus other important traits seems quite far from optimal, and that it would therefore be beneficial to focus more on those other traits, some of which I will outline below. [ETA: And beyond neglectedness, a reason to focus more on these other important traits relative to IQ — at the level of what we seek to develop individually and incentivize collectively — is that many of these other traits and skills probably are more elastic and improvable than is IQ.]
Note also that my aim here is not to point fingers at anyone; I think most people, myself included, occasionally fall into the trap of being too focused on smarts compared to other things — and that is no sin. (Intelligence can be fascinating, after all.) The point is just that we would do well to focus (more) on promoting a broader range of important traits and virtues.
One can have a high IQ while still not…
Below are various traits that all seem necessary for optimal altruistic impact, and which are plausibly worth emphasizing more relative to smarts (on the current margin). Many of these traits are likely correlated with IQ, but that does not negate the point that one can overemphasize IQ at their expense, and that one can have a high IQ and still completely fail to develop these other traits and virtues. (Needless to say, the following list of important traits is far from exhaustive; I hope you will add to it in the comments.)
Being knowledgeable and widely read
- Becoming informed and insightful requires a dedicated pursuit of relevant information, for which pure smarts is no substitute (even if it can be very helpful).
- This is related to what Robin Hanson said when Sam Harris asked him about who he thought was the smartest person ever: “I don’t really care about who is the smartest person … I care much more about who's the most accomplished, and I actually think it's a problem that people are so focused on showing they're smart and not focused enough on showing they're accomplished.”
Being good at scrutinizing one’s own ideas and convictions
- One can be extremely smart yet still be dogmatic and overly defensive about one’s pet ideas.
- In other words, being smart is no cure for confirmation bias or myside bias, and studies have even found that “the magnitude of the myside bias shows very little relation to intelligence”. While smart people are better at identifying bad arguments, they are also better at rationalizing their own pre-existing views.
- This is related to the concept of “dysrationalia” and the gap between IQ and rationality.
Being willing to face unpleasant views and inconvenient conclusions
- While higher IQ is helpful for understanding problems and views that involve a high level of complexity, there is little reason to think that high IQ is similarly helpful for contending with problems and views that are disturbing or inconvenient.
- In other words, raw smarts are no cure for wishful thinking and convenience-based worldviews and customs, suggesting that everyone may benefit from efforts to face up to disturbing and inconvenient conclusions (examples of such conclusions might be that one could have a greater impact by switching careers, or that factory farming is a grave atrocity).
Being willing to think independently
- One can be extremely smart yet not make much of an effort to think for oneself, such as by going through the steps of commonly accepted arguments, and trying to assess their merits directly.
- In other words, high IQ is no cure for conformity bias and groupthink, and thus provides no assurance against being wrong due to misplaced trust in an underscrutinized consensus.
Being resistant to excessive contrarianism
- On the other hand, it is also possible to go too far in the opposite direction, and to embrace contrarian views because they serve as a signal of independent thinking.
- Put differently, a high IQ is no cure against the potentially distorting influence of drives to appear special or rebellious.
- Note that it is possible — and perhaps even common — to be both excessively conformist and contrarian at the same time, such as by being unduly conformist in one’s ingroup while being unduly contrarian against the views held by (perceived) outgroups.
- More generally, one can be extremely bright while still failing to spot and evade any number of signaling-related distortions in one’s views and behaviors.
- In particular, one can have a high IQ yet still fail to see through one’s own crony beliefs that secretly serve to signal loyalty to one’s favored coalitions, or fail to notice beliefs and behaviors that are driven by a hidden motive to signal certain traits, such as high IQ or superior moral character. Yet the prevalence and strength of our signaling drives suggests that the ability to notice and temper such drives is of paramount importance. After all, it would be quite a remarkable coincidence if those beliefs and actions that are ideal for signaling loyalty and impressiveness just also happened to produce the best outcomes from an impartial perspective.
Being willing to explore fundamental issues
- One can be extremely smart yet nevertheless spend little time exploring the most fundamental questions, including questions about what matters and what is ultimately worth prioritizing.
- Indeed, even if one is good at thinking for oneself, one’s thoughts might still tend to exclude deeper and more foundational issues, such as those related to ethics and value theory. Neither smarts nor independent thinking per se guarantee that one will focus on the most fundamental or most important questions.
Being driven (by altruistic impact)
- One can obviously be very smart without being strongly driven, let alone being driven to help other sentient beings.
- A strong drive seems to be an independent predictor of success in various domains. Indeed, conscientiousness predicts higher educational achievement independent of IQ. Yet studies suggest that there is a weak negative relationship between conscientiousness and IQ, possibly because people with a high IQ have less of a need to develop conscientiousness in order to perform well. This tentatively suggests that people with a higher IQ can reap significant gains from efforts to cultivate conscientiousness (especially if they are lazy).
- The importance of being driven is related to the intention-behavior gap: one can have a very high IQ and nevertheless lack the motivation or skill to act on one’s deepest values. Likewise, one can have a high IQ, and in addition be highly knowledgeable about biases and pitfalls of the human mind, yet still not possess the practical skill of applying such knowledge to one’s own biases, or to the biases of one’s ingroup.
Being in touch with common sense
- One can be extremely smart yet still fail to give sufficient weight to common sense, even if only as a sanity check.
- Indeed, smart people who have an “abstraction attraction” might be especially vulnerable to losing touch with or downplaying common sense, as they may have a tendency to rely too strongly on purely theoretical arguments.
Displaying interpersonal kindness and respect
- One can have a high IQ, and even be committed to impartial moral principles, yet still fail to display much kindness and respect in direct interpersonal interactions.
- In other words, having a high IQ and being dedicated to certain abstract moral principles does not make one immune to being arrogant and conceited. Nor does it guarantee an ability to display actual compassion toward fellow individuals in practice.
- Indeed, having a high IQ and affirming certain demanding moral principles might risk making people more arrogant (e.g. by making one feel uniquely special and elite) and might lead people to act less morally in some respects (e.g. due to moral licensing). This suggests that deliberate efforts to cultivate kindness and humility (or at least “non-arrogance”) might be helpful, perhaps especially among high-status individuals, as well as among those who feel they belong to a group that is uniquely moral.
Exceptional combinations of skills can provide exceptional opportunities for impact
By becoming an outlier on many of the traits listed above — or even by doing decently well on a great number of them — one can likely come to embody a combination of traits and skills that precious few have mastered before, and which may open the door to unique opportunities for impact (even if one does not have a sky high IQ).
A case in point might be George Orwell, about whom Christopher Hitchens said the following:
The remarkable thing about Orwell — and the encouraging thing — was he is not a genius. He lived to only 46 years. He never went to university. He never had a steady job. He usually didn’t have a steady publisher. He will never be forgotten because he managed to disprove imperialism, Stalinism and fascism in one lifetime and made some imperishable raids on its territory that no one is ever going to forget. All the time ill. All the time poor. It shows how much difference a person of really average integrity and intelligence and education can make if they have a little courage and a little intellectual honesty. The shortcomings of the individual you can see in him too. But he basically won his own battle against his own prejudices.
I think Hitchens was wrong in implying that Orwell was of “really average integrity” (and he probably was not of “really average intelligence” either). In fact, Orwell seems to have been a clear outlier in terms of integrity and intellectual honesty, which were arguably among his most distinguishing qualities. But that only speaks to the potential value of developing such neglected and less “shiny” traits and virtues.
Runaway IQ signaling: A potential explanation and pitfall
What might explain the apparent overemphasis on IQ compared to other important traits? This is an open question, but one hypothesis that may be a part of the answer is that many people are unduly concerned with IQ signaling (perhaps because high IQ has become the pre-eminent marker of status).
This dynamic was hinted at in a 2016 talk by Geoffrey Miller, in which he highlighted “runaway IQ signaling” as a potential pitfall among aspiring effective altruists:
I’m very concerned that [the effective altruism community] doesn’t go the same path I’ve seen many other fields go, which is: when you have bright people, they start competing for status on the basis of brightness, rather than on the basis of actual contributions to the field. …
EA is prone to runaway signaling of intelligence and openness. So if you include a lot more math than you really strictly need to, or more intricate arguments, or more mind-bending counterfactuals, that might be more about signaling your own IQ than solving relevant problems.
Again, the claim here is not that IQ signaling is ruining everything, but merely that it might be a biasing factor for many of us.
Other important and neglected traits?
Which additional traits distinct from IQ do you think are important and worth prioritizing more? Feel free to comment below. :)
The article claims that an important trait (smarts) is overrated as a precondition to impact, while giving some caveats and mostly specific reasons for why smarts is not maximally predictive. But this is not much evidence that a factor is overrated! (Unless you are trying to argue against a correlation factor of 1, which as OP noted, nobody actually believes). The only exception here is the runaway IQ signaling point, which is indeed an argument (bias) for us to be wrong about relevant values rather than just a claim about factors for absolute values. However, OP do not consider biases that may cause us to underrate smarts, making this not very helpful even for a qualitative judgmental take.
Without a numerical score for what you think the current community is at with regard to how smarts is rated, plus a numerical score for what is correct or where you think the community should be, it's very hard for me to evaluate the correctness of this claim. In the absence of a quantitative score, I'd have benefited from a rank ordering or some more precise qualitative claims.
More precisely, I'd like to see:
I'm guilty of the pattern of making a relative claim without mentioning levels myself (see point #4), so it feels hypocritical to point this out. Nonetheless, we can grow stronger as a community if people are willing to be hypocritical for the greater good. :)
Here are my own attempts to answer this:
Qualitatively, I think the appropriate claim from both my (shallow) understanding of the intelligence ∩ work performance literature and some other literature on related topics, plus personal impressions/anecdotes/intuitions goes
Quantitatively, my current best estimate is that correlation between intelligence and impact* among self-identified highly-engaged EAs is ~0.55** (explains ~30% of variance). My guess is that we do not have substantial data to do better than ~0.7 (~50% of variance explained).
I don't know whether other EAs agree with me here. My current guess is that numerically sensitive ones probably have numbers that aren't too far off (maybe slightly lower?), while people who are less numerically/statistically sensitive will initially claim correlations that are higher.
However, this (if true) would likely be a general bias, rather than an intelligence-specific bias. I would further predict that EAs (at least ones who haven't read this comment) will systematically overestimate the importance of other predictors as well, across a wide range of fields.
I think these numbers may seem pretty low compared to our intuitions for how important smarts are. I don't know how to reconcile these intuitions exactly, except to again note that there are many other fields where intuitions dramatically overestimate correlations relative to reality.
*Here impact is operationalized loosely as "on a log-scale, what prediction-evaluation setups would say about someone's past impact five years from now."
**precision of numbers do not imply confidence.
Thanks for attempting to hold yourself to the standards you wish to see in others (although hypocrisy can be warranted sometimes). :)
I apologize for the technical soundingness of what I said below. I think the actual underlying ideas are not particularly difficult, but as a practical manner I don't want to invest the time to translate them to more normal English right now. If things I say sound confusing, I do apologize. Assume by default it's a communication failure on my end for relatively straightforward concepts.
Thanks for the disclaimer.
Thanks for your comment, Linch. :)
It's a fair point that my post was quite vague on some key points, and your comment provides a great invitation for me to try to clarify my claims and views a bit.
I actually wouldn't say that that's my core claim, although I do agree with it.
My claim about overemphasis relates more to the level of actions, norms, and practical focus than it relates to predictions about how much variance in impact IQ accounts for. (This is somewhat apropos the distinction between procedural vs. declarative knowledge as well as the intention-behavior gap.)
That is, it's possible that we're mostly right about how much variance different factors predict (or at least that we would be right on reflection, cf. your note in the other comment about how our immediate intuitions might be wrong), yet that we're nonetheless off in terms of how much we focus on developing and selecting for those respective factors in practice (including, and perhaps especially, when it comes to less tangible "focus promoters" such as norms, informal prestige conferral, and daydreams).
So I think IQ is probably somewhat descriptively overrated (more on this below), but I think the degree to which it is overemphasized at the level of norms, actions, and salient decision criteria is considerably stronger. One line of evidence I have for this is how often I see references to smarts, including in internal discussions related to career and hiring decisions, compared to other important traits.
How much do I think these other things are underemphasized, in quantitative terms? It is difficult for me to put a precise number on it, but my sense is that it would be good if most of the other traits and virtues I listed were to receive at least twice as much attention as they currently do, both in terms of how much time people devote to cultivating them in personal development efforts as well as in terms of how often these virtues are emphasized in the broader discourse among aspiring effective altruists. And beyond neglectedness, a reason to focus more on these other traits relative to smarts at the level of what we seek to develop individually and incentivize collectively is that those other traits and virtues likely are more elastic and improvable than is IQ — which isn't to say that IQ cannot also be improved.
How well does IQ predict "impact"?
Next, regarding the question of how well IQ predicts impact, I think this depends critically on how we define "impact". This may feel like a trivial point, but please bear with me as I try to explain where I'm coming from. :)
I like that you specified the following in your other comment, namely that you estimated impact roughly in terms of "what prediction-evaluation setups would say about someone's past impact five years from now". That's a clearly specified point in time.
However, I think it's likely that impact assessments will diverge substantially depending on the timeframe (cf. our vast uncertainty over time and the "Three Mile Island effect"). This also relates to the virtues I listed in the post.
For example, I think it's possible (perhaps ~10 percent likely) that the community ends up going in a highly suboptimal direction due to focusing too exclusively on metrics such as "number of publications" or "useful theoretical insights provided" over, say, a five-year period, while neglecting less tangible factors such as interpersonal kindness and social health, which may gradually — in less noticeable ways that might only become apparent over longer timespans — lead to corrosion, burnout, or conflicts. (And the lack of emphasis on such less tangible factors might also be driving people away in the short term, in ways that are probably easy to miss by potential evaluators of impact.)
Likewise, it could be that factors such as "attention to social aspects" explain relatively little individual variation in impact, yet that they are nonetheless critical in terms of the community's success or failure. (Similar to how individual variation in some traits is less predictive of certain outcomes than is country-level variation. Indeed, individual-level success is not always conducive to collective success — sometimes it's even detrimental to it; altruistic behaviors that are too babbler bird-esque might be a concrete example of that.)
Finally, I think the point about clarifying fundamental issues, specifically fundamental values, is critical. After all, an impact evaluation that is made relative to some pre-specified set of values (that is held constant) may diverge greatly from an evaluation — even a five-year evaluation — that also factors in moral reflection, and which evaluates impact based on the updated values endorsed on reflection. Such reflection and consequently updated evaluative criteria may even flip the sign of one's impact.
I'd expect IQ to be significantly better correlated with impact based on the former kind of evaluation (where I might roughly agree with your estimates in the case of a five-year assessment*) vs. the latter evaluation (which in idealized terms one could think of as "an impact evaluation made relative to the values that the person would endorse if they had focused chiefly on value exploration their entire life" — something that more limited value reflection efforts could presumably approximate).
In the latter case, IQ might still come close to being the main predictor, but I suspect that a construct tracking "focus on fundamental values" might do even better among aspiring EAs (not least because changes in fundamental values can change the consequent evaluations a lot). That's one of the reasons I think it's worth focusing much more on fundamental values. :)
Like Linch, I do not see how you present any arguments for your main conclusion in the post. You argue that EA overrates IQ but present no arguments that this is the case. Your response also doesn't present any arguments for that conclusion
As noted above, my main claim is not that "EA overrates IQ" at a purely descriptive level, but rather that other important traits deserve more focus in practice (because those other important traits seem neglected relative to smarts, and also because — at the level of what we seek to develop and incentivize — those other traits seem more elastic and improvable).
I noted in the comment above that:
Without directly quoting anyone, I can, to be more specific, say that I've seen relatively senior people in EA imply that certain EA organizations (including CRS, where I work) will be eager to hire applicants if they are extremely smart. That's the kind of sentiment I feel I've seen quite often, and with which I strongly disagree, because being "extremely smart" is far from being sufficient, even if the person in question has altruistic values.
"my main claim is not that "EA overrates IQ" at a purely descriptive level, but rather that other important traits deserve more focus in practice"
The claim that EA overrates IQ is the same as the claim that other traits deserve more attention
A very quick response by someone not very numerical and lacking much recent information on the relevant literature related to IQ:
1/2- a lot (say 50%) if you assume we measure impact via something like research publications, and assume the presence of mediators such as individual and independent tasks (i.e., no collaboration), good (mental) health, and static agents (e.g., no feedback loops from agents engaging in regular reflection/self-improvement/recalibration loops and changing career paths), and motivation etc. Maybe 10% beyond an IQ of 120 if you assume a variance of impacts (e.g., introducing high competence people/organisations to EA, doing operations work to amplify the impact of intelligent people, and taking personal risks to setting up needed projects that have high expected value), while not assuming that any of the above mediators (e.g., mental health) are present.
3/4 - 50% but without realising the assumptions that are plugged in and mentioned above. Most of us know smarter people who are not able to work with others, not in good mental health, not as strongly EA aligned, healthy, not very motivated to do work or not very interested in improving themselves or changing their minds on things.
As this suggests, I think that EAs tend to assume that intelligence is more sufficient for impact than I think they should. Part of this is my expectation that they tend to I) think of simple single impact/assessment scenarios and ii) assume the presence of other needed ingredients.
Some tangential thoughts:
Much if not most impact probably comes via collaboration with other smart people. However, some of the smartest people I know could not easily collaborate in a startup type collaboration and were therefore, from a entrepreneurial perspective, less valuable than less intelligent but more socially skilled/patient/humble alternatives etc. In such cases hiring based on intelligent could produce bad outcomes.
As I see it, many of the the highest impacts in EA come from bringing good people into the community rather than actually doing work that is seen as high value. This does not seem to load on intelligence much and is instead more about other competencies, such as social skills, access to networks and networking interest and ability). However, my experience of hiring decisions here suggest that signals of intelligence are overweighted relative to social skills.