AT

Alex Turner

7 karmaJoined Jun 2021

Comments
1

This post is heavily influenced by my experience as a new community builder and my perception that, in this situation,  being "a highly cool and well networked EA" and "do  things which need to be done" are pretty similar

Even though these two goals may lead to similar instrumental actions (e.g. doing important work), I think these two goals grow different motivational structures inside of you. I recently wrote:

It's not that my actions were wrong, it's that I did them for the wrong reasons, and that really does matter. Under my model, the cognitive causes (e.g. I want to be like EY) of externally visible actions (study math) are very important, because I think that the responsible cognition gets reinforced into my future action-generators. 

For example, since I wanted to be like Eliezer Yudkowsky, I learned math; since I learned math, I got praised on LessWrong; since I got praised, my social-reward circuitry activated; since the social-reward circuitry activated, credit assignment activates and strengthens all of the preceding thoughts which I just listed, therefore making me more of the kind of person who does things because he wants to be like EY. 

I can write a similar story for doing things because they are predicted to make me more respected. Therefore, over time, I became more of the kind of person who cares about being respected, and not so much about succeeding at alignment or truly becoming stronger.