I am an AI safety researcher and fieldbuilder working at the intersection of AI safety and the social sciences. I work on preparing society for powerful artificial intelligence through technical AI governance, focusing on empirical model behavior and institutional risk management.
As I have been working on SIRA (Societal Impacts Research on AI) for the past three months or so, a common sentiment has been expressed that doesn't sit well with me: that there is limited evidence of current demand for the research and talent SIRA would aim to produce. While I can see how this may be true, I'm reminded of the line attributed (probably apocryphally) to Henry Ford, "If I had asked people what they wanted, they would have said faster horses," and Steve Jobs's version, that people don't know what they want until you show it to them.
I'm using this quick take as a public note to work on this tension and look for evidence against that sentiment. My plan: (1) Make a list of "societal impact" research that I can point to and say, "Hey, look, so-and-so has done this and has addressed xyz." (2) Trace the "impact" of these works to show funders/partners that this type of work can and does make an impact. (3) Write a full blog post about this tension, pointing to this evidence.
Beautiful short piece here, Jacob. I couldn't agree more about the overall thesis of actually tapping into the network around you (in this case, at happy hours and other AIS events). Far too often, we are living below the privilege we have as humans to connect. I think your thesis holds even when in far-flung lands (i.e., not SF, London, Boston, etc.).
I would add that a level of consistency is required to build the practice of finding and talking with interesting people. For example, at the end of this summer, I went on a who's-who spree, emailing and talking to everyone I could. It was incredibly liberating to build up so much momentum and to speak so freely with so many people. However, now that things have settled down, I feel like I've lost the edge I had developed. In sum, I'd like to get better at this, and your post was a helpful reminder to go and do this!
Interesting take. The sociologist in me would think that (1) you are encountering more new people than senior people, and (2) newer people are more likely to give canned answers when asked what they do than the person who has been in a role for a long time and has developed and honed in on the tacit responsibilities and nuances of said role.