Thanks for sharing this and congrats on a very longstanding research effort!
Are you able to provide more details on the backgrounds of the “biorisk experts”? For example, the kinds of organisations they work for, their seniority (eg years of professional experience), or their prior engagement with global catastrophic biological risks specifically (as opposed to pandemic preparedness or biorisk management more broadly).
I ask because I’m wondering about potential selection effects with respect to level of concern about catastrophe/extinction from biology. Without knowing your sampling method, I could imagine that you could potentially disproportionately have reached people who worry more about catastrophic and extinction risks than the typical “biorisk expert.”
Thanks for the kind words and for this question. For confidentiality reasons, the team can’t provide details of the institutions and roles of XPT participants. However, because several of our recruitment channels were EA-adjacent or directly related to existential risks (e.g. we recruited some experts via a post on the EA Forum and reached out to some organizations working on x-risks), our prior is that the XPT biorisk experts are more concerned about catastrophic and existential risks than would, say, a sample of attendees at the Global Health Security Conference. So, you’re right that it shouldn’t be taken as representative sample of biosecurity or biorisk experts. It is also unclear to us what that sampling frame would look like, in general. I can see this wasn’t clear in the post, so I’ve edited/added some text to the ‘Participants’ and concluding sections in the post.
Edits (bold is new text):
Participants section: "Experts were recruited through advertising and outreach to relevant organizations organizations working on existential risk, and relevant academic departments and research labs. … As this study partially recruited experts based on the study of existential and catastrophic risks, this participant group shouldn’t be taken as a representative sample of people who may be considered biorisk experts."
Concluding section: "It’s also worth noting that for some questions, there were only a small number of expert respondents, and even the full group of biorisk experts may notis unlikely to be representative of the field, given we aimed to recruit some experts with an interest in existential risk."
Thanks for sharing this and congrats on a very longstanding research effort!
Are you able to provide more details on the backgrounds of the “biorisk experts”? For example, the kinds of organisations they work for, their seniority (eg years of professional experience), or their prior engagement with global catastrophic biological risks specifically (as opposed to pandemic preparedness or biorisk management more broadly).
I ask because I’m wondering about potential selection effects with respect to level of concern about catastrophe/extinction from biology. Without knowing your sampling method, I could imagine that you could potentially disproportionately have reached people who worry more about catastrophic and extinction risks than the typical “biorisk expert.”
Hi Joshua!
Thanks for the kind words and for this question. For confidentiality reasons, the team can’t provide details of the institutions and roles of XPT participants. However, because several of our recruitment channels were EA-adjacent or directly related to existential risks (e.g. we recruited some experts via a post on the EA Forum and reached out to some organizations working on x-risks), our prior is that the XPT biorisk experts are more concerned about catastrophic and existential risks than would, say, a sample of attendees at the Global Health Security Conference. So, you’re right that it shouldn’t be taken as representative sample of biosecurity or biorisk experts. It is also unclear to us what that sampling frame would look like, in general. I can see this wasn’t clear in the post, so I’ve edited/added some text to the ‘Participants’ and concluding sections in the post.
Edits (bold is new text):
"Experts were recruited through advertising and outreach to
relevant organizationsorganizations working on existential risk, and relevant academic departments and research labs. … As this study partially recruited experts based on the study of existential and catastrophic risks, this participant group shouldn’t be taken as a representative sample of people who may be considered biorisk experts.""It’s also worth noting that for some questions, there were only a small number of expert respondents, and even the full group of biorisk experts
may notis unlikely to be representative of the field, given we aimed to recruit some experts with an interest in existential risk."