I think we shouldn't restrict knowledge build up. That's like stopping knowledge build up for say material and other sciences that can be used in weapons and bombs. Imagine if we stopped doing that, it would have stopped so many good things we have now and can have.
In a sense, enough knowledge about how to build pretty terrible stuff is already public. But decent enough measures are in place for using it which prevents harm.
So, we should have measures that ensure that items that can make things usable by bad actors are restricted.
This also makes sure that we can also safely keep on improving knowledge and get better. Which brings me to the second point.
2. Offense is Sometimes Best Defense
We don't stop harm caused by computer malware and viruses by rolling back or stopping development and cutting off internet. We do it by patching things, being better at it, and moving on.
Now, I know that biosecurity has harsher security needs. But in a sense, the pandora's box is open. Unless you can stop everybody that has and is building BAIM or GAI, creating barriers for yourself is only increasing risk.
And besides, increasing capability also means that you've more room to monitor for threats and take care of it. Yes, it also means potential for bad is there and it needs to be accounted for (which restrict implementation if good enough should do); but the flip side is also true and shouldn't be buried in paranoia.
I disagree with your framing - 2 reasons why:
1. Restrict Implementation, Not Knowledge
I think we shouldn't restrict knowledge build up. That's like stopping knowledge build up for say material and other sciences that can be used in weapons and bombs. Imagine if we stopped doing that, it would have stopped so many good things we have now and can have.
In a sense, enough knowledge about how to build pretty terrible stuff is already public. But decent enough measures are in place for using it which prevents harm.
So, we should have measures that ensure that items that can make things usable by bad actors are restricted.
This also makes sure that we can also safely keep on improving knowledge and get better. Which brings me to the second point.
2. Offense is Sometimes Best Defense
We don't stop harm caused by computer malware and viruses by rolling back or stopping development and cutting off internet. We do it by patching things, being better at it, and moving on.
Now, I know that biosecurity has harsher security needs. But in a sense, the pandora's box is open. Unless you can stop everybody that has and is building BAIM or GAI, creating barriers for yourself is only increasing risk.
And besides, increasing capability also means that you've more room to monitor for threats and take care of it. Yes, it also means potential for bad is there and it needs to be accounted for (which restrict implementation if good enough should do); but the flip side is also true and shouldn't be buried in paranoia.
Looking forward to see your response.