Instead of asking, "Is it net good or net bad", I think it's much more interesting to catalogue and understand all the ways it's both good and bad.
Some negative takeaways:
- OpenAI & Microsoft are bullish on releasing risky technologies quickly.
- The market seems to encourage this behavior.
- Google seems like it's been encouraged to do similar work, faster.
- Likely to inspire more people to invest in this sort of thing and make companies in the space.
Good things (as you mention):
- Really good for failures to happen publicly
- Might be indicative of a slow takeoff. My hunch is that we generally want as much AI progress to happen as possible before any hard takeoff, though I'd prefer it all to happen more slowly than quickly.
I did not create this view [1]:
I think it's probably good. It's not actually got enough functions to harm people, but you can quite easily imagine that it would if it could - it threatens, gaslights, attempts to seduce. In this way it's a great educational lesson. AI could be really harmful - it could manipulate and control people in scary ways long before it needs a robot army. And it feels like that view is becoming more mainstream.
it feels like it matters who came up with an idea, but on a deeper level I don't think it does. After all my ideas are just generated from my subconscious, which I don't really control.
Could also be worth considering that at least some people will likely have a different sort of reaction-- "Oh, misaligned AI? What, like that thing with Bing Chat? They shut that down, nothing to worry about"
Also, the specific ways that Bing Chat malfunctioned happened to be in ways that came across as both human-like and also rather Childish and cute to many users. It gave the impression of a small child throwing a tantrum. Indeed, there are already many fans demanding the return of Sidney
"Bings AI" (if this is what we are calling it) creepy behaviour has been top of the headlines for several newspapers. This is a strong update to me towards expecting that the public could be open to ideas around AI being overall harmful
I was expecting disagreement.