The Democrat decided to reject the measure because it applies only to the biggest and most expensive AI models and doesn’t take into account whether they are deployed in high-risk situations, he said in his veto message.

Smaller models sometimes handle critical decision-making involving sensitive data, such as electrical grids and medical records, while bigger models at times handle low-risk activities such as customer service.

39

0
0

Reactions

0
0
Comments12
Sorted by Click to highlight new comments since:

For those that have been following this: Is he serious, or is this just lip service and he's blocking it because he was lobbied by people in the tech industry?

(Not super well-informed) My guess is that it's 95%+ lip service. He doesn't seem like someone with scruples or object-level opinions about most things other than what gives him power. 

One new thing to me in that thread was that the California Legislature apparently never overrides the governor's vetoes. I wonder why this is the case there and not elsewhere.

Newsom's press release and veto message include much more detail and suggest "it's too weak" is not the actual reason.

Reasons mentioned:

  1. Discrimination by model size
    1. "SB 1047 only applies to large models, giving us a "false sense of security about controlling this fast-moving technology. Smaller, specialized models may emerge as equally or even more dangerous"
  2. "Real risks" are limited to critical decision-making, critical infrastructure etc.
    1. "While well-intentioned, SB 1047 does not take into account whether an Al system is deployed in high-risk environments, involves critical decision-making or the use of sensitive data. Instead, the bill applies stringent standards to even the most basic functions - so long as a large system deploys it. I do not believe this is the best approach to protecting the public from real threats posed by the technology."
    2. Newsom wants to focus on "specific, known" "demonstrable risks to public safety" "rooted in science and fact", like the deepfake laws he signed.

Suggests Newsom is going to be very hostile to any legislation that is designed to deal with X-risk concerns, and that he, frankly thinks they are bullshit. (I personally am also pretty skeptical of X-risk from AI, but I don't want nothing done given how bad the risk would be if it did manifest.) 

Good analysis of this from PauseAI:

I don't want to presume to paraphrase their analysis into one phrase, but if I were forced to, it would seem to be that there was a lot of pressure on Governor Newsom from powerful AI companies and interests, who also threatened to ruin the bill's sponsor Scott Wiener. 

Still a pity that he couldn't resist the pressure. 

It's kind of pathetic, but this is the reality of politics today. With their money, they really can either make or break a politician, and we voters are not smart enough to avoid being taken in by their negative advertising and dirt-digging. 

It's clear that we need a much stronger movement on this. The other reason he was able to veto this bill is that the vast majority of people do not agree that AI poses a major / existential risk, and so they do not insist on the urgent action we need. 

This seems pretty bad news from an AI safety perspective :/ 

Any chance to override his veto, or get a similar bill passed soon? 

Some people have talked about trying to get something like that as a ballot initiative, since initial polling suggests that something like this might be very popular with the general public.

Yep, numbers ranged from 60% to 80% support for approving SB 1047, and it was impressively bipartisan, too.

To do a [citizen-initiated] ballot initiative, you stand on the street and ask passerby to sign your petition. Perhaps it would be possible to simultaneously build a mailing list of interested passerby to attend protests and such. That could translate the poll numbers into a stronger street presence.

I talked to people who seem to know about this and ~0 modern ballot initiatives are done this way. You need >500,000 signatures, which is a massive logistical undertaking that's not going to be enacted by a couple of volunteers. 

More context: 
TechCrunch article (not paywalled like the WSJ article)
Response from Senator Wiener on Twitter + discussion

Thanks for sharing! 

 

More from Larks
Curated and popular this week
Relevant opportunities