California governor vetoes bill to create first-in-nation AI safety measures. (www.voanews.com)
from 101@feddit.org to technology@lemmy.world on 29 Sep 2024 23:00
https://feddit.org/post/3317046

#technology

threaded - newest

transientpunk@sh.itjust.works on 29 Sep 2024 23:10 next collapse

Man, fuck Gavin Newsome. That fucker has to go

jaybone@lemmy.world on 30 Sep 2024 07:23 collapse

He might be going to the White House in the future.

AwesomeLowlander@sh.itjust.works on 29 Sep 2024 23:54 next collapse

The measure, aimed at reducing potential risks created by AI, would have required companies to test their models and publicly disclose their safety protocols to prevent the models from being manipulated to, for example, wipe out the state’s electric grid or help build chemical weapons.

How exactly do LLMs do that? If you’ve given an LLM’s pseudorandom output control over your electrical grid, no regulation will mitigate your stupidity.

[deleted] on 30 Sep 2024 00:00 next collapse

.

oce@jlai.lu on 30 Sep 2024 00:29 next collapse

I think it’s more about asking it the steps to create a bomb or how to disrupt the grid, for example, where to cut the major edges.

AwesomeLowlander@sh.itjust.works on 30 Sep 2024 00:42 collapse

asking it the steps to create a bomb

That sounds like a self-correcting issue right there

dual_sport_dork@lemmy.world on 30 Sep 2024 02:00 next collapse

That, and the Internet has been teaching people how to create bombs since the dial-up days. I don’t predict that LLM’s will be either a benefit or a detriment to that particular strain of natural selection.

vrighter@discuss.tchncs.de on 30 Sep 2024 13:20 collapse

anyone remember the anarchist’s cookbook?

oce@jlai.lu on 30 Sep 2024 02:38 collapse

Still a public safety issue.

AwesomeLowlander@sh.itjust.works on 30 Sep 2024 02:45 collapse

Is it more of a public safety issue than if they actually build a working one from a legit bomb manual and deploy it?

oce@jlai.lu on 30 Sep 2024 07:01 collapse

No, but I think it could make the knowledge more easily available which increases the risk that it may happen.

AwesomeLowlander@sh.itjust.works on 30 Sep 2024 08:14 collapse

I see you’ve never heard of the Anarchist’s Cookbook

oce@jlai.lu on 30 Sep 2024 09:00 collapse

I think I heard about it before, but instead of having to remember that, I could just ask an uncensored LLM.

AwesomeLowlander@sh.itjust.works on 30 Sep 2024 10:40 collapse

The actual point was, bomb making instructions have been floating around on search engine results since the days of dial up. That particular manuscript itself has existed since before the days of the Internet. There’s nothing cgpt could give you that you couldn’t have found by typing the same query into Google. Getting the instructions is literally the easiest, least effort, least risk part of building a bomb.

bamfic@lemmy.world on 30 Sep 2024 00:38 next collapse

Could he understand the halting problem? I doubt he does, but the legislators evidently don’t either

UnderpantsWeevil@lemmy.world on 30 Sep 2024 01:04 collapse

How exactly do LLMs do that?

If you hook an LLM up as an interface replacement for a manual/analog Power Plant interface and start asking the translator to intuit decisions based on fuzzy inputs, you can create a cascade of errors that result in grid failure.

If you’ve given an LLM’s pseudorandom output control over your electrical grid, no regulation will mitigate your stupidity.

This rule would prevent a business or public regulator from doing such a thing without proving out safeguards.

And the governor vetoed it.

brucethemoose@lemmy.world on 29 Sep 2024 23:59 next collapse

Good.

All this bill would have done is given OpenAI/Anthropic and such an effective monopoly (and probably destroy the planet with their insane scaling schemes) by destroying the open model ecosystem. I think fediverse vs. corporate social media is a good analogy, and this is kinda like sniping the Fediverse because it’s “too dangerous” if it gets too big, without actually being specific on how to deal with that, but actually sniping it because its a competitive threat.

And yes, OpenAI opposed this, but that was lip service. Don’t believe a word that comes out of Altman’s mouth.

AbouBenAdhem@lemmy.world on 30 Sep 2024 00:01 next collapse

Newsom on Sunday instead announced that the state will partner with several industry experts, including AI pioneer Fei-Fei Li, to develop guardrails around powerful AI models.

That’s reassuring—Li is one of the best-qualified people for the role, and she isn’t in the pocket of any of the major players.

xia@lemmy.sdf.org on 30 Sep 2024 00:04 next collapse

Great, now we’ll have separate “california-model” ai-models, like cars.

catloaf@lemm.ee on 30 Sep 2024 00:26 collapse

Why? He vetoed it.

not_that_guy05@lemmy.world on 30 Sep 2024 00:33 next collapse

And now lots of cars use the same standard as California which can be registered in California, what’s your point?

Warl0k3@lemmy.world on 30 Sep 2024 00:41 collapse

That… this doesn’t change anything, because he vetoed it, so it’s not a requirement for anyone?

not_that_guy05@lemmy.world on 30 Sep 2024 00:46 collapse

What I mean is we tend to set the trend here. Maybe this isn’t the right one yet. People were complaining about California (and I still do) about their emission regulations, but yet states are adopting the policy as it was the right choice. Inland empire doesn’t have a smog warning of the day saying if you can go outside or if it’s hazardous.

California tends to lead the nation in laws that help the environment and citizens even if we think they fuckin blow. (10 round magazine, really?)

catloaf@lemm.ee on 30 Sep 2024 01:26 collapse

Even if did pass, I’m not sure why you’d think they’d have CA models, because as far as I’m aware they don’t do that for cars.

dual_sport_dork@lemmy.world on 30 Sep 2024 02:14 collapse

Manufacturers absolutely do make only-for-sale-in-California-variant cars. Motorcycles, also. They’re not as common as they used to be because emissions laws elsewhere are also starting to become as stringent as the CARB rules these days as well, so it’s becoming more cost effective to just make everything the “California version.”

Throughout the early 2000’s, the distinction was much more relevant. The last vehicle I had to work on that I know for a fact to be a “California version” was a 2014 KLR650. It has additional (unreliable…) emissions control equipment that is not present on otherwise identical bikes from the same model year that were not intended for sale in California.

Furthermore, California will refuse to plate any vehicle that does not specifically have a California compliant emissions certification if it has fewer than 7500 miles on it, i.e. if it is new. Those that don’t meet California’s standards are labeled “49 state” vehicles.

ravhall@discuss.online on 30 Sep 2024 01:10 collapse

People don’t read. They see California and get all upset because they hate anything remotely progressive, and just assume all the steers left for Texas.

Blackout@fedia.io on 30 Sep 2024 00:16 next collapse

Fun fact, Gavin Nelson is actually a living AI. He doesn't always get the answer right but he does always have words that sound like a plausible answer. He also creates artwork in his mind.

ivanafterall@lemmy.world on 30 Sep 2024 00:30 next collapse

Gavin Nelson, that’s the guy that did “After the Rain,” right? Love that guy. Fitting song for these trying times.

Blackout@fedia.io on 30 Sep 2024 00:39 collapse

Ah yes, the sequel to "Are Those Rain Clouds?" Thought provoking films.

UnderpantsWeevil@lemmy.world on 30 Sep 2024 01:06 next collapse

Gruesome Newsome’s veto pen is to the right of Reagan’s.

FlyingSquid@lemmy.world on 30 Sep 2024 09:51 collapse

Is that Major Nelson’s first name?

<img alt="" src="https://lemmy.world/pictrs/image/9b415f6d-49fd-4709-981e-4ae87b396d9d.png">

oce@jlai.lu on 30 Sep 2024 00:32 next collapse

Trying to do the same thing in EU I guess. It’s funny how the tech giants are mad at it and not releasing their latest energy black hole data pumps in EU. It’s like cocaine gangs threatening us to not sell in our countries if we don’t change the laws. No, thanks.

NeoNachtwaechter@lemmy.world on 30 Sep 2024 05:39 next collapse

Nancy Pelosi, argued that the bill would “kill California tech” and stifle innovation.

As long as the critics of a safety regulation need nothing better than such stupid, short-sighted arguments, nobody will ever be safe.

trailee@sh.itjust.works on 30 Sep 2024 17:52 collapse

Meta: I’ve noticed a lot of VOA links on Lemmy lately, and I’d like to understand why. As I understand it, VOA is essentially a national propaganda news organization targeting an international audience (similar to RT). Why is that a good source for article sharing? Especially in the case of the article at hand, which is just a VOA republication of an Associated Press piece that could have been linked originally.