Skip to main content

California governor vetoes expansive AI safety bill

California Governor Gavin Newsom speaking at a lecturn.
Gage Skidmore / Flickr

California Gov. Gavin Newsom has vetoed SB 1047, the Safe and Secure Innovation for Frontier Artificial Models Act, arguing in a letter to lawmakers that it “establishes a regulatory framework that could give the public a false sense of security about controlling this fast-moving technology.”

“I do not believe this is the best approach to protecting the public from real threats posed by the technology,” he wrote. SB 1047 would have required “that a developer, before beginning to initially train a covered model … comply with various requirements, including implementing the capability to promptly enact a full shutdown … and implement a written and separate safety and security protocol.”

Recommended Videos

However, Newsom noted that 32 of the top 50 AI companies are based in California, and that the bill would focus on only the largest firms. “Smaller, specialized models may emerge as equally or even more dangerous than the models targeted by SB 1047,” he stated.

“While well-intentioned, SB 1047 does not take into account whether an Al system is deployed in high-risk environments, involves critical decision-making or the use of sensitive data,” Newsom wrote. “Instead, the bill applies stringent standards to even the most basic functions – so long as a large system deploys it.”

SB 1047 sparked heated debate within the AI industry as it made its way through the legislature. OpenAI stridently opposed the measure, resulting in researchers William Saunders and Daniel Kokotajlo publicly resigning in protest, while xAI CEO Elon Musk came out in favor of the bill. Many in Hollywood also expressed support for SB 1047, including J.J. Abrams, Jane Fonda, Pedro Pascal, Shonda Rhimes, and Mark Hamill.

“We cannot afford to wait for a major catastrophe to occur before taking action to protect the public. California will not abandon its responsibility. Safety protocols must be adopted. Proactive guardrails should be implemented, and severe consequences for bad actors must be clear and enforceable,” Newsom wrote. However, “ultimately, any framework for
effectively regulating Al needs to keep pace with the technology itself.”

Monday’s announcement comes less than a month after the governor signed AB 2602 and AB 1836, both backed by the SAG-AFTRA union. AB 2602 requires performers grant informed consent prior to using their “digital replicas,” while AB 1836 strengthened protections against ripping off the voice and likeness of deceased performers.

Andrew Tarantola
Andrew Tarantola is a journalist with more than a decade reporting on emerging technologies ranging from robotics and machine…
OpenAI drops nonprofit status in large-scale reorganization
ChatGPT and OpenAI logos.

Reuters reports that, in an effort to make itself more attractive to investors, OpenAI plans to scrap the nonprofit structure of its core business, thereby removing the authority of its board of directors, as well as granting CEO Sam Altman equity in the company.

"We remain focused on building AI that benefits everyone, and we’re working with our board to ensure that we’re best positioned to succeed in our mission. The nonprofit is core to our mission and will continue to exist," an OpenAI spokesperson told Reuters. The nonprofit portion of the business will not be done away with entirely, but instead would continue to exist and own a minority stake in the overall company.

Read more
How you can try OpenAI’s new o1-preview model for yourself
The openAI o1 logo

Despite months of rumored development, OpenAI's release of its Project Strawberry last week came as something of a surprise, with many analysts believing the model wouldn't be ready for weeks at least, if not later in the fall.

The new o1-preview model, and its o1-mini counterpart, are already available for use and evaluation, here's how to get access for yourself.

Read more
OpenAI Project Strawberry: Here’s everything we know so far
a strawberry

Even as it is reportedly set to spend $7 billion on training and inference costs (with an overall $5 billion shortfall), OpenAI is steadfastly seeking to build the world's first Artificial General Intelligence (AGI).

Project Strawberry is the company's next step toward that goal, and as of mid September, it's officially been announced.
What is Project Strawberry?
Project Strawberry is OpenAI's latest (and potentially greatest) large language model, one that is expected to broadly surpass the capabilities of current state-of-the-art systems with its "human-like reasoning skills" when it rolls out. It just might power the next generation of ChatGPT.
What can Strawberry do?
Project Strawberry will reportedly be a reasoning powerhouse. Using a combination of reinforcement learning and “chain of thought” reasoning, the new model will reportedly be able to solve math problems it has never seen before and act as a high-level agent, creating marketing strategies and autonomously solving complex word puzzles like the NYT's Connections. It can even "navigate the internet autonomously" to perform "deep research," according to internal documents viewed by Reuters in July.

Read more