SACRAMENTO, Calif. — California lawmakers are considering legislation that would require artificial intelligence companies to test their systems and add safety measures so they can't be potentially manipulated to wipe out the state's electric grid or help build chemical weapons — scenarios that experts say could be possible in the future as technology evolves at warp speed.
Democratic state Sen. Scott Wiener, who authors the bill, said the proposal would provide reasonable safety standards by preventing “catastrophic harms” from extremely powerful AI models that may be created in the future. The requirements would only apply to systems that cost more than $100 million in computing power to train. No current AI models have hit that threshold as of July.
The proposal, supported by some of the most renowned AI researchers, would also create a new state agency to oversee developers and provide best practices. The state attorney general also would be able to pursue legal actions in case of violations.A growing coalition of tech companies argue the requirements would discourage companies from developing large AI systems or keeping their technology
The proposal could also drive companies out of state to avoid the regulations, the state's Chamber of Commerce said.