To support the safety of highly-capable AI systems, we are developing our approach to catastrophic risk preparedness, including building a Preparedness team and launching a challenge.
AI companies in California breathed a collective sigh of relief as Governor Gavin Newsom vetoed the SB 1047 AI safety bill that the State Senate passed earlier this month. The controversial bill would mandate additional safety checks for AI models that cross a training compute or cost threshold if signed into law. These models would require a “kill switch” and incur heavy fines for makers of the models if they were used to cause “critical harm”. In his letter to the California State Senate, Newsom explained the reasons for his decision to veto the bill. He noted that one of
Although artificial intelligence in health has shown great promise, pressure is mounting for regulators around the world to act, as AI tools demonstrate potentially harmful outcomes.