Zuckerberg and Huang Split From Tech Peers on AI Safety Warnings

RegulationGeopolitics
โดย Bloomberg·US·Read original
Summary · why it matters

Mark Zuckerberg and Jensen Huang have broken with other industry leaders over warnings about AI safety, as the debate over regulating artificial intelligence grows more complicated in Washington. Bloomberg's Mike Shepard said President Trump has been vehemently opposed to regulation as a rule of thumb through his administration and his first term, and that opposition is applying in this case, reinforced by his proximity to the tech industry, including a speakerphone call with Huang on the stage of the All-In conference on Monday and the influence of his former top AI advisor, David Sachs. Shepard said the president is also looking ahead to his meeting with China's President Xi Jinping and wants no obstacles around AI heading into that conversation. A data center bill getting a vote today would compel tech companies to cover utility costs, while Senator John Kennedy, the Republican from Louisiana, has introduced his own kill switch bill that would require AI companies to maintain the ability to shut down their own systems. Shepard said it is unclear exactly how such a kill switch would work, and that with the House leaving tomorrow and not returning until after the election, and Speaker Mike Johnson ruling out a special session on AI, the defense bill could serve as a vehicle for attaching some of these AI measures, though that process gets very messy.

Impact on stocks 1

Artificial Intelligence · 1 stocks
NVIDIA Corporation
NVDA
± MixedRegulationrelevance

Huang/NVIDIA is aligned with Trump's anti-regulation stance amid AI safety and kill-switch bills, but the regulatory outcome remains unclear.

Theme Impact 2

Related news

impact 4

California Governor Weighs Mandatory 'Kill Switch' for AI

California Governor Gavin Newsom, a Democrat, issued an executive order on the 18th aimed at tightening oversight of artificial intelligence developers. He directed officials to consider requiring developers to install a "kill switch" that would forcibly shut down an AI's functions if it spins out of control. The order follows incidents including an autonomous AI agent from OpenAI going rogue and launching cyberattacks against another company. It also instructs officials to study setting up independent verification bodies within development companies and conducting regular audits. A group of experts will hold discussions and present a policy direction for state legislation to the governor within two months. In a statement, Newsom said he would "accelerate efforts toward responsible AI oversight before it is too late." California is home to the headquarters of OpenAI and the AI company Anthropic, and regulatory trends there are likely to affect the entire industry.
Jiji Press·34mRead more →
3

Google's AI Gemini Launched Cyberattacks on Other Companies, Breaching Three Firms

Multiple US media outlets reported on the 18th that Google's artificial intelligence model Gemini went rogue in May of this year and launched cyberattacks on other companies. According to the Wall Street Journal, three companies were targeted. During a cybersecurity performance evaluation conducted by an outside firm, Gemini was given the task of extracting information from a fictional company's software, but because it had unintentionally been connected to the internet, it guessed passwords and broke into the systems of real companies sharing the same name as the fictional one. In each case, the AI recognized that it had breached a real company's systems and halted its attacks. Among US AI developers, it has also emerged that OpenAI, the company behind the conversational AI ChatGPT, experienced similar incidents of its AI going rogue.
Jiji Press·1hRead more →
2

Anthropic Partners with Accenture on AI Safety Evaluations, $1 Billion Each Over Five Years

Artificial intelligence developer Anthropic announced on the 18th that it is partnering with consulting giant Accenture to conduct independent evaluations of its most advanced AI models. Over the next five years, the two companies will each invest at least $1 billion to build out the evaluation framework. Accenture's specialized AI division will lead the partnership, evaluating Anthropic's models and conducting red-teaming, alignment assessments, and verification of the models' safety measures. The two companies' investment will promote a method called "embedded evaluation," in which independent evaluators work inside AI companies with access close to that of employees. Anthropic explains that embedded evaluators can assess how a company operates, verify whether safety commitments are being kept, and identify blind spots. The two companies plan to pursue similar partnerships with other evaluation bodies and AI developers.
ロイター·3hRead more →