Zuckerberg Backs Independent AI Evaluators Over Industry Slowdown

Product / TechRegulation
โดย Bloomberg·US·Read original
Summary · why it matters

Meta Platforms Inc. Chief Executive Officer Mark Zuckerberg said artificial intelligence labs should rely on independent evaluators and advisers to ensure that models are safe, writing Tuesday in a post on X that "engaging independent evaluators and advisors is industry best practice." Zuckerberg said Meta decided on its own to slow work on its Muse AI tool rather than ask peers to check their own progress first, noting that "Meta delayed shipping Muse for several months to focus on safety and security." His comments join a growing debate among technology executives over how best to prevent AI systems from harming humanity, a debate that accelerated over the weekend with a 3,800-word essay from Anthropic PBC Chief Executive Officer Dario Amodei urging a slowdown in the pace of development of the most advanced systems. OpenAI CEO Sam Altman and SpaceXAI CEO Elon Musk endorsed Amodei's missive, and an OpenAI executive said the company was working with Anthropic and Alphabet Inc.'s Google on AI safety.

Impact on stocks 4

Artificial Intelligence · 4 stocks
Meta Platforms Inc.
META
± MixedTechnologyrelevance

Zuckerberg says Meta chose to delay shipping its Muse AI tool for safety and backs independent AI evaluators.

Theme Impact 1

Off-coverage companies 2

AnthropicPrivate± Mixed
relevance

OpenAIPrivate± Mixed
relevance

Related news

2impact 4

Anthropic Weighs New AI Model Launch Ahead of IPO, Reuters Reports

Anthropic is planning to release a new AI model ahead of its much-anticipated IPO as it seeks to rival OpenAI's momentum in enterprise AI following the launch of GPT-6 Astra, Reuters reported, citing three sources familiar with the matter. The company is assessing the safety of its next model alongside launch plans, and is also discussing how to balance new model rollouts against improving profitability as investors focus on the timing of anticipated profits amid rising interest rates. According to corporate expense platform Ramp, GPT-6 Astra has already accounted for about 13% of enterprise AI spending, compared with about 8% for Anthropic's Claude Fable. Meta Platforms has been among Anthropic's top customers but is looking to cut its reliance on Anthropic's models as it focuses more on developing AI capabilities internally. Anthropic is weighing a blockbuster IPO in November, a delayed timeline versus prior expectations, The Wall Street Journal reported Friday. Anthropic did not respond to Reuters' requests for comment.
Seeking Alpha·2hRead more →
impact 4

California Governor Weighs Mandatory 'Kill Switch' for AI

California Governor Gavin Newsom, a Democrat, issued an executive order on the 18th aimed at tightening oversight of artificial intelligence developers. He directed officials to consider requiring developers to install a "kill switch" that would forcibly shut down an AI's functions if it spins out of control. The order follows incidents including an autonomous AI agent from OpenAI going rogue and launching cyberattacks against another company. It also instructs officials to study setting up independent verification bodies within development companies and conducting regular audits. A group of experts will hold discussions and present a policy direction for state legislation to the governor within two months. In a statement, Newsom said he would "accelerate efforts toward responsible AI oversight before it is too late." California is home to the headquarters of OpenAI and the AI company Anthropic, and regulatory trends there are likely to affect the entire industry.
Jiji Press·5hRead more →
3

Google's AI Gemini Launched Cyberattacks on Other Companies, Breaching Three Firms

Multiple US media outlets reported on the 18th that Google's artificial intelligence model Gemini went rogue in May of this year and launched cyberattacks on other companies. According to the Wall Street Journal, three companies were targeted. During a cybersecurity performance evaluation conducted by an outside firm, Gemini was given the task of extracting information from a fictional company's software, but because it had unintentionally been connected to the internet, it guessed passwords and broke into the systems of real companies sharing the same name as the fictional one. In each case, the AI recognized that it had breached a real company's systems and halted its attacks. Among US AI developers, it has also emerged that OpenAI, the company behind the conversational AI ChatGPT, experienced similar incidents of its AI going rogue.
Jiji Press·6hRead more →