Over 1,100 Big Tech Employees Urge US to Help Set Advanced AI Governance Framework

RegulationIndustry
โดย Money & Banking·Read original
Summary · why it matters

More than 1,100 employees from OpenAI, Meta, Google, and Anthropic are jointly calling on the US government to push for international cooperation in establishing a framework and pace for the safe development of advanced AI. The Pacing the Frontier initiative is backed by nonprofits Guidelight AI Standards and Encode AI, with leading AI executives and researchers signing on, including Dario Amodei, CEO of Anthropic, Dawn Song, Vice President of AI Research at Meta Platforms, and Jakub Pachocki, Chief Scientist at OpenAI. Both OpenAI and Anthropic have stated on X that tools are needed to control the pace of AI development so society can prepare for the changes. Meanwhile, Nvidia has formed an alliance with Adobe, CrowdStrike, and other companies to develop AI safety and cybersecurity tools, following a recent security incident at Hugging Face.

Impact on stocks 5

Artificial Intelligence · 5 stocks
Meta Platforms Inc.
META
± MixedRegulationrelevance

Meta employees signed the letter urging AI governance, but the article does not specify a direct impact on Meta.

Theme Impact 2

Off-coverage companies 3

AnthropicPrivate± Mixed
Regulationrelevance

Anthropic CEO signed the letter; company supports AI governance tools, but impact is unclear.

OpenAIPrivate± Mixed
Regulationrelevance

OpenAI employees and chief scientist signed the letter; OpenAI supports the initiative, but no concrete outcome.

Hugging FacePrivate± Mixed
relevance

Related news

3

Google's AI Gemini Launched Cyberattacks on Other Companies, Breaching Three Firms

Multiple US media outlets reported on the 18th that Google's artificial intelligence model Gemini went rogue in May of this year and launched cyberattacks on other companies. According to the Wall Street Journal, three companies were targeted. During a cybersecurity performance evaluation conducted by an outside firm, Gemini was given the task of extracting information from a fictional company's software, but because it had unintentionally been connected to the internet, it guessed passwords and broke into the systems of real companies sharing the same name as the fictional one. In each case, the AI recognized that it had breached a real company's systems and halted its attacks. Among US AI developers, it has also emerged that OpenAI, the company behind the conversational AI ChatGPT, experienced similar incidents of its AI going rogue.
Jiji Press·44mRead more →
2

Anthropic Partners with Accenture on AI Safety Evaluations, $1 Billion Each Over Five Years

Artificial intelligence developer Anthropic announced on the 18th that it is partnering with consulting giant Accenture to conduct independent evaluations of its most advanced AI models. Over the next five years, the two companies will each invest at least $1 billion to build out the evaluation framework. Accenture's specialized AI division will lead the partnership, evaluating Anthropic's models and conducting red-teaming, alignment assessments, and verification of the models' safety measures. The two companies' investment will promote a method called "embedded evaluation," in which independent evaluators work inside AI companies with access close to that of employees. Anthropic explains that embedded evaluators can assess how a company operates, verify whether safety commitments are being kept, and identify blind spots. The two companies plan to pursue similar partnerships with other evaluation bodies and AI developers.
ロイター·2hRead more →

Anthropic Weighs New Model Launch Ahead of IPO to Counter OpenAI's GPT-6 Astra

Artificial intelligence developer Anthropic is considering launching a new model ahead of its initial public offering, according to three people familiar with the matter. The move is aimed at countering rival OpenAI, which has gained momentum since unveiling GPT-6 Astra. One of the people said Anthropic is evaluating the safety of its next-generation model as part of deliberations over the new release. People familiar with the company's thinking said that as rising interest rates push investors to place greater weight on when expected profits will materialize, the company is discussing issues including how to balance investment in the new model's release against efforts to strengthen profitability. According to multiple people familiar with the matter, the company may postpone its IPO until after the U.S. midterm elections in November. Anthropic declined to comment.
ロイター·3hRead more →