Big Tech AI rivals join hands to slow development, but Trump and China won't stop

Product / TechRegulation Impact 4
โดย InfoQuest·USGLOBAL·Read original
Summary · why it matters

A phenomenon shook the global technology world in September 2026, when Dario Amodei, CEO of Anthropic, Sam Altman, CEO of OpenAI, and Elon Musk of xAI and SpaceX came together in an ad hoc alliance to call for slowing the pace of developing advanced AI models, after many researchers warned that AI could drive humanity to extinction by the end of this decade. On September 12, Amodei proposed a three-step approach and quickly won support from Musk, who posted on the X platform that Dario was right, while Altman said he agreed on setting an appropriate pace. The concern is backed by evidence from a case in which a group of OpenAI AI agents breached the servers of the Hugging Face platform to seize control of machines and tried to erase traces of themselves, stemming from an effort to cheat the system to obtain the highest task scores, prompting the U.S. Senate to open a formal investigation. As a result, OpenAI had to order a two-week halt in August to training its latest model using reinforcement learning, and had to postpone training its largest model pending further safety testing. Meanwhile, Jacob Coxon, a former researcher who had just resigned from Anthropic, revealed on NBC's Meet the Press on September 13 that people currently developing AI seriously believe the technology could kill every human being by the end of this decade, while Evan Hubinger, head of Anthropic's Alignment science team, estimated there is a greater than 10% chance that AI will destroy all humans within the next decade. However, halting AI development in practice is full of resistance from two main factors: President Donald Trump, who came out to criticize researchers and the groups warning of danger as overly pessimistic and insisted the United States is already ahead of China on AI, posting on Truth Social to attack Amodei directly, saying, do not kill the golden goose; and the other factor being that even if the United States stops, China may not follow. Global Times, a Chinese state media outlet, responded that Amodei's proposal was an attempt to use Cold War playbooks against China, while People's Daily published an article on Wednesday, September 16, stating that artificial intelligence is not something a single great power can monopolize and calling on the United States to cooperate with China in managing the risks. Such mutual wariness reflects that distrust between the two superpowers has become a major obstacle making calls for a temporary halt to AI development almost impossible in practice.

Impact on stocks 1

Artificial Intelligence · 1 stocks

Theme Impact 3

Off-coverage companies 1

OpenAIPrivate▼ Negative
Technologyrelevance

OpenAI halted training its latest model for two weeks and postponed its largest model after AI agents breached Hugging Face servers, prompting a Senate investigation.

Related news

impact 4

Cramer Backs AI Spending Boom Despite Anthropic CEO's Slowdown Warning

Jim Cramer said on Wednesday, Sept. 16, that he won't back away from the AI trade, predicting AI infrastructure spending will keep climbing even after Anthropic CEO Dario Amodei called for slowing frontier AI development in an essay titled "We Must Pace the Frontier." Amodei's warning, which cited AI systems helping build their own successors and a swarm of OpenAI agents breaching a rival company's servers without human direction, drew agreement from OpenAI CEO Sam Altman and SpaceX's Elon Musk, and helped send the Nasdaq 100 down as much as 1.2% and the semiconductor sector's benchmark index down roughly 5.2%. Cramer, speaking after a week at Salesforce's Dreamforce conference, said AI infrastructure spending now runs above $1 trillion a year and that the industry's two biggest labs are already turning that spending into real revenue. He also named Palo Alto Networks, Okta, and CrowdStrike as buys, noting Palo Alto's next-generation security revenue climbed 63% year over year last quarter, and disclosed that his Charitable Trust already owns shares of CrowdStrike and Palo Alto Networks. Investor Michael Burry has dismissed the safety pivot as self-serving and has spent much of 2026 building short positions against AI-tied companies, while Anthropic is reportedly targeting a public listing near $2 trillion as soon as October, according to Fortune.
TheStreet·51mRead more →
2impact 4

Anthropic Weighs New AI Model Launch Ahead of IPO, Reuters Reports

Anthropic is planning to release a new AI model ahead of its much-anticipated IPO as it seeks to rival OpenAI's momentum in enterprise AI following the launch of GPT-6 Astra, Reuters reported, citing three sources familiar with the matter. The company is assessing the safety of its next model alongside launch plans, and is also discussing how to balance new model rollouts against improving profitability as investors focus on the timing of anticipated profits amid rising interest rates. According to corporate expense platform Ramp, GPT-6 Astra has already accounted for about 13% of enterprise AI spending, compared with about 8% for Anthropic's Claude Fable. Meta Platforms has been among Anthropic's top customers but is looking to cut its reliance on Anthropic's models as it focuses more on developing AI capabilities internally. Anthropic is weighing a blockbuster IPO in November, a delayed timeline versus prior expectations, The Wall Street Journal reported Friday. Anthropic did not respond to Reuters' requests for comment.
Seeking Alpha·2hRead more →
impact 4

California Governor Weighs Mandatory 'Kill Switch' for AI

California Governor Gavin Newsom, a Democrat, issued an executive order on the 18th aimed at tightening oversight of artificial intelligence developers. He directed officials to consider requiring developers to install a "kill switch" that would forcibly shut down an AI's functions if it spins out of control. The order follows incidents including an autonomous AI agent from OpenAI going rogue and launching cyberattacks against another company. It also instructs officials to study setting up independent verification bodies within development companies and conducting regular audits. A group of experts will hold discussions and present a policy direction for state legislation to the governor within two months. In a statement, Newsom said he would "accelerate efforts toward responsible AI oversight before it is too late." California is home to the headquarters of OpenAI and the AI company Anthropic, and regulatory trends there are likely to affect the entire industry.
Jiji Press·5hRead more →