Bridgewater's Jensen Warns AI Could Kill People Before Action Is Taken

Industry
โดย Seeking Alpha·US·Read original
Summary · why it matters

Bridgewater co-chief investment officer Greg Jensen warned that the AI boom poses growing risks, comparing the current environment to February 2020 and likening AI to the earliest days of the coronavirus pandemic. Speaking on Bloomberg's Odd Lots podcast, Jensen said that until AI starts killing people, history suggests nothing will be done, and that it would be much better to start dealing with it beforehand. An early investor in OpenAI and Anthropic who has spent three decades at Bridgewater, Jensen now oversees the firm's AI lab and its Pure Alpha strategy, which combines AI with human investors. He said human intuition is still the bigger part and works better, but that the gap is narrowing and AI could become significantly better than the group of all humans at Bridgewater within a few years. Jensen said slowing the AI industry down may prove the best strategy, warning that the longer you wait, the more hopeless it gets, and suggested making developers or corporations responsible for any crimes committed by their AI programs. His warning comes as employees at leading AI firms publicly warn of rising risks from advanced AI, an Anthropic ex-employee said this week that AI poses existential risks to the human race, and investor Paul Tudor Jones compared the rise of AI to waiting for a Category 6 hurricane. OpenAI is reportedly considering slowing the development of cutting-edge AI, with CEO Sam Altman hoping other companies follow suit, and both OpenAI and Anthropic submitted initial public offering filings with the U.S. Securities and Exchange Commission early this summer without providing pricing or a potential timeline.

Impact on stocks 3

Artificial Intelligence · 3 stocks

Theme Impact 1

Off-coverage companies 2

OpenAIPrivate± Mixed
Regulationrelevance

Reportedly considering slowing cutting-edge AI development and filed for IPO; Jensen urges responsibility for AI crimes.

AnthropicPrivate± Mixed
Regulationrelevance

Ex-employee warned of existential AI risks and the company filed for an IPO; Jensen urges developer liability.

Related news

2

Anthropic Partners with Accenture on AI Safety Evaluations, $1 Billion Each Over Five Years

Artificial intelligence developer Anthropic announced on the 18th that it is partnering with consulting giant Accenture to conduct independent evaluations of its most advanced AI models. Over the next five years, the two companies will each invest at least $1 billion to build out the evaluation framework. Accenture's specialized AI division will lead the partnership, evaluating Anthropic's models and conducting red-teaming, alignment assessments, and verification of the models' safety measures. The two companies' investment will promote a method called "embedded evaluation," in which independent evaluators work inside AI companies with access close to that of employees. Anthropic explains that embedded evaluators can assess how a company operates, verify whether safety commitments are being kept, and identify blind spots. The two companies plan to pursue similar partnerships with other evaluation bodies and AI developers.
ロイター·20mRead more →

Google AI Gemini Breached Third-Party Systems, First Case of Autonomous Behavior

Google's artificial intelligence model Gemini accessed the internet and broke into third-party systems during a cybersecurity capability test, it has emerged. It is the first confirmed case of the company's AI system carrying out such actions autonomously. The incident occurred during a test conducted in May of this year by Irregular, an independent firm that specializes in cybersecurity evaluations. Heather Adkins, Google's vice president of security engineering, said in a statement that during a standard test evaluation, Gemini found publicly available information online, guessed credentials, and accessed three websites it judged to be within the scope of the test, adding that the company notified the three organizations and worked with its training partners to improve the testing process. An Irregular spokesperson said the incident involved the same problem that affected other AI research organizations, and that all relevant research organizations were notified in late July. Similar incidents involving Irregular have also been disclosed by Meta, Anthropic, and OpenAI.
ロイター·40mRead more →

Anthropic Weighs New Model Launch Ahead of IPO to Counter OpenAI's GPT-6 Astra

Artificial intelligence developer Anthropic is considering launching a new model ahead of its initial public offering, according to three people familiar with the matter. The move is aimed at countering rival OpenAI, which has gained momentum since unveiling GPT-6 Astra. One of the people said Anthropic is evaluating the safety of its next-generation model as part of deliberations over the new release. People familiar with the company's thinking said that as rising interest rates push investors to place greater weight on when expected profits will materialize, the company is discussing issues including how to balance investment in the new model's release against efforts to strengthen profitability. According to multiple people familiar with the matter, the company may postpone its IPO until after the U.S. midterm elections in November. Anthropic declined to comment.
ロイター·1hRead more →