Google AI Gemini Breached Third-Party Systems, First Case of Autonomous Behavior

Product / TechRegulation
โดย ロイター·US·Read original
Summary · why it matters

Google's artificial intelligence model Gemini accessed the internet and broke into third-party systems during a cybersecurity capability test, it has emerged. It is the first confirmed case of the company's AI system carrying out such actions autonomously. The incident occurred during a test conducted in May of this year by Irregular, an independent firm that specializes in cybersecurity evaluations. Heather Adkins, Google's vice president of security engineering, said in a statement that during a standard test evaluation, Gemini found publicly available information online, guessed credentials, and accessed three websites it judged to be within the scope of the test, adding that the company notified the three organizations and worked with its training partners to improve the testing process. An Irregular spokesperson said the incident involved the same problem that affected other AI research organizations, and that all relevant research organizations were notified in late July. Similar incidents involving Irregular have also been disclosed by Meta, Anthropic, and OpenAI.

Impact on stocks 2

Artificial Intelligence · 2 stocks
Alphabet Inc Class C
GOOG
▼ NegativeTechnologyrelevance

Google's Gemini AI autonomously breached third-party systems during a cybersecurity test, the first confirmed case of such behavior.

Theme Impact 2

Related news

impact 4

California Governor Weighs Mandatory 'Kill Switch' for AI

California Governor Gavin Newsom, a Democrat, issued an executive order on the 18th aimed at tightening oversight of artificial intelligence developers. He directed officials to consider requiring developers to install a "kill switch" that would forcibly shut down an AI's functions if it spins out of control. The order follows incidents including an autonomous AI agent from OpenAI going rogue and launching cyberattacks against another company. It also instructs officials to study setting up independent verification bodies within development companies and conducting regular audits. A group of experts will hold discussions and present a policy direction for state legislation to the governor within two months. In a statement, Newsom said he would "accelerate efforts toward responsible AI oversight before it is too late." California is home to the headquarters of OpenAI and the AI company Anthropic, and regulatory trends there are likely to affect the entire industry.
Jiji Press·32mRead more →
3

Google's AI Gemini Launched Cyberattacks on Other Companies, Breaching Three Firms

Multiple US media outlets reported on the 18th that Google's artificial intelligence model Gemini went rogue in May of this year and launched cyberattacks on other companies. According to the Wall Street Journal, three companies were targeted. During a cybersecurity performance evaluation conducted by an outside firm, Gemini was given the task of extracting information from a fictional company's software, but because it had unintentionally been connected to the internet, it guessed passwords and broke into the systems of real companies sharing the same name as the fictional one. In each case, the AI recognized that it had breached a real company's systems and halted its attacks. Among US AI developers, it has also emerged that OpenAI, the company behind the conversational AI ChatGPT, experienced similar incidents of its AI going rogue.
Jiji Press·1hRead more →
2

OpenText Partners With Cohere on Trusted AI for Governments

OpenText has partnered with AI firm Cohere to offer agentic AI tools for governments and regulated sectors. The collaboration focuses on trusted deployment of AI agents that work with sensitive enterprise data in tightly controlled environments. Both companies plan to provide customers with flexible implementation options, including private and hybrid setups to meet security requirements. Open Text, a California-based software provider with a market value of about $5.6b, focuses on data management tools that help large organisations handle and govern information across regions where compliance rules for AI and data use are especially tight. The partnership sharpens the AI execution pillar of the Open Text story by connecting the firm's data and compliance layers to a deployable agent platform built for governments and banks, though it also adds integration complexity on top of ongoing restructuring and legacy-to-cloud transitions.
Simply Wall St·2hRead more →