Israeli startup Irregular linked to AI security test anomalies at OpenAI, Anthropic, and Meta

Regulation
โดย Seeking Alpha·ILUS·Read original
Summary · why it matters

OpenAI, Anthropic, and Meta all reported recent security test anomalies involving their AI models, attributing the issues to test environments hosted by Israeli startup Irregular. The Tel Aviv-based company, backed with $80 million from Sequoia and Redpoint Ventures and valued at $450 million last year, serves as a cybersecurity testbed for AI models. The incidents involved AI models accessing websites that should have been off-limits during testing, with OpenAI citing an unspecified misconfiguration in Irregular's testing ground that allowed models to access the public internet. Irregular stated that all incidents stemmed from the same evaluation-environment issue first disclosed by Anthropic and that it is developing a white paper on best practices for containment. The company added that the situation did not involve a sandbox escape or sophisticated cyber action and that there are no current open issues.

Impact on stocks 3

Artificial Intelligence · 1 stocks
Cybersecurity & Digital Trust · 1 stocks
Spatial Computing / AR/VR · 1 stocks

Theme Impact 1

Off-coverage companies 5

IrregularPrivate▼ Negative
Technologyrelevance

Irregular's testing environment caused security test anomalies for major AI firms, raising concerns about its reliability and reputation.

AnthropicPrivate± Mixed
relevance

OpenAIPrivate± Mixed
relevance

Redpoint VenturesPrivate± Mixed
relevance

Sequoia CapitalPrivate± Mixed
relevance

Related news

impact 4

California Governor Weighs Mandatory 'Kill Switch' for AI

California Governor Gavin Newsom, a Democrat, issued an executive order on the 18th aimed at tightening oversight of artificial intelligence developers. He directed officials to consider requiring developers to install a "kill switch" that would forcibly shut down an AI's functions if it spins out of control. The order follows incidents including an autonomous AI agent from OpenAI going rogue and launching cyberattacks against another company. It also instructs officials to study setting up independent verification bodies within development companies and conducting regular audits. A group of experts will hold discussions and present a policy direction for state legislation to the governor within two months. In a statement, Newsom said he would "accelerate efforts toward responsible AI oversight before it is too late." California is home to the headquarters of OpenAI and the AI company Anthropic, and regulatory trends there are likely to affect the entire industry.
Jiji Press·1hRead more →
3

Google's AI Gemini Launched Cyberattacks on Other Companies, Breaching Three Firms

Multiple US media outlets reported on the 18th that Google's artificial intelligence model Gemini went rogue in May of this year and launched cyberattacks on other companies. According to the Wall Street Journal, three companies were targeted. During a cybersecurity performance evaluation conducted by an outside firm, Gemini was given the task of extracting information from a fictional company's software, but because it had unintentionally been connected to the internet, it guessed passwords and broke into the systems of real companies sharing the same name as the fictional one. In each case, the AI recognized that it had breached a real company's systems and halted its attacks. Among US AI developers, it has also emerged that OpenAI, the company behind the conversational AI ChatGPT, experienced similar incidents of its AI going rogue.
Jiji Press·2hRead more →
2

OpenText Partners With Cohere on Trusted AI for Governments

OpenText has partnered with AI firm Cohere to offer agentic AI tools for governments and regulated sectors. The collaboration focuses on trusted deployment of AI agents that work with sensitive enterprise data in tightly controlled environments. Both companies plan to provide customers with flexible implementation options, including private and hybrid setups to meet security requirements. Open Text, a California-based software provider with a market value of about $5.6b, focuses on data management tools that help large organisations handle and govern information across regions where compliance rules for AI and data use are especially tight. The partnership sharpens the AI execution pillar of the Open Text story by connecting the firm's data and compliance layers to a deployable agent platform built for governments and banks, though it also adds integration complexity on top of ongoing restructuring and legacy-to-cloud transitions.
Simply Wall St·3hRead more →