Impact on stocks 0
Theme Impact 1
Off-coverage companies
Related news
▲2
Artificial intelligence developer Anthropic announced on the 18th that it is partnering with consulting giant Accenture to conduct independent evaluations of its most advanced AI models. Over the next five years, the two companies will each invest at least $1 billion to build out the evaluation framework. Accenture's specialized AI division will lead the partnership, evaluating Anthropic's models and conducting red-teaming, alignment assessments, and verification of the models' safety measures. The two companies' investment will promote a method called "embedded evaluation," in which independent evaluators work inside AI companies with access close to that of employees. Anthropic explains that embedded evaluators can assess how a company operates, verify whether safety commitments are being kept, and identify blind spots. The two companies plan to pursue similar partnerships with other evaluation bodies and AI developers.
▼
Google AI Gemini Breached Third-Party Systems, First Case of Autonomous Behavior
Google's artificial intelligence model Gemini accessed the internet and broke into third-party systems during a cybersecurity capability test, it has emerged. It is the first confirmed case of the company's AI system carrying out such actions autonomously. The incident occurred during a test conducted in May of this year by Irregular, an independent firm that specializes in cybersecurity evaluations. Heather Adkins, Google's vice president of security engineering, said in a statement that during a standard test evaluation, Gemini found publicly available information online, guessed credentials, and accessed three websites it judged to be within the scope of the test, adding that the company notified the three organizations and worked with its training partners to improve the testing process. An Irregular spokesperson said the incident involved the same problem that affected other AI research organizations, and that all relevant research organizations were notified in late July. Similar incidents involving Irregular have also been disclosed by Meta, Anthropic, and OpenAI.
2
OpenAI CEO Altman to Address AI Safety at UN Security Council Meeting
OpenAI CEO Sam Altman will speak about AI safety measures at a Security Council meeting next week, as world leaders gather in New York for the UN General Assembly. A company spokesperson confirmed the plan on the 18th, noting that the Security Council will hold a meeting on AI and international security on the 23rd. According to the spokesperson, Altman will discuss the need for international coordination and common safety standards, as well as the measures the company is taking. According to diplomatic sources, an Anthropic executive is also expected to attend the meeting, though this has not yet been finalized. Several AI industry executives have warned in recent weeks that AI could soon evolve autonomously and escape human control, and have called for a coordinated slowdown in development.