Alibaba Group Holding LtdAnthropic report accuses Alibaba of using 3,500 fraudulent accounts and 3M daily Claude exchanges to illicitly distill its AI models

U.S. artificial intelligence company Anthropic published a report on the 10th on cyberattacks that abused its Claude AI model, revealing that Chinese AI developers had carried out "distillation" attacks, using the output of the high-performance model to illicitly train their own models. In Alibaba's case, it said, attackers used more than 3,500 fraudulent accounts and conducted as many as 3 million exchanges per day with Claude, using them to train Alibaba's AI models. The startup Moonshot AI routed questions entered into its own conversational AI to Claude behind the scenes, showing the generated answers to users while also using them to train its own model. The forwarded information included data for surveilling individuals by a person believed to be linked to the Chinese People's Liberation Army. It also named DeepSeek and Beijing Zhipu Huazhang Technology as having carried out distillation attacks.
Alibaba Group Holding LtdAnthropic report accuses Alibaba of using 3,500 fraudulent accounts and 3M daily Claude exchanges to illicitly distill its AI models
Zai Lab LtdAnthropic report says Moonshot AI routed user questions to Claude behind the scenes to train its own model