Apple Inc.Apple's iPhone 17 Pro can run PrismML's Bonsai 27B locally, showcasing its neural accelerators and potentially boosting device sales.
PrismML released Bonsai 27B, a compressed open-weight AI model that can run locally on an Apple iPhone 17 Pro while retaining roughly 90% of the original model's performance. The 3.9-gigabyte model is built on Alibaba's Qwen3.6 and fits within a phone's usable memory, a breakthrough that avoids the performance degradation seen in previous compression attempts. Apple's A19 and A19 Pro chips feature neural accelerators designed for on-device AI, and the company is reportedly in very early discussions with PrismML about the technology. The development could accelerate consumer access to capable, offline AI without monthly fees, while Apple's business model benefits from selling devices with greater memory and capacity.
Apple Inc.Apple's iPhone 17 Pro can run PrismML's Bonsai 27B locally, showcasing its neural accelerators and potentially boosting device sales.
Alibaba Group Holding LtdBonsai 27B is built on Alibaba's Qwen3.6, highlighting Alibaba's model as a foundation for advanced on-device AI.
Astera Labs, Inc.PrismML released Bonsai 27B, a breakthrough compressed model that runs locally on iPhone 17 Pro with minimal performance loss.