iOS 17.4 code shows that Apple may be testing two versions of its Ajax LLM for Siri and Messages, comparing their responses to results from OpenAI's ChatGPT
New emoji, EU App Store changes, unreleased devices, and more! Alan Martin / Tom's Guide : Apple testing souped-up Siri with help from ChatGPT Amber Neely / AppleInsider : iOS 17.4 beta has signs of an AI-improved Siri ahead of WWDC 2024 Emma Roth / The Verge : It looks like Apple is testing more AI features. Ali Salman / Wccftech : Developers Can Now Request Apple To Access Additional Hardware And Software Features On iPhone Threads: Marc Love / @marcslove : Apple appears to be A/B testing 4 models: - a server-based version of Apple's Ajax - a device-based version of Apple's Ajax - GPT-4 - FLAN-T5 (an older open-source instruction-following model from Google) ...or maybe not A/B testing so much as collecting real-world benchmarks against competitors. @hi.nixson : I wonder if on-device LLM processing will be a pro feature, or available on both versions of future iPhone models. Alex Schleifer / @alexoid : It's unlikely they'd use GPT-4 even if it's best in class. The privacy narrative alone would make that weird for them. Would bet you're right and it's benchmarking. X: @ananayarora : First thing, it's calling GPT-3.5 DIRECTLY from device. There is no proxy in the middle or anything. Wondering how this will play out since they'll have to ship out openAI keys with the device which I wonder how they'll be protecting. (2/n) [image] @ananayarora : This seems like a very interesting move since these suggestions are not on-device for the very first time. However, Apple recently put out a paper where they want to run their own LLM on device which is a much better approach from a privacy pov. (4/n) https://arxiv.org/... @ananayarora : There are several prompts in the binary, one of them being able to work with User Received SMSs and suggesting the appropriate action. GPT will also provide a “confidence score” along with it for each action. This along with mini prompts to summarize content. (3/n) [image] @ananayarora : Apple seems to be working on using GPT directly in Siri as reported by 9to5Mac. Here's some insights I found from the iOS 17.4 IPSW 🧵 (1/n) Cullen / @cullend : Pretty sure training your own AI model on OpenAI is considered a big no-no. They execute queries against both their own GPT model and OpenAI at the same time. Probably shouldn't put that in the client code! https://9to5mac.com/... [image] Forums: r/apple : iOS 17.4: Apple continues work on AI-powered Siri and Messages features, with help from ChatGPT - 9to5Mac Msmash / Slashdot : Apple's Large Language Model Shows Up in New iOS Code 3