{"id":635762,"date":"2026-06-13T00:29:20","date_gmt":"2026-06-13T00:29:20","guid":{"rendered":"https:\/\/www.newsbeep.com\/uk\/635762\/"},"modified":"2026-06-13T00:29:20","modified_gmt":"2026-06-13T00:29:20","slug":"apples-third-generation-foundation-models-explained","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/uk\/635762\/","title":{"rendered":"Apple\u2019s third-generation Foundation Models explained"},"content":{"rendered":"<p>\t<img width=\"1600\" height=\"800\" src=\"https:\/\/www.newsbeep.com\/uk\/wp-content\/uploads\/2026\/06\/apple-foundation-models-2026.jpg\" class=\"skip-lazy wp-post-image\" alt=\"\"  decoding=\"async\" fetchpriority=\"high\"\/><\/p>\n<p class=\"wp-block-paragraph\">During the WWDC26 keynote, Apple announced its third generation of Apple Foundation Models (AFM), comprising five models, some of which are local, some of which are cloud-based, and one of which lives in Google\u2019s servers running on Nvidia chips. Here\u2019s a breakdown of how that will work.<\/p>\n<p>A bit of background<\/p>\n<p class=\"wp-block-paragraph\">When Apple first announced its foundation models <a href=\"https:\/\/9to5mac.com\/2024\/06\/14\/apple-doesnt-use-your-data\/\" rel=\"nofollow noopener\" target=\"_blank\">in 2024<\/a>, the lineup included an on-device language model with roughly 3 billion parameters, and \u201ca larger server-based language model available with Private Cloud Compute and running on Apple silicon servers,\u201d as the company <a href=\"https:\/\/machinelearning.apple.com\/research\/introducing-apple-foundation-models\" rel=\"nofollow noopener\" target=\"_blank\">put it<\/a> at the time.<\/p>\n<p class=\"wp-block-paragraph\">Private Cloud Compute was an <a href=\"https:\/\/security.apple.com\/blog\/private-cloud-compute\/\" rel=\"nofollow noopener\" target=\"_blank\">ambitious<\/a> undertaking, as it aimed to deliver cloud-based AI capabilities while preserving the same privacy guarantees users expect from on-device processing.<\/p>\n<p class=\"wp-block-paragraph\">For this reason, keeping everything in-house was essential. Private Cloud Compute ran in Apple data centers, on servers powered by Apple silicon. Even so, its privacy guarantees could be independently verified by third-party security researchers.<\/p>\n<p class=\"wp-block-paragraph\">However, as Apple struggled to get its AI aspirations off the ground, the company <a href=\"https:\/\/9to5mac.com\/2026\/01\/12\/apple-confirms-googles-gemini-will-power-new-siri-features\/\" rel=\"nofollow noopener\" target=\"_blank\">partnered<\/a> with Google to use Gemini as the backbone of its new AI efforts, the results of which it announced earlier this week during the WWDC26 keynote.<\/p>\n<p>Apple\u2019s new foundation models<\/p>\n<p class=\"wp-block-paragraph\">The third generation of AFMs includes five models: AFM 3 Core and AFM 3 Code Advanced, which are on-device models, and AFM Cloud, ADM 3 Cloud (Image), and AFM 3 Cloud Pro, which are server-based. The D in ADM 3 Cloud (Image) stands for diffusion, a technology we\u2019ve covered in the past <a href=\"https:\/\/9to5mac.com\/2025\/07\/04\/apple-just-released-a-weirdly-interesting-coding-language-model\/\" rel=\"nofollow noopener\" target=\"_blank\">here<\/a>.<\/p>\n<p class=\"wp-block-paragraph\">Except for AFM 3 Cloud Pro, all other models were built to run on Apple silicon devices. AFM 3 Cloud Pro, meanwhile, <a href=\"https:\/\/9to5mac.com\/2026\/06\/11\/siri-ai-is-powered-by-gemini-models-but-is-not-gemini-what-does-that-mean\/\" rel=\"nofollow noopener\" target=\"_blank\">runs on NVIDIA GPUs hosted in Google Cloud<\/a>.<\/p>\n<p class=\"wp-block-paragraph\">This was made possible afer Apple <a href=\"https:\/\/security.apple.com\/blog\/expanding-pcc\/\" rel=\"nofollow noopener\" target=\"_blank\">extended<\/a> its Private Cloud Compute architecture to third-party infrastructure for the first time, \u201cwhile maintaining Apple\u2019s powerful security and privacy protections,\u201d according to the company.<\/p>\n<p class=\"wp-block-paragraph\">As for the models themselves, here\u2019s a breakdown of each one, as explained by Apple:<\/p>\n<p>AFM 3 Core, the next generation of our 3-billion-parameter dense model that delivers a step up in quality.<\/p>\n<p>AFM 3 Core Advanced, our most powerful on-device model. It\u2019s natively multimodal, enabling helpful features like expressive voices and higher-accuracy dictation. Built on cutting-edge Apple research, this 20-billion-parameter model uses a sparse architecture, activating just 1 to 4 billion parameters at a time depending on the request. AFM 3 Core Advanced is unlocked by and optimized for our most capable Apple silicon systems.<\/p>\n<p>AFM 3 Cloud, our server-side workhorse, optimized for speed, efficiency, and performance.<\/p>\n<p>ADM 3 Cloud (Image), for image generation and editing, which unlocks advanced photo-editing tools, the all-new Image Playground, and more.<\/p>\n<p>AFM 3 Cloud Pro, our most capable server-based model, which powers our most demanding use cases, like agentic tool use and complex reasoning.<\/p>\n<p class=\"wp-block-paragraph\">The highlights here are AFM 3 Core Advanced and AFM 3 Cloud Pro.<\/p>\n<p class=\"wp-block-paragraph\">Beginning with AFM 3 Core Advanced, it packs 20 billion parameters into an on-device model, which is no small feat. Most on-device models aimed at the general public tend to stay in the low-single-digit billions of parameters.<\/p>\n<p class=\"wp-block-paragraph\">To make AFM 3 Core Advanced run well, Apple used a sparse architecture that activates up to 4 billion parameters at a time, depending on the prompt, rather than a dense architecture that would need to keep all 20 billion parameters active for every request.<\/p>\n<p class=\"wp-block-paragraph\">Although conceptually similar to the <a href=\"https:\/\/9to5mac.com\/2025\/07\/21\/apple-details-how-it-trained-its-new-ai-models-4-interesting-highlights\/\" rel=\"nofollow noopener\" target=\"_blank\">Mixture of Experts approach<\/a>, this selective activation relies on a technique Apple invented and detailed in the interesting study <a href=\"https:\/\/machinelearning.apple.com\/research\/pruning-large-language\" rel=\"nofollow noopener\" target=\"_blank\">Instruction-Following Pruning for Large Language Models<\/a> released a year ago.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" height=\"563\" width=\"1024\" src=\"https:\/\/www.newsbeep.com\/uk\/wp-content\/uploads\/2026\/06\/afm-3-core-architecture.jpg\" alt=\"\" class=\"wp-image-1056423\"  \/><\/p>\n<p class=\"wp-block-paragraph\">As for AFM 3 Cloud Pro, this is the one that runs on an external infrastructure. You can read some of the technical details of this expansion in <a href=\"https:\/\/security.apple.com\/blog\/expanding-pcc\/\" rel=\"nofollow noopener\" target=\"_blank\">this article<\/a> published on Apple\u2019s Security blog earlier this week, but here\u2019s the most important part:<\/p>\n<p class=\"wp-block-paragraph\">On this foundation, Apple and Google collaborated to build capabilities that go far beyond a traditional confidential computing deployment:<\/p>\n<p>We do not rely solely on confidential computing technologies to mitigate attacks that leverage privileged access outside of a confidential VM, including side-channel attacks. We consider every component \u2014 from firmware through the host and guest OS stacks to application code \u2014 to be part of our trusted computing base, subject to our verifiable transparency and no-privileged-access guarantees.<\/p>\n<p>To mitigate the risk of supply chain attacks, we maintain a cryptographically verifiable, append-only ledger of all Google Cloud hardware that is part of the PCC fleet. For components that could be abused to exfiltrate user data if compromised, our software attestation is rooted in at least two separate roots of trust from independent vendors.<\/p>\n<p>Even when deployed with confidential computing, we believe the inference stack must be designed with privacy and security from the start. PCC on Google Cloud leverages many of the same architectural security patterns as PCC on Apple silicon to implement these layered protections: initial network data parsing for each request happens in a dedicated process within its own namespace, shared inference software is recycled with a short time-to-live duration, and attested keys are held in a separate, dedicated confidential VM isolated from external inputs.<\/p>\n<p class=\"wp-block-paragraph\">In its Machine Learning Research blog, Apple <a href=\"https:\/\/machinelearning.apple.com\/research\/introducing-third-generation-of-apple-foundation-models\" rel=\"nofollow noopener\" target=\"_blank\">says<\/a> that all five models \u201cshared a common initial foundation before specializing for their respective architectures and use cases, adding multimodal capabilities like audio, image understanding, long-context reasoning, and high-quality visual generation.\u201d<\/p>\n<p class=\"wp-block-paragraph\">The company adds that, to train these models, it used \u201ca mixture of data that includes publicly available information, data licensed or purchased from third parties, open-sourced data, data obtained through dedicated studies, and synthetic data.\u201d Apple also stresses that the training process did not include user data or interactions and that web publishers can opt out of foundation model training.<\/p>\n<p>The results<\/p>\n<p class=\"wp-block-paragraph\">Apple says it conducted extensive human evaluations of its third-generation foundation models, with in-house reviewers grading responses across categories such as instruction following, truthfulness, presentation, and image understanding.<\/p>\n<p class=\"wp-block-paragraph\">Models were evaluated against their predecessors (when applicable), and you can see some of the results below:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" height=\"704\" width=\"1024\" src=\"https:\/\/www.newsbeep.com\/uk\/wp-content\/uploads\/2026\/06\/afm-3-text.jpg\" alt=\"\" class=\"wp-image-1056419\"  \/><\/p>\n<p class=\"wp-block-paragraph\">Fraction of preferred responses in side-by-side human evaluations of general text capabilities, comparing AFM 3 Core and AFM 3 Cloud against our previous generation of models. Results are presented across four distinct locale groups to demonstrate consistent performance across international variants. \u201cEnglish\u201d represents our global English evaluation set, while \u201cPFIGSCJK\u201d, \u201cDNNSTV\u201d and \u201cAFIHHMPRTU\u201d represent our remaining supported global locales.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" height=\"459\" width=\"1024\" src=\"https:\/\/www.newsbeep.com\/uk\/wp-content\/uploads\/2026\/06\/afm-3-image-understanding.jpg\" alt=\"\" class=\"wp-image-1056418\"  \/><\/p>\n<p class=\"wp-block-paragraph\">Fraction of preferred responses in side-by-side human evaluations of image understanding capabilities in English. The results compare AFM 3 Core and AFM 3 Cloud against their 2025 predecessors.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" height=\"541\" width=\"1024\" src=\"https:\/\/www.newsbeep.com\/uk\/wp-content\/uploads\/2026\/06\/amf-3-audio.jpg\" alt=\"\" class=\"wp-image-1056417\"  \/><\/p>\n<p class=\"wp-block-paragraph\">Fraction of preferred responses in side-by-side human evaluations for dictation tasks. The results compare AFM 3 Core Advanced against Apple\u2019s existing production dictation system across seven quality dimensions. AFM 3 Core Advanced demonstrates a positive win rate in overall quality, with preference extending consistently across all individual formatting and comprehension dimensions.<\/p>\n<p class=\"wp-block-paragraph\">For an even deeper dive into the third-gen Apple Foundation Models, <a href=\"https:\/\/machinelearning.apple.com\/research\/introducing-third-generation-of-apple-foundation-models\" rel=\"nofollow noopener\" target=\"_blank\">follow this link<\/a>.<\/p>\n<p>Worth checking out on Amazon<\/p>\n<p>\t\t<a target=\"_blank\" rel=\"nofollow noopener\" href=\"https:\/\/google.com\/preferences\/source?q=https:\/\/9to5mac.com\" aria-label=\"Add 9to5Mac as a preferred source on Google\"><br \/>\n\t\t\t<img decoding=\"async\" class=\"google-preferred-source-badge-dark\" src=\"https:\/\/www.newsbeep.com\/uk\/wp-content\/uploads\/2026\/01\/1767826569_427_google-preferred-source-badge-dark.png\" alt=\"Add 9to5Mac as a preferred source on Google\"\/><br \/>\n\t\t\t<img decoding=\"async\" class=\"google-preferred-source-badge-light\" src=\"https:\/\/www.newsbeep.com\/uk\/wp-content\/uploads\/2026\/01\/google-preferred-source-badge-light.png\" alt=\"Add 9to5Mac as a preferred source on Google\"\/><br \/>\n\t\t<\/a><\/p>\n<p class=\"disclaimer-affiliate\">FTC: We use income earning auto affiliate links. <a href=\"https:\/\/9to5mac.com\/about\/#affiliate\" rel=\"nofollow noopener\" target=\"_blank\">More.<\/a><\/p>\n<p><a href=\"https:\/\/amzn.to\/43xbZva\" rel=\"nofollow noopener\" target=\"_blank\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-1056443\" src=\"https:\/\/www.newsbeep.com\/uk\/wp-content\/uploads\/2026\/06\/1781310560_988_MSI-9to5Mac_750x150.jpg\" alt=\"\" width=\"750\" height=\"150\"\/><\/a>\t\t\t\t<\/p>\n","protected":false},"excerpt":{"rendered":"During the WWDC26 keynote, Apple announced its third generation of Apple Foundation Models (AFM), comprising five models, some&hellip;\n","protected":false},"author":2,"featured_media":635763,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[554,733,4308,86,56,54,55],"class_list":["post-635762","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-technology","tag-uk","tag-united-kingdom","tag-unitedkingdom"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts\/635762","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/comments?post=635762"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts\/635762\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/media\/635763"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/media?parent=635762"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/categories?post=635762"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/tags?post=635762"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}