AI & Technology
Siri AI Can Now Read the Screen. Apple's Footnotes Mark Where It Stops
Published: 2026-09-14
In short
Apple's Siri AI, which understands on-screen content and acts in apps, began rolling out Sept. 14 in English beta; five languages follow in October.
Mr. Latte's take
For Mac apps built around a single trick, reading the screen and answering questions about it, this release puts the same trick into the operating system. How far the overlap reaches is set by Apple's own footnotes: English first, no iPhone or iPad access in the EU at launch, nothing in China, and daily caps on features that call server-side models. Apple adds that wider access will cost money later but names no price, so it is not yet clear whether the built-in assistant and a paid app will be compared on the same terms.
What Shipped on Sept. 14 Is an English Beta
Apple released iOS 27, iPadOS 27, macOS 27 and its other platform updates on Sept. 14, and Siri AI came with them. Apple calls it an entirely new version of Siri, built around personal context understanding, broad world knowledge, onscreen awareness and more systemwide app actions. It can pull what a user needs from messages, emails and photos, answer questions about what is on screen, and take action on that content.
The rollout is staged. Siri AI starts as a beta in English, with French, Japanese, Korean, Portuguese and Spanish coming in October. Hardware is limited too: on iPhone it needs an iPhone 15 Pro, 15 Pro Max or an iPhone 16 model or later, and on the Mac it needs M1 or later, or the MacBook Neo.
On the Mac, Siri AI sits inside Spotlight, and a Control-click on images, files or text brings it up from the systemwide context menu. TechCrunch’s review notes that one keyboard shortcut adds the focused window to Siri’s context and another lets users select just part of the screen before asking.
Work the Operating System Now Does by Default
TechCrunch’s macOS 27 review set Siri AI against AI productivity apps. Many top browsers other than Safari already ship a sidebar assistant that reads open tabs, and apps such as Highlight, Caddy and Littlebird use the current window as context for questions. The new Siri, TechCrunch wrote, is similar.
The overlap goes beyond screen assistants. Apple says users can have Siri draft and revise text virtually anywhere they type, and that Apple Intelligence now proofreads as people type across the system, including within most third-party apps. TechCrunch also describes AI page tracking in Safari that watches pages without RSS support for price drops, privacy policy changes or new blog posts.
The reviewer did not find Spotlight as advanced as Raycast, the highly extensible Mac productivity tool, but called it much better than before.
How Siri Gets Inside Third-Party Apps
Apple’s third-party examples fall into two groups. Texting a friend in WhatsApp or playing a book on Audible works now. Drafting an email in Microsoft Outlook, finding a homework assignment in Notability or adding a restaurant recommendation to Tripsy is described only as coming soon.
The way an app exposes its actions and data is documented in Apple’s App Intents framework, which makes app content and actions discoverable by Apple Intelligence and supports Siri, Spotlight, Shortcuts and widgets. Developers declare what an app does as app intents and its key data types as app entities, and can apply Apple’s system-defined schemas to declare support for well-known actions.
When Apple introduced Siri AI on June 8, it said personal context understanding extends to third-party apps when developers integrate with Spotlight, and it opened developer testing through the Apple Developer Program that day.
More Than Two Years From Promise to Release
The promise behind Siri AI goes back to Apple’s 2024 Worldwide Developers Conference, where the company announced a “more personalized Siri” that would understand personal context and take action within and across apps. In March 2025 Apple said the features would take longer than it thought to deliver and moved them into the coming year.
In June 2026 Apple reintroduced the idea as Siri AI, saying an English beta would arrive later in the year and more languages would follow quickly. The September announcement put those languages, and October, in writing.
The Lines Drawn in the Footnotes
Apple’s footnotes narrow the overlap. In the EU, Mac and Apple Vision Pro users can use Siri AI when set to a supported language, but it will not initially be available on iOS, iPadOS or watchOS. In China, Siri AI and the other new Apple Intelligence features will not be offered while Apple works through regulatory requirements. Users under 13 cannot use Siri AI.
Usage is capped as well. Features that rely on server-side models, including Siri AI, the photo editing tools, Image Playground and AFM 3 Cloud models in Shortcuts, carry daily limits that vary by feature, request complexity and system demand. Apple says expanded access to those features will be available for a fee in the future. It gave neither a price nor a date.
Sources
- Siri AI, a profoundly more capable and personal assistant powered by the next generation of Apple Intelligence, is here Apple Newsroom
- Major updates for Apple's software platforms are now available Apple Newsroom
- macOS 27: new Siri takes on AI productivity apps TechCrunch
- Apple introduces Siri AI, a profoundly more capable and personal assistant Apple Newsroom
- App Intents Apple Developer Documentation
- AI-powered 'more personalized Siri' is delayed TechCrunch