# Siri AI personal context and onscreen awareness > Source-anchored research for Siri AI personal context and onscreen awareness. Run status: COMPLETED. Parent: [Apple Intelligence](https://llms-explorer.com/tree/apple-intelligence/) · 3 facets · 11 facts · page: https://llms-explorer.com/tree/siri-ai-personal-context-and-onscreen-awareness/ ## How it works - Apple says onscreen awareness can answer questions about and act on the current screen. Its developer sessions explain that, when a person starts a Siri request, Siri's understanding of onscreen text is limited to the visible pixels; adopting onscreen awareness APIs provides additional context about the entities on screen and their locations. App Intents annotations connect visible views to structured entities so Siri can resolve references such as 'this event' or 'the third one.' (high confidence) (verified as of 2026-10-22) — [source](https://support.apple.com/en-us/127893) - For app actions exposed through App Intents, Siri can ask clarifying questions when details are missing and request confirmation before consequential changes. Apple's developer examples show a person revising an event time in a follow-up, confirming an update, and canceling a deletion; confirmation behavior depends on the intent and entity, and Siri may skip it for private entities. (high confidence) — [source](https://developer.apple.com/videos/play/wwdc2026/343/) - Apple's beta enrollment flow asks people to review privacy settings. 9to5Mac reported on 2026-09-14 that a separate opt-in asks whether to share Siri, Dictation, and Translate audio and text to improve Foundation Models, with a later switch in Privacy & Security. That report does not establish whether this data-sharing opt-in controls Siri's access to personal-context sources. (medium confidence) (verified as of 2026-09-14) — [source](https://support.apple.com/en-us/127893) - Apple lists cross-app actions such as sending messages and creating events; its developer sessions show that Siri can ask for missing or ambiguous details and confirm a consequential intent before acting. In Apple’s calendar demo, Siri asks before deleting an event and cancels when the user says “never mind.” (high confidence) (verified as of 2026-10-22) — [source](https://support.apple.com/en-us/127893) ## Problems, failure modes and limitations - September 2026 reporting qualifies the advertised context features: 9to5Mac describes personal-index misses and requests that fail while the device is locked; TidBITS testers report missed cross-app email or message items; Macworld reports friction when interpreting text on screen and service interruptions. These are anecdotal beta tests, not measured failure rates or proof that the same issues persist in October. (high confidence) (verified as of 2026-09-30) — [source](https://9to5mac.com/2026/09/20/five-ways-that-the-new-siri-ai-is-frustrating-iphone-and-apple-watch-users/) - Beta reports varied by test and date: PhoneArena’s June 8 test said Siri missed a next-day Calendar appointment; Tom’s Guide’s June 20 test said an onscreen reminder suggestion still needed manual details; and The Mac Observer’s September 21 roundup reported user complaints about slow answers, connection errors, and unlock prompts while cautioning that scattered complaints do not establish every device is affected. (medium confidence) (verified as of 2026-09-21) — [source](https://www.phonearena.com/news/siri-ai-is-installed-on-my-iphone_id180956) ## Facts and statements - Apple announced Siri AI as a planned next-generation assistant on June 8, 2026; its September 14 release described the rollout as a beta, and the October 22 Apple Support guide still labels it “Siri AI (Beta)” and says users review privacy settings and enter a waitlist whose duration varies. (high confidence) (verified as of 2026-10-22) — [source](https://www.apple.com/newsroom/2026/06/apple-unveils-next-generation-of-apple-intelligence-siri-ai-and-more/) - Apple documents personal-context search across Messages, Mail, Calendar, Notes, Reminders, and more. Its September release illustrates a cross-app request that uses a message and email to add recipe ingredients to Reminders. TechCrunch reports that its hands-on test also retrieved photos, emails, contacts, texts, and calendar appointments from natural-language requests. (high confidence) (verified as of 2026-10-22) — [source](https://support.apple.com/en-us/127893) - Apple Support lists Messages, Mail, Calendar, Notes, Reminders, and more as personal-context sources. In a June 16 beta test, Android Authority reported finding a restaurant recommendation in a message/email context, checking its hours, and drafting a calendar invite; this is one observed task, not a general reliability guarantee. (medium confidence) (verified as of 2026-10-22) — [source](https://support.apple.com/en-us/127893) - Apple says onscreen awareness can answer questions about and act on visible content. Its developer code-along shows app-specific visible entities connected to Siri through .appEntityIdentifier and .userActivity, with actions exposed through App Intents and App Schemas. (high confidence) (verified as of 2026-10-22) — [source](https://support.apple.com/en-us/127893) - An Android Authority beta test reported that a follow-up to an onscreen email summary could create a calendar entry or send a reply. Tom’s Guide reported that Siri’s suggested reminder from Messages still required manual entry, so follow-up capability did not guarantee complete execution in that test. (medium confidence) (verified as of 2026-06-20) — [source](https://www.androidauthority.com/siri-ai-vs-gemini-hands-on-comparison-3677330/)