Every May, Apple previews new accessibility features ahead of Global Accessibility Awareness Day, and this year the company revealed two breakthroughs that go far beyond simple voice commands. The first is a major upgrade to Voice Control, now infused with Apple Intelligence to understand natural language. iPhone and iPad users will be able to say phrases like "tap the guide about best restaurants" in Apple Maps or "tap the purple folder" in the Files app, without needing to remember exact labels or numbers. This ability to describe on-screen elements with one's own words transforms the interaction, making it far more intuitive and inclusive.
The implications are enormous. As several analysts have pointed out, if a human can control an iPhone with natural language, so can an AI agent. The new Voice Control is not just an accessibility improvement but a clear hint at the future of Siri. Apple promised a Siri with 'on-screen awareness' back at WWDC 2024, capable of understanding personal context and taking actions for the user. After delays announced in March 2025, all signs point to these capabilities being the cornerstone of iOS 27, iPadOS 27, and macOS 27, set to be unveiled on June 8 and released to the public in September.
An AI Agent in Your Pocket
The AI-powered Voice Control fits perfectly into Apple's long-term vision of turning Siri into an intelligent agent that can navigate apps and perform complex tasks. We are talking about requests like commenting on an Instagram post or scrolling through a shopping app to add an item to the cart. This kind of interaction requires deep understanding of the user interface, exactly what the new Voice Control demonstrates in preview. It is no coincidence that the feature is limited to devices with A17 Pro, M1 chips or newer, as it leverages the Neural Engine for on-device processing, ensuring user privacy. The connection to the broader AI landscape is clear: while companies like Samsung are redefining customer satisfaction with new security standards in the mobile ecosystem, Apple chooses the path of deep AI integration into everyday experience.
Auto Captions for Personal Videos
The second novelty concerns automatic captions for videos recorded on the iPhone. Apple announced a new on-device speech recognition model that can generate captions in real time for videos that lack them. The feature will work for personal recordings, videos received from friends and family, and even streaming content. Initially limited to English in the United States and Canada, Apple assured that all processing happens on the device, preserving privacy. Users will be able to customize the appearance of captions from the playback menu or Settings. The feature will be available on iPhone, iPad, Mac, Apple TV and Vision Pro, with rollout expected with iOS 27 and Apple's other operating systems.
This move not only improves accessibility for people with hearing impairments but turns every private video into a searchable, more easily shareable asset. It is a significant step forward from manual captions or third-party services. Considering how AI is reshaping work and search, with layoffs at companies like Intuit and exploding startups creating new music models, Apple shows it wants to bring artificial intelligence into the most personal and creative sphere of its users, without compromising data security.
Ahead of WWDC 2026, these previews confirm that the Apple ecosystem is preparing for a profound evolution. The combination of natural voice control and automatic captions is not just a win for accessibility, but the promise of a radically more human and responsive user interface, where the line between voice assistant and AI agent grows ever thinner.
Sponsored Protocol
