Apple today previewed a suite of new accessibility features that leverage Apple Intelligence to transform the experience for users with visual, motor, and hearing impairments. The updates range from advanced image descriptions in VoiceOver to eye-controlled power wheelchair operation on the Apple Vision Pro, marking a significant leap in inclusive technology.
Among the most notable innovations is VoiceOver Image Explorer, which uses on-device AI to generate detailed descriptions of photos, scanned documents, and receipts. Users can press the Action button on iPhone and ask natural-language questions about what the camera sees, receiving immediate answers. This capability extends to Magnifier, now offering high-contrast visual descriptions for users with low vision, supporting spoken commands like “zoom in” or “turn on flashlight”.
Natural Voice Control and On-Device Captions
The Voice Control system receives a fundamental upgrade: natural-language input. Instead of memorizing exact button labels, users can say phrases such as “tap the guide about best restaurants” or “open the purple folder”. Apple noted that this feature also helps where on-screen elements lack proper accessibility labels, making interfaces more navigable. Meanwhile, Accessibility Reader improves reading of complex documents like multi-column scientific articles, with on-demand summaries and built-in translation that preserves custom fonts, colors, and formatting preferences.
Another major addition is Generated Subtitles, powered by on-device speech recognition. It automatically transcribes audio from uncaptioned video content, including clips recorded on iPhone, received from friends, or streamed online. The feature works across iPhone, iPad, Mac, Apple TV, and Vision Pro, initially in English for the U.S. and Canada.
Eye-Controlled Wheelchair and Other Vision Pro Innovations
The Apple Vision Pro headset becomes a mobility tool for people with severe motor disabilities. The new Power Wheelchair Control leverages the headset's precision eye-tracking system as an alternative input method to a joystick. At launch, it supports the Tolt and LUCI alternative drive systems in the U.S. via Bluetooth and wired connections. Additionally, Vehicle Motion Cues coming to visionOS helps reduce motion sickness when using Vision Pro as a passenger. The headset will also support face gestures for taps and system actions, plus a new eye-based selection method using Dwell Control.
Small but Meaningful Improvements Across the Ecosystem
Apple also announced name recognition for deaf or hard-of-hearing users, now expanding to over 50 languages. Larger text support arrives on tvOS, while the Sony Access controller gains compatibility with iOS, iPadOS, and macOS with full button and thumbstick customization. FaceTime gets a new API for sign language interpreter apps, allowing a human interpreter to join a live video call. Touch Accommodations have been refined for easier setup.
Furthermore, the Hikawa Grip & Stand for iPhone, designed in collaboration with people who have disabilities affecting grip, strength, and mobility, is now available in three new colors on the Apple Store online, thanks to a partnership with PopSockets.
Privacy Implications and Parallels with the Disney Case
The use of eye tracking for medical device control inevitably raises questions about biometric data protection. While Apple emphasizes that all processing happens on-device, the debate over surveillance and consent remains heated. Recently, another major company faced a class action lawsuit over facial recognition without consent, highlighting legal and technological challenges that parallel those in accessibility. The line between accessibility and privacy will increasingly be at the center of public discourse.
All announced features are expected to arrive later this year, likely with the new operating systems iOS 27, iPadOS 27, macOS 27, tvOS 27, and visionOS 27, which will be unveiled at WWDC in June and released in September. For a deeper look at the engine behind these innovations, the Wikipedia entry on Apple Intelligence provides comprehensive background.
Sponsored Protocol
