Apple introduces new cognitive accessibility features, Live Speech, Personal Voice and Point and Speak for iPhone and iPad – Times of India

Apple today previewed software features for cognitive, vision, hearing and mobility accessibility, along with new ools for individuals who are non speaking or at risk of losing their ability to speak. These updates draw on advances in hardware and software, include on-device machine learning to ensure user privacy, and expand on Apple’s long-standing commitment to making products for everyone.
Apple has worked in collaboration with community groups representing a broad spectrum of users with disabilities to develop accessibility features.
Apple’s new cognitive accessibility features arriving later this year
Coming later this year, users with cognitive disabilities can use iPhone and iPad with ease and independence with Assistive Access; nonspeaking individuals can type to speak during calls and conversations with Live Speech; and those at risk of losing their ability to speak can use Personal Voice to create a synthesised voice that sounds like them for connecting with family and friends.
For users who are blind or have low vision, Detection Mode in Magnifier offers Point and Speak, which identifies text users point toward and reads it out loud to help them interact with physical objects such as household appliances.
Here’s are the new cognitive accessibility features coming soon to iPhones and iPads
Assitive Access
Assistive Access includes a customised experience for Phone and FaceTime, which have been combined into a single Calls app, as well as Messages, Camera, Photos, and Music. The feature offers a distinct interface with high contrast buttons and large text labels, as well as tools to help trusted supporters tailor the experience for the individual they support.
Live Speech and Personal Voice Advance Speech accessibility
The Live Speech on iPhone, iPad and Mac allows users to type what they want to say to have it be spoken out loud during phone and FaceTime calls as well as in-person conversations. ers can also save commonly used phrases to chime in quickly during lively conversation with family, friends, and colleagues.
Users can create a Personal Voice by reading along with a randomised set of text prompts to record 15 minutes of audio on iPhone or iPad. This speech accessibility feature uses on-device machine learning to keep users’ information private and secure, and integrates seamlessly with Live Speech so users can speak with their Personal Voice when connecting with loved ones.
Detection Mode in Magnifier
This feature introduces Point and Speak for users who are blind or have low vision to make its easier for users to interact with physical objects that have several text labels. For example, while using a household appliance — such as a microwave — Point and Speak combines input from the Camera app, the LiDAR Scanner, and on-device machine learning to announce the text on each button as users move their finger across the keypad. Point and Speak is built into the Magnifier app on iPhone and iPad, works great with VoiceOver, and can be used with other Magnifier features such as People Detection, Door Detection, and Image Descriptions to help users navigate their physical environment.
Additional features
Deaf or hard-of-hearing users can pair Made for iPhone hearing devices directly to Mac and customise them for their hearing comfort.
Voice Control adds phonetic suggestions for text editing so users who type with their voice can choose the right word out of several that might sound alike, like “do,” “due,” and “dew.”
Additionally, with Voice Control Guide, users can learn tips and tricks about using voice commands as an alternative to touch and typing across iPhone, iPad, and Mac.
Users with physical and motor disabilities who use Switch Control can turn any switch into a virtual game controller to play their favourite games on iPhone and iPad.
For users with low vision, Text Size is now easier to adjust across Mac apps such as Finder, Messages, Mail, Calendar, and Notes.
Users who are sensitive to rapid animations can automatically pause images with moving elements, such as GIFs, in Messages and Safari.
For VoiceOver users, Siri voices sound natural and expressive even at high rates of speech feedback; users can also customise the rate at which Siri speaks to them, with options ranging from 0.8x to 2x.