Google Says Disabled People Can Now Use Android Phones With Face Gestures

Android users can scan their phone screen and select a task by smiling, raising eyebrows, opening their mouth, or looking to the left, right, or up.

By Agence France-Presse | Updated: 24 September 2021 10:45 IST

Google Says Disabled People Can Now Use Android Phones With Face Gestures

Photo Credit: Google

An individual and their caregiver can customise Camera Switches

Highlights

The changes are the result of two new features
Camera Switches lets people use their faces instead of swipes
The other is Project Activate, a new Android application

Using a raised eyebrow or smile, people with speech or physical disabilities can now operate their Android-powered smartphones hands-free, Google said Thursday. Two new tools put machine learning and front-facing cameras on smartphones to work detecting face and eye movements. Users can scan their phone screen and select a task by smiling, raising eyebrows, opening their mouth, or looking to the left, right or up.

"To make Android more accessible for everyone, we're launching new tools that make it easier to control your phone and communicate using facial gestures," Google said.

Google Abused Android Dominance, Shows Indian Antitrust Probe Report

The Centers for Disease Control and Prevention estimates that 61 million adults in the United States live with disabilities, which has pushed Google and rivals Apple and Microsoft to make products and services more accessible to them.

"Every day, people use voice commands, like 'Hey Google', or their hands to navigate their phones," the tech giant said in a blog post.

"However, that's not always possible for people with severe motor and speech disabilities."

Chrome 94 Brings Security Fixes, Four-Week Release Cycle, and More

The changes are the result of two new features, one is called "Camera Switches," which lets people use their faces instead of swipes and taps to interact with smartphones.

The other is Project Activate, a new Android application which allows people to use those gestures to trigger an action, like having a phone play a recorded phrase, send a text, or make a call.

"Now it's possible for anyone to use eye movements and facial gestures that are customised to their range of movement to navigate their phone — sans hands and voice," Google said.

The free Activate app is available in Australia, Britain, Canada, and the United States at the Google Play shop.

Apple, Google, and Microsoft have consistently rolled out innovations that make Internet technology more accessible to people with disabilities or who find that age has made some tasks, such as reading, more difficult.

Voice-commanded digital assistants built into speakers and smartphones can enable people with sight or movement challenges to tell computers what to do.

There is software that identifies text on web pages or in images and then reads it aloud, as well as automatic generation of captions that display what is said in videos.

An "AssistiveTouch" feature that Apple built into the software powering its smart watch lets touchscreen displays be controlled by sensing movements such as finger pinches or hand clenches.

"This feature also works with VoiceOver so you can navigate Apple Watch with one hand while using a cane or leading a service animal," Apple said in a post.

Computing colossus Microsoft describes accessibility as essential to empowering everyone with technology tools.

"To enable transformative change accessibility needs to be a priority," Microsoft said in a post.

"We aim to build it into what we design for every team, organisation, classroom, and home."

This week on Orbital, the Gadgets 360 podcast, we discuss iPhone 13, new iPad and iPad mini, and Apple Watch Series 7 — and what they mean to the Indian market. Orbital is available on Apple Podcasts, Google Podcasts, Spotify, Amazon Music and wherever you get your podcasts.

Affiliate links may be automatically generated - see our ethics statement for details.

Comments

For the latest tech news and reviews, follow Gadgets 360 on X, Facebook, WhatsApp, Threads and Google News. For the latest videos on gadgets and tech, subscribe to our YouTube channel. If you want to know everything about top influencers, follow our in-house Who'sThat360 on Instagram and YouTube.