Google launches tool that lets you control your mobile phone with your face

Google launches Project Gameface An accessibility tool that lets you control your Android mobile phone with your face. This feature interprets various facial expressions to receive commands from the user and even allows you to play hands-free.

Now programmers can build their own applications leveraging the tool’s foundation and develop accessibility solutions using facial expressions or gestures. The program can allow commands when it detects that the user is opening their mouth, raising their eyebrows, or blinking just one of their eyes.

Originally the tool was designed for desktop, but Project Gameface has been extended to run on Android. This feature uses the device’s camera and AI processing to capture the user’s facial movements.

Project Gameface was first revealed at Google I/O 2023. However, this Tuesday (14) it was released as open source for Android developers.

According to Google, Project Gameface was inspired by paralyzed streamer Lance Carr. The creator has collaborated with Google since the initiative’s inception, helping the company create the most accessible alternative possible.

More accessibility

“It seamlessly tracks facial expressions and head movements through the device’s camera, turning them into intuitive, personalized control,” Google explains in the announcement.

“Developers can create apps designed to structure personalized experiences with facial expressions, gesture sizes, cursor speed, and more,” he continued.

HE The project was born with the aim of being a tool for players with limited mobilitybut it also serves other purposes. Due to the partnership with the company Incluzza, the resource can also be used for other needs such as work and social interactions.

Although it’s not publicly available, it won’t be long before Project Gameface is available in apps on the Play Store. For now, we have to wait for developers to start implementing the tool in their own programs.