During I/O 2023, Google Presented Project Gameface, a mouse that allows the user to move hands-free, controlling the cursor with head movements and facial movements. Open source, the tool is powered by artificial intelligence (AI).
The story of paralyzed video game publisher Lance Carr inspired the project. Since he has muscular dystrophy, he uses head tracking to move the mouse around the screen while playing games. The streamer lost everything in a fire, including the very expensive mouse.
To help people like him, Carr worked with the Google team on Project Gameface and used the open source solutions from Google MediaPipe, which is now available. The tool is still in development and can be found in the Google repository on GitHub..
For now, the resource works based on user-placed properties. You can click and drag by raising your eyebrows, or even open your mouth and move it. Movements are captured by the webcam that recognizes the use of machine learning.
Each player can adapt the moves according to their needs. They can control the size of gestures and what defines each mouse action.
Source: Tec Mundo
I am a passionate and hardworking journalist with an eye for detail. I specialize in the field of news reporting, and have been writing for Gadget Onus, a renowned online news site, since 2019. As the author of their Hot News section, I’m proud to be at the forefront of today’s headlines and current affairs.
