LIVE UPDATES
Google has taken a significant step towards enhancing accessibility in gaming and beyond by making the code for Project Gameface open-source available to Android developers as of Tuesday.
Google who announced this at its I/O developers conference said Project Gameface introduces a hands-free gaming experience where users control the cursor through facial gestures or head movements.
With the release of the open-source code, developers can now integrate this innovative accessibility feature into their Android apps, offering users a new way to interact with their devices.
Using the device's camera and MediaPipe's Face Landmarks Detection API, Project Gameface tracks facial expressions and head movements to manipulate the cursor. For instance, users can move the cursor by opening their mouths or perform clicking and dragging actions by raising their eyebrows.
Google highlighted the versatility of Project Gameface, emphasizing that developers can customize the user experience by allowing adjustments to facial expressions, gesture sizes, cursor speed, and more.
Initially designed with gamers in mind, Project Gameface aims to broaden its applications beyond gaming. Google has partnered with Incluzza, a social enterprise in India focused on accessibility, to explore how this technology can benefit various settings such as work, school, and social situations.
The inspiration behind Project Gameface stems from the collaboration with quadriplegic video game streamer Lance Carr, who has muscular dystrophy. Carr's input and experience helped shape the project's development, with the goal of creating a more affordable and accessible alternative to existing head-tracking systems.
By releasing the open-source code for Project Gameface, Google is fostering innovation and inclusivity within the technology community, empowering developers to create more accessible experiences for users across different domains.
