Here we review an updated version of FaceNav software (donationware from MotionInput Games, London). We use smiling and open mouth facial expressions tracked by the video camera on the laptop assigned to the acceleration for a motorcycle and braking in Milestone’s MotoGP 25. Other available and assignable expressions include raised eyebrows and pouting. Note: A few successful turns on the racecourse may lead to an accidental smile which can be virtually hazardous if you need to slow down. Smile carefully if you're competitive. If you have any video links you'd like to share, feel free to connect! Help us build our network and create more connections for sharing information.
FaceNav AI based software is ushering in new adaptive video gaming opportunities. You can sit in a neutral position or you can be more active:
I enjoy the feel of the game and the feedback of moving.
The other aspect that's interesting is the ability to be able to combine multiple facial expressions which make you think about your activities as you try to accomplish something like a high speed turn -- where in this example I'm smiling with the accelerator and then opening the mouth to apply the brake and at the same time turning my head to turn right and then nod my head downward to apply a second brake.
Track head movement for steering left and right.
Track head movement downward for the break.
A screenshot of the startup configuration screen is included.
In the adjacent example, I'm using a bunch of strategies for playing a driving game. I could see how it could be used for lots of other types of games and using it to play music and create a virtual musical instrument. More experiences to follow.
We're also experimenting using FaceNav direct mode for digital painting by tracking my nose and the electronic paintbrush. The software can be used in many different ways and we'll have some more examples of different ways it can be used for adaptive techniques for people that may have different types of mobility impairments.
This website effort with a volunteer effort with a small group of subscribers and contributors so if you know of individuals that might be interested in some of the information that we share with the videos and the website and substack newsletter please feel free to share. Please share any links or information you would like posted on the newsletter or website.
dave w
FaceNav: Get ready to smile carefully!
😄
Taking a spin with a several Milestone video games.
Users can create a mouse click and hold the mouse click using facial gestures including smiling. There are other gestures and voice commands that can be used. Many of these features are under development and experimental.
Important voice commands:
Say, "Start" and "stop" to start tracking.
Say "Butterfly!" command re-centers the nose.
Smile to trigger a left mouse click.
Say "Click", "Double Click", and "Right Click"
Note: Right click icon at startup and choose "run as administrator" to save start up settings.
More Voice commands:
Butterfly - recenters
Click
Double Click
Right Click
Copy
Cut
Enter
Escape
Files
Find
Hold left
Hold right
Minimize
Maximize
Page up
Page down
Start Menu
Hold right
Hold left
release right
release left
redo
revert
Volume up
volume down
zoom in
zoom out