The PoseCore ecosystem is an attempt to create a Kinect like gaming experience using your normal webcamera (or in the future an iPhone as the body tracking sensor).
So you start the PoseCore server and then any of the PoseCore client applications/games, and you should now be able to control your game character with your body movements.
You can start the server with or without the embedded camera tracking app.
For now always choose the top alternative (Posecore communication & Posenet server), the option with only the PoseCore communication server will be used later on together with the iPhone sensor.
For now the body tracking is only done in 2D (there is no depth information) but this will be fixed when we have created the iPhone body tracking client.
Have fun trying it out :-)
Observe that the dowload links open in a new tab and starts the download for now, so just close that tab to get back to this page.
The PoseCore server is an application you can run on your Windows/Mac/Linux machine which is the central communication hub & optionally PoseNet body tracker using only your computer webcamera (both tracking your body parts like a Kinect).
It can be be downloaded here:
This is an infinite runner game using the PoseCore server enabling you to use your body as the controller :-)
You can move the character left/right & jump or crouch
This game is actually a tutorial game made by Unity, I just adapted it to using PoseCore as a controller.
This application needs to configure the central body point before running, so for it to run properly, you stand still in a T-pose for 2 seconds (see info text in upper right corner in start screen)
It can be downloaded here:
PoseRunner Windows installation package
Just unzip & run the executable file
This is an simple Kart game using the PoseCore server enabling you to use your body as the controller :-)
You can turn the vehicle with:
Your hands (hold them as a if you hold a steering wheel)
Tilting your head to the left or right
You control which control mechanism you want to use in the control settings (press tab in the game)
This game is actually a tutorial game made by Unity, I just adapted it to using PoseCore as a controller.
It can be downloaded here:
PoseKart Windows installation package
Just unzip & run the executable file
This is a Unity test app to test out the body tracking over the PoseCore server.
It only displays some major body joints as circles & squares.
They should move together with your body if everything works :-)
Tracked body joints are:
left & right ear, eye, hand, knee and foot
Nose
upper spine
pelvis
Downloads:
PoseCore test app Windows installation package
Just unzip & run the executable file
The technical solution being used here are:
Body tracking is done with the brilliant PoseNet (done by the Tensorflow team)
The PoseNet client embedded in the PoseCore server takes the most probable body pose and transmit this to an MQTT server in the PoseCore server
The clients subscribe to these pose events topic and move the relevant game parts based on your body movements
To avoid manual configuration the clients automatically finds the server using UDP broadcasting logic
The server GitHub project can be found here:
https://github.com/miman/posecore-srv-electron
The Unity test client project can be found here:
https://github.com/miman/ik-mqtt-posenet-unity
Created by Mikael Thorman (mimanit@gmail.com)