Projects‎ > ‎

Head in Space

A Headtracking-based Binaural Spatialization System

HiS is a system capable of detecting the position of the listener through a head-tracking system (based on faceAPI optical tracker by Seeing Machine) and rendering a 3D audio environment by binaural spatialization. Head tracking is performed through face recognition algorithms which use a standard webcam, and the result is presented over headphones, like in other typical binaural applications. With this system users can choose an audio file to play, provide a virtual position for the source in an euclidean space, and then listen to the sound as if it is coming from that position. If they move their head, the signal provided by the system changes accordingly in real-time, thus providing a realistic effect.

In order to try HiS:

  1. Download and install Non-Commercial faceAPI License v3.2.0;

  2. Download and unpack the HiS Demo;

  3. Launch HiS Demo.exe.

Headtracker module

Here is the headtracking external object, to use faceAPI within Max/MSP patches.

In order to work with HiS headtracker module:

  1. Download and install Non-Commercial faceAPI License v3.2.0;

  2. Download and Install Max 5;

  3. Copy the content of faceAPI bin dir (C:\Program Files\SeeingMachines\FaceTrackingAPI_NC 3.2\API\bin\) into the Max dir (C:\Program Files\Cycling '74\Max 5.0\);

  4. Download and unpack HiS headtracker external;

  5. Load the headtracker.mxe external or install it by Max window;

  6. Load the HiS_HT.maxpat patch.

Project Related Publication

Ludovico, L.A.; Mauro, D.A.; Pizzamiglio, D. (2010), "Head in Space: A head-tracking based binaural spatialization system", SMC Conference 2010, Barcelona, Spain