Resources

The sound synthesis framework of choice is the Sound Design Toolkit (co-developed by the PI), whose model parameters can be related to action primitives and directly controlled by them via relatively-simple maps. For tactile rendering of trajectories, wearable vests with multipoint vibrotactile stimulation will be the system of choice. Wide interactive pen displays, headphones, and speakers, already available at UNIPA, will be used for experiments in the proximal and peripersonal spaces.

UNIGE will perform the experiments on full-body motion at Casa Paganini, where a large stage and a control balcony offer ideal conditions for experiments involving dancers, musicians, and laypersons involved in multisensory large-scale interactions, with a permanently-installed motion-tracking system. A 250-seats auditorium makes it also easy to disseminate the research results through public events and artistic productions.

The two partners UNIPA and UNIGE will employ one post-doctoral researcher each, and these will be the main actors in the design, conduction, and analysis of the planned experiments, under direct supervision of the two local coordinators. A professional sound designer and media artist will be consulted, to provide expertise on expressive trajectory features and to design a full-scale proof-of-concept artistic installation. The partner IMT will also employ one post-doctoral researcher, working on the development and implementation of feature-based and deep machine learning models, under direct supervision of the local coordinator.

UNIVR will perform the full-body data collection in team-work with partner UNIGE for the experimental settings 2 and 3. It will also be responsible for the experiments to assess the development of sport-specific skills. The partner UNIVR is set with a laboratory for advanced movement and sport performance analysis, equipped with a 8-camera motion capture system, force platforms, force transducers and transcranial magnetic stimulation system. The School of Sport and Human Movement Science at the University of Verona has been ranked among the most prestigious sport science institutions in the world for the last 5 years. The school has continuous partnerships with semi-professional and professional team sport clubs, thereby serving as an excellent research unit to put in place the evaluation of the developed predicting models. The partner UNIVR will employ one post-doctoral researcher for full-body data collection under the direct supervision of the local coordinator.