Embedded Files
Co-located with the 2025 conference of the International Society for Gesture Studies (ISGS10), MULTIDATA offers its first summer workshop.
Interested in the MULTIDATA project? Want to learn how to use our multimodal pipeline?
Join us for the MULTIDATA Summer Workshop on Tuesday, July 8, 2025, at the Max Planck Institute (Nijmegen), just before the ISGS conference.
This hands-on workshop will introduce participants to the MULTIDATA pipeline, covering transcription, speech analysis and OpenPose, followed by interactive sessions on applications in education and research. MULTIDATA is an ERASMUS PLUS KA220 HED project, involving the universities of Murcia, Radboud Nijmegen, and FAU Erlangen-Nürnberg as partners, and the MPI Psycholinguistics and the Red Hen Lab as associated partners. We offer an online platform for the study of multimodal communication (https://www.multi-data.eu/), including an AI-based pipeline to analyze speech and gesture data from videos, as well as other resources for developing audiovisual collections, as well as didactic materials and suggestions for exploiting video data inside and outside the classroom. This workshop will help you make the most of our open-source tools for analyzing gesture along with its co-occurring language and prosody.
Reserve your spot at https://multidata-summerworkshop-2025.eventbrite.com
📅 Date & Time: Tuesday, July 8, 2025 | 13:00 – 17:30
📍 Location: Max Planck Institute (Nijmegen)
📝 Registration: Free registration opens in April 2025
👥 Organizers: Cristóbal Pagán (University of Murcia), Peter Uhrig (FAU Erlangen-Nürnberg), Aslı Özyürek (MPI for Psycholinguistics)
MULTIDATA Summer Workshop Program
MULTIDATA Summer Workshop Program
13:00–13:30 PM – Project Introduction
Speakers: Asli Özyürek, Cristóbal Pagán Cánovas, Peter Uhrig
Welcome from the MULTIDATA Project coordinators, followed by a general overview of the MULTIDATA Project.
13:30–13:40 PM – Platform Sign-Up
Speakers: Peter Uhrig, Raúl Sánchez Sánchez
How to access the MULTIDATA platform.
13:40–14:10 PM – Session + Demo 1: Extracting Aligned Transcriptions and Speech Metrics with MULTIDATA
Speakers: Raúl Sánchez Sánchez, Cristóbal Pagán Cánovas
This session demonstrates how to use the MULTIDATA platform to extract time-aligned transcriptions from video content.
Participants will learn how to:
Generate ELAN-compatible files with a word-level alignment tier
Obtain speech metrics (e.g., pitch and intensity) synchronized with video frame numbers
☕ COFFEE BREAK
14:35–15:25 PM – Session + Demo 2: Using Pose Estimation to Extract Gesture Features from Video Data
Speakers: Peter Uhrig, Brian Herreño Jiménez, Mounika Kanakanti, Ferdinand Paar
This session covers:
Explanation of pose estimation as used for gesture annotation in MULTIDATA
Data acquisition, cleaning, and processing workflows
Demonstration of extracting kinematic features and using them in R dataframes
☕ COFFEE BREAK
15:50–16:20 PM – Showcase Session: Research Highlights Using the MULTIDATA Pipeline
Speakers: Mounika Kanakanti, Yassine Iabdounane, Armine Garibyan
Topics include:
Applications of the MULTIDATA pipeline in multimodal communication research
Spatial visualizations of gestures and signs (e.g., heatmaps)
Exploratory analysis and insights using integrated tools
16:20–16:50 PM – Education Session: The MULTIDATA Pipeline Educational Resources and Applications
Speakers: Daniel Alcaraz Carrión, Sharice Clough
This session introduces:
Current and upcoming online educational resources for multimodal communication
In-class applications of MULTIDATA tools
16:50–17:20 PM – Practical Data Analysis Session: Exploiting MULTIDATA with Your Own Data
Speakers: Cristóbal Pagán Cánovas, Raúl Sánchez Sánchez
Hands-on session where participants can:
Use MULTIDATA tools with their own video data
Ask questions regarding computational resources and analysis
Receive personalized support from the MULTIDATA team
17:20–17:30 PM – Workshop Closing
Speakers: Asli Özyürek, Cristóbal Pagán Cánovas, Peter Uhrig
Final remarks to close the workshop.
Visit us at: https://www.multi-data.eu/
The MULTIDATA project (E+ KA220 HED) seeks to become the EU's portal for video processing to obtain multimodal communication data for learning, research, and industry.
Along with our video processing pipeline and other resources, we organize a series of webinars in which leading professionals discuss tools for multimodal analysis and their application to learning in academia and beyond.
Visit us at: https://www.multi-data.eu/
CREATIME workshop at the University of Navarra, Pamplona, Spain, May 11-12, 2017
Keynote speakers: Rafael Núñez (University of California San Diego), Julio Santiago (University of Granada), and Francis Steen (University of California Los Angeles). Opening lecture by Kensy Cooperrider (University of Chicago).
Collective panel (short presentations, long discussion) by the CREATIME team: Daniel Alcaraz (Lancaster University), Adriana Gordejuela (University of Navarra), Diego Jaén (University of Murcia), Inés Olza (University of Navarra), Cristóbal Pagán Cánovas (University of Navarra), Anna Piata (University of Geneva, University of Neuchâtel), and Javier Valenzuela (University of Murcia).
Demo on multimodal data extraction and annotation: Daniel Alcaraz, Diego Jaén, Inés Olza, Anna Piata, Peter Uhrig (Friedrich Alexander University Erlangen-Nüremberg), and Javier Valenzuela.
Blitz presentations sessions chaired by Kensy Cooperrider (University of Chicago). Presenters: Catherine Barsics (University of Liège, University of Geneva), Edmond Cane (Center for Albanian Studies), Mohamed Douifi (University of Algiers 2), Yan Gu (Tilburg University), Enrique Gutiérrez(University Palacký in Olomouc), Liron Lavi (Tel Aviv University, University of California Los Angeles), Elo Rohult (University of Tartu).
Speakers: Alex Bergs, Irene Mittelberg, Francis Steen, Mark Turner, Javier Valenzuela
A panel at the DiscourseNet 15 conference in Belgrade, March 19-21 2015.
The panel:
1) Cristóbal Pagán Cánovas (Chair) Oral Poetic Discourse: an introduction
2) Lidija D. Delić, Mirjana I. Detelić Epic colors – basic colors?
3) Dragoljub Perić The Traditional Episodic Structure and Serbian Epic Poem (the Function and Meaning of “Text within Text”)
4) Cristóbal Pagán Cánovas (Chair); Mihailo Antović Construction grammar and oral formulaic theory
Freiburg Institute for Advanced Studies, January 24-26, 2013. Keynote speakers: Egbert Bakker, Yale University, Hans C. Boas, University of Texas at Austin, Anna Bonifazi, University of Heidelberg, Winfried Menninghaus, Freie Universität Berlin and Max Planck Institute for Empirical Aesthetics, and Mark Turner, Case Western Reserve University.
As the first conference combining these two fields, Oral poetics and Cognitive Science sought to lay the foundations of a new discipline, Cognitive Oral Poetics, through an interdisciplinary conversation between researchers in oral poetics, empirical literary scholars, linguists and cognitive scientists. The conference was part of my FRIAS Tandem Fellowship project Towards a Cognitive Oral Poetics, with Mihailo Antović, from the University of Niš, Serbia. We will be editing a volume with contributions from speakers at the conference and from other leading researchers in the relevant fields, to be submitted to the FRIAS Linguae & Litterae Series in De Gruyter.
Oral Poetics and Cognitive Science website: https://sites.google.com/site/oralpoetcogsci/
University of Murcia, May 10-12, 2012. Keynote speaker: Mark Turner, Case Western Reserve University.
An international workshop to reflect on how Fauconnier and Turner's Conceptual Integration Theory can relate to different kinds of empirical research, from philological to experimental. The workshop attracted a variety of researchers from literary studies, linguistics, cognitive science, psychology, film, communication and media, emotion, and other backgrounds, from Europe, America, and Israel.
Rethinking Metaphor website: https://sites.google.com/site/blendingmurcia/
Myrifield Institute for Cognition and the Arts (MICA), July 16-18, 2011.
An international workshop to discuss interdisciplinary approaches to literature, emotion, and cognition, including grant proposals and ideas for a new academic journal. I had the pleasure to co-organize this meeting with Margaret Freeman, and to share some days at MICA's idyllic setting with leading researchers in the field.
Cognition and Emotion in Literature website: https://sites.google.com/site/cognitionemotioninliterature/
Cogsci 2011, annual conference of the Cognitive Science Society, Boston (Mass.), July 19-23, 2011.
A panel including the following speakers: Richard Gerrig, SUNY Stony Brook University, Thalia Goldstein, Yale University, Cristóbal Pagán Cánovas, University of Murcia & Case Western Reserve University (organizer), Francis Steen, University of California Los Angeles, Vera Tobin, University of California Santa Barbara.
Panel description on PDF.
ACLA 2011, annual conference of the American Comparative Literature Association, Vancouver, March 31-April 3, 2011. Keynote speaker: Patrick Colm Hogan, University of Connecticut.
An international five-session panel on cognitive and experimental approaches to literature, including over twenty junior and senior researchers.
CogPatterns website: https://sites.google.com/site/cognitivepatternsincomplit/
Case Western Reserve University, February-April 2011.
A series of lectures on a variety of cognitive linguistics and cognitive science topics. I had the privilege to invite leading researchers such as: Yeshayahu Shen, Javier Valenzuela, Jean Mandler, Daniel M. Gross, Michael Anderson, Charles Forceville, or Marina Terkourafi.
Google Sites
Report abuse