Computational Neuroscience, Bio-Inspired Machine Learning & Developmental Robotics

Me creating a torch of neural network dynamics.
Contact info
Email: xavier {dot} hinaut {home symbol} inria {dot} fr

Who am I?
I am a Post-Doc Junior Researcher at Inria in Bordeaux, France (just started in February 2016). My research is at the "edge of chaos" of several fields: Computational Neuroscience, Bio-Inspired Machine Learning & Developmental Robotics. I am in the Mnemosyne team headed by Frédéric Alexandre, at the edge of 3 labs: Inria Bordeaux Sud-Ouest, LaBRI, Institute of Neurodegenerative Diseases (IMN).

My work mainly focus on Recurrent Neural Network modelling (especially to model prefrontal cortex), Language Acquisition (applied to Robotics) and exploration of brain codes of bird song syntax. For modelling, I mainly use Echo State Networks, which is part of the Reservoir Computing framework (here is an introduction to RC).

The common thread of my research aims at the exploration of the neural coding and the modelling of complex sequences processing, chunking, learning and production, for “syntax-based” sequences, and to apply these models to robotics (for future embodiment purposes). In particular, my artificial neural networks based models are were focused on dynamics of prefrontal cortex and basal ganglia.

In these models, I am interested in human (and robot) grammar learning and acquisition as well as the categorization of monkey motor action sequences. Besides, I worked on experimental protocols and on the analysis of neural codings of canary song. In order to better understand human language mechanisms, canary song is particularly interesting because it is very variable, it has a complex “syntax” and continues to evolve even during adult life.

Short bio

After obtaining my Ph.D. at the University of Lyon in January 2013 at the Stem Cell and Brain Research Institute (SBRI / INSERM 846) under the supervision of Peter Ford Dominey, I did post-doctorate internships at the University of Hamburg in 2013 and 2015 (Marie Curie Individual Fellowship) in the team of Stefan Wermter, and a post-doctorate internship (CNRS) in 2014 at the Paris-Saclay Neuroscience Institute (NeuroPSI) in the team of Catherine Del Negro and Jean-Marc Edeline.

Main paper
If you read only one paper of my work it should be this one.

Latest news!
  • March 2017
  • October 2016
  • September 2016

Paper accepted at ICDL-epirob 2016 conference.

  • August 2016

Paper accepted in RO-MAN 2016 conference: Using Natural Language Feedback in a Neuro-inspired Integrated Multimodal Robotic Architecture ResearchGate

  • April 2016

Two papers accepted at ESANN 2016 conference:

Semantic Role Labelling for Robot Instructions using Echo State Networks ResearchGate

Activity recognition with echo state networks using 3D body joints and objects category ResearchGate

  • February 2016

Starting a Researcher position ("Chargé de Recherche 2ème classe", CR2) at INRIA (French Institute for Research in Computer Science and Automation) in the team Mnemosyne. The team is active in several labs: INRIA, IMN and LaBRI.

  • December 2015

New workshop NIPS paper on a Bilingual Recurrent Neural Network learning English and French at the same time:

X. Hinaut, J. Twiefel, M. Petit, P.F. Dominey, S. Wermter (2015) A Recurrent Neural Network for Multiple Language Acquisition: Starting with English and French. Workshop on "Cognitive Computation: Integrating Neural and Symbolic Approaches", CoCo @ NIPS 2015. PDF

  • September 2015

New journal paper on a the Production of sentences in English and Japanese with a Recurrent Neural Network:

X. Hinaut, Lance, C. Drouin, M. Petit, G. Pointeau, P.F. Dominey (2015) Cortico-Striatal Response Selection in Sentence Production: Insights from neural network simulation with Reservoir Computing. Brain and Language, vol. 150, Nov. 2015, pp. 54–68. doi:10.1016/j.bandl.2015.08.002 HTML (FREE until mid-October 2015)

  • July 2015

NEW! IJCAI 2015 video:
"Humanoidly Speaking"
: How the Nao humanoid robot can learn the name of objects and interact with them through common speech.
IJCAI 2015 video competition link.
Software: Take a look at "Syntactic Reservoir Model" and "DOCKS" on the WTM team sofware webpage to download and try the source code to make the same experiment.

Humanoidly Speaking


  • March 2015

I just began a new post-doc at the University of Hamburg with a grant from the European Union:

Marie Curie Intra-European Fellowship (IEF) 2015-2017, "EchoRob": Echo State Networks for Developing Language Robots. University of Hamburg, Dept. of Computer Science, Knowledge Technology group (Stefan Wermter).
Soon will come a dedicated website for this project which will enable users to interact and help robots to learn languages.



Some other videos of my work
Videos of Human-Robot Interaction (HRI): application of our language neural model.

*** French television news (JT de France 2):
If you cannot see the video please follow this link.

France 2 News: Humanoid robot iCub learns to understand and produce complex sentences through HRI (in French)


*** Language comprehension (via syntax learning):

(Description in French)
Le robot humanoïde iCub sur lequel l'équipe dirigée par Peter Ford Dominey de l'unité Inserm 846 (Institut pour les cellules souches et cerveau de Lyon) travaille depuis de nombreuses années est dorénavant capable de comprendre ce qu'on lui dit et d'anticiper la fin d'une phrase. Cette prouesse technologique a été rendue possible par la mise au point d'un « cerveau artificiel simplifié » qui reproduit certains types de connexions dites « récurrentes» observées dans le cerveau humain. Ce système de cerveau artificiel permet au robot d'apprendre, puis de comprendre des phrases nouvelles, avec une structure grammaticale nouvelle. Il peut faire le lien entre deux phrases et peut même prédire la fin de la phrase avant qu'elle ne survienne.
Ces travaux sont publiés par Xavier Hinaut et Peter F. Dominey dans la revue Plos One et dans la revue Frontiers in NeuroRobotics.


If you cannot see the video please follow this link.

Humanoid robot iCub learns to understand complex sentences through HRI



*** Language production (with an "inverse" model similar to the comprehension model):
If you cannot see the video please follow this link.

Humanoid robot iCub learns to say complex sentences through HRI



Latest papers!
  • New workshop NIPS paper on a the Bilingual Recurrent Neural Network learning English and French at the same time:

    X. Hinaut, J. Twiefel, M. Petit, P.F. Dominey, S. Wermter (2015) A Recurrent Neural Network for Multiple Language Acquisition: Starting with English and French. Workshop on "Cognitive Computation: Integrating Neural and Symbolic Approaches", CoCo @ NIPS 2015. PDF

  • New journal paper on a the Production of sentences in English and Japanese with a Recurrent Neural Network:

    X. Hinaut, Lance, C. Drouin, M. Petit, G. Pointeau, P.F. Dominey (2015) Cortico-Striatal Response Selection in Sentence Production: Insights from neural network simulation with Reservoir Computing. Brain and Language, vol. 150, Nov. 2015, pp. 54–68. doi:10.1016/j.bandl.2015.08.002 HTML (FREE until mid-October 2015)

  • (September 2014) in ICANN: An Incremental Approach to Language Acquisition: Thematic Role Assignment with Echo State Networks pdf

Some links!

Social networks pages:
Mendeley,Academia, ResearchGate, Linked-in
Frontiers

Other webpages


Education

  • Ph.D in Computational Neuroscience, 2013, University of Lyon
  • MS in Cognitive Science, 2009, EPHE Paris
  • MS in Computer Science, 2008, University of Technology of Compiègne


Research Interests

Computational Neuroscience, Bio-Inspered Machine Learning, and Developmental Robotics
  • Reservoir computing, Echo State Networks, Recurrent Neural Networks
  • Natural Language Processing, Songbird syntax, Complex sequences processing, Time-series prediction
  • Neural dynamics theory, Dynamical systems
  • Brain hierarchy, Hierarchical and distributed model architectures, Time-scale hierarchy
  • Generic neural model for computation, learning, encoding, production and selection of sequences
  • Developmental robotics, Embodied cognition, Enaction, Multi-modal representations
  • Thalamo-cortico-basal loops, Reinforcement learning, Working memory, Decision making
  • Other bio-inspired methods (Genetic Algorithms, ...), Artificial life, Game theory