Useful Software & Resources

Tools/ software

• WebDialog: https://bitbucket.org/matthen/webdialog
• Multimodal Interaction Tools (MINT): http://www.dsg-bielefeld.de/mint/downloads.html
• ASAP: social agents platform (BML realiser, Flipper, etc etc): http://asap-project.ewi.utwente.nl/
• JSGF Eclipse plugin http://sourceforge.net/projects/jsgfeditor/ - speech recognition grammar editor
• DYLAN: dynamic syntax parser
• WAMI : Web-Accessible Multimodal Applications from MIT
• WEKA: machine learning tools : http://www.cs.waikato.ac.nz/ml/weka/
• Grammar development in Eclipse: NUGram IDE for speech recognition grammars (ABNF)
• JINDIGO (Incremental dialogue tools, G. Skantze, KTH)
• Google Voice Android API - speech recognition on Android phones
• ADST Statistical Dialogue Manager (POMDP, Jason Williams, AT&T)
• Inpro-TK Incremental middleware (D. Schlangen et al., Potsdam)
• IPAACA - Incremental dialogue software (Bielefeld)
• Olympus / RavenClaw (CMU) - dialogue system toolkit
• Crowdflower (crowd-sourcing data-collection)
• Motion capture using KINECT on MAC OSX (from Parag Mital)
• PIAVCA : open source 3D animated Virtual Characters (Marco Gillies)
• ELAN : annotation tool for video and audio
• ICE : internet communications engine
• jSparky : sentence planner (AT&T)
• SimpleNLG : natural language generation : surface realiser (Aberdeen)
• OpenWonderWorld : virtual world creator

Hardware

• NAO torso robot 1205
• Leap Motion controllers (x4)
• Kinect controllers (x3)
• 42-inch multi-touch screen
• Hi-def video cameras (x2)
• Android phones: Samsung Galaxy S3 (x2), Samsung Galaxy S4
• Galaxy Gear (wearable Android)
• Sennheiser Noise cancelling headphones
• Samsung Galaxy Note 3
• Nexus 5
• Jawbone bluetooth mic

Machine Learning Tools:

• see the ML reading group page
• CRF ++ toolkit
• Weka: data mining tools
• Mallet: statistical language processing tools
• FACTORIE: probabilistic programming tools
• JavaBayes: Bayesian Networks tools
• HTK: hidden Markov models tools
• RLI: reinforcement learning tools
• CLUTO: clustering tools
• LIBSVM: library for support vector machines
• GMTK: graphical models tools
• PMTK: probabilistic models
• OpenCV: computer vision tools

Books/websites

• "Foundations of Statistical NLP", Manning & Schutze, MIT Press 1999 - available in the HW library at 0006.35 MAN
• The Spoken Dialogue State Tracking Challenge: http://research.microsoft.com/en-us/events/dstc/