Research interests

• Decision theory
• Reinforcement learning
• Machine learning
• Security

Teaching

• Decision making under uncertainty (period 2)
• Discrete optimization (period 3)
• Artificial Intelligence (period 4)
  

Upcoming events

• AISec 2013 workshop, Berlin.
• RL Competition 2014.

Recent papers

• Monte-Carlo utility estimates for Bayesian reinforcement learning, IEEE CDC 2013.
  
• Probabilistic inverse reinforcement learning in unknown environment, UAI 2013.
• ABC reinforcement learning, ICML 2013.
  
• Linear Bayesian reinforcement learning, IJCAI 2013.
  
• On selecting the nonce length in distance bounding protocols, The Computer Journal.
  
• Network Self-organization Explains the Statistics and Dynamics of Synaptic Connection Strengths in Cortex, PLoS CB.