Curiosity - Artificial

DEVELOPERS

Jürgen Schmidhuber (early 1990s)

BACKGROUND

Artificial curiosity theory - "believes algorithms can be written that allow the programming of curiosity itself. What's interesting? Many interesting things are unexpected, but not all unexpected things are interesting or surprising. According to Schmidhuber's formal theory of surprise & novelty & interestingness & attention & creativity & intrinsic motivation, curious agents are interested in learnable but yet unknown regularities, and get bored by both predictable and inherently unpredictable things. His active reinforcement learners translate mismatches between expectations and reality into curiosity rewards or intrinsic rewards for curious, creative, exploring agents which like to observe / create truly surprising aspects of the world, to learn novel patterns".

Singularity Summit "in our research, virtual and real worlds actually complement each other. We use machine learning and artificial curiosity to learn or improve simulations of the real world, then train the robot in the sim to achieve desirable goals". "Fundamental Principle of Artificial Curiosity and Creativity: Reward the reward- optimizing controller for actions yielding data that cause improvements of the adaptive predictor or data compressor! (Formulated in the early 1990s; basis of much of the recent work in Developmental Robotics since 2004) "

Relationship to Other Theories:

• Curiosity Theory
• Interest Theory

REFERENCES ~ Coding Spreadsheet - Web View

• Schmidhuber, Jürgen. (2010). Jürgen Schmidhuber's theory of active exploration, artificial curiosity & what's interesting.
• Schmidhuber, J. (2009). Simple Algorithmic Theory of Subjective Beauty, Novelty, Surprise, Interestingness, Attention, Curiosity, Creativity, Art, Science, Music, Jokes. Journal of SICE, 48(1):21-32, 2009. PDF. Extended version (2008, revised 2009): arXiv:0812.4360; PDF (Dec 2008); PDF (April 2009).
• Schmidhuber, Jürgen. (2006). Developmental Robotics, Optimal Artificial Curiosity, Creativity, Music, and the Fine Arts. Connection Science, 18(2): 173-187, June.