Thinking Fast and Slow in AI

Leveraging cognitive theories
of human decision making to advance AI

Scope. Here we describe the activities and results of a research project whose aim is to advance AI by leveraging cognitive theories of how humans make decisions, with particular focus on the "thinking fast and slow theory" of Daniel Kahneman. The project is led by IBM Research in collaboration with several academic partners.

Thinking fast and slow (or System 1 and System 2). According to this theory of human decision making, humans make decisions by employing two main modalities, called thinking fast and slow. When we think fast, we make decision in an almost subconscious way, reacting to the environment stimuli, and generating decision out of past experience on similar conditions. When we think slow, instead, we carefully reason about the problem to be solved, we devote all our attention to the reasoning process, and usually we are more accurate in the result. We use the fast-thinking modality most of the times, when we tackle problems that are cognitively easy or very familiar to us. We instead use the slow thinking modality when we perceive the problem to be solved as cognitively difficult or not seen in our past experience.

Thinking fast and slow in AI. This research project aims to build AI-supported machines that can 1) make decisions with emergent behaviors similar to the human ones and 2) support human decision making through nudging and explanations. To achieve these goals, the team is designing and building a cognitive architecture (SOFAI, see below) to mimic these two broad modalities in a machine.

Neuro-symbolic AI. Our approach is one way to build neuro-symbolic AI, where the two approaches (neuro and symbolic) are kept separate and combined through the architecture layer. State-of-the-art AI has many successful and useful applications, but it is often also narrow in scope and demonstrates several limitations including the lack of deep understanding of information coming from data, the absence of common-sense reasoning, the difficulty in dealing with causality, and the inability to learn general concepts from few data. To solve a given problem instance, AI systems usually employ either machine learning or a logical reasoning approach. Each of these approaches has its strengths and weaknesses, but it is hoped that their combination that will bring about a new generation of advanced AI. It is indeed now recognized by the whole scientific AI community that end-to-end machine learning (or deep learning) approaches, although very successful in specific scenarios, cannot bring AI to the next level, and that we need to carefully and effectively combine both machine learning and reasoning techniques. The importance of this combination of methods can be seen in the many specific approaches to neuro-symbolic AI, as well as several workshops and other initiatives in this space.

The SOFAI Architecture

SOFAI (for Slow and Fast AI) is a multi-agent cognitive architecture, inspired by Kahneman's "Thinking Fast and Slow" theory of human reasoning and decision-making. The architecture is designed to be modular as to enable the incorporation of diverse "fast" and "slow" solvers, decision environments, score models (as reward, risk and value alignment), agent deployment economy (solution cost complexity), and emergent behavior attributes.

Fast solvers do not reason about the problem instance but just rely on past experience. Slow solvers, on the other hand, reason about the problem instance and its features, usually employing a logic-based and symbolic approach to generate a solution. The meta-cognition module governs the deployment of either slow or fast solvers, based on the problem instance characteristics, while employing introspection (through a model of self, a model of others, and a model of the world). The model updater keeps all models updated with new experience that the two kinds of solvers accumulate over time.

Fast solvers activate independently as soon as the problem instance is provided. The meta-cognitive agents wait for the fast solver(s) to propose a solution, and then decides whether to adopt that solution or to activate a slow solver.

Project Workstreams


To achieve its objectives, this project is structures in various workstreams, each addressing a specific dimension of the problem and the requires technologies. Currently we have the following workstreams:

  • Metacognition

  • Human Decision Models

  • Decision Support Systems

  • Planning

  • Ethics