Bayesian Nanoelectronics

Bayesian inference is a probabilistic framework which permits decision-making in situations with incomplete information, maximally incorporating all available evidence, assumptions, and prior knowledge. Bayesian inference functions in a world of uncertainty and probabilities, which seems to mirror the issues of nanoelectronics. As neural networks, Bayesian models are highly topological in nature, suffer intensely of the von Neumann bottleneck, and map well to the concept of in-memory computing. This is why we strongly believe that novel nanoelectronic provide provide an ideal path for deploying Bayesian reasoning at the edge.

Bayesian models are not directly brain-inspired, but have been connected to biological intelligence, and significant evidence supports humans use of Bayesian inference for perception and other cognitive tasks. For example, visual illusions reveal the brain’s use of priors for image analysis, a signature of Bayesian inference. From the applicative side, Bayesian models have recently been used for applications such as robotics, multiple sensor data fusion, and computer-aided surgery. In fact, Bayesian models excel where neural networks struggle: due to their capability to incorporate prior knowledge and expertise, they deal well with small data situations, or when uncertainty is extreme. For these reasons, we are excited about their deployment at the edge.

We have taped out a first hybrid resistive memory / CMOS test chip implementing in-memory Bayesian inference, and are looking forward to testing it soon!

Selected Publications

  1. A. Mizrahi, T. Hirtzlin, A. Fukushima, H. Kubota, S. Yuasa, J. Grollier and D. Querlioz, "Neural-like computing with populations of superparamagnetic basis functions", Nature Communications, Vol. 9, Article number: 1533 (2018). Open access link. Press release
  2. D. Vodenicarevic, N. Locatelli, A. Mizrahi, J. S. Friedman, A. F. Vincent, M. Romera, A. Fukushima, K. Yakushiji, H. Kubota, S. Yuasa, S. Tiwari, J. Grollier, and D. Querlioz, "Low-energy truly random number generation with superparamagnetic tunnel junctions for unconventional computing", Physical Review Applied, Vol. 8, 054045, 2017. Link. Preprint . Story in nanotechweb
  3. J. S. Friedman, L. E. Calvet, P. Bessière, J. Droulez, D. Querlioz, "Bayesian Inference with Muller C-Elements", IEEE Transactions on Circuits and Systems I, Vol. 63, No. 6, p. 895, 2016. Link. Preprint.
  4. D. Querlioz, O. Bichler, A. F. Vincent, C. Gamrat, "Bioinspired Programming of Memory Devices for Implementing an Inference Engine", Proceedings of the IEEE, Vol. 103, No. 8, p. 1398, 2015 (invited paper). Link. Preprint.