Benjamin Scellier

Research Interests

My current research interests lie at the interface of machine learning (ML) and physics. I am more particularly interested in physics-based computation and physics-based learning.

Much of my current research revolves around equilibrium propagation (EP), a learning framework grounded in physical principles. Unlike the more conventional ML framework based on automatic differentiation ("backpropagation"), EP performs inference and extracts gradient using the same physical laws, which makes it a potentially useful framework for the design of energy-efficient hardware for ML.

For a very brief introduction to EP, see these notes. (For a more detailed introduction to EP, Chapter 2 of my PhD thesis may be relevant) For EP-related code, click here. If you are interested in EP, feel free to reach out.

Recent Articles and Preprints

Training of physical neural networks - a review paper of training methods for physical systems.

Energy-based learning algorithms for analog computing: a comparative study - this paper clarifies the differences between EP and other contrastive learning algorithms, and compares them in theory and in numerical experiments.

EP in nonlinear resistive networks: Training end-to-end analog neural networks with equilibrium propagation, Universal approximation theorem for nonlinear resistive networks, A fast algorithm to simulate nonlinear resistive networks.

Quantum equilibrium propagation: gradient-descent training of quantum systems - a version of EP for quantum systems.

Training a convergent energy transformer with equilibrium propagation - applying EP to transformer-like models.

Training a predictive coding network on ImageNet with equilibrium propagation - scaling EP to full-size ImageNet classification.

Agnostic physics-driven deep learning - this paper introduces Agnostic EP, a version of EP for black box systems in which the weights are updated directly via physical dynamics