Published March 1, 2020
| Version v1
Journal article
Thresholds of descending algorithms in inference problems
- 1. Institut de Physique Théorique, CEA, Orme des Merisiers, 91191 Gif-sur-Yvette (France)
Description
We review recent works (Sarao Mannelli et al 2018 arXiv:1812.09066, 2019 Int. Conf. on Machine Learning 4333–42, 2019 Adv. Neural Information Processing Systems 8676–86) on analyzing the dynamics of gradient-based algorithms in a prototypical statistical inference problem. Using methods and insights from the physics of glassy systems, these works showed how to understand quantitatively and qualitatively the performance of gradient-based algorithms. Here we review the key results and their interpretation in non-technical terms accessible to a wide audience of physicists in the context of related works. (statphys 27)
Availability note (English)
Available from http://dx.doi.org/10.1088/1742-5468/ab7123Additional details
Identifiers
Publishing Information
- Journal Title
- Journal of Statistical Mechanics
- Journal Volume
- 2020
- Journal Issue
- 3
- Journal Page Range
- [11 p.]
- ISSN
- 1742-5468
INIS
- Country of Publication
- United Kingdom
- Country of Input or Organization
- International Atomic Energy Agency (IAEA)
- INIS RN
- 53028830
- Subject category
- S71: CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSICS;
- Descriptors DEI
- DATA PROCESSING; MACHINE LEARNING; PERFORMANCE
- Descriptors DEC
- ALGORITHMS; ARTIFICIAL INTELLIGENCE; LEARNING; MATHEMATICAL LOGIC; PROCESSING