Analogue neural networks on correlated random graphs
- 1. Dipartimento di Fisica, Università degli Studi di Parma, viale G Usberti 7, I-43100 Parma (Italy)
- 2. Dipartimento di Scienze di Base Applicate per l'Ingegneria-Sezione di Matematica, Via Antonio Scarpa, I-16-00161 Rome (Italy)
- 3. Dipartimento di Fisica, Sapienza Università di Roma, Piazzale Aldo Moro, I-2-00185 Rome (Italy)
Description
We consider a generalization of the Hopfield model, where the entries of patterns are Gaussian and diluted. We focus on the high-storage regime and we investigate analytically the topological properties of the emergent network, as well as the thermodynamic properties of the model. We find that, by properly tuning the dilution in the pattern entries, the network can recover different topological regimes characterized by peculiar scalings of the average coordination number with respect to the system size. The structure is also shown to exhibit a large degree of cliquishness, even when very sparse. Moreover, we obtain explicitly the replica-symmetric free energy and the self-consistency equations for the overlaps (order parameters of the theory), which turn out to be classical weighted sums of 'sub-overlaps' defined on all possible sub-graphs. Finally, a study of criticality is performed through a small-overlap expansion of the self-consistencies and through a whole fluctuation theory developed for their rescaled correlations: both approaches show that the net effect of dilution in pattern entries is to rescale the critical noise level at which ergodicity breaks down. (paper)
Availability note (English)
Available from http://dx.doi.org/10.1088/1751-8113/45/36/365001Additional details
Identifiers
Publishing Information
- Journal Title
- Journal of Physics. A, Mathematical and Theoretical (Online)
- Journal Volume
- 45
- Journal Issue
- 36
- Journal Page Range
- [23 p.]
- ISSN
- 1751-8121
INIS
- Country of Publication
- United Kingdom
- Country of Input or Organization
- International Atomic Energy Agency (IAEA)
- INIS RN
- 44047228
- Subject category
- S71: CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSICS;
- Descriptors DEI
- COORDINATION NUMBER; CORRELATIONS; CRITICALITY; DILUTION; EQUATIONS; EXPANSION; FLUCTUATIONS; FREE ENERGY; GRAPH THEORY; NEURAL NETWORKS; NOISE; ORDER PARAMETERS; RANDOMNESS; SCALING; SIMULATION; SYMMETRY
- Descriptors DEC
- DIMENSIONLESS NUMBERS; ENERGY; MATHEMATICS; PHYSICAL PROPERTIES; THERMODYNAMIC PROPERTIES; VARIATIONS