The Critical Phenomena of 2024 Nobel Physics Prize

The awarding of the Nobel Prize in Physics to these pioneers emphasizes the deep connections between mathematical models and real-world phenomena

Sigrid Jin
3 min readOct 13, 2024

The 2024 Nobel Prize in Physics was awarded to John J. Hopfield and Geoffrey E. Hinton for their pioneering work on neural networks, laying the foundations for modern machine learning.

Their research bridges physics and artificial intelligence, specifically through models that demonstrate critical phenomena — the point where small changes trigger dramatic shifts in system behavior — and emergence, where complex patterns arise from simple, interacting elements.

Mathematical Insights into Critical Phenomena

At the heart of Hopfield’s contribution lies the Hopfield network, a recurrent neural network inspired by the behavior of spins in condensed matter physics. In this model, neurons are connected in a way that mirrors spin glasses.

A disordered magnetic system described by the Sherrington-Kirkpatrick model

Here, si​ and sj​ represent spin states, with Jij describing the coupling strength between two sites, and hi denoting the influence of an external magnetic field. This equation captures the interactions between components that collectively determine the system’s behavior at critical points — where a small change (like temperature) causes a sudden shift in magnetization.

Hopfield Networks and Associative Memory

Hopfield applied the mathematics of spin glasses to create a neural network that stores and retrieves patterns efficiently.

The energy function of a Hopfield network

The function is mathematically similar to the spin glass Hamiltonian. Here, vi​ and vj are the states of neurons, wij​ are the connection weights, and θi​ represents activation thresholds. The network minimizes this energy by adjusting the neuron states until it stabilizes on a stored memory pattern, akin to how spin systems reach low-energy configurations.

This neural network behaves near critical points: small inputs (like partial memories) can trigger the activation of the entire stored pattern, demonstrating a phase transition. This reflects how critical phenomena allow local interactions to yield global outcomes — a key concept shared with portfolio optimization and spin systems.

Portfolio Optimization and Emergence of Global Patterns

Portfolio optimization, as formulated by Markowitz, also follows this structure, balancing the interactions between correlated assets.

​The aformentioned energy-like function captures the trade-off between risk and return. Here, Cij​ represents correlations between assets, while Ri​ is the return of asset i. Like neural networks and spin glasses, a small shift in market parameters near a critical point — such as a change in volatility — can lead to large-scale reallocation, showing the presence of phase transitions and emergent behaviors.

The work of Hopfield and Hinton exemplifies how self-organized criticality emerges across various domains. Their research in neural networks showcases how systems evolve toward critical points naturally, without external control, and how complex patterns arise from simple rules.

This is not just a breakthrough in AI but a unifying framework connecting physics, neuroscience, and finance, where local interactions produce emergent, global behaviors.

--

--

No responses yet