How are memories stored in neural networks? | The Hopfield Network #SoME2
Can we measure memories in networks of neurons in bytes? Or should we think of our memory differently?
Submission to the Summer of Math Exposition 2022 (#SoME2). More information: https://summerofmathexposition.substack.com/p/the-summer-of-math-exposition-is
Time stamps:
0:00 - Where is your memory?
1:41 - Computer memory in a nutshell
2:58 - Modeling neural networks
4:42 - Memories in dynamical systems
9:54 - Learning
13:36 - Memory capacity and conclusion
Animations largely made using the manim community edition:
https://www.manim.community/
Original Paper on Hopfield Networks:
Hopfield, J. J. (1982). Neural networks and physical systems with emergent collective computational abilities. Proceedings of the national academy of sciences, 79(8), 2554-2558.
Neuron image by Santiago Ramón y Cajal, The pyramidal neuron of the cerebral cortex, 1904 Ink and pencil on paper, 8 5/8 x 6 7/8 in. Credit: Cajal Institute (CSIC), Madrid
Music: Aakash Gandhi - "Dreamland"
Can we measure memories in networks of neurons in bytes? Or should we think of our memory differently?
Submission to the Summer of Math Exposition 2022 (#SoME2). More information: https://summerofmathexposition.substack.com/p/the-summer-of-math-exposition-is
Time stamps:
0:00 – Where is your memory?
1:41 – Computer memory in a nutshell
2:58 – Modeling neural networks
4:42 – Memories in dynamical systems
9:54 – Learning
13:36 – Memory capacity and conclusion
Animations largely made using the manim community edition:
https://www.manim.community/
Original Paper on Hopfield Networks:
Hopfield, J. J. (1982). Neural networks and physical systems with emergent collective computational abilities. Proceedings of the national academy of sciences, 79(8), 2554-2558.
Neuron image by Santiago Ramón y Cajal, The pyramidal neuron of the cerebral cortex, 1904 Ink and pencil on paper, 8 5/8 x 6 7/8 in. Credit: Cajal Institute (CSIC), Madrid
Music: Aakash Gandhi – “Dreamland”
