John Hopfield
@HopfieldJohn
Followers
6K
Following
20
Media
2
Statuses
25
I work on neural networks and biology, often from the view point of my roots in physics. Professor @PrincetonNeuro.
Joined July 2020
Dense Associative Memories, aka modern Hopfield networks, have a huge memory storage capacity. But are they biologically realistic? In our new paper with @DimaKrotov we argue that they can be written in terms of biological variables. https://t.co/w58EAQ54xm
14
112
421
I very much enjoyed reading the papers from the first iteration of this workshop in 2023. If you are working on associative memory, consider submitting your work and participating in this event.
I am super excited to announce the call for papers for the New Frontiers in Associative Memories workshop at ICLR 2025. New architectures and algorithms, memory-augmented LLMs, energy-based models, Hopfield networks, associative memory and diffusion, and many other exciting
3
10
55
A few days ago, I spoke with @Nature about my work at the interface between disciplines https://t.co/VVHiW0Yruo
nature.com
Nature - John Hopfield has had a varied career and delights in working in the cracks between disciplines.
12
73
417
This award is very hard to respond to. I have received many hundred congratulatory notes, from former students, post-docs, Princeton University juniors and seniors, funding agencies and foundations, authors, signature collectors, amateurs, elementary school neural network
27
176
1K
The CfP for our @NeurIPSConf Workshop on Associative Memory & Hopfield Networks is out! The deadline is Sep 29th! Details: https://t.co/sxEjEZ6rwF Speakers: @HopfieldJohn @DimaKrotov @HochreiterSepp @carlolucibello @kchorolab @FieteGroup
@MITIBMLab @Harvard @IBMResearch
amhn.vizhub.ai
Associative Memory & Hopfield Network Worshop @NeurIPS 2023. Discuss the latest multidisciplinary developments in Associative Memory and Hopfield Networks. Imagine new tools built around memory as...
0
12
43
I was welcome in this group because I knew so little about conventional neuroscience that my questions threatened no one.
1
1
29
Their scientific interaction at small meetings of the Associates was intended to usefully drive the science. Alas, this meeting was more of the prima-donna behavior of a set of scientific leaders, rather than a coherent chorus, which frustrated Frank Schmitt.
1
1
17
Francis 'Frank' Schmitt already had an amazing view in 1962 of where neuroscience needed to go if you were serious about understanding higher brain function. His Neuroscience Research Program had a set of Associates spread across the relevant fields.
@TonyZador @suzanahh Yes! And some exciting things emerged out of the multidisciplinary meetings Schmidt organized on this topic - like @HopfieldJohn ’s inspiration to create Hopfield networks.
1
8
35
The mathematical idea that makes this possible is the Lagrangian for the dynamical system. This system can be turned into a multi-layer network with simultaneous forward and feedback flow of information.
1
5
26
Everybody knows about Lyapunov functions in simple networks with local non-linearities. What this paper shows is that with symmetric feedback a Lyapunov function can be constructed for arbitrary non-linear activation functions involving groups of neurons.
One of the great features of deep learning is that we can easily stack multiple layers (e.g. dense, conv, attention) with arbitrary activation functions to build a useful feedforward network. Wouldn’t it be cool if we could do the same for Modern Hopfield Networks with feedback?
2
28
125
Please check out Dima's presentation at #ICLR2021 next Tuesday.
What is Dense Associative Memory or Modern Hopfield Network❓ Our paper will be presented at #ICLR2021 next week. I want to highlight some of the main results here. Paper: https://t.co/jYAxIjvgKf Longer seminar: https://t.co/e2h8L2iIvO Thread 🧵1/N
0
5
25
Very much looking forward to hearing this dialog Wednesday
1
7
43
A perceptive commentary on the Biden election and the US political divide from the English experience of Thatcherism and Brexit. On with the celebration https://t.co/dDUXXRqwue via @JARWillis
jarwillis.com
The cloud of four years has lifted, let us enjoy our celebration.
0
2
11
A feeling of community is so important!
Hello world! Welcome to the brand new twitter home of APS-DBIO! Connecting members (including potential future members) of APS-DBIO. Please help us grow, follow + retweet! @MARGARETSCHEUNG @squishycell1
@DrJennyRoss @ApsDsoft @wbialek @oritpeleg @phybiofunc @cplcillinois
0
2
15
New microscopic theory of Dense Associative Memory aka modern Hopfield network can be reduced to the model proposed in “Hopfield Networks is All You Need’’ paper, which is equivalent to self-attention mechanism of Transformers. Work with @HopfieldJohn
https://t.co/jYAxIjvgKf
1
60
163
Several people asked me today about Dense Associative Memories and Hopfield networks. In this talk from 2018 I explain some of the intuition behind them. Apologies that the camera does not focus on the slides. Talk: https://t.co/GeBQjsn95h Slides: https://t.co/0Otb4dGbpP
1
16
37
New blog for @icmlconf paper. Fruit fly olfactory network inspires unsupervised similarity search. Data driven locality sensitive hashing with weights learned in a bio-plausible way @wrong_whp @HopfieldJohn @LeopoldGrinberg #ICML2020
mitibmwatsonailab.mit.edu
1
23
49
New @icmlconf paper on biologically inspired unsupervised similarity search with @wrong_whp @DimaKrotov @LeopoldGrinberg
https://t.co/WaeUTTzOM1
#icml2020
0
34
88