MLPs Are Hebbian Memories: A Simple Recipe for Fact-Storing Transformers

2 points | by ayushpai a day ago