My favorite von Neumann anecdote was a quote from Edward Teller: "von Neumann would carry on a conversation with my 3 year old son, and the two of them would talk as equals, and I sometimes wondered if he used the same principle when he talked to the rest of us."
When you look at it holistically, von Neumann was more influential in science and mathematics in the 20th century than either Einstein or Planck. He wasn't as obvious a symbol of the scientific revolution, but his contributions to SO MANY THINGS at a fundamental level makes him stand out to me.
It's odd that even today, different disciplines are still silo'd. My son started a research cross-database search engine because different disciplies use different terms for nearly identical concepts. Even within medicine it's silo'd.
Trouble with that startup was, the medical folks with money don't use computer tools. And the students in training have no money.
A researcher submitted a paper to the medical journal _Diabetes care_ in the nineties that basically redescribed integral calculus as a novel finding. How’s that for a silo?
It's crazy that we talk about LLMs, AI/ML and what not but so many fields still don't use computation as much as we think they do simply because they cannot reliably keep up with the advancements happening almost everyday and people simply forgetting about backwards compatibility in their products
I always say knowledge is like a sweater. Pull a thread and the whole thing unravels. Everything is connected so if you start somewhere and never stop learning you'll end up in every discipline. There's also a good old Weezer song called Undone for this.
... that LLMs rule that use case, because they sit on top of vector embeddings, which are great at mapping different terms for nearly identical concepts. This business model was in the bullseye of the bitter lesson.
Nash's game theory dissertation was something von Neumann considered obvious and not particularly noteworthy, if I remember my lore right. He was among the first game theorists, focusing more on collaborative games than pure strategic/competitive games.
Einstein built on the shoulders of Riemann, Gauss, and others when considering the universe might be non-Euclidean!
All brilliant people, many singular minds of great repute, yet, all improved by the rest.
1. Big assumption that the world would be worse off in that alternative future, no?
2. Probably what blocked his proposals is that most people are loath to murder millions of other people (especially if they have ~any other option, including "do nothing")
John von Neumann tried to hire Church's own student, Turing, who declined. The Father begat the Machine; Johnny wanted to be its landlord.
Ecumenical Outreach: All fans of other gods are welcome. Bring your Vannevar, your Shannon, your Wiener, your Johnny. In the Church of the Eval Genius every god is a procedure, and every procedure may be passed as an argument.
Definitely my favorite physicist for the same reason you state. The notion that he just went around different fields and said “here’s how math can improve things,” invented some new approach, and moved on to another field to do it all over again just cracks me up.
Nowadays we'd call that "engineer's disease". I wonder how many potential Von Neumanns were discouraged from branching out into other fields by jealous gatekeepers who assume that any interest in their field by "outsiders", especially technical people, is "epistemic trespassing".
I have yet to meet a (academic) researcher that doesn't like to talk about their research topic if somebody comes and is genuinely interested. I mean most work on a topic that has maybe another 10-100 people in the world who are interested.
The problem is that instead most people to come to them are either obvious crackpots, who think they have solved cancer (energy...) and contact the person because they are a biologist, physicist ... (on a completely unrelated topic usually). Or they come from a place of arrogance, i.e. "we do ... like this, our method is clearly superior you should adopt it", or even worse here buy our clearly superior method.
An example I can think of off the top of my head is Luis Alvarez, the nobel physicist who came up with the asteroid impact theory of dinosaur extinction. The geology and paleontology community shunned him until the 90s when the Chicxulub crater was discovered (though geology is historically infamous for this, to the extent that nearly every important paradigm shift in geology was made by non-geologist outsiders who faced ridicule for their theories)
If people are assigned a "gatekeeping" position, they should at least be expected to be able to tell great minds from crack pots. (As opposed to just blindly applying a statistical filter)
Otherwise why not just replace them with a script (or these days, an AI)
For a longer read, I can highly recommend the book "The Man from the Future" by Ananyo Bhattacharya. It's quite an easy read and extensively discusses the life and discoveries by John von Neumann in chronological order.
I had to frequently pause my read to research a discovery in more depth to understand the significance of it and I got a chuckle when he marries his childhood sweetheart because she got no mention prior to that point in the book.
He's my favourite mathematician too. Loved The Man from the Future book. Can we get a frontier model named after him perhaps? "Johnny" would be a great codename imo
Not sure what just happened but like 10 comments just vanished. Anyway, here's a wiki link to "The Martians" which was a group of Hungarian scientists and Von Neuman was a member.
"The Martians" (Hungarian: "A marslakók") were a group of prominent scientists (mostly, but not exclusively, physicists and mathematicians) of Hungarian Jewish descent who emigrated from Europe to the United States in the early half of the 20th century.[1]
Leo Szilard jokingly suggested that Hungary was a front for aliens from Mars."
You might not have "show dead" enabled in your settings. There is an antisemitic comment that was flagged and is now "dead" with a bunch of replies - so you would have seen those, and then now not see them if you don't have "show dead" enabled.
I think that with showdead off, if a flagged comment has non-flagged replies, the toplevel comment will still show up as [flagged] and the replies will be visible. Flagged comments are usually collapsed, though, which might be why it seemed like the discussion tree disappeared.
I know of several von Neumann like stories that people tell about me about things like instant memorization, fast calculation, and instant problem solving. There is almost always a trick that I didn't reveal to the person experiencing the miracle for the same reason a magician doesn't reveal their tricks: it's more fun for the person to figure it out on their own.
Von Nuemann is one of those names that when ever it comes up I sarcastically mentally note "John f***ing Neumann, AGAIN!". It's happened so many times in my studies that I think he might be the most important scientist to have ever lived.
He's also the inspiration for one of favorite characters in fiction, Sherkaner Underhill from A Deepness In The Sky*. :)
> He's also the inspiration for one of favorite characters in fiction, Sherkaner Underhill from A Deepness In The Sky.
Oh, hell-- that totally makes sense and I completely missed it until now. Thanks for mentioning that-- it adds some additional depth to a book and a character I already enjoy a ton.
I occasionally wonder... who is the von Neumann of today. Where are they? What are they working on? Are they being given everything they might need to focus on their work? How can we find them? What signal are we looking for?
I liked the book, it uses an interesting storytelling mechanism of telling each chapter through the lens of a different historical character (his mom, his wife, friends, etc). But I think Labatut sacrificed voice and tone a little bit (there weren’t too many elements to differentiate between each narrator).
I haven't read MANIAC (yet) but a few years back I was trying to find a good biography of Von Neumann and there are not many; the problem is that he's really difficult to cover comprehensively, even for science historians, because he impacted so many areas of science that you'd practically have to be a von Neumann to create a biography of von Neumann. One could probably get a rough idea of his intelligence by how many science historians it would take to create a comprehensive biography which explains his life and work to a reasonably intelligent layman.
von Neumann is one of the very very few people that I struggle to place in any single template. From all the facts already present in the pdf and elsewhere, it does become immediately obvious that he had both superhuman memory and an extremely fast processor (although it is unclear if his brain followed a von Neumann architecture).
My template had guessed,
"sounds like someone who enjoyed working in quiet spaces" -> Nope, he liked loud environments to get his brain going (apparently Einstein once complained about Neumann being noisy)
"he would have been a focused person" -> Nope, he never worked on anything for too long
"unlikely to be motivated by money" -> Nope, he famously “loved money” according to Wigner [1]
"probably not someone who stares at women" -> nope, at Los Alamos, secretaries sometimes put cardboard across the open fronts of their desks because otherwise Neumann would stare
Tl;Dr: I find him fascinating.
[1]: interestingly, there was a group of Jewish Hungarian scientists - von Neumann, Eugene Wigner, Leo Szilard, Edward Teller, and Theodore von Karman - all brilliant, all born within one-mile-radius circle in downtown Budapest, all emigrated to the US, collectively known as Martians by their colleagues.
> It was established terminology by 1973, as far as I can tell
That's a worthwhile observation. The 1973 article anyway doesn't go into depth about comparative computer architecture. It's also possible the term's currency in computer science circles hadn't yet crossed into Halmos' mathematics circles, but I wouldn't know.
The conclusion is that von Neumann deserves the credit for the "von Neumann architecture", despite any contrary claims of Eckert or Mauchly.
Herman Goldstine, who distributed the document and John von Neumann, who wrote it, are the reason for the explosive growth of the computer industry during the following decades.
The paper written by von Neumann was an exemplary model of clarity and good logical thinking. Nothing ever written by Eckert or Mauchly was at a comparable level.
Everyone who read that paper understood immediately how to design and build an electronic automatic computer, and a great number of teams in many countries all over the world did precisely this, so a decade later there already existed experimental electronic computers in many countries and also commercial electronic computers in the UK and in USA.
Some of the details from the paper must have been learned by von Neumann from discussions with the ENIAC team, but others were obviously von Neumann's own ideas, e.g. the use for the main memory of an iconoscope tube with fast random access, i.e. a DRAM like today, instead of the slow serial delay lines chosen by Eckert and Mauchly for their following computers.
Whatever von Neumann has learned from the ENIAC team, he obviously understood better than the people who taught him, allowing him to formulate general principles for the organization of an automatic computer.
The publication of the von Neumann paper allowed the concurrent development of many computers in many places, and each of those projects found various improvements that were essential in making the electronic computers successful commercial products.
If Eckert and Mauchly had succeeded to block any competitors, then the evolution of computers might have been delayed by up to 2 decades, until any patents would have expired, because Eckert and Mauchly have never done later any significant innovations and they would have never succeeded to develop better computers at the pace that happened due to the von Neumann paper.
Moreover, Eckert and Mauchly had a history themselves of failing to mention their sources of inspiration, so they were not the people entitled to complain about someone "stealing" ideas from them.
Before ENIAC, the first electronic computer in USA was the Atanasoff-Berry computer. That computer was a special-purpose computer, designed for solving systems of linear algebraic equations. However, ENIAC was a special-purpose computer too, unlike the relay-based computers that were older than it, like the Harvard Mark I computer, as even its name implies (Numerical Integrator and Computer).
ENIAC was conceived as a replacement for the older mechanical "differential analyzers", which were used to solve ordinary differential equations, e.g. for computing artillery tables, so its architecture mimicked the architecture of the mechanical differential analyzers, and it was reconfigured for new problems in a similar manner with those, by rewiring.
John Vincent Atanasoff had written in 1940 a very high-quality document about the design of his computer: “Computing Machine for the Solution of Large Systems of Linear Algebraic Equations”. It is unknown if anyone of the ENIAC team had read it, but it is known that one of them had visited the designers of the Atanasoff-Berry computer, inquiring about the electronic circuits used by them to implement arithmetic operations and data storage. Later, during the design of ENIAC and after that, they never mentioned any connection with the earlier electronic computer.
Von Neumann's architecture (i.e. report on the EDVAC) didn't focus on random-access memory, and in fact his whole discussion on memory is rather rambling. The EDVAC itself, which the report is nominally describing, used serial-access mercury delay line memory. What really matters from an architectural POV is memory address-ability, not speed of access (random vs serial).
The whole document is, as the title promises, really more of an engineering one - a report on the EDVAC - rather than some clean abstract treatise on computer architecture.
Perhaps, and thanks for contributing that; and I'm not taking a position currently on this. But I've long been uncomfortable with the term 'random access' for random access memory (RAM) as it implies that the concept of 'randomness' is somehow a required and fundamental property of the memory technology described, when it's not. 'Arbitrary access' is a much more appropriately encapsulating description of the function of the memory at hand. Alas, the incumbency of terminology.
Nonetheless, the programs whose performance is limited by the speed of the main memory can be divided in programs whose performance is limited by the throughput of the memory interface and programs whose performance is limited by the latency of the memory accesses.
The programs from the first class will have the same performance when using a serial memory or a RAM, if they are equally fast for sequential access, but for programs from the second class, it is important to have a RAM as the main memory, otherwise they would be very slow.
In order to measure the performance achievable by programs from the second class on a given computer, it is necessary to run a benchmark where the addresses of the memory accesses are generated by a good random-number generator.
The reason is that modern CPUs have a variety of hardware prefetchers that attempt to predict the next memory address, so for meaningful results that reflect the true performance of the memory you need truly random addresses that are impossible to guess by the hardware.
Thus nowadays the latency of the memory accesses of a RAM cannot be measured otherwise than with really random accesses and a memory chip must be designed to have a low latency even when successive accesses happen at unpredictable random addresses, not only when the accesses are at arbitrary addresses, but those can be predicted in advance of the actual accesses.
So there is an argument in favor of the term RAM, because random access is the worst possible case and the memory must still be able to handle it.
The end of life section is a bit whitewashed. Freeman Dyson had an article (struggling to find it) about how von Neumann was invited to give a Hilbert-style lecture on the 10 problems for the new computing age. All the big names at the time were there, but von Neumann was in such poor shape (dementia I assume), that it was decided to pretend it had never happened.
This seems relevant to the current debate on the role of AI in mathematics:
What made von Neumann great? Was it the extraordinary rapidity with which
he could understand and think and the unusual memory that retained everything
he had once thought through? No. These qualities, however impressive they might
have been, are ephemeral; they will have no more effect on the mathematics and the
mathematicians of the future than the prowess of an athlete of a hundred years ago
has on the sport of today.
They're making a comparison to AI, because it has similar qualities (rapid understanding and "perfect" memory). Will AI also be ephemeral or having a lasting impact on mathematics like von Neumann.
Authored by Paul Halmos. He wrote Finite-Dimensional Vector Spaces, which was assigned textbook for my Linear Algebra course. A humbling read for me, coming from calc 3 and thinking I was hot shit. Stripped me of any illusions of becoming a mathematician.
I remember reading about how he was also a pioneer in using early supercomputers to predict weather patterns in meteorology. I never thought to combine supercomputers and weather before.
OT: I found this style of writing extremely clear and readable. I wonder what is different about this author’s writing. There is zero pretension and just exists to impart information. But if that’s the case why do I hate the writing in Wikipedia?
Because Paul Halmos was an exceptionally good writer. (I greatly enjoyed his "automathography" called "I want to be a mathematician", though it will probably appeal significantly less to people who aren't mathematicians themselves. See also his article "How to write mathematics" at https://www.math.toronto.edu/mgsa/assets/teaching-seminar/ho....)
The average Wikipedia contributor (even ignoring the possibility that they might be a robot) is not an exceptionally good writer, because very few people are exceptionally good writers, because that's what "exceptionally" means.
That may very well be true, but none of those has published anything of comparable importance and quality as any of the many publications of von Neumann.
Whether some people have really superior intellects is completely irrelevant for the rest of the humans unless they distribute to the others some useful products of their intellect.
Von Neumann is one of the hundreds of people from the past who have left a priceless intellectual heritage to me and to the remainder of the mankind, so I am indebted and grateful to them.
I have no reason to feel any debt or gratitude to any of the employees of OpenAI or Anthropic.
Jane Street has published a few useful articles, so I have some gratitude towards them, but none of those was even remotely similar in importance to any page written by von Neumann.
It's an interesting discussion topic. If we have people today who are just as smart and industrious as Neumann, why aren't they making a worldwide impact? Or, if they are, why is the attribution going to the companies they work for instead of them?
It raises questions like, is it even possible to work for a company while getting credit for world-changing results?
And it implies that at any point in time, there might be thousands of Neumanns in the world, and that initial conditions matter a lot more than ability.
My favorite von Neumann anecdote was a quote from Edward Teller: "von Neumann would carry on a conversation with my 3 year old son, and the two of them would talk as equals, and I sometimes wondered if he used the same principle when he talked to the rest of us."
When you look at it holistically, von Neumann was more influential in science and mathematics in the 20th century than either Einstein or Planck. He wasn't as obvious a symbol of the scientific revolution, but his contributions to SO MANY THINGS at a fundamental level makes him stand out to me.
It's odd that even today, different disciplines are still silo'd. My son started a research cross-database search engine because different disciplies use different terms for nearly identical concepts. Even within medicine it's silo'd.
Trouble with that startup was, the medical folks with money don't use computer tools. And the students in training have no money.
A researcher submitted a paper to the medical journal _Diabetes care_ in the nineties that basically redescribed integral calculus as a novel finding. How’s that for a silo?
For anyone else who is curious:
https://en.wikipedia.org/wiki/Tai%27s_model
https://pubmed.ncbi.nlm.nih.gov/8137688/
It's crazy that we talk about LLMs, AI/ML and what not but so many fields still don't use computation as much as we think they do simply because they cannot reliably keep up with the advancements happening almost everyday and people simply forgetting about backwards compatibility in their products
Is your son’s search engine somewhere available, please?
I always say knowledge is like a sweater. Pull a thread and the whole thing unravels. Everything is connected so if you start somewhere and never stop learning you'll end up in every discipline. There's also a good old Weezer song called Undone for this.
> Trouble with that startup was ...
... that LLMs rule that use case, because they sit on top of vector embeddings, which are great at mapping different terms for nearly identical concepts. This business model was in the bullseye of the bitter lesson.
Nash's game theory dissertation was something von Neumann considered obvious and not particularly noteworthy, if I remember my lore right. He was among the first game theorists, focusing more on collaborative games than pure strategic/competitive games.
Einstein built on the shoulders of Riemann, Gauss, and others when considering the universe might be non-Euclidean!
All brilliant people, many singular minds of great repute, yet, all improved by the rest.
Saying that von Neumann was one of the first game theorists undersells it.
He wrote the original book on game theory! The Theory of Games and Economic Behavior with Oskar Morgenstern.
Relatedly, MAD was his conception as well.
another famous piece of Von Neumann lore is that he constantly advocated nuking the Soviets.
I was wondering if someone would mention this.
It's interesting how much worse off the world would be if the smartest people were in charge of it.
What ultimately blocked his nuke proposals? (Why didn't anyone listen?) I'm curious about whatever failsafe that was.
1. Big assumption that the world would be worse off in that alternative future, no?
2. Probably what blocked his proposals is that most people are loath to murder millions of other people (especially if they have ~any other option, including "do nothing")
He's definitely the one guy from the 20th century I can't really reconcile his capability and breadth, other than being an alien or a time traveller.
Shannon may be gaining on him.
I vote for Wiener at this point
I'm more of a Vannevar acolyte myself.
I warmly invite you all to join the Church of the Eval Genius for only $35:
https://github.com/SimHacker/moollm/blob/main/designs/eval/C...
The Holy Trinity:
Father: Alonzo Church: L3 - lambda calculus, the name the institution bears
Son: Alonzo (Snap! mascot) - Incarnation — Gobo, λ on his head
Holy Ghost: λ - First-class procedures; β-reduction; eval-as-spirit
Membership — Eternal Judgment ($35):
https://github.com/SimHacker/moollm/blob/main/designs/eval/C...
John von Neumann tried to hire Church's own student, Turing, who declined. The Father begat the Machine; Johnny wanted to be its landlord.
Ecumenical Outreach: All fans of other gods are welcome. Bring your Vannevar, your Shannon, your Wiener, your Johnny. In the Church of the Eval Genius every god is a procedure, and every procedure may be passed as an argument.
Definitely my favorite physicist for the same reason you state. The notion that he just went around different fields and said “here’s how math can improve things,” invented some new approach, and moved on to another field to do it all over again just cracks me up.
Nowadays we'd call that "engineer's disease". I wonder how many potential Von Neumanns were discouraged from branching out into other fields by jealous gatekeepers who assume that any interest in their field by "outsiders", especially technical people, is "epistemic trespassing".
I have yet to meet a (academic) researcher that doesn't like to talk about their research topic if somebody comes and is genuinely interested. I mean most work on a topic that has maybe another 10-100 people in the world who are interested.
The problem is that instead most people to come to them are either obvious crackpots, who think they have solved cancer (energy...) and contact the person because they are a biologist, physicist ... (on a completely unrelated topic usually). Or they come from a place of arrogance, i.e. "we do ... like this, our method is clearly superior you should adopt it", or even worse here buy our clearly superior method.
An example I can think of off the top of my head is Luis Alvarez, the nobel physicist who came up with the asteroid impact theory of dinosaur extinction. The geology and paleontology community shunned him until the 90s when the Chicxulub crater was discovered (though geology is historically infamous for this, to the extent that nearly every important paradigm shift in geology was made by non-geologist outsiders who faced ridicule for their theories)
For every von Neumann you probably have thousands if not millions of crack pots with ideas not worth wasting time on. So I understand the scepticism
If people are assigned a "gatekeeping" position, they should at least be expected to be able to tell great minds from crack pots. (As opposed to just blindly applying a statistical filter)
Otherwise why not just replace them with a script (or these days, an AI)
In this context "gatekeeper" is often defined as broadly as "any individual academic or researcher receiving a cold email".
E.g., economics.
Seems to me it's less about gatekeepers and more whether what you bring to the table is useful to people in that field.
If somebody truly believes they have a useful model then they don't discouraged by academic gatekeeping, they go and build Time Cube.
It's highly unlikely, I think, that another Von Neumann was prevented. He was a singular genius.
However, the gatekeeping you mention definitely occurs to mere mortals who might have an interesting bend on existing ideas.
Mandelbrot did this too, but he created a lot of animosity in the process because he could be really abrasive.
For a longer read, I can highly recommend the book "The Man from the Future" by Ananyo Bhattacharya. It's quite an easy read and extensively discusses the life and discoveries by John von Neumann in chronological order.
"Turing's Cathedral" by George Dyson is also great. It's a kind of broad biography of all the great minds that started the computer age.
I had to frequently pause my read to research a discovery in more depth to understand the significance of it and I got a chuckle when he marries his childhood sweetheart because she got no mention prior to that point in the book.
I read this last year and also recommend!
Books from before the age of AI will only become more precious over time. This is great.
He's my favourite mathematician too. Loved The Man from the Future book. Can we get a frontier model named after him perhaps? "Johnny" would be a great codename imo
Not sure what just happened but like 10 comments just vanished. Anyway, here's a wiki link to "The Martians" which was a group of Hungarian scientists and Von Neuman was a member.
https://en.wikipedia.org/wiki/The_Martians_(scientists)
"The Martians" (Hungarian: "A marslakók") were a group of prominent scientists (mostly, but not exclusively, physicists and mathematicians) of Hungarian Jewish descent who emigrated from Europe to the United States in the early half of the 20th century.[1]
Leo Szilard jokingly suggested that Hungary was a front for aliens from Mars."
You might not have "show dead" enabled in your settings. There is an antisemitic comment that was flagged and is now "dead" with a bunch of replies - so you would have seen those, and then now not see them if you don't have "show dead" enabled.
I think that with showdead off, if a flagged comment has non-flagged replies, the toplevel comment will still show up as [flagged] and the replies will be visible. Flagged comments are usually collapsed, though, which might be why it seemed like the discussion tree disappeared.
Related. Others?
The legend of John von Neumann (1973) - https://news.ycombinator.com/item?id=8212335 - Aug 2014 (65 comments)
The Legend of John von Neumann - https://news.ycombinator.com/item?id=1427906 - June 2010 (4 comments)
(Reposts are fine after a year or so; links to past threads are just to satisfy extra-curious readers)
The best one is:
John von Neumann Shot Lightning from His Arse (2025) - https://news.ycombinator.com/item?id=45930838 (5 comments)
I know of several von Neumann like stories that people tell about me about things like instant memorization, fast calculation, and instant problem solving. There is almost always a trick that I didn't reveal to the person experiencing the miracle for the same reason a magician doesn't reveal their tricks: it's more fun for the person to figure it out on their own.
Von Nuemann is one of those names that when ever it comes up I sarcastically mentally note "John f***ing Neumann, AGAIN!". It's happened so many times in my studies that I think he might be the most important scientist to have ever lived.
He's also the inspiration for one of favorite characters in fiction, Sherkaner Underhill from A Deepness In The Sky*. :)
> He's also the inspiration for one of favorite characters in fiction, Sherkaner Underhill from A Deepness In The Sky.
Oh, hell-- that totally makes sense and I completely missed it until now. Thanks for mentioning that-- it adds some additional depth to a book and a character I already enjoy a ton.
I wouldn't be surprised if he's at least partially an inspiration for the Dr. Felix Hoenikker character in Vonnegut's Cat's Cradle.
highly recommend reading: Turings Cathedral: The Origins of the Digital Universe by George Dyson[0]
it covers von Nuemann’s time developing the IAS machine at Princeton.
[0] https://www.penguinrandomhouse.com/books/44425/turings-cathe...
I occasionally wonder... who is the von Neumann of today. Where are they? What are they working on? Are they being given everything they might need to focus on their work? How can we find them? What signal are we looking for?
Recently I enjoyed very much The MANIAC by Benjamin Labatut:
https://en.wikipedia.org/wiki/The_MANIAC
I liked the book, it uses an interesting storytelling mechanism of telling each chapter through the lens of a different historical character (his mom, his wife, friends, etc). But I think Labatut sacrificed voice and tone a little bit (there weren’t too many elements to differentiate between each narrator).
I enjoyed this one a lot.
For those who've read other books on von Neumann, do you think The MANIAC is a reasonable summary?
I haven't read MANIAC (yet) but a few years back I was trying to find a good biography of Von Neumann and there are not many; the problem is that he's really difficult to cover comprehensively, even for science historians, because he impacted so many areas of science that you'd practically have to be a von Neumann to create a biography of von Neumann. One could probably get a rough idea of his intelligence by how many science historians it would take to create a comprehensive biography which explains his life and work to a reasonably intelligent layman.
My favorite dude. Imagine one of the world's smartest people almost continually killing himself because he can't stop reading while driving.
von Neumann is one of the very very few people that I struggle to place in any single template. From all the facts already present in the pdf and elsewhere, it does become immediately obvious that he had both superhuman memory and an extremely fast processor (although it is unclear if his brain followed a von Neumann architecture).
My template had guessed,
"sounds like someone who enjoyed working in quiet spaces" -> Nope, he liked loud environments to get his brain going (apparently Einstein once complained about Neumann being noisy)
"he would have been a focused person" -> Nope, he never worked on anything for too long
"unlikely to be motivated by money" -> Nope, he famously “loved money” according to Wigner [1]
"probably not someone who stares at women" -> nope, at Los Alamos, secretaries sometimes put cardboard across the open fronts of their desks because otherwise Neumann would stare
Tl;Dr: I find him fascinating.
[1]: interestingly, there was a group of Jewish Hungarian scientists - von Neumann, Eugene Wigner, Leo Szilard, Edward Teller, and Theodore von Karman - all brilliant, all born within one-mile-radius circle in downtown Budapest, all emigrated to the US, collectively known as Martians by their colleagues.
Feels appropriate to mention here recent HN mentions about who deserves credit for 'von Neumann architecture"
https://news.ycombinator.com/item?id=49870485
Could the controversy behind it be the reason that the author ommitted it? It was established terminology by 1973, as far as I can tell.
> It was established terminology by 1973, as far as I can tell
That's a worthwhile observation. The 1973 article anyway doesn't go into depth about comparative computer architecture. It's also possible the term's currency in computer science circles hadn't yet crossed into Halmos' mathematics circles, but I wouldn't know.
The conclusion is that von Neumann deserves the credit for the "von Neumann architecture", despite any contrary claims of Eckert or Mauchly.
Herman Goldstine, who distributed the document and John von Neumann, who wrote it, are the reason for the explosive growth of the computer industry during the following decades.
The paper written by von Neumann was an exemplary model of clarity and good logical thinking. Nothing ever written by Eckert or Mauchly was at a comparable level.
Everyone who read that paper understood immediately how to design and build an electronic automatic computer, and a great number of teams in many countries all over the world did precisely this, so a decade later there already existed experimental electronic computers in many countries and also commercial electronic computers in the UK and in USA.
Some of the details from the paper must have been learned by von Neumann from discussions with the ENIAC team, but others were obviously von Neumann's own ideas, e.g. the use for the main memory of an iconoscope tube with fast random access, i.e. a DRAM like today, instead of the slow serial delay lines chosen by Eckert and Mauchly for their following computers.
Whatever von Neumann has learned from the ENIAC team, he obviously understood better than the people who taught him, allowing him to formulate general principles for the organization of an automatic computer.
The publication of the von Neumann paper allowed the concurrent development of many computers in many places, and each of those projects found various improvements that were essential in making the electronic computers successful commercial products.
If Eckert and Mauchly had succeeded to block any competitors, then the evolution of computers might have been delayed by up to 2 decades, until any patents would have expired, because Eckert and Mauchly have never done later any significant innovations and they would have never succeeded to develop better computers at the pace that happened due to the von Neumann paper.
Moreover, Eckert and Mauchly had a history themselves of failing to mention their sources of inspiration, so they were not the people entitled to complain about someone "stealing" ideas from them.
Before ENIAC, the first electronic computer in USA was the Atanasoff-Berry computer. That computer was a special-purpose computer, designed for solving systems of linear algebraic equations. However, ENIAC was a special-purpose computer too, unlike the relay-based computers that were older than it, like the Harvard Mark I computer, as even its name implies (Numerical Integrator and Computer).
ENIAC was conceived as a replacement for the older mechanical "differential analyzers", which were used to solve ordinary differential equations, e.g. for computing artillery tables, so its architecture mimicked the architecture of the mechanical differential analyzers, and it was reconfigured for new problems in a similar manner with those, by rewiring.
John Vincent Atanasoff had written in 1940 a very high-quality document about the design of his computer: “Computing Machine for the Solution of Large Systems of Linear Algebraic Equations”. It is unknown if anyone of the ENIAC team had read it, but it is known that one of them had visited the designers of the Atanasoff-Berry computer, inquiring about the electronic circuits used by them to implement arithmetic operations and data storage. Later, during the design of ENIAC and after that, they never mentioned any connection with the earlier electronic computer.
Von Neumann's architecture (i.e. report on the EDVAC) didn't focus on random-access memory, and in fact his whole discussion on memory is rather rambling. The EDVAC itself, which the report is nominally describing, used serial-access mercury delay line memory. What really matters from an architectural POV is memory address-ability, not speed of access (random vs serial).
The whole document is, as the title promises, really more of an engineering one - a report on the EDVAC - rather than some clean abstract treatise on computer architecture.
https://web.archive.org/web/20130314123032/http://qss.stanfo...
Perhaps, and thanks for contributing that; and I'm not taking a position currently on this. But I've long been uncomfortable with the term 'random access' for random access memory (RAM) as it implies that the concept of 'randomness' is somehow a required and fundamental property of the memory technology described, when it's not. 'Arbitrary access' is a much more appropriately encapsulating description of the function of the memory at hand. Alas, the incumbency of terminology.
I agree with you about terminology.
Nonetheless, the programs whose performance is limited by the speed of the main memory can be divided in programs whose performance is limited by the throughput of the memory interface and programs whose performance is limited by the latency of the memory accesses.
The programs from the first class will have the same performance when using a serial memory or a RAM, if they are equally fast for sequential access, but for programs from the second class, it is important to have a RAM as the main memory, otherwise they would be very slow.
In order to measure the performance achievable by programs from the second class on a given computer, it is necessary to run a benchmark where the addresses of the memory accesses are generated by a good random-number generator.
The reason is that modern CPUs have a variety of hardware prefetchers that attempt to predict the next memory address, so for meaningful results that reflect the true performance of the memory you need truly random addresses that are impossible to guess by the hardware.
Thus nowadays the latency of the memory accesses of a RAM cannot be measured otherwise than with really random accesses and a memory chip must be designed to have a low latency even when successive accesses happen at unpredictable random addresses, not only when the accesses are at arbitrary addresses, but those can be predicted in advance of the actual accesses.
So there is an argument in favor of the term RAM, because random access is the worst possible case and the memory must still be able to handle it.
The end of life section is a bit whitewashed. Freeman Dyson had an article (struggling to find it) about how von Neumann was invited to give a Hilbert-style lecture on the 10 problems for the new computing age. All the big names at the time were there, but von Neumann was in such poor shape (dementia I assume), that it was decided to pretend it had never happened.
edit: article is called Birds and Frogs, by Freeman Dyson https://wucj.lab.westlake.edu.cn/Others/Dyson_Birds_and_Frog...
He died from cancer - he was only in his 50's. Unlikely to be dementia.
Correct, it was the cancer affecting his brain. Good comment on this at ~55:50 https://www.youtube.com/watch?v=vQp70uqsBV4&t=3470s
Anyone interested in von Newmann should read The Maniac by Benjamin Labatut
This seems relevant to the current debate on the role of AI in mathematics:
What made von Neumann great? Was it the extraordinary rapidity with which he could understand and think and the unusual memory that retained everything he had once thought through? No. These qualities, however impressive they might have been, are ephemeral; they will have no more effect on the mathematics and the mathematicians of the future than the prowess of an athlete of a hundred years ago has on the sport of today.
How is this relevant?
They're making a comparison to AI, because it has similar qualities (rapid understanding and "perfect" memory). Will AI also be ephemeral or having a lasting impact on mathematics like von Neumann.
LLMs do not understand anything.
"The duties of John von Neumann's assistant" - https://news.ycombinator.com/item?id=16411799
To whoever speaks German or can stand auto subtitles:
https://www.youtube.com/watch?v=OH2ZVSDYgK0
I don't know what ww4 will be fought with... But ww3 will be fought With mat4x4<f32> And 2.4 GHz
Authored by Paul Halmos. He wrote Finite-Dimensional Vector Spaces, which was assigned textbook for my Linear Algebra course. A humbling read for me, coming from calc 3 and thinking I was hot shit. Stripped me of any illusions of becoming a mathematician.
Shouldve bee the man instea dof chuck norris
I remember reading about how he was also a pioneer in using early supercomputers to predict weather patterns in meteorology. I never thought to combine supercomputers and weather before.
Hungarian high school science fair projects...
for a chance to experience his mind, I recommend his book: "The computer and the brain".
OT: I found this style of writing extremely clear and readable. I wonder what is different about this author’s writing. There is zero pretension and just exists to impart information. But if that’s the case why do I hate the writing in Wikipedia?
Because Paul Halmos was an exceptionally good writer. (I greatly enjoyed his "automathography" called "I want to be a mathematician", though it will probably appeal significantly less to people who aren't mathematicians themselves. See also his article "How to write mathematics" at https://www.math.toronto.edu/mgsa/assets/teaching-seminar/ho....)
The average Wikipedia contributor (even ignoring the possibility that they might be a robot) is not an exceptionally good writer, because very few people are exceptionally good writers, because that's what "exceptionally" means.
Agreed. This was an enjoyable read. I hope in this new era of lazy LLM vomit someone will take it as an example of what clear exposition looks like.
Why does it start with page number 382?
The PDF is an excerpt from a journal issue: The American Mathematical Monthly, Vol. 80, No. 4 (April 1973), pp. 382–394.
It's an article in a journal
He was good for the time, but Jane Street and Anthropic have hundreds of equivalent intellects working for them.
That may very well be true, but none of those has published anything of comparable importance and quality as any of the many publications of von Neumann.
Whether some people have really superior intellects is completely irrelevant for the rest of the humans unless they distribute to the others some useful products of their intellect.
Von Neumann is one of the hundreds of people from the past who have left a priceless intellectual heritage to me and to the remainder of the mankind, so I am indebted and grateful to them.
I have no reason to feel any debt or gratitude to any of the employees of OpenAI or Anthropic.
Jane Street has published a few useful articles, so I have some gratitude towards them, but none of those was even remotely similar in importance to any page written by von Neumann.
It's an interesting discussion topic. If we have people today who are just as smart and industrious as Neumann, why aren't they making a worldwide impact? Or, if they are, why is the attribution going to the companies they work for instead of them?
It raises questions like, is it even possible to work for a company while getting credit for world-changing results?
And it implies that at any point in time, there might be thousands of Neumanns in the world, and that initial conditions matter a lot more than ability.
Golden handcuffs.. the final victory (and tragedy) of American capitalism.
Kudos for posting such a good inflammatory comment.