- EC - Stories That Build the Future
- Posts
- His thesis made computers possible. It was not even his most important idea.
His thesis made computers possible. It was not even his most important idea.
Entropy, the bit, and the theorem underneath every channel you use.

Relay switching equipment, the hardware Shannon's algebra described. Photo: Panel Switchman, via Wikimedia Commons. Public domain.
In our recent post, we left Claude Shannon in 1937, a 21-year-old whose master's thesis had just proven that switches could compute. Eleven years later, at Bell Labs, he published the theory that makes the first idea usable at planetary scale. This is that story.
THE PROBLEM WAS NOISE
The problem on Bell's desk was noise. Long telephone lines needed amplifiers, and amplifiers boosted everything: the voice, and every imperfection on the line. Stretch a line far enough and the signal drowned in its own hiss. Engineers largely treated noise as a hard ceiling: past some distance or speed, reliable communication simply ended.
Shannon had been circling the question for a decade. His 1937 thesis had given circuits a mathematics. His classified wartime work on cryptography had forced him to think about messages stripped of their meaning, as pure symbols. By 1948 the pieces joined, in a paper in the Bell System Technical Journal with a quietly enormous title: A Mathematical Theory of Communication. It opens with a diagram of five boxes, source, encoder, channel, decoder, destination, that has been redrawn in probably every communications textbook printed since. It dismantled that ceiling by asking a question nobody had made precise: what is information, and how much of it does a message actually contain?
The 1948 paper. Scan: Bell System Technical Journal, July 1948, via Internet Archive.
THE BIT
His answer gave information a unit. The bit: the amount of information that distinguishes between two equally likely outcomes. One coin flip. The word came from his Bell Labs colleague John Tukey, who had coined it in a 1947 memo as a contraction of binary digit, and Shannon said so plainly in the paper. But the two bits are not the same idea. Tukey's bit was a symbol, a 1 or a 0. Shannon's bit was a quantity, a measure of uncertainty resolved. That distinction is why information could suddenly be treated like a physical thing: counted, compressed, budgeted.
TWO LAWS YOUR DAY RUNS ON
Entropy: every source of messages has a measurable information rate, a floor below which it cannot be compressed without loss. That number is why a photo zips smaller but a second zip gains nothing.
Channel capacity: every channel, a wire, a radio band, a fiber, has a maximum rate at which information can pass through it, set by its bandwidth and its noise. And then the theorem that still reads like a magic trick: below that capacity, communication can be made as reliable as you like. Noise does not end communication. It sets a speed limit. Encode cleverly enough, and errors can be driven as close to zero as you want, over a channel that is actively corrupting your signal. Your wifi, your phone, a CD playing through scratches, and a space probe whispering across billions of kilometers all live inside that theorem.

Shannon's communication system. Everything from wifi to deep-space links fits in these five boxes.
THE CAFETERIA
There is a good wartime footnote. When Alan Turing visited Bell Labs in 1943, he and Shannon met almost daily over tea in the cafeteria, two people who between them were quietly sketching the century: one had shown machines could compute, the other was working out what they would compute with. No photograph of the two together is known to exist. The meetings were wartime, classified adjacent, and unrecorded. Which is somehow fitting for the two people who defined what a record is.

Claude Shannon (photo: Tekniska Museet, via Wikimedia Commons, CC BY 2.0) and Alan Turing (photo: Elliott and Fry, 1951, public domain, via Wikimedia Commons).
ONE IDEA GROWING UP
Here is the through-line worth keeping. The 1937 thesis and the 1948 paper are one idea growing up.
The thesis says: logic can live in hardware.
The paper says: information is a quantity with laws.
Put them together and you get the digital world, machines that compute, connected by channels that carry. One man, still in his early thirties by the second paper, built both floors.

The master's thesis, written at 21. Scan: public domain, via Wikimedia Commons.
The reception told its own story. A year after the paper, it was reprinted as a book with an introduction by Warren Weaver, and the title changed by one word. A Mathematical Theory of Communication became The Mathematical Theory of Communication. The field had already agreed there was only going to be one.
We have spent this series on lessons written in metal: a bridge, a cabin, a wing. This one was written on paper, and it holds up more of your day than any of them.
One more thing, and it is fitting that it lands in this issue.
We just crossed 5,000 followers on LinkedIn, and we built something to mark it. It is called SHANNON, named for the man you just read about. It is our new home for these stories: a living archive where every piece we publish gets its own place on a timeline you can explore. The first line is KELLY, after Kelly Johnson, and it lays out eight decades of military aircraft, first flight by first flight, from the P-38 to the B-21. The stories we have told are lit and linked. The ones still coming are sealed, for now.
You will notice something else sealed on those plates. Under each aircraft sits a section called Crew Remarks: the best things our community has said about that machine. A U-2 pilot describing the fuel slick under a parked Blackbird. An engineer whose father helped solve the P-38's flutter problem at Langley. A man in Bristol who discovered, years later, that his small software company had helped schedule the B-2 program.
Every one of those remarks is currently blacked out, and none of them carry a name. We have asked each person for permission first, and until they say yes, their words stay sealed. As approvals come in, the bars lift one by one. It felt like the only right way to do it. These are their words, not ours.
More lines are already in fabrication: engineering failures, the regulations written in blood, and others we are not ready to name. And if you find an error on any plate, tell us. There is a defect report on SHANNON, and confirmed fixes go into a public errata log.
Take a look, and watch it fill in: shannon.engineeringcommunity.net
To mark the milestone properly, this July we will also feature five people from this community: people who faced a hard technical problem, solved one, or are deep in one right now. If that is you, or someone you know, reply to this email or write us here.
And thank you, genuinely. That thousands of you read these means more than the number suggests. If you are reading this, you are likely one of the people who keep the world running. Thank you for that too.