3blue1brown
@3blue1brown·8.4M subscribers·240 videos
Reinventing Entropy | Compression is Intelligence Part 1
Posted
June 7, 2026
Views
787,930
Likes
35,144
Comments
1,824
Engagement
4.69%
June 7, 2026
787,930
35,144
1,824
4.69%
Every word spoken in this episode is indexed. Type any phrase to jump straight to the moment it was said.
Type any word or phrase that may have been spoken. Click a result to seek the player to that exact moment.
Try a name, a topic, or a quoted line
32:20Now PlayingWhat is the fundamental compressibility of language?
Check out our virtual career fair
See new projects before they go live
Animation credit:
Manim scenes by Aaron Gostein and Grant Sanderson
Shannon’s story, as well as those for various pi creatures, by Mitchell Zemil.
Lunar robot and prediction/compression coin by Paul Dancstep
NanoGPT animations by Clayton Rabideau
The way of visualizing entropy shown here is something I first came across in this excellent post by Chris Olah:
Shannon’s “A Mathematical Theory of Communication”
Shannon’s “Prediction and Entropy of Printed English”
Scientific American article that mentions the story with Von Neumann suggesting the name Entropy:
Timestamps:
------------------
These animations are largely made using a custom Python library, manim. See the FAQ comments here:
Music by Vincent Rubinetti.
------------------
3blue1brown is a channel about animating math, in all senses of the word animate. If you're reading the bottom of a video description, I'm guessing you're more interested than the average viewer in lessons here. It would mean a lot to me if you chose to stay up to date on new ones, either by subscribing here on YouTube or otherwise following on whichever platform below you check most regularly.
Mailing list
Sentinel Indexing in Progress
Metadata and chapters are available. Claim extraction for this episode is pending.
All video content is delivered via YouTube embedded players in accordance with the YouTube Terms of Service. Sentinel provides research tools that promote discovery and accountability across political media.
