Related posts
reinventing compression entropy
The the words it uses that this site has seen
least often elsewhere. Posts are matched on those words alone —
nothing here is a summary of this one.
Sources
All
x.com Recommends Newsletter Podcast Bluesky YouTube Korrents Mastodon Papers
Top people
Grant Sanderson
Zed Shaw
Tomasz Tunguz
Christian Oliff
Mitchell Hashimoto
Amelia Wattenberger
Tyler Cowen
Charity Majors
Justin Jackson
Maxence Poutord
Andrej Karpathy
Eugene Yan
Showing
Profile →
Show everything
Hiding
Show them again
Show them again
Further back ↓
Hiding
Show them again
6 September
Programmer, writer and musician; author of the Learn Code the Hard Way books and of Mongrel, the Ruby web server.
Video Compression Idea: Existing compression algorithm with an attached sequence of upscalers. Compress it at 720p and then choose/tune upscaler settings at varying boundaries to scale it up to different sizes without or minimal distortion. Related
3 September
Venture capitalist and founder of Theory Ventures, previously a partner at Redpoint. Writes a near-daily blog on startups, SaaS metrics, data and AI.
How large is Snowflake's AI revenue? Management lowered product gross margin guidance from 76% → 74% due to "fast-growing AI workloads." If GPU inference runs at ~25%–35% gross margins, that 200 bps compression implies ~$60M–$75M/quarter (~$240M–$300M ARR) in direct AI token consumption. Related
British front-end web developer based in Japan; writes about HTML, CSS, web performance and browser tooling at christianoliff.com.
Their words
Hazel for automating tasks such as image compression
Show the whole quote
christianoliff.com
2 September
Co-founder of Superlogical, started in 2026 to build server-side terminal infrastructure; creator of Ghostty. Co-founded HashiCorp and created Vagrant and Terraform before that.
A video explaining a handful of the tricks we use to optimize for memory within the Superlogical server: in-memory compression, moving file descriptors between event-driven and blocked threads dynamically, full terminal state binary snapshot/restore in microseconds, and more! Related
7 August
Designer and engineer; formerly principal research engineer at GitHub Next; writes at wattenberger.com.
"generative AI" puts the focus in the wrong place. what I think is actually the new superpower is * translation * between languages, but also between mediums. sketch <> figma design <> code <> image also, they do an inverted form of lossy compression: input + priors = input inflated with understanding of the world we're so focused on changing the input, but swapping out the priors is interesting as well what happens when we intentionally replace the priors with a different mindset / a different culture? can we trick ourselves into a rubber hand illusion, but for experiencing the world as some… Related
16 July
Mathematician and maker of the 3Blue1Brown YouTube channel, which explains mathematics through animation. Creator of the open-source Manim animation library and founder of the Summer of Math Exposition.
15 July
Economist at George Mason University, co-author of Marginal Revolution, host of Conversations with Tyler. Writes in short, dense claims about economics, culture and AI, and has moved position on AI in public more than once.
12 June
Mathematician and maker of the 3Blue1Brown YouTube channel, which explains mathematics through animation. Creator of the open-source Manim animation library and founder of the Summer of Math Exposition.
Bluesky Here's an excerpt from the most recent video on how Shannon studied the entropy of English, animated by Mitchell Zemil Related
YouTube Short Measuring the entropy of English Related
10 June
Mathematician and maker of the 3Blue1Brown YouTube channel, which explains mathematics through animation. Creator of the open-source Manim animation library and founder of the Summer of Math Exposition.
Bluesky Suppose you wanted to reinvent the idea of Shannon Entropy for yourself. This puzzle is a good place to start (Full video on YouTube). Related
x.com Suppose you wanted to reinvent the idea of Shannon Entropy for yourself. This puzzle is a good place to start (Full video on YouTube). Related
2 June
Co-founder and CTO of Honeycomb; previously an infrastructure engineer at Parse, Facebook and Linden Lab, and co-author of Observability Engineering.
4 March
Canadian bootstrapper and writer on small software businesses. Co-founder of the podcast hosting company Transistor.fm and author of the book Marketing for Developers.
9 February
French software engineer, public speaker and fully remote nomadic worker; writes about frontend development at maxpou.fr.
Their words
Squoosh - Image compression
Show the whole quote
maxpou.fr
17 October 2025
Founding member of OpenAI and former director of AI at Tesla; creator of nanoGPT and the term "vibe coding".
Their words
Um so I almost feel like because the internet is so terrible, we actually have to sort of like build really big models to compress all that. Uh most of that compression is memory work instead of like cognitive work. But what we really want is the cognitive part actually delete the memory
Show the whole quote
youtube.com
19 April 2025
Member of technical staff at Anthropic. He has led ML/AI teams at Amazon, Alibaba and Lazada, and writes about LLMs, recommender systems and engineering at eugeneyan.com.
The default state of projects is to drift toward entropy; you need to actively resist & reverse it. Related
21 March 2025
Writer and former McKinsey/BCG strategy consultant; author of The Pathless Path and Good Work, about leaving the default career track. Publishes the Boundless newsletter and podcast.
Their words
Ben's personal reflections on reinventing himself at "midlife" (though relatable at any age). I love how he leaned into a new version of himself without dramatically blowing up his life.
Show the whole quote
pathlesspath.com
13 June 2024
Astrobiologist and theoretical physicist at Arizona State University, working on assembly theory and the physics of life.
Their words
And there’s still a lot of impetus in the physics community to think that non-equilibrium physics will explain life. But I think that’s not the right approach. I don’t think ultimately the solution to what life is there, and I don’t really think entropy has much to do with it unless it’s entirely reformulated.
Show the whole quote
youtube.com
22 April 2024
Theoretical physicist and philosopher, Homewood Professor of Natural Philosophy at Johns Hopkins and fractal faculty at the Santa Fe Institute. Writes the Preposterous Universe blog and hosts the Mindscape podcast.
Their words
Sometimes people think that complexity or life or whatever is fighting against the second law of thermodynamics, fighting against the increase of entropy. That is precisely the wrong way to think about it. We are surfers riding the wave of increasing entropy. We rely on increasing entropy to survive.
Show the whole quote
youtube.com
4 April 2024
Software engineer who writes the blog Made of Bugs about performance, debugging and understanding computer systems. Previously worked at Anthropic on interpretability, at Stripe on Sorbet, and at Ksplice.
(De)compression is conceptually quite straightforward: The decompression algorithm specifies a weird domain-specific VM, and the compressor is simply an automated code golfer for that architecture. Related
12 January 2024
Professor of Cognitive and Computational Neuroscience at the University of Sussex, co-director of the Sussex Centre for Consciousness Science, and author of Being You: A New Science of Consciousness.
Nothing matches. Show everything
What is a korrent?
A korrent is a belief a person has stated in their own words: one
sentence stating the claim, backed by a quote and a source, kept at
korrents.com .
Under a name here, the quoted block is what they actually said.
The korrent beneath it is the claim those words support, in
korrents' wording — tap it to see the record, its source, and who
else holds it.
Nobody here wrote their own korrents. They are compiled from public
statements, and a person can change their mind, which is recorded too.
Got it
About the English under a post
Some people here publish in a language other than English. Where they
do, this site shows a machine translation beneath the post, in
this typeface — the site's own, not theirs.
The post itself is never changed, moved or hidden: what is set in the
serif above is exactly what the person published, and it is what to
quote them on. A translation can be wrong in ways that matter,
especially about tone.
Only the post's own words are translated. A quoted post, a linked
article and a belief on korrents.com
are left in their original language.
Got it