Related posts
Vicki Boykis
GitHub
what_are_embeddings — A deep dive into embeddings starting from fundamentals
embeddings fundamentals dive
The the words it uses that this site has seen
least often elsewhere. Posts are matched on those words alone —
nothing here is a summary of this one.
Sources
All
Bluesky x.com Newsletter Korrents Recommends Site Blog
Top people
Chamath Palihapitiya
Jason Liu
Gergely Orosz
Ben Carlson
Mitchell Hashimoto
Aswath Damodaran
Cassidy Williams
Scott Rao
Dex Horthy
Grant Sanderson
Sunil Pai
Scott Sumner
Showing
Profile →
Show everything
Hiding
Show them again
Show them again
Further back ↓
Hiding
Show them again
17 September
Writes The Pragmatic Engineer, the software-engineering newsletter, and wrote The Software Engineer's Guidebook. Formerly an engineering manager at Uber, and at Microsoft/Skype and Skyscanner before that.
Bluesky Why is the “grill-me” skill so popular, and why does its creator swear by the importance of software fundamentals? We cover this & many more w @mattpocock.com YouTube: www.youtube.com/watch?v=4Dhc... Spotify: open.spotify.com/episode/3pLP... Apple: podcasts.apple.com
Related
x.com Pretty incredible how the skills repo by @mattpocockuk is only 6 months old, and has more stars than the React one. We had to sit down and talk. Timestamps: 00:00 Intro 05:48 How Matt got into tech 10:14 How Matt got into open source 12:58 Joining Vercel 18:39 Total TypeScript 23:21 AI’s impact on technical education 30:32 Building reusable skills for AI coding agents 40:46 The “smart zone” vs the “dumb zone” 45:02 The wayfinder skill 47:52 Why agents excel at software engineering 50:54 “Leading words” 1:01:10 Learning the fundamentals 1:09:17 Local vs. cloud agents 1:12:36 Planning vs. cours… TypeScript coding agents Related
Newsletter AI Skills with Matt Pocock Matt Pocock explains how he uses AI coding skills and agents to plan and build software, and why engineering fundamentals matter more than ever.
Related
Systems and developer-tools engineer at Cloudflare as of 2026, on durable infrastructure for AI agents; worked on React and PartyKit before that. Writes at sunilpai.dev.
JavaScript
Their words
the jev release is giving react major version drop vibes. just a massive crashing wave, everyone rethinking fundamental stuff and thinking through the implications of a novel new primitive.
Show the whole quote
@threepointone on X x.com
10 September
Director of institutional asset management at Ritholtz Wealth Management. Writes the A Wealth of Common Sense blog and co-hosts the Animal Spirits podcast with Michael Batnick.
The top 10 stocks in the S&P 500 now make up ~40% of the index Every company in the top 10 has a market cap of $1 trillion or more 3 things: 1. This is a bull mkt phenomenon 2. Almost every other country is even more concentrated 3. The fundamentals back it up awealthofcommonsense.com
Related
6 September
Director of institutional asset management at Ritholtz Wealth Management. Writes the A Wealth of Common Sense blog and co-hosts the Animal Spirits podcast with Michael Batnick.
3 September
Co-founder of Superlogical, started in 2026 to build server-side terminal infrastructure; creator of Ghostty. Co-founded HashiCorp and created Vagrant and Terraform before that.
Guess which one is Rust btw. 🤣 (The point is the language isn't a free lunch for performance. Rust could be just as small as any other here. It isn't a given. Fundamentals and system design trump everything else. Language wars are stupid as hell.) Quoting @mitchellh The Superlogical server is built to run anywhere and everywhere and serve a level of scale (terminals+clients) unmatched w/ prior solutions. So let's start talking about that, starting with memory usage and comparisons to other popular multiplexers. I want to start by talking high level: why does t… Related
2 September
Co-founder of Superlogical, started in 2026 to build server-side terminal infrastructure; creator of Ghostty. Co-founded HashiCorp and created Vagrant and Terraform before that.
Their words
Invest in building strong fundamentals, invisible supports, and outcomes flow like water.
Show the whole quote
@mitchellh on X x.com
Professor of finance at NYU's Stern School of Business, known for his work on valuation. He publishes his data, spreadsheets and classes free at Damodaran Online and writes the Musings on Markets blog.
1 September
Monetary economist known for NGDP-level targeting. Wrote TheMoneyIllusion until it closed in 2024 and now writes The Pursuit of Happiness.
British open-standards and open-source technologist, formerly of the UK Government Digital Service and the W3C Advisory Committee. Blogs at shkspr.mobi, where he posts a book review most weeks.
Their words
Evan Prodromou has the unenviable task of making the whole ecosystem easy to understand. Thankfully he does that well. Things are logically laid out, there are comprehensive descriptions of even the most obscure parts of the spec, and it builds up nicely from the fundamentals.
Show the whole quote
shkspr.mobi
31 August
Software engineer in Chicago; writes the cassidoo.co blog and a weekly developer newsletter.
x.com The latest issue of my newsletter is out! We've got a lovely quote, a fun practice coding question, a punny joke, my latest hobby deep dive, and mooore. Check out the archive and subscribe: cassidoo.co
Related
Bluesky The latest issue of my newsletter is out! We've got a lovely quote, a fun practice coding question, a punny joke, my latest hobby deep dive, and mooore. Check out the archive and subscribe: cassidoo.co
Related
28 August
Founder and CEO of Social Capital, a venture firm; co-host of the All-In podcast and an early Facebook executive. Writes an annual letter and a weekly newsletter on markets and technology.
24 August
Latvian full-stack WordPress developer and course creator at WPElevator; blogs since 2007 about the open web, electronics, home automation and sustainable living.
During the weekend I built a contextual search tool for a photo library with 42k images across 2.8k galleries. The results are amazing! Turns out the AI models that generate embedding vectors from images directly are BAD at capturing the image contents, so I had to first generate captions and then generate the embeddings for the captions instead. Total cost: $30 for both captions (gpt-5-mini) and embeddings (text-embedding-3-large with 3072 dimensions). OpenAI Related
14 August
Founder and CEO of Social Capital, a venture firm; co-host of the All-In podcast and an early Facebook executive. Writes an annual letter and a weekly newsletter on markets and technology.
9 August
Coffee consultant and author of books on espresso, roasting and brewing, including The Professional Barista's Handbook and The Coffee Roaster's Companion; writes about brewing gear and roast control at scottrao.com.
Sample Roesting In this post, I’d like to dive into our sample roasting system at Prodigal. Why do we sample roast? If you want to cup samples before purchasing green coffee, you have two choices: ask suppliers for…
Related
6 August
Founder and CEO of Social Capital, a venture firm; co-host of the All-In podcast and an early Facebook executive. Writes an annual letter and a weekly newsletter on markets and technology.
31 July
Founder and CEO of Social Capital, a venture firm; co-host of the All-In podcast and an early Facebook executive. Writes an annual letter and a weekly newsletter on markets and technology.
22 July
Founder and CEO of Social Capital, a venture firm; co-host of the All-In podcast and an early Facebook executive. Writes an annual letter and a weekly newsletter on markets and technology.
15 July
Founder of HumanLayer; wrote 12-Factor Agents, on how to build AI agents that hold up in production.
From one piece
Context engineering with Dex Horthy
2 beliefs, in the piece's order there
18 June
Professor of finance at NYU's Stern School of Business, known for his work on valuation. He publishes his data, spreadsheets and classes free at Damodaran Online and writes the Musings on Markets blog.
3 June
Engineer and teacher; wrote Kubernetes the Hard Way, was a distinguished engineer at Google Cloud, and retired from full-time work in 2023.
MCP
Their words
So I'm looking at this like guys the fundamentals of this isn't like everything is going to change because of MCP. What the hell? A whole conference guys? This is just API design.
Show the whole quote
youtube.com
18 May
Co-founder of Ethereum. Publishes long essays on mechanism design, governance and what cryptography is for, and returns to earlier positions to say which parts they no longer hold.
16 May
AI research engineer working on large language models. He writes the Ahead of AI newsletter and is the author of Build a Large Language Model (From Scratch).
14 May
Software engineer working on distributed systems and databases; creator of rqlite, the distributed database built on SQLite.
Taking control of the #sqlite WAL - a deep dive into how rqlite lifts the lid on SQLite. And a h/t to @benbjohnson whose work on Litestream showed it was possible. philipotoole.com
SQLite Related
1 May
Freelance climate and energy analyst in Oslo, writing on Europe, the US and Australia; worked in the Australian renewables industry before that.
9 April
Science fiction novelist, journalist and technology activist; writes the daily blog and newsletter Pluralistic, and coined the term enshittification.
Their words
This book is a beautiful capstone to a brilliant career that defined the fight for cyber rights, and a deep, accessible dive into the defining tech and human rights battles of this century.
Show the whole quote
pluralistic.net
22 March
Hosts the Lex Fridman Podcast — long, unhurried conversations with scientists, engineers and public figures. Several of the interviews quoted elsewhere on this site are episodes of it.
It was an honor to hang out with Jensen Huang, CEO of @nvidia, and do a long-form podcast with him. Really fun & fascinating technical deep-dive conversation on & off the mic. One of the most brilliant & thoughtful human beings I've ever met. NVIDIA is the most valuable company in the world by market cap and is the engine powering the AI revolution. Podcast probably out tomorrow (Monday) unless I get stuck in too many interesting conversations while running around in SF ;-) PS: I haven't checked my messages in days. Sorry for slow replies 🙏 Trying to stay deeply focused at in overwhelmingly… Related
23 January
Software developer and entrepreneur; co-founder of Heroku, author of The Twelve-Factor App, and a researcher at Ink & Switch.
16 January
Software entrepreneur who bootstrapped and sold FeedbackPanda and now builds Podscan; writes The Bootstrapped Founder.
28 December 2025
Novelist, author of twelve books including Foundry, Bandwidth and Cumulus. Sends a newsletter of monthly book recommendations.
Their words
Playground by Richard Powers is a strange and wonderful novel set (mostly) on a remote atoll in French Polynesia that follows the tangled lives of an environmental advocate, a sculptor, a tech entrepreneur, and a brilliant bookworm trying to escape the grinding poverty of Chicago's South Side. The richly drawn characters drive the story, but what I love most about the book is that it's a love letter to the ocean with prose that comes closer than anything else I've read to capturing what it feels like to, for example, dive a thriving coral reef.
Show the whole quote
eliotpeper.substack.com
10 December 2025
Investing columnist for The Wall Street Journal and editor of the revised edition of Benjamin Graham's The Intelligent Investor.
27 October 2025
Game designer and director of the NYU Game Center; made Universal Paperclips and writes Donkeyspace.
10 October 2025
Writes on effective altruism, energy and the arithmetic behind arguments people repeat — including how much electricity a chatbot query actually uses.
17 September 2025
Member of technical staff at Anthropic. He has led ML/AI teams at Amazon, Alibaba and Lazada, and writes about LLMs, recommender systems and engineering at eugeneyan.com.
I've been nerdsniped by the idea of Semantic IDs. Here's the result of my training runs: • RQ-VAE to compress item embeddings into tokens • SASRec to predict the next item (i.e., 4-tokens) exactly • Qwen3-8B that can return recs and natural language! eugeneyan.com
Related
11 September 2025
Machine learning engineer and consultant focused on RAG and retrieval systems. He writes about applied AI engineering at jxnl.co and is the author of the instructor library.
+ 2 more
6 September 2025
Scottish software developer on the Statamic core team; runs a one-person business maintaining Statamic addons such as Runway and writes at duncanmcclean.com.
Their words
I started using PHPStorm last year and I love it. I honestly don't know how I managed to live without it. It makes it a breeze to refactor a large codebase or source dive some vendor code.
Show the whole quote
duncanmcclean.com
1 September 2025
Machine learning engineer working on recommender systems, personalization and information retrieval. Previously worked on LLMs and LLM infrastructure at Mozilla.ai and on ML and recsys at Duo, Tumblr, Automattic and Comcast; wrote the 'What are embeddings?' text and ran the Normconf conference.
How big are our embeddings now and why? A few years ago, I wrote a paper on embeddings. At the time, I wrote that 200-300 dimension embeddings were fairly common in industry, and that adding more dimensions during training would create diminishing returns for…
Related
3 July 2025
Founded PSPDFKit in 2011 and ran it for a decade. Came back from a break to work on AI agents — the OpenClaw project, and OpenAI, joined in February 2026. Writes at steipete.me.
26 June 2025
Writes jvns.ca, turning "hard and scary" topics — networking, debugging, Linux internals — into plain explanations and hand-drawn comics. Publishes Wizard Zines, illustrated programming zines. Software developer based in Montreal.
5 June 2025
Senior economist at the Foundation for American Innovation; writes Second Best, and was the Niskanen Center's director of social policy before that.
30 April 2025
Mathematician and maker of the 3Blue1Brown YouTube channel, which explains mathematics through animation. Creator of the open-source Manim animation library and founder of the Summer of Math Exposition.
Bluesky New video! This covers the fundamentals of quantum computing and builds up to a step-by-step walk-through of an important algorithm in the field. youtu.be
Related
x.com I just put up a new video on the fundamentals of quantum computing, building up to a step-by-step walk-through of something known as Grover’s algorithm. Here's an excerpt of a quiz used to introduce the topic. Related
21 March 2025
Writer and former McKinsey/BCG strategy consultant; author of The Pathless Path and Good Work, about leaving the default career track. Publishes the Boundless newsletter and podcast.
Their words
A nice personal + historical deep dive into finding your dharma by embracing both your gifts and limitations in service of something greater than yourself.
Show the whole quote
pathlesspath.com
3 December 2024
Co-founder of Microsoft and of the Gates Foundation. Writes Gates Notes on global health, energy and climate, and on whatever they have been reading.
Their words
Whether you already know a lot about the ’60s or you’re just dipping your toe into those waters, whether you want a deep dive into the art of political writing or a charming story about a married couple who adored each other, you’ll get it from An Unfinished Love Story.
Show the whole quote
gatesnotes.com
13 November 2024
Coffee consultant and author of books on espresso, roasting and brewing, including The Professional Barista's Handbook and The Coffee Roaster's Companion; writes about brewing gear and roast control at scottrao.com.
A Deep Dive into Cup of Excellence My sincere thanks to Peter Jones of Idle Hands Roasting and Trident Cafe, and to Benjamin Paz of Beneficio San Vicente, for their help with this post. If you enjoy this post and want to help increase awareness of Cup of…
Related
6 November 2024
Interface designer and researcher, known for the talks Inventing on Principle and Media for Thinking the Unthinkable and for essays on dynamic representations of ideas. Founder of Dynamicland, where he is building a communal computer.
Their words
History is the best distinguisher of fashion from fundamentals.
Show the whole quote
worrydream.com
24 September 2024
Investment researcher and engineer who runs Lyn Alden Investment Strategy, writing on macroeconomics, currency systems and equity analysis.
19 June 2024
Co-founder and CEO of Perplexity, an AI answer engine; previously a research scientist at OpenAI and a PhD student at UC Berkeley.
Their words
There is an algorithm called BM25 precisely for this, which is a more sophisticated version of TF-IDF. TF-IDF is term frequency times inverse document frequency, a very old-school information retrieval system that just works actually really well even today. And BM25 is a more sophisticated version of that, that is still beating most embeddings on ranking.
Show the whole quote
youtube.com
3 January 2024
General partner at Andreessen Horowitz and author of The Cold Start Problem. Previously led rider growth teams at Uber; has blogged on growth, network effects and marketplaces since 2007.
Their words
I’ve started to do a China history deep dive and this was on the list
Show the whole quote
andrewchen.com
23 November 2023
American author of The Subtle Art of Not Giving a F*ck and Everything Is F*cked. Writes essays and book reviews at markmanson.net.
3 Hard Truths You Need to Hear Welcome to the realm of uncomfortable truths, where I, Mark Manson, will make you question everything you've ever believed in. Buckle up, buttercup. Let's dive into the rabbit hole of reality. https://youtu.be/ueDus1n3t…
Related
Nothing matches. Show everything
What is a korrent?
A korrent is a belief a person has stated in their own words: one
sentence stating the claim, backed by a quote and a source, kept at
korrents.com .
Under a name here, the quoted block is what they actually said.
The korrent beneath it is the claim those words support, in
korrents' wording — tap it to see the record, its source, and who
else holds it.
Nobody here wrote their own korrents. They are compiled from public
statements, and a person can change their mind, which is recorded too.
Got it
About the English under a post
Some people here publish in a language other than English. Where they
do, this site shows a machine translation beneath the post, in
this typeface — the site's own, not theirs.
The post itself is never changed, moved or hidden: what is set in the
serif above is exactly what the person published, and it is what to
quote them on. A translation can be wrong in ways that matter,
especially about tone.
Only the post's own words are translated. A quoted post, a linked
article and a belief on korrents.com
are left in their original language.
Got it