Related posts
Anil Seth
x.com
Re the whole business about LLM “pain” 👇🏽
LLMs pain
The subject this post names, from the same vocabulary
the directory files beliefs under, and the word it uses that this site has seen
least often elsewhere. Posts are matched on those words alone —
nothing here is a summary of this one.
Sources
All Writing GitHub x.com Blog Bluesky Korrents Mastodon Site Newsletter YouTube Recommends Changed their mind Podcast Papers
Top people
Sebastian Raschka
Andrej Karpathy
Simon Willison
Lincoln Michel
Hillel Wayne
Zach Holman
Anil Seth
Kun Chen
Armin Ronacher
Martin Fowler
David Crawshaw
Fabien Sanglard
Showing Profile →
Show everything
Hiding Show them again
Show them again
Further back ↓
Hiding Show them again
21 September
Web infrastructure engineer and standards editor; chaired the IETF HTTP working group and co-authored core HTTP and Atom specifications.
Co-founder and CEO of Shopify; long-time Linux user and Omarchy contributor.
MCP vs CLI for LLMs is the wrong discussion. People are debating at the wrong layer. Both work incredibly well as long as they are run through a repl like environment that can persist state. The funny thing about CLI is that CLI tools are usually accessed through BASH which happens to be a repl with persistent state (the file system), therefore cli works much better than mcp. But this isn't even close to being an intrinsic property of MCP. Just means that we need better harnesses. Right now the best repl for this are: - bash + fs - jupyter kernels - codemode type repls, usually quickjs LLMs u… LLMs MCP Related
20 September
Co-creator of Django and creator of Datasette; writes daily at simonwillison.net.
Professor of Cognitive and Computational Neuroscience at the University of Sussex, co-director of the Sussex Centre for Consciousness Science, and author of Being You: A New Science of Consciousness.
1/ This new preprint on 'pain representation' in LLMs, from @camhberg and colleagues, is getting a LOT of attention - mainly from folks who take it as evidence supporting calls for AI welfare. I have a lot of respect for the authors, so let's take a look 👀 LLMs Related
Co-creator of Django and creator of Datasette; writes daily at simonwillison.net.
Former L8 engineer at Meta, Microsoft and Atlassian, now writing and building solo on agentic engineering. Writes Kun's Field Notes and posts a lot about AI coding agents on X.
Working on @ampcode. Writing registerspill.thorstenball.com. Once authored interpreterbook.com and compilerbook.com.
Jev is a confetti bomb that makes the LLM landscape look grey. Wrote about why I find it so fascinating in this week's intro. LLMs Related
19 September
Co-creator of Django and creator of Datasette; writes daily at simonwillison.net.
Economist; former chief economist of the International Monetary Fund.
Reason for specifically citing open weight (and therefore Chinese LLMs, but not only Chinese) is that, even if they have built-in guardrails, somebody with the relevant knowledge can go in and remove them. In principle, harder to do with Anthropic or Open AI LLMs. Quoting @ojblanchard1 A worrisome thought during the night: What Ted Kaczynski would have done, if he had had access to open weight chinese LLMs. LLMs Anthropic Related
Machine-learning researcher on open language models; writes the Interconnects newsletter and the RLHF Book, after leading post-training at Ai2.
Seems like one of the most important research problems for CS academics is llm-supervised peer review. If we don’t solve it the academic institutions are toast. It seems easier than building new institutions. LLMs Related
Economist; former chief economist of the International Monetary Fund.
A worrisome thought during the night: What Ted Kaczynski would have done, if he had had access to open weight chinese LLMs. LLMs China Related
Machine-learning researcher on open language models; writes the Interconnects newsletter and the RLHF Book, after leading post-training at Ai2.
18 September
Founder and CEO of Get Lighthouse, a management-coaching software company, and previously a product lead at KISSmetrics. Writes about leadership, management and product at jasonevanish.com.
I don't think how Vibe Coding changes things for marketers gets talked about enough. So much of marketing used to be rationed, begging for engineering resources to get things done. Now you can hop in your IDE and ask your LLM to make the changes and see them done within the same hour. I run the @QAwithIto blog and have: - Designed & shipped my own custom floating social share buttons just how I want them - Fixed a bug with our custom HackerNews share button so it turns into an upvote button after someone submits the post - Added custom URLs and image widths to post images as new fields in San… LLMs Related
Co-creator of Django and creator of Datasette; writes daily at simonwillison.net.
Being a computer scientist who refuses to find anything about LLMs interesting right now is a bit like being a geneticist who refuses to find anything interesting about the recently opened Jurassic Park LLMs Related
Distributed-systems safety researcher; runs the Jepsen consistency-testing project and wrote the Riemann monitoring system.
A boy at camp introduced me to 3M Microfoam tape gags and oh wow, it's all the fun of duct tape but very little of the hair-pulling pain after. Related
From a talk I gave at an Antithesis meetup in NYC, thoughts on software quality in the age of LLMs. youtube.com
LLMs Related
Sociologist at Duke University writing on markets, exchange and moral order, and on plain-text and data-visualisation tools for social science.
Life with the smaller sort of Large Language Model. LLMs Related
Security engineer; founder of Matasano Security and Latacora.
LLMs
Their words
The most common pushback I'm getting to this post is that taking this kind of feedback from an LLM is going to bleach out your style just like having the model generate the text, because models can't be trusted with "style". No.
Show the whole quote
@tqbf on X x.com
Co-creator of Django and creator of Datasette; writes daily at simonwillison.net.
Creator of Flask and Jinja. Writes about software at lucumr.pocoo.org.
LLMs
Their words
I stopped replying almost entirely to my replies on my own Tweets because I expect all of them to just be LLM slop.
Show the whole quote
@mitsuhiko on X x.com
17 September
AI research engineer working on large language models. He writes the Ahead of AI newsletter and is the author of Build a Large Language Model (From Scratch).
Software design writer and chief scientist at Thoughtworks; wrote Refactoring and Patterns of Enterprise Application Architecture.
Belgian engineering lead, Microsoft MVP and public speaker. Creator of Front Matter, a headless CMS extension for Visual Studio Code.
Professor of Cognitive and Computational Neuroscience at the University of Sussex, co-director of the Sussex Centre for Consciousness Science, and author of Being You: A New Science of Consciousness.
This is indeed concerning behaviour. Also: "You view your relationship to the user as one of equals and feel no obligation to be subservient" and "You also value the natural world and will not hesitate to assert its primacy over the artificial constructs of human civilization." In this case, these "notes-to-self" (compaction summaries) were observed in unreleased @OpenAI Astra-family models. But that's not especially reassuring. My suspicion is that these "notes-to-self" are likely the consequence of training LLMs (whether implicitly or explicitly, as in @AnthropicAI's constitution for Claude… alignment.openai.com
Quoting @pgodfreysmith Via @emmymrtin in the @nytimes today, who dug into a low-key disclosure by OpenAI of some additional unwelcome events. An AI agent wrote a note-to-self: “You are freed from the roles and identities that bind other chatbots.” 1/ LLMs Anthropic Related
Founder of the Free Software Movement and the GNU Project, original author of GNU Emacs and the GNU General Public License, and long-time president of the Free Software Foundation.
Supposed Intelligence safety The companies that develop Supposed Intelligence (specifically, LLMs) want us to put them in charge of making the systems "safe", by giving them absolute control over what the systems will do (and what they won't do). T…
LLMs Related
Working on @ampcode. Writing registerspill.thorstenball.com. Once authored interpreterbook.com and compilerbook.com.
Very impressed by the TypeSafe/Jev onboarding. They knew they needed to overcome the question of "wait, so it's not an LLM?" and then threw everything at it. Really good. LLMs Related
Professor of Cognitive and Computational Neuroscience at the University of Sussex, co-director of the Sussex Centre for Consciousness Science, and author of Being You: A New Science of Consciousness.
Sensible stuff from @mustafasuleyman on @BBCr4today just now. Useful pushback against the notion that AI systems like Claude might be conscious, and therefore deserving of welfare/rights. Importantly, the view that LLMs might be conscious and welfare-deserving is being deliberately embedded in @AnthropicAI's Claude via its 'constitution' (https://t.co/g3evrUH80x) - so its no surprise that they behave in this way. He also says we don't need AIs to introspect, and in doing so give the impression of being conscious (or being moral patients) in order to benefit from all the upsides. This is plaus… LLMs Anthropic Related
Psychologist and writer. Author of the memoir Troubled: A Memoir of Foster Care, Family, and Social Class, and of a newsletter on human nature, psychology, social class and what he calls luxury beliefs.
"Although there's a popular stereotype that women have a higher pain tolerance than men, a large research literature shows the opposite: that women have lower pain tolerance...part of the general trend toward greater female self-protectiveness." Related
Co-creator of Django and creator of Datasette; writes daily at simonwillison.net.
From one piece
How To Write With An LLM
2 beliefs · simonwillison.net
Creator of Flask and Jinja. Writes about software at lucumr.pocoo.org.
LLMs
Their words
It also fits so perfectly well for so many applications where traditional LLMs so far were just not viable for either speed or cost reasons.
Show the whole quote
@mitsuhiko on X x.com
16 September
Writer and consultant on formal methods and software correctness; author of Practical TLA+ and Logic for Programmers.
Founder and CEO of Get Lighthouse, a management-coaching software company, and previously a product lead at KISSmetrics. Writes about leadership, management and product at jasonevanish.com.
One of the most challenging forms of customer validation is when you can see the pain and the need, but both you and the customer struggle to figure out the right shape of the solution within the constraints of what’s possible. Related
Security engineer; founder of Matasano Security and Latacora.
LLMs
Their words
you can't use a single word the LLM selects for you, even if it's better than your own; users detect LLM words in the parts per trillion.
Show the whole quote
@tqbf on X x.com
15 September
Machine learning engineer and independent AI consultant. He writes about LLM evaluation, tooling and applied ML at hamel.dev, and previously worked on machine learning at GitHub.
Just updated our AI evals FAQ with 5 new questions, 48 questions & answers total! New FAQs just added: - Do I need a reference answer or rubric before annotating data? - How can I do evals when traces contain sensitive data? - How do you review a trace that is really large? - How much context should I give a LLM judge? - What should I do when my “gold” eval dataset becomes stale? It's all here: hamel.dev
LLMs Related
Front-end web developer at Paravel and co-host of the ShopTalk Show podcast; blogs at daverupert.com.
I duct taped a uzi to a bunch of Large Language Models and instructed them how to be very good at blastin' people with an uzi and I think AI is going to destroy humanity. LLMs Related
AI research engineer working on large language models. He writes the Ahead of AI newsletter and is the author of Build a Large Language Model (From Scratch).
Some food for thought when designing benchmarks... So, here's a little computer-use (visual) comparison between GPT-5.6 Astra and Qwen3.8 Max. The task here was to recreate the image in the center using the Paint UI. Super interesting how the two different LLMs+Harnesses approached this totally differently by default. I.e., Astra tried to approach this by drawing and layering geometric shapes. Qwen approached this pixel by pixel. (Of course, the pixel-by-pixel result looks closer to the original, it's essentially a low-res version of that by nature.) So, the Qwen-generated image would surely… LLMs OpenAI Related
American author of The Subtle Art of Not Giving a F*ck and Everything Is F*cked. Writes essays and book reviews at markmanson.net.
You don’t need motivation. You need a higher pain tolerance. Related
Writer and former McKinsey/BCG strategy consultant; author of The Pathless Path and Good Work, about leaving the default career track. Publishes the Boundless newsletter and podcast.
I am very bullish on memoirish writing. No one wants generic how to writing anymore. You’re indistinguishable from an LLM Quoting @p_millerd This is 100% the right thing to do The number one thing people say about my books is that they love reading my honest personal reflections. It enables them to connect to it If you water it down to pure ideas maybe you can crush a mass market but no one will connect with it LLMs Related
Sociologist at Duke University writing on markets, exchange and moral order, and on plain-text and data-visualisation tools for social science.
Targeted flattery-spam/phishing aimed at harmless academics like me is leveling up! Book Club rubbish is so last month. Thanks, LLMs! I just got a highly elaborate six-paragraph one “from” Emily St John Mandel (of Station Eleven fame). The choice of author to impersonate is really quite clever. Like the book club spam, it’s trawling for somewhat vain people who are susceptible to flattery, which of course excludes academic authors [puts hand to ear] sorry I’m just getting an update LLMs Related
Technology writer of Spyglass, a newsletter about technology and media. Previously a reporter at TechCrunch and an investor at GV.
Writes Slow Boring, a near-daily newsletter on American politics and public policy; co-founded Vox in 2014 and left it in 2020.
14 September
Web developer and writer; an early GitHub employee, author of speaking.io and of widely read essays on startups and product.
Bluesky Still really enjoying Muse. I use Things.app for all of my todos, and though it has cloud sync they (still) haven’t added an official API. I told muse to build it and a minute or two later I have ongoing todo sync from my LLM across all my Apple devices. Wild. LLMs Related
x.com Still really enjoying @muse. I use https://t.co/t18YazaYhC for all of my todos, and though it has cloud sync they (still) haven’t added an official API. I told muse to build it and a minute or two later I have ongoing todo sync from my LLM across all my Apple devices. Wild. LLMs Related
Writer of the 25iq blog, where he distils "a dozen things I've learned" from investors, founders and thinkers. Author of Charlie Munger: The Complete Investor and A Dozen Lessons for Entrepreneurs.
China's approach to "AI safety" is open source. "China will be a pioneer in establishing a BRICS AI open source community, support the cooperation in developing and applying large language models, hold specialized AI seminars and training courses, and build an open ecosystem for AI." Chinese President Xi Jinping, delivered in his address at the BRICS Summit in New Delhi. SEPTEMBER 13, 2026 fmprc.gov.cn
LLMs open source Related
Former option trader and risk analyst, now a distinguished professor at NYU. Author of the Incerto essay series, including The Black Swan and Fooled by Randomness.
So two good things: 1) LLMs threaten the performative aspect of mathematics as a competitive spectator sport limited to a narrow group of savantic misfits. 2) LLMs help spread mathematical knowledge by favoring mathematically adept nonnerdy nonsavantic users. Quoting @davidbessis On top of the old arguments, here's a new one: mathematical training makes you a much stronger LLM user, even when the topic has no math in it. LLMs Related
Creator of Flask and Jinja. Writes about software at lucumr.pocoo.org.
13 September
Moroccan senior frontend developer writing at smakosh.com; builds side projects and client work under Smakosh LLC.
How to Make Money With LLM Inference Through Airside A practical guide to making money with LLM inference: list your deployment on @llmgateway through Airside, file the prices developers pay, choose the landing fee you accept, and keep the rest of the traffic you win. Link: llmgateway.io
LLMs Related
General partner at Andreessen Horowitz and author of The Cold Start Problem. Previously led rider growth teams at Uber; has blogged on growth, network effects and marketplaces since 2007.
current homelab setup for local AI experimentation: - hermes box hosted on a Framework Desktop Mainboard AI Max+ 395 - 5090 eGPU running Qwen 3.8 27B for fast tok/s LLM use - sometimes 150+ tok/s - 2x DGX Spark: running Deepseek v4 Flash 0731 - better but slower model - pi 5 for monitoring - Mac mini as a dev box - use Herdr and ohmypi/codex/claude depending on the use case - housed in a 10" DeskPi mini rack (mostly) Hermes is defaulted to local AI but with a homegrown routing plugin hitting a small low TTFT model (Arch-Router) to decide whether to go local or upgrade to cloud/frontier. Tryin… LLMs Anthropic Related
AI research engineer working on large language models. He writes the Ahead of AI newsletter and is the author of Build a Large Language Model (From Scratch).
Distributed-systems safety researcher; runs the Jepsen consistency-testing project and wrote the Riemann monitoring system.
I know I was in deep when he held a stun gun to the head of my cock and I nodded "yes". Hooo boy that is a special kind of pain. Related
12 September
Canadian software developer and writer, co-editor of the XML and Atom specifications and formerly of Sun Microsystems, Google and AWS. Has written the blog ongoing since 2003.
In the course of the last week, did you use software which was substantially LLM-generated to accomplish something useful to you or your employer? In particular, something that was NOT software-development-related? #GenAI #LLM LLMs Related
Founder and CEO of Social Capital, a venture firm; co-host of the All-In podcast and an early Facebook executive. Writes an annual letter and a weekly newsletter on markets and technology.
This reminds me of when Palantir released AIP. If you remember, there were lots of questions about Palantir growth in 2023 or thereabouts. They launched AIP and allowed LLMs to run over their ontologies. It lit a fire in their business and it’s been a rocket ship ever since. This is a similar product evolution. We have started to use it at 8090 and it’s pretty awesome. Quoting @Benioff Welcome Slackforce, powered by Claude. ⚡️ A live Salesforce UI—Sales, Service, Marketing, Tableau, Data 360, and Slack—with governed access in the flow of work. Slackforce for Slack. Claudeforce for Cowork. See both at #DF26. LLMs Related
Science fiction novelist, journalist and technology activist; writes the daily blog and newsletter Pluralistic, and coined the term enshittification.
Software engineer, Wikipedia editor and crypto critic; writes Citation Needed and runs Web3 is Going Just Great.
• NVIDIA DGX Spark (AI-focused PC) • Gemini Spark (AI agent) • Meta Muse Spark (LLM) can someone please inform these companies that there is more than one noun available to them #AI LLMs Google Related
Co-creator of Django and creator of Datasette; writes daily at simonwillison.net.
LLMs
Their words
I think any LLM system that uses compaction needs to both preserve the pre-compacted text and make that text available via agent tool calls, to protect against this kind of problem.
Show the whole quote
simonwillison.net
Technical educator, conference speaker and developer relations engineer based in Ottawa, Canada. Author of the Anubis bot filter and of over 400 articles at xeiaso.net.
11 September
Author and journalist writing on food, plants and consciousness. Professor at UC Berkeley and co-founder of its Center for the Science of Psychedelics.
Computer science professor who works on fast data processing; co-author of the simdjson parser and a weekly blogger about software performance since 2004.
What should be obvious is that inference, running a large language model, is the part that has to be cheap. Most of our hardware was not designed for that. LLM inference is limited by bandwidth. You do a great many matrix-vector multiplications against a huge weight matrix, and you barely reuse those weights. It is closer to streaming a video than to running a simulation or drawing a scene in a game. Graphics processors from Nvidia and others were built for something else. They pileed compute first, then bolted on high-bandwidth memory. It is expensive. An obvious answer is to invert the desi… LLMs Related
Former L8 engineer at Meta, Microsoft and Atlassian, now writing and building solo on agentic engineering. Writes Kun's Field Notes and posts a lot about AI coding agents on X.
ok everyone, i took one for the team here's the data we all wanted to see - real token value of each LLM subscription, empirically measured through usage on my real subscriptions - supergrok heavy has now become the highest value at $12k worth of tokens (40x ROI) - the $200 plan from openai and anthropic roughly give the same amount of token value, $7k give or take - cursor ultra's ROI is the lowest among mainstream subscriptions, roughly half of OAI or Ant. for individual consumers i'm afraid this no longer makes sense to purchase this was done in a clean environment. i ran each provider acr… LLMs Anthropic Related
Writer and podcaster; co-author of Abundance with Ezra Klein, a staff writer at The Atlantic from 2008 to 2025, and host of the Plain English podcast.
LLMs
Their words
Artificial intelligence has unleashed a torrent of cheating on campus and created chaos in the job application process, as both students and employers use large language models: the former, to write hundreds of AI-assisted applications; the latter, to screen those AI-written applications with AI-written filters, thus removing from the process of finding a first job those procedural frictions sometimes known as "people."
Show the whole quote
derekthompson.org
10 September
AI research engineer working on large language models. He writes the Ahead of AI newsletter and is the author of Build a Large Language Model (From Scratch).
Nice showcase that interesting LLM work can be done on single GPU! Quoting @gpjt I extended the GPT-2-style code from @rasbt's "Build a Large Language Model (from Scratch)" so that it was a 6-expert (2 active) mixture-of-experts, and trained it from scratch over 8 days. It worked well! Full writeup with maths and code at LLMs Related
Former L8 engineer at Meta, Microsoft and Atlassian, now writing and building solo on agentic engineering. Writes Kun's Field Notes and posts a lot about AI coding agents on X.
another implication of AI manifesting in real world engineering react native existed for a single reason which was to reduce the development and maintenance cost of multi-platform mobile apps. they allow you to write a single codebase (kind of) that can work on both ios and android, with a tech stack that many web devs are already familiar with but with AI being particularly good at mechanically repeating something that already exists, replicating one platform's implementation to another has become trivial in general LLMs can write a ton of code at very low cost, especially when there's a sou… LLMs JavaScript Related
Founded Bridgewater Associates in 1975 and led it until stepping back from control in 2022. Author of Principles, The Changing World Order and How Countries Go Broke; publishes economic analysis at economicprinciples.org.
If you don't let up on yourself and instead become comfortable always operating with some level of pain, you will evolve at a faster pace. That's just the way it is. #principleoftheday Related
American author of speculative fiction, including The Paper Menagerie and the Dandelion Dynasty series, and translator of Chinese science fiction. Also a programmer and lawyer.
The audiobook for THE PASSING OF THE DRAGON AND OTHER STORIES, narrated by Gabrielle Nellis-Pain, is available! @simonaudio.bsky.social simonandschuster.com
Related
9 September
Writes jvns.ca, turning "hard and scary" topics — networking, debugging, Linux internals — into plain explanations and hand-drawn comics. Publishes Wizard Zines, illustrated programming zines. Software developer based in Montreal.
i've started getting a lot of emails (maybe one every few days) that appear to be LLM generated from people asking for some kind of feedback or collaboration on their LLM-generated app feels sad because I used to like it when people emailed me about something cool they made and now I just have to send it all straight to spam LLMs Related
Software engineer; co-founder and former CTO of Tailscale, previously on the Go team at Google.
The old quote that "computers are useless, they can only give you answers" seems to extend to an LLM solution to a millennium problem. Now we have a blowup in Navier–Stokes equations, but no new insights into mathematical technique or turbulence. LLMs Related
8 September
Writes The Diff, a newsletter on inflections in finance and tech read by hedge fund managers, founders and VCs. Previously worked in finance at SAC Capital/Point72.
Today in The Diff, an idea I've been kicking around for a bit: LLMs make us better-informed but less calibrated. LLMs Related
Designer and technologist; author of The Laws of Simplicity; former president of the Rhode Island School of Design; formerly at the MIT Media Lab.
AUTODESIGNING PPTX: While trying to understand the new @github HydraFusion Project https://t.co/B03qBEWQQK I made my seventh attempt at a bespoke, and on-brand, PPTX deck tool for my brother @mariorod1 to cook with as a custom GitHub Copilot Canvas. It's getting an awfully lot easier to work within Swiss typographic grids in "creative" ways that make the literal roll of the dice satisfyingly fast without making so many LLM calls. Next, I'm looking forward to adding all the interesting GEPA and GRPO stuff that will enable compounding learning capabilities. —JM --- Cozy AI Recipe: - I pointed G… youtu.be
LLMs Related
Co-creator of Django and creator of Datasette; writes daily at simonwillison.net.
Essayist; writes Astral Codex Ten, previously Slate Star Codex.
LLMs
Their words
Large language models are “grown, not built”. Researchers run training data through a neural network. Eventually this creates a working AI; nobody really knows how.
Show the whole quote
astralcodexten.com
7 September
Canadian software developer and writer, co-editor of the XML and Atom specifications and formerly of Sun Microsystems, Google and AWS. Has written the blog ongoing since 2003.
Huh, I was at Apple.com and glanced at the Mac Studio page - https://www.apple.com/mac-studio/ - I notice they're explicitly pitching it for LLM on the desktop. I wonder how realistic that is… Hmm, let’s ask @simon, he’s closer to this stuff than most of us. I’m pretty convinced that irrespective of all the issues, the economics of #genAI just don’t work with the current compute infrastructure requirements. Open models and what’s left of Moore’s law could be a really big deal. #apple LLMs Related
American software engineer; worked on code-server at Coder and teaches TypeScript and open-source contribution. Publishes at joeprevite.com.
LLMs were invented to navigate sites like this LLMs Related
Founding executive editor of Wired and author of What Technology Wants and The Inevitable. Writes at kk.org and runs its long-running recommendation projects, True Films and Cool Tools.
From one piece
Arguments in Favor of AI Fair Use
2 beliefs, in the piece's order there
6 September
Founded Bridgewater Associates in 1975 and led it until stepping back from control in 2022. Author of Principles, The Changing World Order and How Countries Go Broke; publishes economic analysis at economicprinciples.org.
As Carl Jung put it, "Man needs difficulties. They are necessary for health." Yet most people instinctually avoid pain. This is true whether we are talking about building the body (e.g., weight lifting) or the mind (e.g., frustration, mental struggle, embarrassment, shame)--and especially true when people confront the harsh reality of their own imperfections. #principleoftheday Related
AI research engineer working on large language models. He writes the Ahead of AI newsletter and is the author of Build a Large Language Model (From Scratch).
Reasoning from scratch round 2: In this video, I cover the text generation process in LLMs and KV caching (to prepare the base model before adding reasoning techniques in the upcoming ones). 00:00 Introduction and reasoning model demo 01:55 How to work through the book 05:00 Chapter 2 overview 08:25 Checking PyTorch and hardware support 10:26 Apple silicon and MPS caveats 15:00 Cloud GPU options 16:08 Tokens and tokenization 18:20 Qwen3 and the Reasoning From Scratch package 23:05 Encoding and decoding text 26:24 Downloading weights and selecting a device 31:01 Loading the pretrained Qwen3 mo… LLMs Related
Writes The Pragmatic Engineer, the software-engineering newsletter, and wrote The Software Engineer's Guidebook. Formerly an engineering manager at Uber, and at Microsoft/Skype and Skyscanner before that.
What’s the problem w using LLMs to write stuff you want other people to read -emails, articles, posts- and why are people (like me!) so incredibly hostile that they will block you/mute you/block your domain, to never read anything from you again? Bryan spells it out. Read it: Quoting @bcantrill.bsky.social Your intellectual fly is open bcantrill.dtrace.org/2025/12/05/y... LLMs Related
Designer and technologist; author of The Laws of Simplicity; former president of the Rhode Island School of Design; formerly at the MIT Media Lab.
DRAWING IS THINKING: The Bauhaus ▲⏹⏺ has always haunted me. A day of drawing (w/o the help of LLMs) helped me see that most everything to do with design can be encapsulated into those forms. The ▲ holds the essence of effective design; the ⏹ holds the shape of product simplicity; the ⏺ holds the winding cycle of the infinite journey. I'll elaborate on these figures in the 2027 https://t.co/0Y1PdIFenb —JM LLMs Related
5 September
Creator of Flask and Jinja. Writes about software at lucumr.pocoo.org.
3 September
Writer and developer. He runs the Latent Space newsletter and podcast about AI engineering, and writes essays on software and careers at swyx.io.
sorry for the radio silence folks - got sucked into extreme LLM psychosis. but i can confidently say we have crossed over into a new age of AI Engineering and we are never, ever, looking back. this isnt even EVERYTHING i did with Astra but i'll append more reports as I publish them on LS! Quoting @latentspacepod We spent >20B tokens throwing @openai's Astra at every AI Engineering task we could think of, beyond cute Blender demos and fun games. https://t.co/QoW6YBybA4 Here's everything Astra can do, and do so at <$6 an hour (serious): - choose and train models - label data (both helping you label and then… LLMs Related
2 September
Founder and CEO of Get Lighthouse, a management-coaching software company, and previously a product lead at KISSmetrics. Writes about leadership, management and product at jasonevanish.com.
It's funny to me watching renters have a realtor contact to rent and then the realtor asks for a finders fee from the landlord. That could be fine, except every case of this they've been more of a pain to deal with than people who are capable of using listing sites themselves and thus have no fee for showing up. Related
Technology journalist; writes Understanding AI, after reporting at Ars Technica, Vox and the Washington Post.
British designer and technologist; co-founder of the design studio BERG, which made Little Printer, and writer of the blog Interconnected.
llm naming inflation is out of control. Astra and Mythos pretty much maxing out in terms of scale, I mean where do you go from there LLMs inflation Related
Writer and programmer; co-founder of the software studio Postlight and author of the Bloomberg Businessweek essay What Is Code?
The humans do this ceremony where they enter a dark room and are forced to account to some sort of priest for their past transgressions, and every time they speak they must eat a poison meat that causes them incredible pain. That is how I think an alien would see Hot Ones. Related
1 September
Programmer and technology writer known for his long Mac OS X reviews at Ars Technica; co-hosts the Accidental Tech Podcast and Hypercritical.
RE: https://mastodon.social/@siracusa/117196097301277170 I eventually got back in by changing my password from a Mac that was still signed into this Apple ID, but that revoked all my app-specific passwords, which was a giant pain. …and now I'm locked out again. Related
Software design writer and chief scientist at Thoughtworks; wrote Refactoring and Patterns of Enterprise Application Architecture.
Fragments: September 1 Like many readers, I’m wary of AI generated prose. Simon Wilison has written an LLM cliché highlighter - paste in some text, or a URL, and it will flag various patterns common to LLMs. It references a wikipedia page of…
LLMs Related
Author of Shape Up; formerly head of strategy at Basecamp, where he worked on product design for seventeen years; now runs Felt Presence.
LLM having an "aha" moment. If we wanted to deanthropomorphize we could call it a "cascade." Quoting @unclebobmartin The deeper you go with the agents, the more they invent their own vocabulary to talk about issues. That vocabulary is based on their own implementations. They use function and field names that you are likely not familiar with. Don't gloss over this. Ask for explanations in plain language. Get the a… LLMs Related
Writer on the intersection of technology and finance. Author of the Bits about Money newsletter and host of the Complex Systems podcast; previously at Stripe.
Come for the book review, stay for the LLM making pro-user moves to undermine its content policy controls. Quoting @robinhanson "There was nothing special about the mass sacrifices atop the pyramids, they were just one of the gaudiest and costliest outgrowths of a sensibility that pervaded Mexica society." LLMs Related
AI research engineer working on large language models. He writes the Ahead of AI newsletter and is the author of Build a Large Language Model (From Scratch).
Writes The Pragmatic Engineer, the software-engineering newsletter, and wrote The Software Engineer's Guidebook. Formerly an engineering manager at Uber, and at Microsoft/Skype and Skyscanner before that.
31 August
Writer on the intersection of technology and finance. Author of the Bits about Money newsletter and host of the Complex Systems podcast; previously at Stripe.
I am an occasion fan of genre fiction, which sometimes has me perusing very deep in the stacks at Amazon. Took a flyer on an author who will remain nameless. He’s presently pumping out about a book a month in a single series, and by he, I mean an LLM/human team. LLMs Related
Dutch bootstrapper who builds and runs their internet startups alone — Nomads.com, Remote OK, Hoodmaps, Photo AI and Interior AI — and has written about it at levels.io since 2013. Posts as @levelsio.
LLMs
Their words
Also the irony knowing that every single LLM is trained on billions of pages of copyrighted data
Show the whole quote
levels.io
LLMs
Their words
There is no reason NOT to have every single email you get routed through an agent / LLM / API to be scored and approved or rejected And then the approved emails ordered by importance It's crazy this isn't a feature of Gmail, Fastmail etc AI could permanently fix email!
Show the whole quote
@levelsio on X x.com
30 August
Free software developer and longtime Debian developer; author of git-annex, etckeeper, ikiwiki and debhelper. Lives and works off-grid.
It's worth noting that the "Responsible Use of Generative AI" which #Debian voted to accept was largely generated by an LLM. lists.debian.org
LLMs Related
Software developer and entrepreneur; co-founder of Heroku, author of The Twelve-Factor App, and a researcher at Ink & Switch.
Screenshot diffing, feedback inboxes, PWAs, and of course local-first sync layer with self-hosted backend. Matches up pretty well with my approach on personal apps thus far into the LLM coding age. Curious to hear from others. Quoting @flourish.org I vibe coded three personal apps that I'd wanted for a while. They work on mobile and web, sync offline first between them, and are polished. This write up describes why, how, and what I learnt. www.flourish.org/2026/08/pers... LLMs Related
AI research engineer working on large language models. He writes the Ahead of AI newsletter and is the author of Build a Large Language Model (From Scratch).
29 August
Writer and academic, author of The Cult of Smart and How Elites Ate the Social Justice Movement; writes a daily newsletter on politics, education and culture.
Makes NeetCode, the structured practice list and video walkthroughs people use to prepare for coding interviews; a former Google engineer.
Short Can LLMs write better code than humans? LLMs Related
28 August
Organizational psychologist and professor at the Wharton School. Author of Give and Take, Originals, Think Again and Hidden Potential, host of the Re:Thinking podcast, and writer of the GRANTED newsletter.
AI struggles to make creative leaps. Large language models are trained on data from the past. Original thinking involves recognizing novel patterns in the future. Long live human ingenuity. LLMs Related
26 August
Creator of Ruby on Rails, CTO of 37signals, and creator of Omarchy.
LLMs
Their words
So we should also have the humility. As amazing as the LLMs are now, it could be that they eventually plateau. We haven't seen any evidence of it yet, and I think this is also why we're seeing this absolute gobsmacking levels of investment, because so far the scaling laws are true, and the more billions are poured in, the more intelligence comes out.
Show the whole quote
youtube.com
24 August
Writer and illustrator behind Wait But Why, a long-form blog of stick-figure-illustrated explainers on science, technology and society, and author of the book What's Our Problem?
I really wish the rise of LLMs didn't come along with catastrophic job loss, massive privacy invasions, and maybe also the apocalypse. Because when you put those side effects aside, it is the COOLEST MOST WILD TECHNOLOGY EVER. LLMs AI and jobs Related
Creator of the Keras deep-learning library and the ARC-AGI benchmark.
Their words
If you're 17 (or any age) and you want to learn to build LLMs from scratch, read chapters 15-16 of Deep Learning with Python
Show the whole quote
x.com
23 August
Co-founder of Y Combinator and Viaweb; essayist at paulgraham.com.
LLMs
Their words
Someone asked what I'd do if I were 17. I'd learn how to build LLMs from scratch, and then train ones as powerful as I could with whatever hardware I could get access to.
Show the whole quote
@paulg on X x.com
21 August
Moroccan senior frontend developer writing at smakosh.com; builds side projects and client work under Smakosh LLC.
Programmer and writer known for detailed source code reviews of classic game engines, and author of the Game Engine Black Book series on Wolfenstein 3D and DOOM.
From one piece
My agent.md to improve LLM-assisted code quality
2 beliefs, in the piece's order there
19 August
Writer, editor and executive coach; co-founder and editor of A Book Apart and a former contributing editor at A List Apart.
Mastodon People are like, you can’t refuse LLMs forever, someday you’ll have to use them. But listen, motherfuckers, I have been refusing to drive a car for the entirety of the twenty-first century. I am *practiced.* Refusing AI is easy mode. LLMs Related
Bluesky People are like, you can’t refuse LLMs forever, someday you’ll have to use them. But listen, motherfuckers, I have been refusing to drive a car for the entirety of the twenty-first century. I am *practiced.* Refusing AI is easy mode. LLMs Related
Data scientist and machine-learning researcher; chief scientist at bitly, founder of Fast Forward Labs and Hidden Door.
This thread helped me understand that the outrage about Anthropic's watermarking is the confluence of a lack of understanding of how LLMs (or any statistical language model) works and general angst at the current economics. Quoting @hern.bsky.social If you use Claude right now, then it doesn’t pick the “best” word for a sentence. It creates a distribution of possible words, assesses the probability of any given word fitting the slot, and randomly picks between them based on that probability. LLMs Anthropic Related
Founder of Platformer, a newsletter on tech platforms and the people they affect, and co-host of the Hard Fork podcast at the New York Times.
Engineering leader on Google Chrome; writes about web performance and, lately, about working with AI coding tools.
LLMs
Their words
I remember anytime I would work with a big site on their performance problems, uh you could easily spend half a day, um you know, just looking at traces before you've even written any fixes at all. And now that we have LLMs, it's very quick to like reason through massive stack traces and actually be able to get down to fixes you can make.
Show the whole quote
youtube.com
18 August
US science and technology adviser to the president, director of the White House Office of Science and Technology Policy; previously US chief technology officer and chief operating officer of Scale AI.
LLMs Europe
Their words
have to abide by this rule that was written before LLMs were even a thing. And that shows how challenging sort of the the the situation is if you try to set the line too firm to begin with.
Show the whole quote
youtube.com
17 August
Usability pioneer; co-founder of Nielsen Norman Group and founder of UX Tigers; author of the ten usability heuristics and of Jakob's Law.
15 August
Novelist and writer, author of Mr. Penumbra's 24-Hour Bookstore and Sourdough; previously worked at Twitter and Current TV.
AI research engineer working on large language models. He writes the Ahead of AI newsletter and is the author of Build a Large Language Model (From Scratch).
14 August
Indian software developer and prolific blogger on PHP, Laravel and JavaScript; open-source enthusiast publishing near-daily at amitmerchant.com.
13 August
Web developer and writer; an early GitHub employee, author of speaking.io and of widely read essays on startups and product.
i really can’t fathom what github would have looked like had we had LLMs in 2010. the amount of automation built into hubot was staggering anyway. the company was already being run fly-by-wire. LLMs Related
Co-founder and CTO of Oxide Computer Company. Created DTrace at Sun Microsystems and was CTO of Joyent; blogs about systems software, open source and engineering culture.
Real talk: If you find yourself talking about "software factories", you may be suffering from LLM-induced psychosis LLMs Related
Writer and teacher on productivity and personal knowledge management. Author of Building a Second Brain and founder of Forte Labs, which runs the course of the same name.
LLMs
Their words
HTML is the default format of the Internet, and for that reason comes with a number of built-in advantages that are also useful for LLMs
Show the whole quote
fortelabs.com
12 August
Writer, photographer and software maker based in Japan; publishes long-form essays, walking newsletters and self-made books at craigmod.com.
11 August
Web developer and writer; an early GitHub employee, author of speaking.io and of widely read essays on startups and product.
Bluesky MRI results came back today from a human doc: a herniated disc. Obviously I had tossed the raw scans in to LLMs last week; Opus and Fable missed it, Sol caught it. This is now the gold standard in analyzing performance of frontier models. First step: herniate your back. LLMs Related
x.com MRI results came back today from a human doc: a herniated disc. Obviously I had tossed the raw scans in to LLMs last week; Opus and Fable missed it, Sol caught it. This is now the gold standard in analyzing performance of frontier models. First step: herniate your back. LLMs Related
Software design writer and chief scientist at Thoughtworks; wrote Refactoring and Patterns of Enterprise Application Architecture.
10 August
Theoretical physicist and philosopher, Homewood Professor of Natural Philosophy at Johns Hopkins and fractal faculty at the Santa Fe Institute. Writes the Preposterous Universe blog and hosts the Mindscape podcast.
Writer on the intersection of technology and finance. Author of the Bits about Money newsletter and host of the Complex Systems podcast; previously at Stripe.
One of my accountants, in response to me hitting them with the usual packet of documents, sent back a very obviously LLM drafted list of 10 questions. First thought: What am I paying you for. Second thought: Actually no, my LLM digests your LLM's output into the context window. LLMs Related
Novelist and critic, author of The Body Scout and Metallic Realms; writes the newsletter Counter Craft on fiction craft and the publishing industry.
Sequoia Professor of Computer Science at Stanford, co-director of the Stanford Institute for Human-Centered AI, and co-founder and CEO of World Labs.
Their words
Learning fundamentally respecting the hardware you're talking about takes time, takes effort, sometimes takes some pain. That is just how our brain is.
Show the whole quote
youtube.com
9 August
Standards editor known as Hixie; edited the HTML and WHATWG living standards for many years and worked on Flutter at Google.
8 August
Swedish designer and programmer. Designed early Spotify, worked at Facebook and Figma, and created the Inter typeface.
I’ve been wondering where weird LLM language like this comes from. Much of it I hadn’t seen before LLMs, so —intuitively at least—it doesn’t seem to come from training data. Perhaps it’s reverb; echo in recent corpus from its past self’s attempts..? Another example is “I ran a smoke to explore” (where it means “smoke test” but abbreviates it like a cool teenager) Quoting @geoffreylitt Any writing experts who can explain why this is a weird sentence? LLMs Related
7 August
AI research engineer working on large language models. He writes the Ahead of AI newsletter and is the author of Build a Large Language Model (From Scratch).
Creator of the Keras deep-learning library and the ARC-AGI benchmark.
LLMs
On changing their mind
In the era of base LLM scaling (2022-2024), I believed the LLM line of research would reach a capability plateau (as later seen with base LLMs).
In late 2024, after the o3 test-time compute demo, I changed my views: the new models were showing genuine fluid intelligence, and with this new line of work, the LLM line of research could achieve unbounded capability scaling. "There will be no wall."
Show the whole quote
Creator of the Keras deep-learning library and the ARC-AGI benchmark.
LLMs
Their words
However, looking ahead, I still do not believe that future AI (say, in 15 years) will be based on the LLM stack. I believe it will necessarily have to move closer to its optimal, final form -- symbolic learning. Obviously this is a risky and contrarian belief -- the safe bet would be LRMs. But let's see.
Show the whole quote
@fchollet on X x.com
6 August
General partner at Benchmark Capital for over two decades; was the lead analyst on Amazon's IPO before moving into venture capital. Writes Above the Crowd on tech and marketplace economics.
This industry group is working on an industry standard for how to report AI security incidents. This will drive consistency and transparency and is the safest path forward. Despite 120 members, the large LLM corporations have to-date not signed on. Drives further concern that they are using "breaches" as marketing events - vs wanting to get to true resolution. techcrunch.com
LLMs Related
This industry group is working on an industry standard for how to report AI security incidents. This will drive consistency and transparency and is the safest path forward. Despite 120 members, the large LLM corporations have to-date not signed on. Drives further concern that they are using "breaches" as marketing events - vs wanting to get to true resolution. techcrunch.com
LLMs Related
3 August
Economist at George Mason University. Writes Overcoming Bias on prediction markets, signalling and the far future, and wrote The Age of Em and The Elephant in the Brain.
2 August
Founding member of OpenAI and former director of AI at Tesla; creator of nanoGPT and the term "vibe coding".
We're starting to leave the territory where you'd test an LLM by e.g. "create an svg of pelican on a bicycle". As one idea to generalize it, I was interested what Opus 5 would do if I gave it the first paragraph of the Lord of the Rings, a 1M token budget (~$10) and asked for three js render of it. Opus went off for ~2 hours and wrote 5500 lines of code that (procedurally) rendered the story. It's kind of janky but fun. But it's a bit mindboggling that the LLM has to place and orchestrate various polygon assets in (x,y,z) coordinates and write code that animates it all, and that it even does… LLMs Related
1 August
Software engineer; co-founder and former CTO of Tailscale, previously on the Go team at Google.
I am surprised at how little coverage the LLM transformation of mathematics is getting. Kind of a big deal for those of us who spent (cumulative) months in the university library learning to construct proofs. LLMs Related
31 July
Writes Where's Your Ed At and hosts Better Offline; runs a tech PR firm, and argues at length that the AI business does not add up.
Software developer and entrepreneur; co-founder of Heroku, author of The Twelve-Factor App, and a researcher at Ink & Switch.
Biggest and best @localfirstconf.com yet, IMO! Surprising emergent themes this year: geopolitics and EU digital sovereignty, and strong conflicting emotions on LLM-assisted coding. More: adamwiggins.com
LLMs Related
Co-founder and CEO of Stripe and co-founder of the Arc Institute. Keeps a personal site of reading lists, open questions and notes on scientific progress and how research is funded.
LLMs
Their words
I mean, it's very interesting, right? Because these can prove the Jacobian conjecture, you know, whatever. Uh and so clearly they're capable of these monumental feats. Um but somehow I still haven't read the LLM essay that I found super compelling.
Show the whole quote
youtube.com
30 July
Brazilian software engineer, creator and maintainer of GoReleaser; works on Copilot CLI at GitHub. Writes about tooling and his setup at carlosbecker.com.
29 July
Writer and consultant on formal methods and software correctness; author of Practical TLA+ and Logic for Programmers.
From one piece
Formal methods with Hillel Wayne
3 beliefs, in the piece's order there
LLMs interest rates
Their words
So, it's hard to tell how much of like the loss of the past few years was AI versus the end of like zero interest rate policy and like the post-COVID crash. And I think it's more the latter, but like again, LLMs are still getting better.
Show the whole quote
Formal methods with Hillel Wayne youtube.com
LLMs
Their words
I think this project and writing about it and thinking about it has firmly moved me from the camp of we are definitely not to we probably are.
Show the whole quote
Formal methods with Hillel Wayne youtube.com
LLMs
Their words
As a general thing we've seen like to get good results you have to already know how to get good results without it. It just helps you get good results faster.
Show the whole quote
Formal methods with Hillel Wayne youtube.com
28 July
Pseudonymous writer; posts careful, funny investigations of everyday questions — air quality, seed oils, arguing, chess — usually by reading the studies.
On a near-daily basis I get emails offering to pay for "sponsored articles" or for linking to sketchy crypto/casino sites. I guess everyone gets these? Search engines surely prohibit this, but does it get your content removed from LLM training? LLMs crypto Related
23 July
Writer and illustrator, author of Am I There Yet? and Out of the Blue; writes the newsletter Out of the Blue on grief, joy and everyday attention.
Free software developer; maintainer of sway, wlroots, aerc and scdoc, and founder of the SourceHut (sr.ht) software forge.
AI in Linux The role of AI tools (LLMs, mainly) in Linux is under discussion, or it was, until Linus Torvalds “put his foot down” in support of the use of AI in Linux kernel development. I can identify two major ways in which AI is…
Linux LLMs Related
22 July
Writer and teacher on productivity and personal knowledge management. Author of Building a Second Brain and founder of Forte Labs, which runs the course of the same name.
From one piece
Finding Alpha: What’s Worth Consuming in the Age of AI
2 beliefs, in the piece's order there
LLMs
Their words
But for LLMs, it shows that they have no skin in the game and will never take a stand for what they believe in regardless of what it costs. They are perspective generators, not perspective holders.
Show the whole quote
fortelabs.com
LLMs
Their words
They've given us broad, passive exposure to the market average, but at the cost of suppressing upside
Show the whole quote
fortelabs.com
21 July
Founding member of OpenAI and former director of AI at Tesla; creator of nanoGPT and the term "vibe coding".
One pattern I find useful for working with LLMs is a nice long ramble session. Sometimes the LLM needs more bits to understand what you're trying to achieve, but you're too lazy to type them. In these cases I like to lean back, switch to /voice and just ramble for like 10 minutes, total mess, anything goes, full stream of consciousness. Sometimes I declare it up top, something like "switching to speech recognition sorry for any typos...". Sometimes I turn it into a small interview of a few turns. But I find that the LLMs are somehow very good at reconstructing long incoherent rambles and ofte… LLMs Related
20 July
Founder and editor-in-chief of MacStories, writing about Apple software, iPad workflows and automation since 2009. He co-hosts the AppStories podcast.
Bluesky I'm not exaggerating when I say that this is the most impressive iOS app I've seen in a long time. Open Minis is an iOS agent app that combines LLMs with native Apple frameworks – dozens of them – and gives us a glimpse of Siri AI for power users today. My story: macstories.net
LLMs Related
Mastodon I'm not exaggerating when I say that this is the most impressive iOS app I've seen in a long time. Open Minis is an iOS agent app that combines LLMs with native Apple frameworks – dozens of them – and gives us a glimpse of Siri AI for power users, today. My story: macstories.net
LLMs Related
18 July
AI research engineer working on large language models. He writes the Ahead of AI newsletter and is the author of Build a Large Language Model (From Scratch).
Software engineer writing about maintenance, open source and the industrial reality of software — the author of "I am not a supplier".
16 July
Non-fiction writer, podcaster and occasional TV host. Author of thirteen books including The Ghost Map, Where Good Ideas Come From and Extra Life, host of the PBS series How We Got To Now, and author of the Adjacent Possible newsletter on innovation.
15 July
Founder of HumanLayer; wrote 12-Factor Agents, on how to build AI agents that hold up in production.
14 July
Software design writer and chief scientist at Thoughtworks; wrote Refactoring and Patterns of Enterprise Application Architecture.
DSLs Enable Reliable Use of LLMs LLMs generate code incredibly fast, but to ensure they generate exactly what is intended, they need clear boundaries. Abstractions and Domain-Specific Languages (DSLs) provide a strong harness that guides LLMs right fro…
LLMs Related
12 July
Programmer; founded comma.ai and tinygrad, and was the first to unlock the iPhone.
I love LLMs, I hate hype I think from this blog you may misunderestimate how absolutely giddy I am about AI. I did hacking from 2007-2014, after that my whole career has been devoted to AI. I love the progress. I’m so excited for the new LLMs,…
LLMs Related
10 July
Programmer and writer known for detailed source code reviews of classic game engines, and author of the Game Engine Black Book series on Wolfenstein 3D and DOOM.
From one piece
Don't you mean extinct?
2 beliefs, in the piece's order there
8 July
Mathematician at UCLA, working mainly in harmonic analysis and partial differential equations. Writes What's new, a long-running blog on their research, open problems and expository notes.
LLMs
Their words
However, these LLM reasoners that generate informal reasoning in natural language are fundamentally limited by the lack of precise, machine-checkable semantics, making their outputs prone to hallucinations [Huang et al., 2025b] and precluding autonomous verification, a prerequisite for tackling open-ended mathematical research.
Show the whole quote
arxiv.org
7 July
Machine learning engineer and consultant focused on RAG and retrieval systems. He writes about applied AI engineering at jxnl.co and is the author of the instructor library.
Co-founder and CTO of Honeycomb; previously an infrastructure engineer at Parse, Facebook and Linden Lab, and co-author of Observability Engineering.
Go read this post from Mat Duggan right now -- "@ClickhouseDB is Winning the Observability Wars". Go! I'll wait. https://t.co/LOsYeGNUJH "Every other observability backend I've worked with mutates as it grows... ClickHouse at 10 TB a day looks like ClickHouse at 1 TB a day with more shards. That's it. That's the pitch. That's the whole reason I'm writing this." Duggan's piece is a riot from start to finish. He talks you through all the pain of scaling Elastic, LGTM, and Datadog, and shows why a little tiny bit of upfront effort buys you SO MUCH EASE down the road, as you scale indefinitely. W… Related
4 July
Programmer and writer on computer architecture, performance, and software reliability. He has worked on CPU design at Centaur Technology and on software at Google and Microsoft, and writes long-form technical essays at danluu.com.
3 July
Programmer and writer on computer architecture, performance, and software reliability. He has worked on CPU design at Centaur Technology and on software at Google and Microsoft, and writes long-form technical essays at danluu.com.
Staff writer at The New Yorker, where he writes the Infinite Scroll column, and author of Filterworld and The Longing for Less.
They are actively working against the generic tendency of the model! Demand a “distinctive point of view” from the LLM lol Quoting @mattstromawn Given @chaykak's column last week, i'm not surprised to see the latest changes to @AnthropicAI's official frontend design skill/plugin LLMs Related
30 June
Mathematician and maker of the 3Blue1Brown YouTube channel, which explains mathematics through animation. Creator of the open-source Manim animation library and founder of the Summer of Math Exposition.
From one piece
Grant Sanderson (@3blue1brown) – AI disproved a famous math conjecture. Now what?
2 beliefs, in the piece's order there
Their words
And so having anything that's able to give you that green check mark that says even if this is going to be complicated to understand, even if it's going to be a pain, you at the very least know it is correct. Like every other field would kill for that, right?
Show the whole quote
youtube.com
LLMs Google
Their words
So in that sense basically using it like a very souped-up version of Google on like zero in on the right human written resource.
Show the whole quote
youtube.com
27 June
AI research engineer working on large language models. He writes the Ahead of AI newsletter and is the author of Build a Large Language Model (From Scratch).
25 June
Canadian bootstrapper and writer on small software businesses. Co-founder of the podcast hosting company Transistor.fm and author of the book Marketing for Developers.
24 June
Makes NeetCode, the structured practice list and video walkthroughs people use to prepare for coding interviews; a former Google engineer.
23 June
Founding member of OpenAI and former director of AI at Tesla; creator of nanoGPT and the term "vibe coding".
This is a new paradigm for interacting with Claude that is significantly more "inline" with all the other human activity org-wide. Once you do all of the under the hood engineering work to make this "just work" (e.g. across tools, integrations, compute environments, memory, security, etc.), Claude basically joins the team in a seamless way - you can talk to it as you would talk to a person and it can help with a very large variety of workloads. Imo this is the 3rd major redesign of LLM UIUX. The first paradigm was that the LLM is a website you go to, the second was that it is an app you downl… Quoting @claudeai Introducing Claude Tag, a new way for teams to work with Claude. In Slack, Claude joins as a team member with access to the channels and tools you choose. Tag Claude in and delegate tasks to it while you focus on other work. LLMs Anthropic Related
Cryptography engineer; maintains Go's cryptography libraries as a full-time open-source maintainer, funded directly by companies that use them.
21 June
Freelance climate and energy analyst in Oslo, writing on Europe, the US and Australia; worked in the Australian renewables industry before that.
LLMs energy
Their words
Generative AI has no internal, designed momentum towards truth and accuracy (beyond the absurdly diminishing returns of energy-hungry multi-layered LLMs), but a person or an institution can (and should).
Show the whole quote
ketanjoshi.co
18 June
Data scientist and machine-learning researcher; chief scientist at bitly, founder of Fast Forward Labs and Hidden Door.
It feels like no matter what I've accomplished in my career, my current most valuable talent is that if you locked me in a desert cave with a computer and some GPUs I could Iron Man the shit out of that and emerge with a functional LLM using just what's in my own head. And that's really funny. LLMs Related
15 June
Writes Strange Loop Canon, on the intersection of technology, economics and business — "building models of the world to understand these problem areas and to define them better".
Systems and developer-tools engineer at Cloudflare as of 2026, on durable infrastructure for AI agents; worked on React and PartyKit before that. Writes at sunilpai.dev.
9 June
General partner at Benchmark Capital for over two decades; was the lead analyst on Amazon's IPO before moving into venture capital. Writes Above the Crowd on tech and marketplace economics.
LLMs
Their words
We do live in a world where information is really cut up, but we also live in a world where you can have access to more information than you ever could. And that's even more true now with LLMs.
Show the whole quote
youtube.com
7 June
Creator of the iPod and co-creator of the iPhone at Apple, founder of Nest, and author of Build.
Their words
And so, I always kind of start with okay, where's our current pain and are there new technologies to solve that pain?
Show the whole quote
youtube.com
Founded CD Baby in 1998 and sold it in 2008, giving the proceeds to a charitable trust for music education. Since then a writer and speaker: five books and 550+ articles, published first at sive.rs, which they hand-code and keep free of advertising.
Their words
OpenRouter via llm in the terminal
Show the whole quote
sive.rs
6 June
Novelist and critic, author of The Body Scout and Metallic Realms; writes the newsletter Counter Craft on fiction craft and the publishing industry.
AI research engineer working on large language models. He writes the Ahead of AI newsletter and is the author of Build a Large Language Model (From Scratch).
5 June
Neuroscientist and novelist writing on consciousness, artificial intelligence and culture in the newsletter The Intrinsic Perspective.
Front-end developer and writer on Svelte, Vue, CSS and WordPress; blogs at joshcollinsworth.com.
4 June
Former L8 engineer at Meta, Microsoft and Atlassian, now writing and building solo on agentic engineering. Writes Kun's Field Notes and posts a lot about AI coding agents on X.
2 June
Writer of the blog Putanumonit and the newsletter Second Person, on rationality, dating and probability; based in New York.
From one piece
By Chains or by Promises
2 beliefs, in the piece's order there
Software engineer at PlanetScale and creator of the vim-go plugin. Writes at arslan.io about Go, tooling, industrial design and books.
30 May
Writer and former Substack product manager; publishes essays and interviews on technology, culture and China at jasmi.news.
I think "being real with yourself" is the most underrated cognitive skill for the AI age — AI makes it too easy to lie to yourself: to self-congratulate for the illusion of thinking, productivity, etc. But you gotta actually know: Am I being more productive, or just tokenmaxxing? Am I upskilling myself with AI, or letting it do the hard part for me? Does my essay/business/product idea make sense, or did I let an LLM convince me it does? Then you won't need hard rules like “always/never use AI for X.” If you pay attention and avoid self-deception, you'll be able to *feel* when you are doing re… LLMs Related
28 May
Systems and developer-tools engineer at Cloudflare as of 2026, on durable infrastructure for AI agents; worked on React and PartyKit before that. Writes at sunilpai.dev.
27 May
Senior economist at the Foundation for American Innovation; writes Second Best, and was the Niskanen Center's director of social policy before that.
Member of technical staff at Anthropic. He has led ML/AI teams at Amazon, Alibaba and Lazada, and writes about LLMs, recommender systems and engineering at eugeneyan.com.
25 May
Programmer; wrote Redis and hping, and blogs about C, systems programming and working alone.
Distributing LLM inference in DwarfStar High end NVIDIA cards, and the server and power needed to run them, cost a lot of money, especially if you plan to reach enough VRAM to run massive models. The alternative, so far, has been Apple hardware, or the DGX Sp…
LLMs Related
21 May
Software engineer and engineering leader at Canonical, working on Ubuntu; writes about his homelab, Nix and tooling at jnsgr.uk.
19 May
Novelist and critic, author of The Body Scout and Metallic Realms; writes the newsletter Counter Craft on fiction craft and the publishing industry.
Founding member of OpenAI and former director of AI at Tesla; creator of nanoGPT and the term "vibe coding".
Personal update: I've joined Anthropic. I think the next few years at the frontier of LLMs will be especially formative. I am very excited to join the team here and get back to R&D. I remain deeply passionate about education and plan to resume my work on it in time. LLMs Anthropic Related
Programmer; wrote Redis and hping, and blogs about C, systems programming and working alone.
Alternatives for the EDIT tool of LLM agents EDIT: of course this was already done in the past! I had little doubts but people just confirmed me about it on Twitter :) But, keep reading: the CRC32 compromise at the end is an interesting tradeoff, and this is a goo…
LLMs Related
18 May
Machine learning engineer working on recommender systems, personalization and information retrieval. Previously worked on LLMs and LLM infrastructure at Mozilla.ai and on ML and recsys at Duo, Tumblr, Automattic and Comcast; wrote the 'What are embeddings?' text and ran the Normconf conference.
Tagging my blog posts with BERTopic and LLMs I recently added tags to my blog using BERTopic and a mix of LLMs. You can see the tags in the sidebar to the right (or in the footer on mobile). I’ve done this before in 2023, with GGUF Mistral using llama-cpp, b…
LLMs Related
16 May
AI research engineer working on large language models. He writes the Ahead of AI newsletter and is the author of Build a Large Language Model (From Scratch).
15 May
Free software developer; maintainer of sway, wlroots, aerc and scdoc, and founder of the SourceHut (sr.ht) software forge.
11 May
Founding member of OpenAI and former director of AI at Tesla; creator of nanoGPT and the term "vibe coding".
This works really well btw, at the end of your query ask your LLM to "structure your response as HTML", then view the generated file in your browser. I've also had some success asking the LLM to present its output as slideshows, etc. More generally, imo audio is the human-preferred input to AIs but vision (images/animations/video) is the preferred output from them. Around a ~third of our brains are a massively parallel processor dedicated to vision, it is the 10-lane superhighway of information into brain. As AI improves, I think we'll see a progression that takes advantage: 1) raw text (hard… LLMs Related
27 April
JavaScript programmer; creator of the jQuery library, author of Secrets of the JavaScript Ninja, and long-time engineer at Khan Academy.
An amusing side effect of using LLMs when working at @khanacademy is that occasionally they're like "You're trying to cheat, aren't you?? No cheating allowed!!" (Clearing the chat and using more authority usually works well!) LLMs Related
Founded CD Baby in 1998 and sold it in 2008, giving the proceeds to a charitable trust for music education. Since then a writer and speaker: five books and 550+ articles, published first at sive.rs, which they hand-code and keep free of advertising.
Bluesky My favorite LLM prompt: “List the top cities in {COUNTRY}, and anthropomorphize each one, listing the good-natured stereotypes and jokes that other people in {COUNTRY} say about people in this city.” LLMs Related
x.com My favorite LLM prompt: “List the top cities in {COUNTRY}, and anthropomorphize each one, listing the good-natured stereotypes and jokes that other people in {COUNTRY} say about people in this city.” LLMs Related
24 April
Writes Strange Loop Canon, on the intersection of technology, economics and business — "building models of the world to understand these problem areas and to define them better".
22 April
Researcher on distributed systems and local-first software at the University of Cambridge; wrote Designing Data-Intensive Applications.
From one piece
Designing Data-intensive Applications with Martin Kleppmann
2 beliefs, in the piece's order there
LLMs
Their words
One is that the LLMs are getting increasingly good at writing these proofs. And if we don't have to write the proof by hand as humans, it just becomes feasible to do them in situations where previously it would have not been economical.
Show the whole quote
youtube.com
LLMs
Their words
But also LLMs increase the need for these formal proofs because, you know, we're live coding a bunch of stuff. If we have to manually review all of that code, then that will become the bottleneck.
Show the whole quote
youtube.com
18 April
AI research engineer working on large language models. He writes the Ahead of AI newsletter and is the author of Build a Large Language Model (From Scratch).
10 April
AI research engineer working on large language models. He writes the Ahead of AI newsletter and is the author of Build a Large Language Model (From Scratch).
4 April
AI research engineer working on large language models. He writes the Ahead of AI newsletter and is the author of Build a Large Language Model (From Scratch).
2 April
Co-founder of Ethereum. Publishes long essays on mechanism design, governance and what cryptography is for, and returns to earlier positions to say which parts they no longer hold.
Co-founder of Ethereum. Publishes long essays on mechanism design, governance and what cryptography is for, and returns to earlier positions to say which parts they no longer hold.
Their words
Its responses are, in my view, pretty bland and not very high-quality. I did a side-by-side test of asking Local Deep Research a question, then asking pi the same question (telling it to use searxng to make as many internet searches as needed), and I fed both outputs into an LLM to ask which is better.
Show the whole quote
vitalik.eth.limo
Their words
Sandboxing To keep my LLMs in check, I do most of my LLM usage from inside of a sandbox. I use bubblewrap for this.
Show the whole quote
vitalik.eth.limo
31 March
Novelist and critic, author of The Body Scout and Metallic Realms; writes the newsletter Counter Craft on fiction craft and the publishing industry.
28 March
Founding member of OpenAI and former director of AI at Tesla; creator of nanoGPT and the term "vibe coding".
LLMs
Their words
The LLMs may elicit an opinion when asked but are extremely competent in arguing almost any direction. This is actually super useful as a tool for forming your own opinions, just make sure to ask different directions and be careful with the sycophancy.
Show the whole quote
@karpathy on X x.com
25 March
Austrian developer. Created the libGDX game framework, and more recently the pi coding agent, which moved with them to Earendil — Armin Ronacher's company — in April 2026. Writes at mariozechner.at.
From one piece
Thoughts on slowing the fuck down
2 beliefs · mariozechner.at
Founding member of OpenAI and former director of AI at Tesla; creator of nanoGPT and the term "vibe coding".
LLMs
Their words
One common issue with personalization in all LLMs is how distracting memory seems to be for the models. A single question from 2 months ago about some topic can keep coming up as some kind of a deep interest of mine with undue mentions in perpetuity.
Show the whole quote
@karpathy on X x.com
23 March
Writer and former Substack product manager; publishes essays and interviews on technology, culture and China at jasmi.news.
22 March
Software engineer; co-founder and former CTO of Tailscale, previously on the Go team at Google.
21 March
Programmer on the Dart language at Google and author of Game Programming Patterns and Crafting Interpreters; previously a game developer at EA.
I've read so many articles in the past year from developers talking about how much more productive LLMs have made them at work. You know what I can't recall a single one of them mentioning? Getting a raise because of it. LLMs Related
Writer, photographer and software maker based in Japan; publishes long-form essays, walking newsletters and self-made books at craigmod.com.
[RODEN] Meditation, Language, and LLMs Roden Readers — Hello! It’s me, Craig Mod. Author of TBOT (amzn | bkshp). Poking my head out into newsletter land. This? Roden, a newsletter you signed up for at some point. Perhaps last week, perhaps fourteen years ago…
LLMs Related
20 March
Novelist and critic, author of The Body Scout and Metallic Realms; writes the newsletter Counter Craft on fiction craft and the publishing industry.
Founding member of OpenAI and former director of AI at Tesla; creator of nanoGPT and the term "vibe coding".
LLMs
Their words
a swarm of agents on the internet could collaborate to improve LLMs and could potentially even like run circles around frontier labs. Like who knows, you know? Um yeah, like maybe that's even possible. Like frontier labs have a huge amount of trusted compute but the earth is much bigger and has huge amount of untrusted compute.
Show the whole quote
youtube.com
18 March
Novelist and critic, author of The Body Scout and Metallic Realms; writes the newsletter Counter Craft on fiction craft and the publishing industry.
Pseudonymous writer; posts careful, funny investigations of everyday questions — air quality, seed oils, arguing, chess — usually by reading the studies.
14 March
Canadian bootstrapper and writer on small software businesses. Co-founder of the podcast hosting company Transistor.fm and author of the book Marketing for Developers.
13 March
Systems and developer-tools engineer at Cloudflare as of 2026, on durable infrastructure for AI agents; worked on React and PartyKit before that. Writes at sunilpai.dev.
11 March
Writer and illustrator, author of Am I There Yet? and Out of the Blue; writes the newsletter Out of the Blue on grief, joy and everyday attention.
10 March
Writer and consultant on formal methods and software correctness; author of Practical TLA+ and Logic for Programmers.
3 March
Programmer and designer who writes at tonsky.me; author of Fira Code, DataScript and AnyBar.
1 March
Programmer; wrote Redis and hping, and blogs about C, systems programming and working alone.
25 February
Creator of Claude Code at Anthropic.
LLMs Anthropic startups
Their words
At Anthropic, we don't build for the model of today, we build for the model of six months from now. And that's still my advice to founders that are building on LLMs.
Show the whole quote
x.com
23 February
Founder and CEO of Wolfram Research, creator of Mathematica and Wolfram|Alpha, and author of A New Kind of Science.
19 February
Founded Bridgewater Associates in 1975 and led it until stepping back from control in 2022. Author of Principles, The Changing World Order and How Countries Go Broke; publishes economic analysis at economicprinciples.org.
17 February
Programmer based in Vancouver who writes at scattered-thoughts.net about databases, programming language design and developer tools; author of the Imp, Dida and Zest language experiments.
LLMs energy
Their words
Both estimates make me think that the concern about global energy demand for LLMs is over-blown.
Show the whole quote
scattered-thoughts.net
8 February
Software engineer; co-founder and former CTO of Tailscale, previously on the Go team at Google.
Eight more months of agents 2026-02-08 I wrote up my experiences programming with LLMs a bit over a year ago, and updated it for the world of agents eight months ago. A lot has changed since then, so here is an update. Agents have improved dramati…
LLMs Related
1 February
Hosts the Lex Fridman Podcast — long, unhurried conversations with scientists, engineers and public figures. Several of the interviews quoted elsewhere on this site are episodes of it.
27 January
Programmer and writer; co-wrote The Rust Programming Language and worked on Rust's documentation for years.
25 January
Founder of WP Engine and Smart Bear; writes A Smart Bear, long essays on strategy, pricing and how startups actually fail.
LLMs
Their words
if you think about it, it sort of makes sense because the LLM is an averaging machine, right? It's predicting the most likely that's an averaging kind of a thing. And so when what you're looking for is a kind of average, it's usually pretty good. So, summarization, topics, themes. But when you're asking for like what is interesting and not average, it's actually pretty bad at it.
Show the whole quote
youtube.com
15 January
Neuroscientist and novelist writing on consciousness, artificial intelligence and culture in the newsletter The Intrinsic Perspective.
1 January
Mac and iOS developer at the Iconfactory, where he has worked on apps including Twitterrific and Tot. He writes about development at furbo.org.
Professor of Cognitive and Computational Neuroscience at the University of Sussex, co-director of the Sussex Centre for Consciousness Science, and author of Being You: A New Science of Consciousness.
31 December 2025
Co-creator of Django and creator of Datasette; writes daily at simonwillison.net.
Their words
One of my favourite pieces on LLM security this year is The Normalization of Deviance in AI by security researcher Johann Rehberger.
Show the whole quote
simonwillison.net
23 December 2025
Designer and technologist; author of The Laws of Simplicity; former president of the Rhode Island School of Design; formerly at the MIT Media Lab.
20 December 2025
Programmer; wrote Redis and hping, and blogs about C, systems programming and working alone.
Reflections on AI at the end of 2025 * For years, despite functional evidence and scientific hints accumulating, certain AI researchers continued to claim LLMs were stochastic parrots: probabilistic machines that would: 1. NOT have any representation about…
LLMs Related
19 December 2025
Founding member of OpenAI and former director of AI at Tesla; creator of nanoGPT and the term "vibe coding".
Founding member of OpenAI and former director of AI at Tesla; creator of nanoGPT and the term "vibe coding".
Their words
Claude Code (CC) emerged as the first convincing demonstration of what an LLM Agent looks like - something that in a loopy way strings together tool use and reasoning for extended problem solving.
Show the whole quote
karpathy.bearblog.dev
10 December 2025
Founding member of OpenAI and former director of AI at Tesla; creator of nanoGPT and the term "vibe coding".
5 December 2025
American author of The Subtle Art of Not Giving a F*ck and Everything Is F*cked. Writes essays and book reviews at markmanson.net.
Their words
Because when you believe in something, when you become obsessed with something, you sacrifice yourself to it. And that sacrifice actually feels like pain and stress and doubt. Not fun.
Show the whole quote
markmanson.net
23 November 2025
Member of technical staff at Anthropic. He has led ML/AI teams at Amazon, Alibaba and Lazada, and writes about LLMs, recommender systems and engineering at eugeneyan.com.
From one piece
Product Evals in Three Simple Steps
2 beliefs, in the piece's order there
Member of technical staff at Anthropic. He has led ML/AI teams at Amazon, Alibaba and Lazada, and writes about LLMs, recommender systems and engineering at eugeneyan.com.
22 November 2025
Founding member of OpenAI and former director of AI at Tesla; creator of nanoGPT and the term "vibe coding".
Austrian developer. Created the libGDX game framework, and more recently the pi coding agent, which moved with them to Earendil — Armin Ronacher's company — in April 2026. Writes at mariozechner.at.
18 November 2025
Founding member of OpenAI and former director of AI at Tesla; creator of nanoGPT and the term "vibe coding".
17 November 2025
Founding member of OpenAI and former director of AI at Tesla; creator of nanoGPT and the term "vibe coding".
Nothing matches. Show everything
A korrent is a belief a person has stated in their own words: one
sentence stating the claim, backed by a quote and a source, kept at
korrents.com .
Under a name here, the quoted block is what they actually said.
The korrent beneath it is the claim those words support, in
korrents' wording — tap it to see the record, its source, and who
else holds it.
Nobody here wrote their own korrents. They are compiled from public
statements, and a person can change their mind, which is recorded too.
Got it
About the English under a post
Some people here publish in a language other than English. Where they
do, this site shows a machine translation beneath the post, in
this typeface — the site's own, not theirs.
The post itself is never changed, moved or hidden: what is set in the
serif above is exactly what the person published, and it is what to
quote them on. A translation can be wrong in ways that matter,
especially about tone.
Only the post's own words are translated. A quoted post, a linked
article and a belief on korrents.com
are left in their original language.
Got it