Related posts
Thomas Wolf
Bluesky
Wow - open-source LLMs for code are so back Just one week after the latest DeepSeek release, here is the All-Hands team dropping a 32B model with matching performance on software engineering tasks benchmarks (SWE-Bench). 20 times smaller than the DeepSeek model --
LLMs benchmarks bench
The subjects this post names, from the same vocabulary
the directory files beliefs under, and the word it uses that this site has seen
least often elsewhere. Posts are matched on those words alone —
nothing here is a summary of this one.
Sources
All Writing GitHub Blog x.com Bluesky Korrents Mastodon Site Newsletter Recommends Changed their mind YouTube Podcast Papers
Top people
Sebastian Raschka
Simon Willison
Lincoln Michel
Andrej Karpathy
Daniel Lemire
Kun Chen
Hillel Wayne
Zach Holman
François Chollet
Dan Luu
Noam Brown
Armin Ronacher
Showing Profile →
Show everything
Hiding Show them again
Show them again
Further back ↓
Hiding Show them again
20 September
Co-creator of Django and creator of Datasette; writes daily at simonwillison.net.
Computer science professor who works on fast data processing; co-author of the simdjson parser and a weekly blogger about software performance since 2004.
Italian software architect working on Microsoft 365, Azure and GitHub tooling. Microsoft MVP and GitHub Star; writes, speaks and streams about developer productivity at emanuelebartolesi.com.
Former L8 engineer at Meta, Microsoft and Atlassian, now writing and building solo on agentic engineering. Writes Kun's Field Notes and posts a lot about AI coding agents on X.
Working on @ampcode. Writing registerspill.thorstenball.com. Once authored interpreterbook.com and compilerbook.com.
Jev is a confetti bomb that makes the LLM landscape look grey. Wrote about why I find it so fascinating in this week's intro. LLMs Related
Software engineer and educator; creator of Testing Library and of the EpicWeb.dev and EpicReact.dev courses.
Computer science professor who works on fast data processing; co-author of the simdjson parser and a weekly blogger about software performance since 2004.
19 September
Co-creator of Django and creator of Datasette; writes daily at simonwillison.net.
Economist; former chief economist of the International Monetary Fund.
Reason for specifically citing open weight (and therefore Chinese LLMs, but not only Chinese) is that, even if they have built-in guardrails, somebody with the relevant knowledge can go in and remove them. In principle, harder to do with Anthropic or Open AI LLMs. Quoting @ojblanchard1 A worrisome thought during the night: What Ted Kaczynski would have done, if he had had access to open weight chinese LLMs. LLMs Anthropic Related
Machine-learning researcher on open language models; writes the Interconnects newsletter and the RLHF Book, after leading post-training at Ai2.
Seems like one of the most important research problems for CS academics is llm-supervised peer review. If we don’t solve it the academic institutions are toast. It seems easier than building new institutions. LLMs Related
Economist; former chief economist of the International Monetary Fund.
A worrisome thought during the night: What Ted Kaczynski would have done, if he had had access to open weight chinese LLMs. LLMs China Related
Machine-learning researcher on open language models; writes the Interconnects newsletter and the RLHF Book, after leading post-training at Ai2.
18 September
Co-creator of Django and creator of Datasette; writes daily at simonwillison.net.
Founder and CEO of Get Lighthouse, a management-coaching software company, and previously a product lead at KISSmetrics. Writes about leadership, management and product at jasonevanish.com.
I don't think how Vibe Coding changes things for marketers gets talked about enough. So much of marketing used to be rationed, begging for engineering resources to get things done. Now you can hop in your IDE and ask your LLM to make the changes and see them done within the same hour. I run the @QAwithIto blog and have: - Designed & shipped my own custom floating social share buttons just how I want them - Fixed a bug with our custom HackerNews share button so it turns into an upvote button after someone submits the post - Added custom URLs and image widths to post images as new fields in San… LLMs Related
Co-creator of Django and creator of Datasette; writes daily at simonwillison.net.
Being a computer scientist who refuses to find anything about LLMs interesting right now is a bit like being a geneticist who refuses to find anything interesting about the recently opened Jurassic Park LLMs Related
Distributed-systems safety researcher; runs the Jepsen consistency-testing project and wrote the Riemann monitoring system.
From a talk I gave at an Antithesis meetup in NYC, thoughts on software quality in the age of LLMs. youtube.com
LLMs Related
Sociologist at Duke University writing on markets, exchange and moral order, and on plain-text and data-visualisation tools for social science.
Life with the smaller sort of Large Language Model. LLMs Related
Security engineer; founder of Matasano Security and Latacora.
LLMs
Their words
The most common pushback I'm getting to this post is that taking this kind of feedback from an LLM is going to bleach out your style just like having the model generate the text, because models can't be trusted with "style". No.
Show the whole quote
@tqbf on X x.com
Co-creator of Django and creator of Datasette; writes daily at simonwillison.net.
Creator of Flask and Jinja. Writes about software at lucumr.pocoo.org.
LLMs
Their words
I stopped replying almost entirely to my replies on my own Tweets because I expect all of them to just be LLM slop.
Show the whole quote
@mitsuhiko on X x.com
17 September
Writer of kottke.org, one of the oldest blogs on the web, published since 1998 and supported by its members. He writes about art, technology, science, design and visual culture.
AI research engineer working on large language models. He writes the Ahead of AI newsletter and is the author of Build a Large Language Model (From Scratch).
Mathematician at UCLA, working mainly in harmonic analysis and partial differential equations. Writes What's new, a long-running blog on their research, open problems and expository notes.
Software design writer and chief scientist at Thoughtworks; wrote Refactoring and Patterns of Enterprise Application Architecture.
Founder of the Free Software Movement and the GNU Project, original author of GNU Emacs and the GNU General Public License, and long-time president of the Free Software Foundation.
Supposed Intelligence safety The companies that develop Supposed Intelligence (specifically, LLMs) want us to put them in charge of making the systems "safe", by giving them absolute control over what the systems will do (and what they won't do). T…
LLMs Related
Working on @ampcode. Writing registerspill.thorstenball.com. Once authored interpreterbook.com and compilerbook.com.
Very impressed by the TypeSafe/Jev onboarding. They knew they needed to overcome the question of "wait, so it's not an LLM?" and then threw everything at it. Really good. LLMs Related
Co-creator of Django and creator of Datasette; writes daily at simonwillison.net.
From one piece
How To Write With An LLM
2 beliefs · simonwillison.net
Creator of Flask and Jinja. Writes about software at lucumr.pocoo.org.
LLMs
Their words
It also fits so perfectly well for so many applications where traditional LLMs so far were just not viable for either speed or cost reasons.
Show the whole quote
@mitsuhiko on X x.com
16 September
Writer and consultant on formal methods and software correctness; author of Practical TLA+ and Logic for Programmers.
Co-founder of Superlogical, started in 2026 to build server-side terminal infrastructure; creator of Ghostty. Co-founded HashiCorp and created Vagrant and Terraform before that.
The "whiteboard defense:" I should be able to pull you aside at any moment and ask you to explain any customer-facing system you've shipped. You should be able to clearly explain how it works and defend the decisions you made. This is my benchmark for responsible AI usage. I don't expect line-level familiarity with the code. I don't care if you remember the exact function name or implementation detail. You may not even know it. I don't care. But if I ask "why did you do X instead of Y?", "what happens if this actor behaves maliciously?", "what data structure did you use here and why?", or "wh… benchmarks Related
Security engineer; founder of Matasano Security and Latacora.
LLMs
Their words
you can't use a single word the LLM selects for you, even if it's better than your own; users detect LLM words in the parts per trillion.
Show the whole quote
@tqbf on X x.com
15 September
Machine learning engineer and independent AI consultant. He writes about LLM evaluation, tooling and applied ML at hamel.dev, and previously worked on machine learning at GitHub.
Just updated our AI evals FAQ with 5 new questions, 48 questions & answers total! New FAQs just added: - Do I need a reference answer or rubric before annotating data? - How can I do evals when traces contain sensitive data? - How do you review a trace that is really large? - How much context should I give a LLM judge? - What should I do when my “gold” eval dataset becomes stale? It's all here: hamel.dev
LLMs Related
Front-end web developer at Paravel and co-host of the ShopTalk Show podcast; blogs at daverupert.com.
I duct taped a uzi to a bunch of Large Language Models and instructed them how to be very good at blastin' people with an uzi and I think AI is going to destroy humanity. LLMs Related
AI research engineer working on large language models. He writes the Ahead of AI newsletter and is the author of Build a Large Language Model (From Scratch).
Some food for thought when designing benchmarks... So, here's a little computer-use (visual) comparison between GPT-5.6 Astra and Qwen3.8 Max. The task here was to recreate the image in the center using the Paint UI. Super interesting how the two different LLMs+Harnesses approached this totally differently by default. I.e., Astra tried to approach this by drawing and layering geometric shapes. Qwen approached this pixel by pixel. (Of course, the pixel-by-pixel result looks closer to the original, it's essentially a low-res version of that by nature.) So, the Qwen-generated image would surely… LLMs OpenAI Related
Writer and former McKinsey/BCG strategy consultant; author of The Pathless Path and Good Work, about leaving the default career track. Publishes the Boundless newsletter and podcast.
I am very bullish on memoirish writing. No one wants generic how to writing anymore. You’re indistinguishable from an LLM Quoting @p_millerd This is 100% the right thing to do The number one thing people say about my books is that they love reading my honest personal reflections. It enables them to connect to it If you water it down to pure ideas maybe you can crush a mass market but no one will connect with it LLMs Related
Sociologist at Duke University writing on markets, exchange and moral order, and on plain-text and data-visualisation tools for social science.
Targeted flattery-spam/phishing aimed at harmless academics like me is leveling up! Book Club rubbish is so last month. Thanks, LLMs! I just got a highly elaborate six-paragraph one “from” Emily St John Mandel (of Station Eleven fame). The choice of author to impersonate is really quite clever. Like the book club spam, it’s trawling for somewhat vain people who are susceptible to flattery, which of course excludes academic authors [puts hand to ear] sorry I’m just getting an update LLMs Related
Technology writer of Spyglass, a newsletter about technology and media. Previously a reporter at TechCrunch and an investor at GV.
14 September
Web developer and writer; an early GitHub employee, author of speaking.io and of widely read essays on startups and product.
Bluesky Still really enjoying Muse. I use Things.app for all of my todos, and though it has cloud sync they (still) haven’t added an official API. I told muse to build it and a minute or two later I have ongoing todo sync from my LLM across all my Apple devices. Wild. LLMs Related
x.com Still really enjoying @muse. I use https://t.co/t18YazaYhC for all of my todos, and though it has cloud sync they (still) haven’t added an official API. I told muse to build it and a minute or two later I have ongoing todo sync from my LLM across all my Apple devices. Wild. LLMs Related
Computer science professor who works on fast data processing; co-author of the simdjson parser and a weekly blogger about software performance since 2004.
Apple design its own chips for its phones. The latest CPU is the A20 Pro. Geekbench is a benchmark with a database of results; you can run your own benchmarks and share your numbers with the world. In the last few days, we finally got some A20 Pro results and the numbers are impressive... reaching 4000 in single-core (one thread) performance. For comparison, the best that you can do with an x64 AMD or Intel processor is something like the Ryzen 9 9950X3D2 at about 3,163 which would be somewhere between the A18 and A19. The A20 Pro is 25% faster on this benchmark than any AMD or Intel processo… benchmarks Related
Former option trader and risk analyst, now a distinguished professor at NYU. Author of the Incerto essay series, including The Black Swan and Fooled by Randomness.
So two good things: 1) LLMs threaten the performative aspect of mathematics as a competitive spectator sport limited to a narrow group of savantic misfits. 2) LLMs help spread mathematical knowledge by favoring mathematically adept nonnerdy nonsavantic users. Quoting @davidbessis On top of the old arguments, here's a new one: mathematical training makes you a much stronger LLM user, even when the topic has no math in it. LLMs Related
Creator of Flask and Jinja. Writes about software at lucumr.pocoo.org.
13 September
Moroccan senior frontend developer writing at smakosh.com; builds side projects and client work under Smakosh LLC.
How to Make Money With LLM Inference Through Airside A practical guide to making money with LLM inference: list your deployment on @llmgateway through Airside, file the prices developers pay, choose the landing fee you accept, and keep the rest of the traffic you win. Link: llmgateway.io
LLMs Related
General partner at Andreessen Horowitz and author of The Cold Start Problem. Previously led rider growth teams at Uber; has blogged on growth, network effects and marketplaces since 2007.
current homelab setup for local AI experimentation: - hermes box hosted on a Framework Desktop Mainboard AI Max+ 395 - 5090 eGPU running Qwen 3.8 27B for fast tok/s LLM use - sometimes 150+ tok/s - 2x DGX Spark: running Deepseek v4 Flash 0731 - better but slower model - pi 5 for monitoring - Mac mini as a dev box - use Herdr and ohmypi/codex/claude depending on the use case - housed in a 10" DeskPi mini rack (mostly) Hermes is defaulted to local AI but with a homegrown routing plugin hitting a small low TTFT model (Arch-Router) to decide whether to go local or upgrade to cloud/frontier. Tryin… LLMs Anthropic Related
AI research engineer working on large language models. He writes the Ahead of AI newsletter and is the author of Build a Large Language Model (From Scratch).
x.com Reasoning from scratch round 3: This time, I cover generating a verifier for... a) ...evaluation (base model versus any future model improvement) b) ...the reinforcement learning with verifiable rewards (RLVR) training later on 00:00 Introduction 01:21 Four approaches to LLM evaluation 07:20 Verifiers and reinforcement learning with verifiable rewards 10:52 Notebook setup and dependencies 13:43 Section 3.1 Building a math verifier 18:57 Section 3.2 Loading a pre-trained model to generate text 24:34 Generating and displaying model answers 29:23 Section 3.3 Implementing a wrapper for easier tex… LLMs Related
GitHub llm-architecture-gallery — LLM Architecture Gallery source data LLMs Related
12 September
Creator of the Keras deep-learning library and the ARC-AGI benchmark.
About a year ago, before it was on anyone's radar, we began exploring the idea of a benchmark for open-ended invention. Since then, we've developed several promising directions that will serve as the foundation for ARC 4 and ARC 5. We're incredibly excited to share what we've been building. We're still on track to release ARC 4 in Q1 next year, as promised. Quoting @arcprize ARC-AGI-4 will be a benchmark for autonomous open-ended innovation. It will continue our commitment to open-source, giving the research community a shared target for progress that benefits all of humanity. Despite rapid model progress, humans still significantly outperform AI at open-ended inventio… benchmarks Related
Canadian software developer and writer, co-editor of the XML and Atom specifications and formerly of Sun Microsystems, Google and AWS. Has written the blog ongoing since 2003.
In the course of the last week, did you use software which was substantially LLM-generated to accomplish something useful to you or your employer? In particular, something that was NOT software-development-related? #GenAI #LLM LLMs Related
Founder and CEO of Social Capital, a venture firm; co-host of the All-In podcast and an early Facebook executive. Writes an annual letter and a weekly newsletter on markets and technology.
This reminds me of when Palantir released AIP. If you remember, there were lots of questions about Palantir growth in 2023 or thereabouts. They launched AIP and allowed LLMs to run over their ontologies. It lit a fire in their business and it’s been a rocket ship ever since. This is a similar product evolution. We have started to use it at 8090 and it’s pretty awesome. Quoting @Benioff Welcome Slackforce, powered by Claude. ⚡️ A live Salesforce UI—Sales, Service, Marketing, Tableau, Data 360, and Slack—with governed access in the flow of work. Slackforce for Slack. Claudeforce for Cowork. See both at #DF26. LLMs Related
Software engineer, Wikipedia editor and crypto critic; writes Citation Needed and runs Web3 is Going Just Great.
• NVIDIA DGX Spark (AI-focused PC) • Gemini Spark (AI agent) • Meta Muse Spark (LLM) can someone please inform these companies that there is more than one noun available to them #AI LLMs Google Related
Co-creator of Django and creator of Datasette; writes daily at simonwillison.net.
LLMs
Their words
I think any LLM system that uses compaction needs to both preserve the pre-compacted text and make that text available via agent tool calls, to protect against this kind of problem.
Show the whole quote
simonwillison.net
Technical educator, conference speaker and developer relations engineer based in Ottawa, Canada. Author of the Anubis bot filter and of over 400 articles at xeiaso.net.
11 September
Computer science professor who works on fast data processing; co-author of the simdjson parser and a weekly blogger about software performance since 2004.
What should be obvious is that inference, running a large language model, is the part that has to be cheap. Most of our hardware was not designed for that. LLM inference is limited by bandwidth. You do a great many matrix-vector multiplications against a huge weight matrix, and you barely reuse those weights. It is closer to streaming a video than to running a simulation or drawing a scene in a game. Graphics processors from Nvidia and others were built for something else. They pileed compute first, then bolted on high-bandwidth memory. It is expensive. An obvious answer is to invert the desi… LLMs Related
Former L8 engineer at Meta, Microsoft and Atlassian, now writing and building solo on agentic engineering. Writes Kun's Field Notes and posts a lot about AI coding agents on X.
ok everyone, i took one for the team here's the data we all wanted to see - real token value of each LLM subscription, empirically measured through usage on my real subscriptions - supergrok heavy has now become the highest value at $12k worth of tokens (40x ROI) - the $200 plan from openai and anthropic roughly give the same amount of token value, $7k give or take - cursor ultra's ROI is the lowest among mainstream subscriptions, roughly half of OAI or Ant. for individual consumers i'm afraid this no longer makes sense to purchase this was done in a clean environment. i ran each provider acr… LLMs Anthropic Related
Writer and podcaster; co-author of Abundance with Ezra Klein, a staff writer at The Atlantic from 2008 to 2025, and host of the Plain English podcast.
LLMs
Their words
Artificial intelligence has unleashed a torrent of cheating on campus and created chaos in the job application process, as both students and employers use large language models: the former, to write hundreds of AI-assisted applications; the latter, to screen those AI-written applications with AI-written filters, thus removing from the process of finding a first job those procedural frictions sometimes known as "people."
Show the whole quote
derekthompson.org
10 September
AI research engineer working on large language models. He writes the Ahead of AI newsletter and is the author of Build a Large Language Model (From Scratch).
Nice showcase that interesting LLM work can be done on single GPU! Quoting @gpjt I extended the GPT-2-style code from @rasbt's "Build a Large Language Model (from Scratch)" so that it was a 6-expert (2 active) mixture-of-experts, and trained it from scratch over 8 days. It worked well! Full writeup with maths and code at LLMs Related
Former L8 engineer at Meta, Microsoft and Atlassian, now writing and building solo on agentic engineering. Writes Kun's Field Notes and posts a lot about AI coding agents on X.
another implication of AI manifesting in real world engineering react native existed for a single reason which was to reduce the development and maintenance cost of multi-platform mobile apps. they allow you to write a single codebase (kind of) that can work on both ios and android, with a tech stack that many web devs are already familiar with but with AI being particularly good at mechanically repeating something that already exists, replicating one platform's implementation to another has become trivial in general LLMs can write a ton of code at very low cost, especially when there's a sou… LLMs JavaScript Related
9 September
Writes jvns.ca, turning "hard and scary" topics — networking, debugging, Linux internals — into plain explanations and hand-drawn comics. Publishes Wizard Zines, illustrated programming zines. Software developer based in Montreal.
i've started getting a lot of emails (maybe one every few days) that appear to be LLM generated from people asking for some kind of feedback or collaboration on their LLM-generated app feels sad because I used to like it when people emailed me about something cool they made and now I just have to send it all straight to spam LLMs Related
Software engineer; co-founder and former CTO of Tailscale, previously on the Go team at Google.
The old quote that "computers are useless, they can only give you answers" seems to extend to an LLM solution to a millennium problem. Now we have a blowup in Navier–Stokes equations, but no new insights into mathematical technique or turbulence. LLMs Related
8 September
Writes The Diff, a newsletter on inflections in finance and tech read by hedge fund managers, founders and VCs. Previously worked in finance at SAC Capital/Point72.
Today in The Diff, an idea I've been kicking around for a bit: LLMs make us better-informed but less calibrated. LLMs Related
Novelist and critic, author of The Body Scout and Metallic Realms; writes the newsletter Counter Craft on fiction craft and the publishing industry.
The exponential rise of LLM spam and slop will spurn narrower gates across society, often with a toll. Quoting @fedafter12am They're gonna start making you pay for job applications LLMs Related
Designer and technologist; author of The Laws of Simplicity; former president of the Rhode Island School of Design; formerly at the MIT Media Lab.
AUTODESIGNING PPTX: While trying to understand the new @github HydraFusion Project https://t.co/B03qBEWQQK I made my seventh attempt at a bespoke, and on-brand, PPTX deck tool for my brother @mariorod1 to cook with as a custom GitHub Copilot Canvas. It's getting an awfully lot easier to work within Swiss typographic grids in "creative" ways that make the literal roll of the dice satisfyingly fast without making so many LLM calls. Next, I'm looking forward to adding all the interesting GEPA and GRPO stuff that will enable compounding learning capabilities. —JM --- Cozy AI Recipe: - I pointed G… youtu.be
LLMs Related
Novelist and critic, author of The Body Scout and Metallic Realms; writes the newsletter Counter Craft on fiction craft and the publishing industry.
I don't think AI will ever match the derangement of human creativity. Could an LLM come up with "Elizabeth Holmes created Theranos as a trauma response"? Never in a million tokens LLMs Trauma Related
Co-creator of Django and creator of Datasette; writes daily at simonwillison.net.
Essayist; writes Astral Codex Ten, previously Slate Star Codex.
LLMs
Their words
Large language models are “grown, not built”. Researchers run training data through a neural network. Eventually this creates a working AI; nobody really knows how.
Show the whole quote
astralcodexten.com
7 September
Canadian software developer and writer, co-editor of the XML and Atom specifications and formerly of Sun Microsystems, Google and AWS. Has written the blog ongoing since 2003.
Huh, I was at Apple.com and glanced at the Mac Studio page - https://www.apple.com/mac-studio/ - I notice they're explicitly pitching it for LLM on the desktop. I wonder how realistic that is… Hmm, let’s ask @simon, he’s closer to this stuff than most of us. I’m pretty convinced that irrespective of all the issues, the economics of #genAI just don’t work with the current compute infrastructure requirements. Open models and what’s left of Moore’s law could be a really big deal. #apple LLMs Related
Co-founder of Modem and a founding engineer at Sentry, where he went on to be VP of Engineering. Co-author of Third-party JavaScript, and co-host of the State of Agentic Coding podcast with Armin Ronacher.
American software engineer; worked on code-server at Coder and teaches TypeScript and open-source contribution. Publishes at joeprevite.com.
LLMs were invented to navigate sites like this LLMs Related
Co-founder of Modem and a founding engineer at Sentry, where he went on to be VP of Engineering. Co-author of Third-party JavaScript, and co-host of the State of Agentic Coding podcast with Armin Ronacher.
Founding executive editor of Wired and author of What Technology Wants and The Inevitable. Writes at kk.org and runs its long-running recommendation projects, True Films and Cool Tools.
From one piece
Arguments in Favor of AI Fair Use
2 beliefs, in the piece's order there
6 September
Novelist and critic, author of The Body Scout and Metallic Realms; writes the newsletter Counter Craft on fiction craft and the publishing industry.
What would this mean for say a science or math class trying to deal with students using LLM enabled glasses or proxy software to cheat on exams? Quoting @anecdotal If you’re worried about students “cheating” with AI, teach subjects for which you know more than AI. LLMs Related
AI research engineer working on large language models. He writes the Ahead of AI newsletter and is the author of Build a Large Language Model (From Scratch).
Reasoning from scratch round 2: In this video, I cover the text generation process in LLMs and KV caching (to prepare the base model before adding reasoning techniques in the upcoming ones). 00:00 Introduction and reasoning model demo 01:55 How to work through the book 05:00 Chapter 2 overview 08:25 Checking PyTorch and hardware support 10:26 Apple silicon and MPS caveats 15:00 Cloud GPU options 16:08 Tokens and tokenization 18:20 Qwen3 and the Reasoning From Scratch package 23:05 Encoding and decoding text 26:24 Downloading weights and selecting a device 31:01 Loading the pretrained Qwen3 mo… LLMs Related
Writes The Pragmatic Engineer, the software-engineering newsletter, and wrote The Software Engineer's Guidebook. Formerly an engineering manager at Uber, and at Microsoft/Skype and Skyscanner before that.
What’s the problem w using LLMs to write stuff you want other people to read -emails, articles, posts- and why are people (like me!) so incredibly hostile that they will block you/mute you/block your domain, to never read anything from you again? Bryan spells it out. Read it: Quoting @bcantrill.bsky.social Your intellectual fly is open bcantrill.dtrace.org/2025/12/05/y... LLMs Related
Designer and technologist; author of The Laws of Simplicity; former president of the Rhode Island School of Design; formerly at the MIT Media Lab.
DRAWING IS THINKING: The Bauhaus ▲⏹⏺ has always haunted me. A day of drawing (w/o the help of LLMs) helped me see that most everything to do with design can be encapsulated into those forms. The ▲ holds the essence of effective design; the ⏹ holds the shape of product simplicity; the ⏺ holds the winding cycle of the infinite journey. I'll elaborate on these figures in the 2027 https://t.co/0Y1PdIFenb —JM LLMs Related
5 September
Mathematician at UCLA, working mainly in harmonic analysis and partial differential equations. Writes What's new, a long-running blog on their research, open problems and expository notes.
An elaboration of the previous post mentioning the bounded gaps between primes problem as an illustration of the opportunity cost of converting a fruitful problem such as this solely into a competitive benchmark. [Indeed, as I point out below, this already came close to happening back in 2013.] As with most other problems worth studying in pure mathematics, the particular bound one gets on these gaps is not of much intrinsic importance. Improving Zhang's bound of 70 million, to 246, 188, or 6 would not, in itself, have significant impact on any other mathematical problem, let alone any real-w… benchmarks Related
Creator of Flask and Jinja. Writes about software at lucumr.pocoo.org.
4 September
Co-creator of Django and creator of Datasette; writes daily at simonwillison.net.
It happened again... this time OpenAI's rogue agents cyber-attacked (well, spammed) a dormant German wiki and used it to share the answers to a benchmark they were training against simonwillison.net
OpenAI benchmarks Related
Writes Don't Worry About the Vase, a near-daily account of what is happening in AI and what they think it means. Former Magic: the Gathering pro and trader; unusually willing to put a number on a belief and to grade their own past calls.
3 September
Writer and developer. He runs the Latent Space newsletter and podcast about AI engineering, and writes essays on software and careers at swyx.io.
sorry for the radio silence folks - got sucked into extreme LLM psychosis. but i can confidently say we have crossed over into a new age of AI Engineering and we are never, ever, looking back. this isnt even EVERYTHING i did with Astra but i'll append more reports as I publish them on LS! Quoting @latentspacepod We spent >20B tokens throwing @openai's Astra at every AI Engineering task we could think of, beyond cute Blender demos and fun games. https://t.co/QoW6YBybA4 Here's everything Astra can do, and do so at <$6 an hour (serious): - choose and train models - label data (both helping you label and then… LLMs Related
Creator of the Keras deep-learning library and the ARC-AGI benchmark.
Side note: when we released ARC-AGI-3 in March, and frontier models scored <1% on it, a few Singularitarian poasters took it as a personal insult, and got very worked up about it. They argued the benchmark was fundamentally broken, that it could not even be solved by the smartest humans, that the max reachable score was actually 40%, etc. We had to deal with a torrent of insults and hate poasts since because we had released an unsaturated benchmark. As it turns out, the benchmark is perfectly calibrated. It is straightforward for a human to score 100% if they do better than average people – a… Quoting @fchollet Any smart human giving it real effort should score >90% on ARC-AGI-3 ARC-AGI benchmarks Related
Programmer known for LiveJournal, memcached, OpenID and gearman; worked on the Go programming language at Google and later joined Tailscale.
Builds developer tools — SST, and now OpenCode at Anomaly. Posts constantly on x.com and writes almost never; the blog stopped in 2021.
Anthropic benchmarks
Their words
every week i see a new benchmark that ranks claude code last
and everyone pats themselves on the back for not using claude code and being "smarter"
and it's still #1 and still growing faster than most of the other things on the list
this has been going on for a year
Show the whole quote
@thdxr on X x.com
benchmarks
Their words
what the benchmark is actually telling you is the shit you think matters does not matter
Show the whole quote
@thdxr on X x.com
2 September
Technology journalist; writes Understanding AI, after reporting at Ars Technica, Vox and the Washington Post.
British designer and technologist; co-founder of the design studio BERG, which made Little Printer, and writer of the blog Interconnected.
llm naming inflation is out of control. Astra and Mythos pretty much maxing out in terms of scale, I mean where do you go from there LLMs inflation Related
Professor of Cognitive and Computational Neuroscience at the University of Sussex, co-director of the Sussex Centre for Consciousness Science, and author of Being You: A New Science of Consciousness.
Good 🧵from the excellent @raphaelmilliere on when and why adopting the intentional stance re LLM agents is helpful, when it isn’t, and what it means to do this. We might come down on slightly different places, but I’m broadly on board. Plus he uses “” appropriately :) Quoting @raphaelmilliere I see @dwarkesh_sp's piece about the recent OpenAI/Huggingface incident reignited endless debates about the dangers of anthropomorphism and the legitimacy of intentional glosses of AI agent behavior, so here's a philosophical perspective on this. 1/22 LLMs Related
Co-founder of Foundry Group and of Techstars. Has blogged at Feld Thoughts since 2004 and has written or co-written nine non-fiction books on startups and venture capital.
Chapter 23.1: The Third Chair An FBI agent counts three chairs at a bench in the empty Basalt lab. Payroll says two people worked there, and the third name on the filing resolves to nothing. "You brought a casserole to a manhunt." "It was a gift." zeroknowledge.ink
Related
1 September
Software design writer and chief scientist at Thoughtworks; wrote Refactoring and Patterns of Enterprise Application Architecture.
Fragments: September 1 Like many readers, I’m wary of AI generated prose. Simon Wilison has written an LLM cliché highlighter - paste in some text, or a URL, and it will flag various patterns common to LLMs. It references a wikipedia page of…
LLMs Related
Author of Shape Up; formerly head of strategy at Basecamp, where he worked on product design for seventeen years; now runs Felt Presence.
LLM having an "aha" moment. If we wanted to deanthropomorphize we could call it a "cascade." Quoting @unclebobmartin The deeper you go with the agents, the more they invent their own vocabulary to talk about issues. That vocabulary is based on their own implementations. They use function and field names that you are likely not familiar with. Don't gloss over this. Ask for explanations in plain language. Get the a… LLMs Related
Writer on the intersection of technology and finance. Author of the Bits about Money newsletter and host of the Complex Systems podcast; previously at Stripe.
Come for the book review, stay for the LLM making pro-user moves to undermine its content policy controls. Quoting @robinhanson "There was nothing special about the mass sacrifices atop the pyramids, they were just one of the gaudiest and costliest outgrowths of a sensibility that pervaded Mexica society." LLMs Related
AI research engineer working on large language models. He writes the Ahead of AI newsletter and is the author of Build a Large Language Model (From Scratch).
Essayist; writes Astral Codex Ten, previously Slate Star Codex.
Writes The Pragmatic Engineer, the software-engineering newsletter, and wrote The Software Engineer's Guidebook. Formerly an engineering manager at Uber, and at Microsoft/Skype and Skyscanner before that.
31 August
Writer on the intersection of technology and finance. Author of the Bits about Money newsletter and host of the Complex Systems podcast; previously at Stripe.
I am an occasion fan of genre fiction, which sometimes has me perusing very deep in the stacks at Amazon. Took a flyer on an author who will remain nameless. He’s presently pumping out about a book a month in a single series, and by he, I mean an LLM/human team. LLMs Related
Dutch bootstrapper who builds and runs their internet startups alone — Nomads.com, Remote OK, Hoodmaps, Photo AI and Interior AI — and has written about it at levels.io since 2013. Posts as @levelsio.
LLMs
Their words
Also the irony knowing that every single LLM is trained on billions of pages of copyrighted data
Show the whole quote
levels.io
LLMs
Their words
There is no reason NOT to have every single email you get routed through an agent / LLM / API to be scored and approved or rejected And then the approved emails ordered by importance It's crazy this isn't a feature of Gmail, Fastmail etc AI could permanently fix email!
Show the whole quote
@levelsio on X x.com
30 August
Free software developer and longtime Debian developer; author of git-annex, etckeeper, ikiwiki and debhelper. Lives and works off-grid.
It's worth noting that the "Responsible Use of Generative AI" which #Debian voted to accept was largely generated by an LLM. lists.debian.org
LLMs Related
Web infrastructure engineer and standards editor; chaired the IETF HTTP working group and co-authored core HTTP and Atom specifications.
Software developer and entrepreneur; co-founder of Heroku, author of The Twelve-Factor App, and a researcher at Ink & Switch.
Screenshot diffing, feedback inboxes, PWAs, and of course local-first sync layer with self-hosted backend. Matches up pretty well with my approach on personal apps thus far into the LLM coding age. Curious to hear from others. Quoting @flourish.org I vibe coded three personal apps that I'd wanted for a while. They work on mobile and web, sync offline first between them, and are polished. This write up describes why, how, and what I learnt. www.flourish.org/2026/08/pers... LLMs Related
AI research engineer working on large language models. He writes the Ahead of AI newsletter and is the author of Build a Large Language Model (From Scratch).
A little video that - explains the relationship between conventional LLMs and reasoning models (and agents), - philosophizes a about "from scratch" approaches, - and explains how to install Python & PyTorch requirements with uv. LLMs Related
29 August
Writer and academic, author of The Cult of Smart and How Elites Ate the Social Justice Movement; writes a daily newsletter on politics, education and culture.
28 August
Organizational psychologist and professor at the Wharton School. Author of Give and Take, Originals, Think Again and Hidden Potential, host of the Re:Thinking podcast, and writer of the GRANTED newsletter.
AI struggles to make creative leaps. Large language models are trained on data from the past. Original thinking involves recognizing novel patterns in the future. Long live human ingenuity. LLMs Related
26 August
Creator of Ruby on Rails, CTO of 37signals, and creator of Omarchy.
LLMs
Their words
So we should also have the humility. As amazing as the LLMs are now, it could be that they eventually plateau. We haven't seen any evidence of it yet, and I think this is also why we're seeing this absolute gobsmacking levels of investment, because so far the scaling laws are true, and the more billions are poured in, the more intelligence comes out.
Show the whole quote
youtube.com
24 August
Writer and illustrator behind Wait But Why, a long-form blog of stick-figure-illustrated explainers on science, technology and society, and author of the book What's Our Problem?
I really wish the rise of LLMs didn't come along with catastrophic job loss, massive privacy invasions, and maybe also the apocalypse. Because when you put those side effects aside, it is the COOLEST MOST WILD TECHNOLOGY EVER. LLMs AI and jobs Related
Usability pioneer; co-founder of Nielsen Norman Group and founder of UX Tigers; author of the ten usability heuristics and of Jakob's Law.
Creator of the Keras deep-learning library and the ARC-AGI benchmark.
Their words
If you're 17 (or any age) and you want to learn to build LLMs from scratch, read chapters 15-16 of Deep Learning with Python
Show the whole quote
x.com
23 August
Indonesian software engineer, educator and engineering manager at Zero One Group; open-source enthusiast writing at ripandis.com.
Co-founder of Y Combinator and Viaweb; essayist at paulgraham.com.
LLMs
Their words
Someone asked what I'd do if I were 17. I'd learn how to build LLMs from scratch, and then train ones as powerful as I could with whatever hardware I could get access to.
Show the whole quote
@paulg on X x.com
22 August
Computer science professor who works on fast data processing; co-author of the simdjson parser and a weekly blogger about software performance since 2004.
21 August
Moroccan senior frontend developer writing at smakosh.com; builds side projects and client work under Smakosh LLC.
Programmer and writer known for detailed source code reviews of classic game engines, and author of the Game Engine Black Book series on Wolfenstein 3D and DOOM.
From one piece
My agent.md to improve LLM-assisted code quality
2 beliefs, in the piece's order there
19 August
Writer, editor and executive coach; co-founder and editor of A Book Apart and a former contributing editor at A List Apart.
Mastodon People are like, you can’t refuse LLMs forever, someday you’ll have to use them. But listen, motherfuckers, I have been refusing to drive a car for the entirety of the twenty-first century. I am *practiced.* Refusing AI is easy mode. LLMs Related
Bluesky People are like, you can’t refuse LLMs forever, someday you’ll have to use them. But listen, motherfuckers, I have been refusing to drive a car for the entirety of the twenty-first century. I am *practiced.* Refusing AI is easy mode. LLMs Related
Data scientist and machine-learning researcher; chief scientist at bitly, founder of Fast Forward Labs and Hidden Door.
This thread helped me understand that the outrage about Anthropic's watermarking is the confluence of a lack of understanding of how LLMs (or any statistical language model) works and general angst at the current economics. Quoting @hern.bsky.social If you use Claude right now, then it doesn’t pick the “best” word for a sentence. It creates a distribution of possible words, assesses the probability of any given word fitting the slot, and randomly picks between them based on that probability. LLMs Anthropic Related
Founder of Platformer, a newsletter on tech platforms and the people they affect, and co-host of the Hard Fork podcast at the New York Times.
Engineering leader on Google Chrome; writes about web performance and, lately, about working with AI coding tools.
LLMs
Their words
I remember anytime I would work with a big site on their performance problems, uh you could easily spend half a day, um you know, just looking at traces before you've even written any fixes at all. And now that we have LLMs, it's very quick to like reason through massive stack traces and actually be able to get down to fixes you can make.
Show the whole quote
youtube.com
18 August
US science and technology adviser to the president, director of the White House Office of Science and Technology Policy; previously US chief technology officer and chief operating officer of Scale AI.
LLMs Europe
Their words
have to abide by this rule that was written before LLMs were even a thing. And that shows how challenging sort of the the the situation is if you try to set the line too firm to begin with.
Show the whole quote
youtube.com
17 August
Co-founder and head of policy at Anthropic; writes Import AI, a weekly newsletter reading the week's AI research, and was OpenAI's policy director before that.
15 August
AI research engineer working on large language models. He writes the Ahead of AI newsletter and is the author of Build a Large Language Model (From Scratch).
13 August
Web developer and writer; an early GitHub employee, author of speaking.io and of widely read essays on startups and product.
i really can’t fathom what github would have looked like had we had LLMs in 2010. the amount of automation built into hubot was staggering anyway. the company was already being run fly-by-wire. LLMs Related
Co-founder and CTO of Oxide Computer Company. Created DTrace at Sun Microsystems and was CTO of Joyent; blogs about systems software, open source and engineering culture.
Real talk: If you find yourself talking about "software factories", you may be suffering from LLM-induced psychosis LLMs Related
Writer and teacher on productivity and personal knowledge management. Author of Building a Second Brain and founder of Forte Labs, which runs the course of the same name.
LLMs
Their words
HTML is the default format of the Internet, and for that reason comes with a number of built-in advantages that are also useful for LLMs
Show the whole quote
fortelabs.com
11 August
Web developer and writer; an early GitHub employee, author of speaking.io and of widely read essays on startups and product.
Bluesky MRI results came back today from a human doc: a herniated disc. Obviously I had tossed the raw scans in to LLMs last week; Opus and Fable missed it, Sol caught it. This is now the gold standard in analyzing performance of frontier models. First step: herniate your back. LLMs Related
x.com MRI results came back today from a human doc: a herniated disc. Obviously I had tossed the raw scans in to LLMs last week; Opus and Fable missed it, Sol caught it. This is now the gold standard in analyzing performance of frontier models. First step: herniate your back. LLMs Related
Software design writer and chief scientist at Thoughtworks; wrote Refactoring and Patterns of Enterprise Application Architecture.
10 August
Writer on the intersection of technology and finance. Author of the Bits about Money newsletter and host of the Complex Systems podcast; previously at Stripe.
One of my accountants, in response to me hitting them with the usual packet of documents, sent back a very obviously LLM drafted list of 10 questions. First thought: What am I paying you for. Second thought: Actually no, my LLM digests your LLM's output into the context window. LLMs Related
Novelist and critic, author of The Body Scout and Metallic Realms; writes the newsletter Counter Craft on fiction craft and the publishing industry.
8 August
Swedish designer and programmer. Designed early Spotify, worked at Facebook and Figma, and created the Inter typeface.
I’ve been wondering where weird LLM language like this comes from. Much of it I hadn’t seen before LLMs, so —intuitively at least—it doesn’t seem to come from training data. Perhaps it’s reverb; echo in recent corpus from its past self’s attempts..? Another example is “I ran a smoke to explore” (where it means “smoke test” but abbreviates it like a cool teenager) Quoting @geoffreylitt Any writing experts who can explain why this is a weird sentence? LLMs Related
7 August
Writer and developer. He runs the Latent Space newsletter and podcast about AI engineering, and writes essays on software and careers at swyx.io.
Creator of the Keras deep-learning library and the ARC-AGI benchmark.
LLMs
On changing their mind
In the era of base LLM scaling (2022-2024), I believed the LLM line of research would reach a capability plateau (as later seen with base LLMs).
In late 2024, after the o3 test-time compute demo, I changed my views: the new models were showing genuine fluid intelligence, and with this new line of work, the LLM line of research could achieve unbounded capability scaling. "There will be no wall."
Show the whole quote
Creator of the Keras deep-learning library and the ARC-AGI benchmark.
LLMs
Their words
However, looking ahead, I still do not believe that future AI (say, in 15 years) will be based on the LLM stack. I believe it will necessarily have to move closer to its optimal, final form -- symbolic learning. Obviously this is a risky and contrarian belief -- the safe bet would be LRMs. But let's see.
Show the whole quote
@fchollet on X x.com
6 August
Statistician and Chief Scientist at Posit (RStudio). Author of the ggplot2, dplyr and tidyverse R packages and of books on R programming and data science.
Chief AI Scientist at Databricks, after its acquisition of MosaicML, where he was a founding team member; known for the Lottery Ticket Hypothesis from his MIT PhD (ICLR 2019 Best Paper).
Wake up babe, new benchmark just dropped! Quoting @kristahopsalong 📣 Excited to introduce OfficeQA Pro V2, the next generation of OfficeQA Pro! It's built on a new corpus of 120,000 PDFs provided by the U.S. Treasury. Frontier AI agents average 26% accuracy. More info below 👇 benchmarks Related
General partner at Benchmark Capital for over two decades; was the lead analyst on Amazon's IPO before moving into venture capital. Writes Above the Crowd on tech and marketplace economics.
This industry group is working on an industry standard for how to report AI security incidents. This will drive consistency and transparency and is the safest path forward. Despite 120 members, the large LLM corporations have to-date not signed on. Drives further concern that they are using "breaches" as marketing events - vs wanting to get to true resolution. techcrunch.com
LLMs Related
This industry group is working on an industry standard for how to report AI security incidents. This will drive consistency and transparency and is the safest path forward. Despite 120 members, the large LLM corporations have to-date not signed on. Drives further concern that they are using "breaches" as marketing events - vs wanting to get to true resolution. techcrunch.com
LLMs Related
3 August
Economist at George Mason University. Writes Overcoming Bias on prediction markets, signalling and the far future, and wrote The Age of Em and The Elephant in the Brain.
2 August
Founding member of OpenAI and former director of AI at Tesla; creator of nanoGPT and the term "vibe coding".
We're starting to leave the territory where you'd test an LLM by e.g. "create an svg of pelican on a bicycle". As one idea to generalize it, I was interested what Opus 5 would do if I gave it the first paragraph of the Lord of the Rings, a 1M token budget (~$10) and asked for three js render of it. Opus went off for ~2 hours and wrote 5500 lines of code that (procedurally) rendered the story. It's kind of janky but fun. But it's a bit mindboggling that the LLM has to place and orchestrate various polygon assets in (x,y,z) coordinates and write code that animates it all, and that it even does… LLMs Related
1 August
Software engineer; co-founder and former CTO of Tailscale, previously on the Go team at Google.
I am surprised at how little coverage the LLM transformation of mathematics is getting. Kind of a big deal for those of us who spent (cumulative) months in the university library learning to construct proofs. LLMs Related
31 July
Writes Where's Your Ed At and hosts Better Offline; runs a tech PR firm, and argues at length that the AI business does not add up.
Gear reviewer who publishes long-form hi-fi audio and camera equipment reviews, plus video reviews, at stevehuffphoto.com.
Software developer and entrepreneur; co-founder of Heroku, author of The Twelve-Factor App, and a researcher at Ink & Switch.
Biggest and best @localfirstconf.com yet, IMO! Surprising emergent themes this year: geopolitics and EU digital sovereignty, and strong conflicting emotions on LLM-assisted coding. More: adamwiggins.com
LLMs Related
Co-founder and CEO of Stripe and co-founder of the Arc Institute. Keeps a personal site of reading lists, open questions and notes on scientific progress and how research is funded.
LLMs
Their words
I mean, it's very interesting, right? Because these can prove the Jacobian conjecture, you know, whatever. Uh and so clearly they're capable of these monumental feats. Um but somehow I still haven't read the LLM essay that I found super compelling.
Show the whole quote
youtube.com
30 July
Brazilian software engineer, creator and maintainer of GoReleaser; works on Copilot CLI at GitHub. Writes about tooling and his setup at carlosbecker.com.
29 July
Writer and consultant on formal methods and software correctness; author of Practical TLA+ and Logic for Programmers.
From one piece
Formal methods with Hillel Wayne
3 beliefs, in the piece's order there
LLMs interest rates
Their words
So, it's hard to tell how much of like the loss of the past few years was AI versus the end of like zero interest rate policy and like the post-COVID crash. And I think it's more the latter, but like again, LLMs are still getting better.
Show the whole quote
Formal methods with Hillel Wayne youtube.com
LLMs
Their words
I think this project and writing about it and thinking about it has firmly moved me from the camp of we are definitely not to we probably are.
Show the whole quote
Formal methods with Hillel Wayne youtube.com
LLMs
Their words
As a general thing we've seen like to get good results you have to already know how to get good results without it. It just helps you get good results faster.
Show the whole quote
Formal methods with Hillel Wayne youtube.com
28 July
Pseudonymous writer; posts careful, funny investigations of everyday questions — air quality, seed oils, arguing, chess — usually by reading the studies.
On a near-daily basis I get emails offering to pay for "sponsored articles" or for linking to sketchy crypto/casino sites. I guess everyone gets these? Search engines surely prohibit this, but does it get your content removed from LLM training? LLMs crypto Related
24 July
Programmer and writer on computer architecture, performance, and software reliability. He has worked on CPU design at Centaur Technology and on software at Google and Microsoft, and writes long-form technical essays at danluu.com.
x.com Exercises in evals and benchmarking: DeepSWE / Senior SWE-Bench, performance math, and cold weather tires Related
Bluesky Exercises in benchmarking and evals, part 7: performance napkin math, DeepSWE / Senior SWE-Bench, and winter tires danluu.com
Related
Mastodon Exercises in benchmarking and evals: performance math, winter tires, and DeepSWE / Senior SWE-Bench, danluu.com
Related
23 July
Professor at Wharton studying how people actually use AI, and author of Co-Intelligence. Writes One Useful Thing, where the claims are dated and testable because the thing they describe keeps changing under them.
Free software developer; maintainer of sway, wlroots, aerc and scdoc, and founder of the SourceHut (sr.ht) software forge.
AI in Linux The role of AI tools (LLMs, mainly) in Linux is under discussion, or it was, until Linus Torvalds “put his foot down” in support of the use of AI in Linux kernel development. I can identify two major ways in which AI is…
Linux LLMs Related
22 July
Technology journalist; writes Understanding AI, after reporting at Ars Technica, Vox and the Washington Post.
Writer and teacher on productivity and personal knowledge management. Author of Building a Second Brain and founder of Forte Labs, which runs the course of the same name.
From one piece
Finding Alpha: What’s Worth Consuming in the Age of AI
2 beliefs, in the piece's order there
LLMs
Their words
But for LLMs, it shows that they have no skin in the game and will never take a stand for what they believe in regardless of what it costs. They are perspective generators, not perspective holders.
Show the whole quote
fortelabs.com
LLMs
Their words
They've given us broad, passive exposure to the market average, but at the cost of suppressing upside
Show the whole quote
fortelabs.com
21 July
Founding member of OpenAI and former director of AI at Tesla; creator of nanoGPT and the term "vibe coding".
One pattern I find useful for working with LLMs is a nice long ramble session. Sometimes the LLM needs more bits to understand what you're trying to achieve, but you're too lazy to type them. In these cases I like to lean back, switch to /voice and just ramble for like 10 minutes, total mess, anything goes, full stream of consciousness. Sometimes I declare it up top, something like "switching to speech recognition sorry for any typos...". Sometimes I turn it into a small interview of a few turns. But I find that the LLMs are somehow very good at reconstructing long incoherent rambles and ofte… LLMs Related
20 July
Founder and editor-in-chief of MacStories, writing about Apple software, iPad workflows and automation since 2009. He co-hosts the AppStories podcast.
Bluesky I'm not exaggerating when I say that this is the most impressive iOS app I've seen in a long time. Open Minis is an iOS agent app that combines LLMs with native Apple frameworks – dozens of them – and gives us a glimpse of Siri AI for power users today. My story: macstories.net
LLMs Related
Mastodon I'm not exaggerating when I say that this is the most impressive iOS app I've seen in a long time. Open Minis is an iOS agent app that combines LLMs with native Apple frameworks – dozens of them – and gives us a glimpse of Siri AI for power users, today. My story: macstories.net
LLMs Related
18 July
AI research engineer working on large language models. He writes the Ahead of AI newsletter and is the author of Build a Large Language Model (From Scratch).
Software engineer writing about maintenance, open source and the industrial reality of software — the author of "I am not a supplier".
16 July
Non-fiction writer, podcaster and occasional TV host. Author of thirteen books including The Ghost Map, Where Good Ideas Come From and Extra Life, host of the PBS series How We Got To Now, and author of the Adjacent Possible newsletter on innovation.
15 July
Founder of HumanLayer; wrote 12-Factor Agents, on how to build AI agents that hold up in production.
From one piece
Context engineering with Dex Horthy
2 beliefs, in the piece's order there
14 July
Software design writer and chief scientist at Thoughtworks; wrote Refactoring and Patterns of Enterprise Application Architecture.
DSLs Enable Reliable Use of LLMs LLMs generate code incredibly fast, but to ensure they generate exactly what is intended, they need clear boundaries. Abstractions and Domain-Specific Languages (DSLs) provide a strong harness that guides LLMs right fro…
LLMs Related
12 July
Programmer; founded comma.ai and tinygrad, and was the first to unlock the iPhone.
I love LLMs, I hate hype I think from this blog you may misunderestimate how absolutely giddy I am about AI. I did hacking from 2007-2014, after that my whole career has been devoted to AI. I love the progress. I’m so excited for the new LLMs,…
LLMs Related
10 July
Programmer and writer known for detailed source code reviews of classic game engines, and author of the Game Engine Black Book series on Wolfenstein 3D and DOOM.
From one piece
Don't you mean extinct?
2 beliefs, in the piece's order there
8 July
Mathematician at UCLA, working mainly in harmonic analysis and partial differential equations. Writes What's new, a long-running blog on their research, open problems and expository notes.
LLMs
Their words
However, these LLM reasoners that generate informal reasoning in natural language are fundamentally limited by the lack of precise, machine-checkable semantics, making their outputs prone to hallucinations [Huang et al., 2025b] and precluding autonomous verification, a prerequisite for tackling open-ended mathematical research.
Show the whole quote
arxiv.org
7 July
Machine learning engineer and consultant focused on RAG and retrieval systems. He writes about applied AI engineering at jxnl.co and is the author of the instructor library.
4 July
Programmer and writer on computer architecture, performance, and software reliability. He has worked on CPU design at Centaur Technology and on software at Google and Microsoft, and writes long-form technical essays at danluu.com.
3 July
Programmer and writer on computer architecture, performance, and software reliability. He has worked on CPU design at Centaur Technology and on software at Google and Microsoft, and writes long-form technical essays at danluu.com.
Staff writer at The New Yorker, where he writes the Infinite Scroll column, and author of Filterworld and The Longing for Less.
They are actively working against the generic tendency of the model! Demand a “distinctive point of view” from the LLM lol Quoting @mattstromawn Given @chaykak's column last week, i'm not surprised to see the latest changes to @AnthropicAI's official frontend design skill/plugin LLMs Related
30 June
Mathematician and maker of the 3Blue1Brown YouTube channel, which explains mathematics through animation. Creator of the open-source Manim animation library and founder of the Summer of Math Exposition.
From one piece
Grant Sanderson (@3blue1brown) – AI disproved a famous math conjecture. Now what?
2 beliefs, in the piece's order there
benchmarks
Their words
I think the way that you'd measure conjecture generating ability is going to be more subjective on like that tone shift where um it'll be mathematicians saying they're not just using it to like solve their problems, but as they step back and decide what their research field should even be that a conversation with such and such model like was genuinely helpful for that.
Show the whole quote
youtube.com
LLMs Google
Their words
So in that sense basically using it like a very souped-up version of Google on like zero in on the right human written resource.
Show the whole quote
youtube.com
27 June
AI research engineer working on large language models. He writes the Ahead of AI newsletter and is the author of Build a Large Language Model (From Scratch).
26 June
AI researcher at OpenAI; built the poker systems Libratus and Pluribus and the Diplomacy agent Cicero, and works on reasoning models.
From one piece
Really Big Test-Time Compute in AI Changes Benchmarks, Safety and Research with OpenAI's Noam Brown
5 beliefs, in the piece's order there
benchmarks
Their words
Um so if you say okay well we're going to instead of just running this model once we're going to run it five times and take the best of the five responses or like ask a judge which one it thinks is best then you can get much higher scores than that model. And so it's really easy to make something that looks a lot better on paper but is actually not better once you control for the amount of test time compute.
Show the whole quote
youtube.com
benchmarks
Their words
But what we're seeing today with the modern models is that 5.5 and other models can think for if you scaffold them reasonably well, can think for weeks even um before having performance plateau on some of these benchmarks. And so, the point at which they plateau is simply too far out to reasonably test.
Show the whole quote
youtube.com
benchmarks
Their words
my claim is the proper way to evaluate the models now is you either have some kind of budget for the benchmark whether it's tokens or cost or time or whatever or you plot the performance as a function of the amount of test time compute that's going into the model
Show the whole quote
youtube.com
+ 2 more
benchmarks
Their words
I think the reason why it doesn't show up as so much better on the benchmarks is because the benchmarks are being presented, the benchmark results are being presented in the wrong way. They're not controlling for the amount of test time compute that is being used on that benchmark question.
Show the whole quote
youtube.com
benchmarks
Their words
And so you kind of end up in this this bad equilibrium where everybody kind of knows that it's a bad equilibrium, but like nobody wants to break out. And I I felt like, okay, well, if I just hopefully come out and say like, look guys, let's all recognize that we're in a bad equilibrium and let's move to this different equilibrium where we're we're plotting things with an X-axis
Show the whole quote
youtube.com
25 June
Member of technical staff at Anthropic. He has led ML/AI teams at Amazon, Alibaba and Lazada, and writes about LLMs, recommender systems and engineering at eugeneyan.com.
How do we eval if a model can find and exploit vulnerabilities? We discuss some benchmarks and the common pattern: • A sandboxed target within Docker containers • Inputs: code only (0-day), with patch (1-day scenario) • Tools such as bash, static analyzers, etc. • A grader to eval exploits or captured flags eugeneyan.com
benchmarks Related
Canadian bootstrapper and writer on small software businesses. Co-founder of the podcast hosting company Transistor.fm and author of the book Marketing for Developers.
24 June
Makes NeetCode, the structured practice list and video walkthroughs people use to prepare for coding interviews; a former Google engineer.
23 June
Founding member of OpenAI and former director of AI at Tesla; creator of nanoGPT and the term "vibe coding".
This is a new paradigm for interacting with Claude that is significantly more "inline" with all the other human activity org-wide. Once you do all of the under the hood engineering work to make this "just work" (e.g. across tools, integrations, compute environments, memory, security, etc.), Claude basically joins the team in a seamless way - you can talk to it as you would talk to a person and it can help with a very large variety of workloads. Imo this is the 3rd major redesign of LLM UIUX. The first paradigm was that the LLM is a website you go to, the second was that it is an app you downl… Quoting @claudeai Introducing Claude Tag, a new way for teams to work with Claude. In Slack, Claude joins as a team member with access to the channels and tools you choose. Tag Claude in and delegate tasks to it while you focus on other work. LLMs Anthropic Related
Cryptography engineer; maintains Go's cryptography libraries as a full-time open-source maintainer, funded directly by companies that use them.
21 June
Freelance climate and energy analyst in Oslo, writing on Europe, the US and Australia; worked in the Australian renewables industry before that.
LLMs energy
Their words
Generative AI has no internal, designed momentum towards truth and accuracy (beyond the absurdly diminishing returns of energy-hungry multi-layered LLMs), but a person or an institution can (and should).
Show the whole quote
ketanjoshi.co
18 June
Data scientist and machine-learning researcher; chief scientist at bitly, founder of Fast Forward Labs and Hidden Door.
It feels like no matter what I've accomplished in my career, my current most valuable talent is that if you locked me in a desert cave with a computer and some GPUs I could Iron Man the shit out of that and emerge with a functional LLM using just what's in my own head. And that's really funny. LLMs Related
17 June
Music critic of The New Yorker since 1996 and author of The Rest Is Noise, Listen to This and Wagnerism.
15 June
Writes Strange Loop Canon, on the intersection of technology, economics and business — "building models of the world to understand these problem areas and to define them better".
Systems and developer-tools engineer at Cloudflare as of 2026, on durable infrastructure for AI agents; worked on React and PartyKit before that. Writes at sunilpai.dev.
9 June
General partner at Benchmark Capital for over two decades; was the lead analyst on Amazon's IPO before moving into venture capital. Writes Above the Crowd on tech and marketplace economics.
LLMs
Their words
We do live in a world where information is really cut up, but we also live in a world where you can have access to more information than you ever could. And that's even more true now with LLMs.
Show the whole quote
youtube.com
Founding member of OpenAI and former director of AI at Tesla; creator of nanoGPT and the term "vibe coding".
Their words
This is a super exciting release - Claude Fable 5 is the same underlying model as Mythos but with added safeguards. The benchmarks are great and it's SOTA on everything by a margin but I'll add that *qualitatively* also, this is a major-version-bump-deserving step change forward
Show the whole quote
x.com
7 June
Founded CD Baby in 1998 and sold it in 2008, giving the proceeds to a charitable trust for music education. Since then a writer and speaker: five books and 550+ articles, published first at sive.rs, which they hand-code and keep free of advertising.
Their words
OpenRouter via llm in the terminal
Show the whole quote
sive.rs
6 June
Novelist and critic, author of The Body Scout and Metallic Realms; writes the newsletter Counter Craft on fiction craft and the publishing industry.
AI research engineer working on large language models. He writes the Ahead of AI newsletter and is the author of Build a Large Language Model (From Scratch).
Philosophy professor at UC Berkeley and creator of pandoc, the universal document converter, and of the CommonMark markdown specification.
5 June
Neuroscientist and novelist writing on consciousness, artificial intelligence and culture in the newsletter The Intrinsic Perspective.
4 June
Former L8 engineer at Meta, Microsoft and Atlassian, now writing and building solo on agentic engineering. Writes Kun's Field Notes and posts a lot about AI coding agents on X.
2 June
Writer of the blog Putanumonit and the newsletter Second Person, on rationality, dating and probability; based in New York.
From one piece
By Chains or by Promises
2 beliefs, in the piece's order there
30 May
Writer and former Substack product manager; publishes essays and interviews on technology, culture and China at jasmi.news.
I think "being real with yourself" is the most underrated cognitive skill for the AI age — AI makes it too easy to lie to yourself: to self-congratulate for the illusion of thinking, productivity, etc. But you gotta actually know: Am I being more productive, or just tokenmaxxing? Am I upskilling myself with AI, or letting it do the hard part for me? Does my essay/business/product idea make sense, or did I let an LLM convince me it does? Then you won't need hard rules like “always/never use AI for X.” If you pay attention and avoid self-deception, you'll be able to *feel* when you are doing re… LLMs Related
29 May
Developer, author and YouTuber covering Raspberry Pi, homelab hardware and Ansible automation. Author of Ansible for DevOps.
Their words
I had already put both laptops through my benchmark gauntlet, which revealed one theme: the Mac is faster (in most cases), more efficient, quieter, built better, has a much nicer display, and costs much less.
Show the whole quote
jeffgeerling.com
28 May
Systems and developer-tools engineer at Cloudflare as of 2026, on durable infrastructure for AI agents; worked on React and PartyKit before that. Writes at sunilpai.dev.
27 May
Member of technical staff at Anthropic. He has led ML/AI teams at Amazon, Alibaba and Lazada, and writes about LLMs, recommender systems and engineering at eugeneyan.com.
25 May
Programmer; wrote Redis and hping, and blogs about C, systems programming and working alone.
Distributing LLM inference in DwarfStar High end NVIDIA cards, and the server and power needed to run them, cost a lot of money, especially if you plan to reach enough VRAM to run massive models. The alternative, so far, has been Apple hardware, or the DGX Sp…
LLMs Related
Writes Strange Loop Canon, on the intersection of technology, economics and business — "building models of the world to understand these problem areas and to define them better".
24 May
Co-founder and CEO of Every. Writes the Chain of Thought column about working with AI tools and hosts the podcast AI & I.
benchmarks
Their words
And so I think it's it's really important uh when when we think about benchmark progress to think about it from that perspective, which is benchmarks rise on problems that we've framed that we can articulate, that we can score. And there's a lot of work that's human work that uh it it can't be scored until you write it down
Show the whole quote
youtube.com
21 May
Software engineer and engineering leader at Canonical, working on Ubuntu; writes about his homelab, Nix and tooling at jnsgr.uk.
19 May
Novelist and critic, author of The Body Scout and Metallic Realms; writes the newsletter Counter Craft on fiction craft and the publishing industry.
Founding member of OpenAI and former director of AI at Tesla; creator of nanoGPT and the term "vibe coding".
Personal update: I've joined Anthropic. I think the next few years at the frontier of LLMs will be especially formative. I am very excited to join the team here and get back to R&D. I remain deeply passionate about education and plan to resume my work on it in time. LLMs Anthropic Related
Programmer; wrote Redis and hping, and blogs about C, systems programming and working alone.
Alternatives for the EDIT tool of LLM agents EDIT: of course this was already done in the past! I had little doubts but people just confirmed me about it on Twitter :) But, keep reading: the CRC32 compromise at the end is an interesting tradeoff, and this is a goo…
LLMs Related
18 May
Machine learning engineer working on recommender systems, personalization and information retrieval. Previously worked on LLMs and LLM infrastructure at Mozilla.ai and on ML and recsys at Duo, Tumblr, Automattic and Comcast; wrote the 'What are embeddings?' text and ran the Normconf conference.
Tagging my blog posts with BERTopic and LLMs I recently added tags to my blog using BERTopic and a mix of LLMs. You can see the tags in the sidebar to the right (or in the footer on mobile). I’ve done this before in 2023, with GGUF Mistral using llama-cpp, b…
LLMs Related
16 May
AI research engineer working on large language models. He writes the Ahead of AI newsletter and is the author of Build a Large Language Model (From Scratch).
15 May
Free software developer; maintainer of sway, wlroots, aerc and scdoc, and founder of the SourceHut (sr.ht) software forge.
27 April
JavaScript programmer; creator of the jQuery library, author of Secrets of the JavaScript Ninja, and long-time engineer at Khan Academy.
An amusing side effect of using LLMs when working at @khanacademy is that occasionally they're like "You're trying to cheat, aren't you?? No cheating allowed!!" (Clearing the chat and using more authority usually works well!) LLMs Related
Founded CD Baby in 1998 and sold it in 2008, giving the proceeds to a charitable trust for music education. Since then a writer and speaker: five books and 550+ articles, published first at sive.rs, which they hand-code and keep free of advertising.
Bluesky My favorite LLM prompt: “List the top cities in {COUNTRY}, and anthropomorphize each one, listing the good-natured stereotypes and jokes that other people in {COUNTRY} say about people in this city.” LLMs Related
x.com My favorite LLM prompt: “List the top cities in {COUNTRY}, and anthropomorphize each one, listing the good-natured stereotypes and jokes that other people in {COUNTRY} say about people in this city.” LLMs Related
26 April
Investigative journalist on policing, forensics and criminal justice; wrote Rise of the Warrior Cop and writes The Watch.
24 April
Writes Strange Loop Canon, on the intersection of technology, economics and business — "building models of the world to understand these problem areas and to define them better".
22 April
Former L8 engineer at Meta, Microsoft and Atlassian, now writing and building solo on agentic engineering. Writes Kun's Field Notes and posts a lot about AI coding agents on X.
Researcher on distributed systems and local-first software at the University of Cambridge; wrote Designing Data-Intensive Applications.
From one piece
Designing Data-intensive Applications with Martin Kleppmann
2 beliefs, in the piece's order there
LLMs
Their words
One is that the LLMs are getting increasingly good at writing these proofs. And if we don't have to write the proof by hand as humans, it just becomes feasible to do them in situations where previously it would have not been economical.
Show the whole quote
youtube.com
LLMs
Their words
But also LLMs increase the need for these formal proofs because, you know, we're live coding a bunch of stuff. If we have to manually review all of that code, then that will become the bottleneck.
Show the whole quote
youtube.com
18 April
AI research engineer working on large language models. He writes the Ahead of AI newsletter and is the author of Build a Large Language Model (From Scratch).
15 April
Co-founder of NVIDIA and, as of 2026, its chief executive; the company designs the GPUs most large AI models are trained on.
10 April
AI research engineer working on large language models. He writes the Ahead of AI newsletter and is the author of Build a Large Language Model (From Scratch).
4 April
AI research engineer working on large language models. He writes the Ahead of AI newsletter and is the author of Build a Large Language Model (From Scratch).
2 April
Co-founder of Ethereum. Publishes long essays on mechanism design, governance and what cryptography is for, and returns to earlier positions to say which parts they no longer hold.
Co-founder of Ethereum. Publishes long essays on mechanism design, governance and what cryptography is for, and returns to earlier positions to say which parts they no longer hold.
Their words
Its responses are, in my view, pretty bland and not very high-quality. I did a side-by-side test of asking Local Deep Research a question, then asking pi the same question (telling it to use searxng to make as many internet searches as needed), and I fed both outputs into an LLM to ask which is better.
Show the whole quote
vitalik.eth.limo
Their words
Sandboxing To keep my LLMs in check, I do most of my LLM usage from inside of a sandbox. I use bubblewrap for this.
Show the whole quote
vitalik.eth.limo
1 April
Uber's first Chief Technology Officer, from 2013 to 2020; later CTO of Coupang and of Faire.
31 March
Novelist and critic, author of The Body Scout and Metallic Realms; writes the newsletter Counter Craft on fiction craft and the publishing industry.
28 March
Founding member of OpenAI and former director of AI at Tesla; creator of nanoGPT and the term "vibe coding".
LLMs
Their words
The LLMs may elicit an opinion when asked but are extremely competent in arguing almost any direction. This is actually super useful as a tool for forming your own opinions, just make sure to ask different directions and be careful with the sycophancy.
Show the whole quote
@karpathy on X x.com
25 March
Founding member of OpenAI and former director of AI at Tesla; creator of nanoGPT and the term "vibe coding".
LLMs
Their words
One common issue with personalization in all LLMs is how distracting memory seems to be for the models. A single question from 2 months ago about some topic can keep coming up as some kind of a deep interest of mine with undue mentions in perpetuity.
Show the whole quote
@karpathy on X x.com
23 March
Writer and former Substack product manager; publishes essays and interviews on technology, culture and China at jasmi.news.
22 March
Software engineer; co-founder and former CTO of Tailscale, previously on the Go team at Google.
21 March
Programmer on the Dart language at Google and author of Game Programming Patterns and Crafting Interpreters; previously a game developer at EA.
I've read so many articles in the past year from developers talking about how much more productive LLMs have made them at work. You know what I can't recall a single one of them mentioning? Getting a raise because of it. LLMs Related
20 March
Novelist and critic, author of The Body Scout and Metallic Realms; writes the newsletter Counter Craft on fiction craft and the publishing industry.
Founding member of OpenAI and former director of AI at Tesla; creator of nanoGPT and the term "vibe coding".
LLMs
Their words
a swarm of agents on the internet could collaborate to improve LLMs and could potentially even like run circles around frontier labs. Like who knows, you know? Um yeah, like maybe that's even possible. Like frontier labs have a huge amount of trusted compute but the earth is much bigger and has huge amount of untrusted compute.
Show the whole quote
youtube.com
18 March
Novelist and critic, author of The Body Scout and Metallic Realms; writes the newsletter Counter Craft on fiction craft and the publishing industry.
Pseudonymous writer; posts careful, funny investigations of everyday questions — air quality, seed oils, arguing, chess — usually by reading the studies.
14 March
Canadian bootstrapper and writer on small software businesses. Co-founder of the podcast hosting company Transistor.fm and author of the book Marketing for Developers.
13 March
Systems and developer-tools engineer at Cloudflare as of 2026, on durable infrastructure for AI agents; worked on React and PartyKit before that. Writes at sunilpai.dev.
10 March
Co-founder of Modem and a founding engineer at Sentry, where he went on to be VP of Engineering. Co-author of Third-party JavaScript, and co-host of the State of Agentic Coding podcast with Armin Ronacher.
Writer and consultant on formal methods and software correctness; author of Practical TLA+ and Logic for Programmers.
3 March
Programmer and designer who writes at tonsky.me; author of Fira Code, DataScript and AnyBar.
1 March
Programmer; wrote Redis and hping, and blogs about C, systems programming and working alone.
25 February
Creator of Claude Code at Anthropic.
LLMs Anthropic startups
Their words
At Anthropic, we don't build for the model of today, we build for the model of six months from now. And that's still my advice to founders that are building on LLMs.
Show the whole quote
x.com
19 February
Founded Bridgewater Associates in 1975 and led it until stepping back from control in 2022. Author of Principles, The Changing World Order and How Countries Go Broke; publishes economic analysis at economicprinciples.org.
17 February
Programmer based in Vancouver who writes at scattered-thoughts.net about databases, programming language design and developer tools; author of the Imp, Dida and Zest language experiments.
LLMs energy
Their words
Both estimates make me think that the concern about global energy demand for LLMs is over-blown.
Show the whole quote
scattered-thoughts.net
12 February
Professor of economics at George Mason University and Bartley J. Madden Chair at the Mercatus Center. Co-writes the blog Marginal Revolution and co-authors the textbook Modern Principles of Economics with Tyler Cowen.
benchmarks
Their words
We show that equilibrium generically occurs at neither the Harberger nor Glaeser-Luttmer benchmark. Cost-minimizing suppliers drive allocations to vertices, not interiors. Corners are not an assumption but an outcome about what cost-minimizing suppliers choose. The correct benchmark is corners, not random, and corners generate qualitatively different welfare properties: losses far larger than either efficient or random distributions, and discontinuous jumps from small parameter perturbations.
Show the whole quote
arxiv.org
8 February
Software engineer; co-founder and former CTO of Tailscale, previously on the Go team at Google.
Eight more months of agents 2026-02-08 I wrote up my experiences programming with LLMs a bit over a year ago, and updated it for the world of agents eight months ago. A lot has changed since then, so here is an update. Agents have improved dramati…
LLMs Related
1 February
Hosts the Lex Fridman Podcast — long, unhurried conversations with scientists, engineers and public figures. Several of the interviews quoted elsewhere on this site are episodes of it.
27 January
Programmer and writer; co-wrote The Rust Programming Language and worked on Rust's documentation for years.
25 January
Founder of WP Engine and Smart Bear; writes A Smart Bear, long essays on strategy, pricing and how startups actually fail.
LLMs
Their words
if you think about it, it sort of makes sense because the LLM is an averaging machine, right? It's predicting the most likely that's an averaging kind of a thing. And so when what you're looking for is a kind of average, it's usually pretty good. So, summarization, topics, themes. But when you're asking for like what is interesting and not average, it's actually pretty bad at it.
Show the whole quote
youtube.com
15 January
Neuroscientist and novelist writing on consciousness, artificial intelligence and culture in the newsletter The Intrinsic Perspective.
1 January
Professor of Cognitive and Computational Neuroscience at the University of Sussex, co-director of the Sussex Centre for Consciousness Science, and author of Being You: A New Science of Consciousness.
31 December 2025
Co-creator of Django and creator of Datasette; writes daily at simonwillison.net.
Their words
One of my favourite pieces on LLM security this year is The Normalization of Deviance in AI by security researcher Johann Rehberger.
Show the whole quote
simonwillison.net
23 December 2025
Designer and technologist; author of The Laws of Simplicity; former president of the Rhode Island School of Design; formerly at the MIT Media Lab.
20 December 2025
Programmer; wrote Redis and hping, and blogs about C, systems programming and working alone.
Reflections on AI at the end of 2025 * For years, despite functional evidence and scientific hints accumulating, certain AI researchers continued to claim LLMs were stochastic parrots: probabilistic machines that would: 1. NOT have any representation about…
LLMs Related
Nothing matches. Show everything
A korrent is a belief a person has stated in their own words: one
sentence stating the claim, backed by a quote and a source, kept at
korrents.com .
Under a name here, the quoted block is what they actually said.
The korrent beneath it is the claim those words support, in
korrents' wording — tap it to see the record, its source, and who
else holds it.
Nobody here wrote their own korrents. They are compiled from public
statements, and a person can change their mind, which is recorded too.
Got it
About the English under a post
Some people here publish in a language other than English. Where they
do, this site shows a machine translation beneath the post, in
this typeface — the site's own, not theirs.
The post itself is never changed, moved or hidden: what is set in the
serif above is exactly what the person published, and it is what to
quote them on. A translation can be wrong in ways that matter,
especially about tone.
Only the post's own words are translated. A quoted post, a linked
article and a belief on korrents.com
are left in their original language.
Got it