Related posts
Sebastian Raschka
GitHub
RAGs — RAGs: Simple implementations of Retrieval Augmented Generation (RAG) Systems
implementations augmented retrieval
The the words it uses that this site has seen
least often elsewhere. Posts are matched on those words alone —
nothing here is a summary of this one.
Sources
All Writing GitHub Blog Bluesky x.com Newsletter Korrents Site
Top people
Daniel Lemire
Eugene Yan
Jason Liu
Scott Hanselman
Luke Wroblewski
Ben Vinegar
Steven Johnson
Hillel Wayne
Stefan Judis
Nelson Elhage
Richard Sutton
Hamel Husain
Showing Profile →
Show everything
Hiding Show them again
Show them again
Further back ↓
Hiding Show them again
17 September
Computer science professor who works on fast data processing; co-author of the simdjson parser and a weekly blogger about software performance since 2004.
Release fastconstmap v0.10.0 — v0.10.0 — PairedVerifiedConstMap, formats shared with Go and Rust — Fast, immutable, compact map from strings to 64-bit integers — for Python. Release notes PairedVerifiedConstMap, a cache-friendlier layout for the verified map, and file formats shared with the Go and Rust implementations. Nothing existing changes behaviour: every class, method and error is as before, and e…
Related
Release rsconstmap v0.3.0 — v0.3.0: PairedVerifiedConstMap, interoperable formats — A static map from strings to u64 values using binary fuse filter construction. It can be several times smaller and faster t… Release notes PairedVerifiedConstMap, a cache-friendlier layout for the verified map, and file formats shared with the Go and Python implementations. This release is purely additive. Nothing was removed or renamed, and the CMAP0001 a…
Related
Release constmap v1.2.0 — A fast, compact, immutable map from strings to uint64 values in Go. Release notes PairedVerifiedConstMap, a cache-friendlier layout for the verified map, and file formats shared with the Rust and Python implementations. This release is purely additive. Nothing was removed or renamed, and the CMAP0001…
Related
22 August
Computer science professor who works on fast data processing; co-author of the simdjson parser and a weekly blogger about software performance since 2004.
17 August
Product designer and entrepreneur; author of Mobile First and Web Form Design; formerly a product director at Google; now building AI products.
Ask LukeW: A New Retrieval System The Ask LukeW feature on my Web site has been answering people's product design questions using my writings, talks, images, and videos for over three years. During that time, I've seen people ask lots of different kinds…
Related
20 July
Co-founder of Modem and a founding engineer at Sentry, where he went on to be VP of Engineering. Co-author of Third-party JavaScript, and co-host of the State of Agentic Coding podcast with Armin Ronacher.
3 June
Non-fiction writer, podcaster and occasional TV host. Author of thirteen books including The Ghost Map, Where Good Ideas Come From and Extra Life, host of the PBS series How We Got To Now, and author of the Adjacent Possible newsletter on innovation.
Covered a lot of ground with @dblums on the Webby-winning Future Around And Find Out podcast, including: • why AI podcasts need imperfections • how Dungeons & Dragons players are embracing @NotebookLM • using AI to uncover unexpected connections • the new possibilities of AI-augmented writing • the downsides of cognitive offloading • using AI as your second brain to help you deepen your thinking, not replace it youtube.com
Related
21 April
Writer and consultant on formal methods and software correctness; author of Practical TLA+ and Logic for Programmers.
1 April
German web developer, writer and conference speaker. Publishes the Web Weekly newsletter and blogs about the web platform at stefanjudis.com.
23 March
Software engineer who writes the blog Made of Bugs about performance, debugging and understanding computer systems. Previously worked at Anthropic on interpretability, at Stripe on Sorbet, and at Ksplice.
From error-handling to structured concurrency How should we think about error-handling in concurrent programs? In single-threaded programs, we’ve mostly converged on a standard pattern, with a diverse zoo of implementations and concrete patterns. When an error occu…
Related
9 February
Programmer, teacher and speaker; long-time Microsoft developer-community figure, host of the Hanselminutes podcast and author of the hanselman.com blog.
4 February
Programmer, teacher and speaker; long-time Microsoft developer-community figure, host of the Hanselminutes podcast and author of the hanselman.com blog.
26 September 2025
Reinforcement-learning researcher; co-wrote the field's standard textbook, wrote The Bitter Lesson, and shared the 2024 Turing Award.
Their words
So I do think succession to digital or digital intelligence or augmented humans is inevitable.
Show the whole quote
youtube.com
14 September 2025
Member of technical staff at Anthropic. He has led ML/AI teams at Amazon, Alibaba and Lazada, and writes about LLMs, recommender systems and engineering at eugeneyan.com.
11 September 2025
Machine learning engineer and consultant focused on RAG and retrieval systems. He writes about applied AI engineering at jxnl.co and is the author of the instructor library.
+ 1 more
12 April 2025
Member of technical staff at Anthropic. He has led ML/AI teams at Amazon, Alibaba and Lazada, and writes about LLMs, recommender systems and engineering at eugeneyan.com.
Stumbled on the first(?) RAG in NarrativeQA from 2017. Because books & movies were too large for LSTMs to do Q&A on, they embedded 200-word chunks and retrieved similar snippets to answer questions. "Chunking and cosine similarity retrieval is so 2017." arxiv.org
Related
8 April 2025
Member of technical staff at Anthropic. He has led ML/AI teams at Amazon, Alibaba and Lazada, and writes about LLMs, recommender systems and engineering at eugeneyan.com.
Can't wait for when I can vibe code a production recommender system. Until then, here's some system designs: • Retrieval vs. Ranking: eugeneyan.com/writing/syst... • Real-time retrieval: eugeneyan.com/writing/real... • Personalization: eugeneyan.com
Related
29 July 2024
Machine learning engineer and independent AI consultant. He writes about LLM evaluation, tooling and applied ML at hamel.dev, and previously worked on machine learning at GitHub.
An Open Course on LLMs, Led by Practitioners Today, we are releasing Mastering LLMs, a set of workshops and talks from practitioners on topics like evals, retrieval-augmented-generation (RAG), fine-tuning and more. This course is unique because it is: Taught by 25…
LLMs Related
7 July 2024
Member of technical staff at Anthropic. He has led ML/AI teams at Amazon, Alibaba and Lazada, and writes about LLMs, recommender systems and engineering at eugeneyan.com.
19 June 2024
Co-founder and CEO of Perplexity, an AI answer engine; previously a research scientist at OpenAI and a PhD student at UC Berkeley.
Their words
There is an algorithm called BM25 precisely for this, which is a more sophisticated version of TF-IDF. TF-IDF is term frequency times inverse document frequency, a very old-school information retrieval system that just works actually really well even today. And BM25 is a more sophisticated version of that, that is still beating most embeddings on ranking.
Show the whole quote
youtube.com
15 April 2024
Research scientist at Meta in Berlin working on multilingual models and evaluation; led the multilingual team at Cohere and was a research scientist at Google DeepMind before that.
LLMs
Their words
Retrieval-augmented generation (RAG; Lewis et al., 2020), which conditions on the LLM's generation on retrieved documents is the most practical paradigm IMO.
Show the whole quote
Command R+ ruder.io
9 February 2024
Writer and illustrator behind Wait But Why, a long-form blog of stick-figure-illustrated explainers on science, technology and society, and author of the book What's Our Problem?
29 June 2023
Programmer; founded comma.ai and tinygrad, and was the first to unlock the iPhone.
LLMs
Their words
I think future LLMs are going to be smaller, but are going to run looping on themselves and are going to have retrieval systems. And the thing about using a retrieval system is you can cite sources, explicitly.
Show the whole quote
youtube.com
15 April 2022
Machine-learning researcher; has written the Lil'Log survey posts on how a model technique works since 2017, and worked at OpenAI from 2018 to 2024, latterly leading its safety systems team.
Nothing matches. Show everything
A korrent is a belief a person has stated in their own words: one
sentence stating the claim, backed by a quote and a source, kept at
korrents.com .
Under a name here, the quoted block is what they actually said.
The korrent beneath it is the claim those words support, in
korrents' wording — tap it to see the record, its source, and who
else holds it.
Nobody here wrote their own korrents. They are compiled from public
statements, and a person can change their mind, which is recorded too.
Got it
About the English under a post
Some people here publish in a language other than English. Where they
do, this site shows a machine translation beneath the post, in
this typeface — the site's own, not theirs.
The post itself is never changed, moved or hidden: what is set in the
serif above is exactly what the person published, and it is what to
quote them on. A translation can be wrong in ways that matter,
especially about tone.
Only the post's own words are translated. A quoted post, a linked
article and a belief on korrents.com
are left in their original language.
Got it