What public figures publish and believe, in their own words.
About this feed
Highlights: posts that did unusually well for the person who wrote them, everything they published at length, each release and new project, and every belief — at most two a day from anyone. Day by day, newest day first; within a day, the people with the most beliefs on this site come first. Nothing else orders it. Show everything instead.
The quoted blocks are what people actually said; a beneath one is the belief those words support, in korrents' wording. Nobody here wrote their own page.
Top people are the people in this feed with the most beliefs on this site, then the most here. Choose an area and the row leads with the people whose beliefs are about it; tap a face for their feed.
All of AI
GoogleLLMsAI alignmentOpenAIdata centersAnthropicbenchmarksAGIAI and jobsARC-AGIHuggingFace
Top people in AI
Showing Profile →
Hiding
Hiding
8 April 2025
5 April 2025
From one piece Nonproliferation is the wrong approach to AI misuse 4 beliefs, in the piece's order there
-
Their words
By trying to use misuse as a fig leaf for their real concerns, they end up sounding much less credible than if they just tried to argue for what they actually meant.
-
Their words
But we do not have experience with the kinds of problems we’ll face if we build machines that are smarter and more capable than us, so I feel much less sanguine that an adaptation-based strategy will help us there.
-
Their words
We should think of the gap between frontier models and proliferated models as an adaptation buffer: a limited time window when we know what bad actors will soon be able to use AI for, which gives us a chance to implement defensive measures that increase society’s resilience to the danger.
+ 1 more
-
Their words
But with AI, it’s different: it’s often only a couple of years between when you need a world-class computing cluster to do something and when you can run it on a high-end gaming chip on your laptop.
3 April 2025
-
Their words
But no one has (yet) been able to develop a model that is resistant to targeted “jailbreaking” that evades these restrictions.
1 April 2025
-
Their words
These systems will be absolutely central to the economy, technology, and national security, and will be capable of so much autonomy that I consider it basically unacceptable for humanity to be totally ignorant of how they work.
31 March 2025
30 March 2025
26 March 2025
25 March 2025
From one piece The Death of Product Development as We Know it 2 beliefs · lg.substack.com
-
Their words
Welcome to the era of AI-native companies, where individual contributors (ICs) reign supreme.
The Death of Product Development as We Know itlg.substack.com
-
Their words
Say goodbye to cycles of mock and doc feedback, and say hello to code-first prototypes with constant iteration (on prompts, models, etc) to answer three key questions.
The Death of Product Development as We Know itlg.substack.com
24 March 2025
23 March 2025
-
Their words
basically everything I thought would work out well, people use it less than I thought they did. And everything where I was like, I don't know, but let's build the thing. People love that.
22 March 2025
From one piece ThePrimeagen: Programming, AI, ADHD, Productivity, Addiction, and God | Lex Fridman Podcast #461 5 beliefs, in the piece's order there
-
korrents.com
Coding with an AI assistant slides from copiloting into autopiloting, and the bugs that follow are hard to trace.Their words
For me personally, I kept introducing bugs, and I couldn't figure out why. And what I realized is that I developed... I wasn't copiloting well, I was autopiloting much better.
-
Their words
Sometimes you have to move fast at the sacrifice of knowledge, and I'm totally on board for that, but I worry that what we'll create is an entire generation of incompetent programmers who can do some amount of things well, but anything that is unique, bespoke, or requires some extra like little elbow grease, might become very difficult. It might cause a whole chasm where juniors remain juniors forever.
-
korrents.com
Prompt injection is an extremely hard attack to defend against, and hardly anyone integrating AI is talking about it.Their words
One thing that I don't think a lot of people are talking about as we integrate more and more AI is that prompt injection is an extremely hard thing to defend against because it's not really clear how you defend against it.
+ 2 more
-
Their words
It doesn't actually care about the craft. But when you work with an intern or you work with somebody else, they care. When they factor something, they actually go over and go, "Oh yeah, this is actually kind of bad. I'm going to come back to that." They finish this, they go back over here and they make this even better. They actually care about the thing itself.
-
Their words
And if you truly make yourself irrelevant, I would challenge you that you're just doing something that was just slightly too complicated to automate.
-
korrents.com
A strong track record in a technical field is only weak evidence that someone has good strategic judgment about AGI.Their words
Having a good research track record is some evidence of good big-picture takes about AGI, but it's weak evidence.
18 March 2025
16 March 2025
13 March 2025
11 March 2025
9 March 2025
-
Their words
It's easy to get impressive-looking results if you're comparing against a poorly-tuned baseline, and that observation turns out to explain a surprising fraction of supposed improvements.
7 March 2025
-
Their words
In a vibe coding future, companies will hopefully invest more in understanding user needs, refining the interface, and polishing details that delight users, because those are harder for AI to get right without guidance.
6 March 2025
5 March 2025
2 March 2025
-
Lovedrcmnd.app
Claude 3.7 SonnetTheir words
As a Python and JavaScript programmer my favorite models right now are Claude 3.7 Sonnet with thinking turned on, OpenAI’s o3-mini-high and GPT-4o with Code Interpreter (for Python).
27 February 2025
21 February 2025
-
Their words
Once, humans navigated the web manually. In the future, AI agents will act on our behalf, browsing, clicking, and deciding. This shift marks the end of traditional UI design and accessibility, ushering in a future where agents are the primary users of digital services.
20 February 2025
16 February 2025
15 February 2025
From one piece Some Very Important Things (That I Won't Be Working On This Year) 2 beliefs, in the piece's order there
-
Their words
I’m quite confident that AI will eliminate many millions of people’s jobs in the next few years.
-
Their words
Contrary to some people’s beliefs, companies do not in fact have sufficient incentives to mitigate all major risks, and competition is driving corner-cutting that needs to be reined in somehow.
14 February 2025
12 February 2025
-
Likedaffiliate linkrcmnd.app
Google FiTheir words
I switched to Google Fi in 2015 for worldwide, $20-per-month phone service that just works.
11 February 2025
10 February 2025
9 February 2025
-
korrents.com
People will find new kinds of useful work as AI advances, though it will not resemble the jobs of today.Their words
We will find new things to do, new ways to be useful to each other, and new ways to compete, but they may not look very much like the jobs of today.
3 February 2025
From one piece DeepSeek, China, OpenAI, NVIDIA, xAI, TSMC, Stargate, and AI Megaclusters | Lex Fridman Podcast #459 5 beliefs, in the piece's order there
-
Their words
OpenAI has a fantastic margin. When they're doing inference, their gross margins are north of 75%. So that's a four to five X factor right there of the cost difference, is that OpenAI is just making crazy amounts of money because they're the only one with the capability.
-
Their words
It's an objective fact that the world has been the most peaceful it's ever been when there are global hegemons, or regional hegemons in historical context. The Mediterranean was the most peaceful ever when the Romans were there.
-
Their words
if you believe we're in this sort of stage of economic growth and change that we've been in for the last 20 years, the export controls are absolutely guaranteeing that China will win long-term.
+ 2 more
-
Their words
China, if they wanted to build the largest data center in the world, if they had access to the chips, could. So it's just a question of when, not if.
-
Their words
it won't be one person rule them all, but it will be, the thing I worry about is it'll be few people, hundreds, thousands, tens of thousands, maybe millions of people rule whoever's left and the economy around it.
From one piece DeepSeek, China, OpenAI, NVIDIA, xAI, TSMC, Stargate, and AI Megaclusters | Lex Fridman Podcast #459 5 beliefs, in the piece's order there
-
Their words
until there are feedback loops of open source AI, it seems like mostly an ideological mission. People like Mark Zuckerberg, which is like America needs this and I agree with him, but in the time where the motivation ideologically is high, we need to capitalize and build this ecosystem around, what benefits do you get from seeing the language model data?
-
Their words
The more progress that AI makes or the higher the derivative of AI progress is, especially because NVIDIA's in the best place, the higher the derivative is, the sooner the market's going to be bigger and expanding and NVIDIA's the only one that does everything reliably right now.
-
Their words
Accepted practice is that for any given model that is a notable advancement, you're going to do two to 4x compute of the full training run in experiments alone.
+ 2 more
-
Their words
This is why you want to work in post-training because the GPU cost for training is lower. So you can make a higher percentage of your training runs YOLO runs.
-
Their words
Code and data is hard, but ideas is easy. Silicon Valley operates on the way that top employees get bought out by other companies for a pay raise, and a large reason why these companies do this is to bring ideas with them.
2 February 2025
From one piece The Real Lesson of DeepSeek's R1 3 beliefs, in the piece's order there
-
korrents.com
AI progress is faster than people expect, and ordinary scaling can be enough to solve problems that looked very hard.Their words
GPT-2, R1, and nearly every other AI model released since 2018 have all been part of a consistent story: AI capabilities that rival and ultimately exceed human intelligence are easier and cheaper to build than almost anyone can intuitively grasp, and this gets easier and cheaper every month.
-
Their words
AI competition needs to be tempered with a recognition that China isn’t going away as a player in AI, and that coexistence must also be a part of America’s strategy.
-
Their words
Each and every time, it took at most a few years but typically months before other companies would achieve the same level of performance using a broadly similar, and always relatively simple, recipe.
-
Recommendsrcmnd.app
The Hard Thing About Hard ThingsTheir words
Zero To One, Hard Thing about Hard Things, High Growth Handbook, AI Superpowers
-
Recommendsrcmnd.app
AI SuperpowersTheir words
Zero To One, Hard Thing about Hard Things, High Growth Handbook, AI Superpowers
-
Recommendsrcmnd.app
High Growth HandbookTheir words
Zero To One, Hard Thing about Hard Things, High Growth Handbook, AI Superpowers
+ 1 more
-
Recommendsrcmnd.app
Zero to OneTheir words
Zero To One, Hard Thing about Hard Things, High Growth Handbook, AI Superpowers
31 January 2025
30 January 2025
-
Usesrcmnd.app
CursorTheir words
It is a fork of Visual Studio Code with AI-based auto completion and code generation built-in. It’s my go-to for programming with AI assistance at the moment.
-
Likedrcmnd.app
llmTheir words
This is a command line tool with plenty of plugins that lets you prompt different models. Think of it as a command-line version of Open WebUI. It’s particularly useful for quick scripting and basic automation.
-
Usesrcmnd.app
OllamaTheir words
First and foremost, I use this to talk to local models hosted by Ollama, but secondarily I also use it to interface with other remote services like OpenAI, Anthropic and DeepSeek.
+ 1 more
-
Usesrcmnd.app
ChatGPT PlusTheir words
Like probably most AI users, I use ChatGPT, particularly on my phone. I pay for the Plus subscription because I use it enough to get a lot of value out of it.
29 January 2025
-
Their words
And so, while the Jevons paradox case was 100% correct in the long run, 97% of the fiber laid in 2001 was unlit.
27 January 2025
From one piece Building personal software with Claude 3 beliefs, in the piece's order there
-
Their words
Also, current models, while impressive, still fall well short of expert human performance.
-
korrents.com
As AI makes code cheaper to produce, understanding and architectural design become more valuable.Their words
Thus, code is cheaper than ever, but I suspect that insight and good architectural design and understanding, at least for now, will become more valuable than ever.
-
korrents.com
AI tooling and interface design lags behind the underlying models' actual capabilities.Their words
Overall, though, this experience reinforced my belief that the tooling and interface design around LLMs is lagging way behind the actual capabilities, and is an area of active experimentation and development, even aside from any future model improvements.
26 January 2025
-
Likedrcmnd.app
GeminiTheir words
Gemini’s advantage is a family of powerful models including reasoners, very good integration with search, and a pretty easy-to-use user interface, as you might expect from Google. It also has top-flight image and video generation.
-
Likedrcmnd.app
ChatGPTTheir words
currently has the best Live Mode in its Advanced Voice Mode. The other big advantage of ChatGPT is that it does everything, often in somewhat confusing ways
-
Lovedrcmnd.app
Claude 3.5 SonnetTheir words
and really only has one model you care about - Claude 3.5 Sonnet. But Sonnet is very, very good. It often seems to be clever and insightful in ways that the other models are not.
24 January 2025
-
Their words
More generally, we should actually solve alignment instead of just trying to control misaligned AI.
Should we control AI instead of aligning it?aligned.substack.com
19 January 2025
From one piece 10 growth tactics that never work | Elena Verna (Amplitude, Miro, Dropbox, SurveyMonkey) 2 beliefs, in the piece's order there
-
korrents.com
Industry benchmarks are a dangerous target because every company defines the underlying metric differently.Their words
So, taking also any benchmark that is derived from competition and saying this is where we should be is also so dangerous because it might not even be applicable depending on how you define the metric.
-
Their words
Focusing on these earned channels that you own becomes the utmost priority. And if you don't have them on your growth road map, you're going to be in some really big trouble over the next year to two years because your cost of acquisition is only going to go up.
16 January 2025
From one piece Common pitfalls when building generative AI applications 3 beliefs, in the piece's order there
-
korrents.com
Building a working AI demo is far easier than turning it into a reliable production product.Their words
This is perhaps one of the first painful lessons anyone who has built an AI product quickly learns. It's easy to build a demo, but hard to build a product.
-
Their words
Because everyone uses the same models nowadays, the AI components of AI products are similar, and the differentiation is product.
-
korrents.com
AI judges used to evaluate AI outputs need ongoing validation and iteration, just like any other AI system.Their words
AI judges must be evaluated and iterated over time, just like all other AI applications.
15 January 2025
13 January 2025
From one piece Capital Cycles and AI 2 beliefs, in the piece's order there
-
Their words
What prevents this from being a broad-based bubble is that we are missing a critical feedback loop from the announcement's impact, like network growth or land value.
-
korrents.com
If the AI build-out does become a bubble, power and data centres are the assets that will carry it.Their words
In today’s world, I think the increase in self-fulfilling asset prices will be due to power and data centers.
From one piece PM speech on AI Opportunities Action Plan, 13 January 2025 3 beliefs · gov.uk
-
korrents.com
On AI the state's job does not stop at safety; leaving everything else to the market is a mistake.Their words
We shouldn’t just focus on safety and leave the rest to the market… Government has a responsibility to make it work for working people…
-
Their words
This is the global race of our lives. Now, some countries are going to make AI breakthroughs and export them… Others will end up buying those breakthroughs and importing them. The question is – which of those will Britain be? AI maker or AI taker?
-
korrents.com
AI will make public services more human rather than less, by giving staff back the time the paperwork takes.Their words
And in a way that’s the irony of AI… It will make public services more human… Reconnect staff with the reasons they came to public service in the first place…
12 January 2025
11 January 2025
10 January 2025
7 January 2025
-
korrents.com
Most real-world AI agent systems are actually multi-agent systems made of multiple components.Their words
Because most agentic workflows are sufficiently complex to involve multiple components, most agents are multi-agent.
6 January 2025
From one piece How I program with LLMs 2 beliefs, in the piece's order there
-
Their words
One thing humans appear to be much better than LLMs at (as of January 2025) is not getting distracted.
-
Their words
So I foresee a world with far more specialized code, with fewer generalized packages, and more readable tests.
3 January 2025
2 January 2025
-
Lovedrcmnd.app
Google Cloud PlatformTheir words
We use GCP extensively at work and I absolutely love their many quality services.
1 January 2025
31 December 2024
-
Their words
There’s still plenty to worry about with respect to the environmental impact of the great AI datacenter buildout, but a lot of the concerns over the energy cost of individual prompts are no longer credible.
-
Recommendsrcmnd.app
Is AI progress slowing down?Their words
To understand more about inference scaling I recommend Is AI progress slowing down?
-
Recommendsrcmnd.app
The Rattle BagTheir words
The Rattle Bag edited by Seamus Heaney and Ted Hughes - In an age of LLM-generated poetry and machine learning curation (even coming from yours truly sometimes), it's refreshing to have real people who love poetry curate it and show you what you need to read to touch grass.
23 December 2024
22 December 2024
-
korrents.com
Large language models will not get to real agency, because a mind has to be embedded in a world through a body.Their words
But they said, "Look, in the end, actually the only way to actually get a real brain in the VAT is actually to have a brain in a body." And it could be a robot body, but you still need a brain in the body. So I don't think LLMs will get there because they can't. You really need to be embedded in a world, at least that's the E-four idea.
20 December 2024
-
Their words, before
This "memorize, fetch, apply" paradigm can achieve arbitrary levels of skills at arbitrary tasks given appropriate training data, but it cannot adapt to novelty or pick up new skills on the fly (which is to say that there is no fluid intelligence at play here.)
Their words now
OpenAI's new o3 model represents a significant leap forward in AI's ability to adapt to novel tasks. This is not merely incremental improvement, but a genuine breakthrough, marking a qualitative shift in AI capabilities compared to the prior limitations of LLMs.
From one piece OpenAI o3 Breakthrough High Score on ARC-AGI-Pub 2 beliefs · arcprize.org
-
Their words
Passing ARC-AGI does not equate to achieving AGI, and, as a matter of fact, I don't think o3 is AGI yet. o3 still fails on some very easy tasks, indicating fundamental differences with human intelligence.
OpenAI o3 Breakthrough High Score on ARC-AGI-Pubarcprize.org
-
Their words
o3's improvement over the GPT series proves that architecture is everything. You couldn't throw more compute at GPT-4 and get these results. Simply scaling up the things we were doing from 2019 to 2023 -- take the same architecture, train a bigger version on more data -- is not enough.
OpenAI o3 Breakthrough High Score on ARC-AGI-Pubarcprize.org
16 December 2024
-
Readrcmnd.app
Software Engineering at GoogleTheir words
the second part is interesting in getting a proper look into Google software engineering practices.
-
Their words
a good overview of SRE at Google. For those who worked at places with oncall, much of the first part of the book will likely be very familiar. Keep in mind that your mileage might vary: what works at Google scale, might not be the ideal fit for your use case.
-
Lovedrcmnd.app
Leading Effective Engineering TeamsTheir words
A decade of lessons learned in motivating and leading engineering teams at Google.
10 December 2024
-
Usestheir ownrcmnd.app
Cloudflare WorkersTheir words
Anyway that’s why I’m using Cloudflare Workers for my AI agent stuff. Race you to the finish line.
-
Likedtheir ownrcmnd.app
Workers AITheir words
Workers AI has dope models for your use. No API keys when used inside Workers.
9 December 2024
3 December 2024
-
Lovedrcmnd.app
The Coming WaveTheir words
Most of the coverage of The Coming Wave has focused on what it has to say about artificial intelligence—which makes sense, given that it's one of the most important books on AI ever written.
30 November 2024
28 November 2024
-
korrents.com
More capable AI agents are more likely to find and exploit flaws in their reward functions.Their words
A more intelligent agent is more capable of finding "holes" in the design of reward function and exploiting the task specification-in other words, achieving higher proxy rewards but lower true rewards.
Reward Hacking in Reinforcement Learninglilianweng.github.io
21 November 2024
-
Their words
When a team of 10 AI-enabled super-designers can do the work that used to require a UX department of 100, the need for higher management levels shrivels. I call this the “pancaking” of the design profession.
Design Leaders Should Go “Founder Mode”jakobnielsenphd.substack.com
9 November 2024
8 November 2024
-
Their words
Therefore it’s simply intractable to meaningfully oversee all but a tiny fraction of our models’ behavior with actual humans.
30 October 2024
29 October 2024
-
Lovedrcmnd.app
Google GeminiTheir words
The Google Gemini series are my favourite multi-modal models right now due to the size and breadth of content they support.
28 October 2024
14 October 2024
-
korrents.com
There are few clear-cut cases in biopharma today where buying an AI system is obviously worth it.Their words
At the moment, there are in fact not very many slam-dunk gotta-get-me-some-of-that-AI decisions out there in our business.
11 October 2024
From one piece LLMs don’t do formal reasoning - and that is a HUGE problem 2 beliefs, in the piece's order there
-
Their words
Neurosymbolic AI — combining such machinery with neural networks – is likely a necessary condition for going forward.
-
Their words
Another manifestation of the lack of sufficiently abstract, formal reasoning in LLMs is the way in which performance often fall apart as problems are made bigger.
7 October 2024
-
korrents.com
The web is being flooded with coherent, generic, generated text that buries the writing worth reading.Their words
What is out there is buried among ever-growing piles of useless content farm material or, increasingly, AI-generated garbage.
1 October 2024
-
korrents.com
Within a couple of decades there will not be many people who can write, because AI has removed the pressure to learn.Their words
I'm usually reluctant to make predictions about technology, but I feel fairly confident about this one: in a couple decades there won't be many people who can write.
From one piece Machines of Loving Grace (October 2024) 3 beliefs · darioamodei.com
-
Their words
It could be as simple as a large universal basic income for everyone, although I suspect that will only be a small part of a solution.
-
Their words
Unfortunately, I see no strong reason to believe AI will preferentially or structurally advance democracy and peace, in the same way that I think it will structurally advance human health and alleviate poverty.
-
korrents.com
Powerful AI will compress the biological and medical progress of the next 50-100 years into 5-10 years.Their words
To summarize the above, my basic prediction is that AI-enabled biology and medicine will allow us to compress the progress that human biologists would have achieved over the next 50-100 years into 5-10 years.
21 September 2024
20 September 2024
-
Lovedrcmnd.app
ClaudeTheir words
What amazes me about these interactions is not just that Claude could help me solve the problems, but how it walked me through the process, explaining each step.
19 September 2024
From one piece AI and Biology 2 beliefs, in the piece's order there
-
Their words
So for these reasons, I (unfortunately) do not expect any big AI-driven breakthroughs in biological understanding any time soon.
-
Their words
I predict (with confidence bordering on arrogance) that whatever machine-learning progress can be made will correlate extremely closely with the quality of the data around any given problem
31 August 2024
From one piece Why A.I. Isn't Going to Make Art 5 beliefs, in the piece's order there
-
Their words
The task that generative A.I. has been most successful at is lowering our expectations, both of the things we read and of ourselves when we write anything for others to read.
-
korrents.com
A language model is not using language at all, because language requires an intention to communicate.Their words
But a large language model is not a writer; it’s not even a user of language. Language is, by definition, a system of communication, and it requires an intention to communicate.
-
Their words
The selling point of generative A.I. is that these programs generate vastly more than you put into them, and that is precisely what prevents them from being effective tools for artists.
+ 2 more
-
korrents.com
Generative AI appeals to people who want to express themselves in a medium without working in it.Their words
Generative A.I. appeals to people who think they can express themselves in a medium without actually working in that medium.
-
Their words
It is a fundamentally dehumanizing technology because it treats us as less than what we are: creators and apprehenders of meaning. It reduces the amount of intention in the world.
20 August 2024
-
Their words
They could have shipped ChatGPT for example, I heard, in 2019. And they never shipped it because they were so stuck in bureaucracy. But they had everything. They had the data, they had the tech, they had the engineers and they didn’t do it.
8 August 2024
-
Their words
Right now, they can make simple social media posts for small companies and individual influencers. Two years from now, they can make simple campaigns and tradeshow collateral for mid-sized businesses. And in 10 years, I bet that even the richest brand will rely heavily on these tools.
7 August 2024
-
Usesrcmnd.app
RØDE NT1Their words
I have recently been recording using a RØDE NT1 with a RØDE AI-1 interface. RØDE is also responsible for attaching the mic to the desk using the PSA1 boom arm.
-
Usesrcmnd.app
SafariTheir words
For browsers, I use Safari for browsing and Google Chrome for development.
29 July 2024
25 July 2024
-
Their words
Context construction for foundation models is equivalent to feature engineering for classical ML models.
13 July 2024
-
Lovedrcmnd.app
ChatGPT Code InterpreterTheir words
ChatGPT Code Interpreter has been one of my favourite AI tools for over a year.
7 July 2024
From one piece Extrinsic Hallucinations in LLMs 2 beliefs, in the piece's order there
-
korrents.com
Using supervised fine-tuning to teach a language model new knowledge risks increasing its hallucination rate.Their words
These empirical results from Gekhman et al. (2024) point out the risk of using supervised fine-tuning for updating LLMs' knowledge.
-
korrents.com
A language model avoids hallucinating only by being factual and admitting when it does not know the answer.Their words
To avoid hallucination, LLMs need to be (1) factual and (2) acknowledge not knowing the answer when applicable.
21 June 2024
-
Lovedrcmnd.app
Your AI Product Needs EvalsTheir words
Your AI Product Needs Evals by Hamel Husain remains my favourite piece of writing on how to go about putting these together.
19 June 2024
From one piece Aravind Srinivas: Perplexity CEO on Future of AI, Search & the Internet | Lex Fridman Podcast #434 5 beliefs, in the piece's order there
-
Their words
What makes humans special though, is our curiosity. Even if AI’s cracked this, it’s us still asking them to go explore something. And one thing that I feel like AI’s haven’t cracked yet, is being naturally curious and coming up with interesting questions to understand the world and going and digging deeper about them.
-
Their words
It’s less about access to a model’s weights, it’s more access to compute that is putting the world in more concentration of power and few individuals. Because not everyone’s going to be able to afford this much amount of compute to answer the hardest questions.
-
Their words
In Google, even though we call it 10 blue links, you get annoyed if you don’t even have the right link in the first three or four. The eye is so tuned to getting it right. LLMs are fine. You get the right link maybe in the 10th or ninth. You feed it in the model. It can still know that that was more relevant than the first.
+ 2 more
-
Their words
What is the weakness of Google is that any ad unit that’s less profitable than a link, or any ad unit that kind of disincentivizes the link click is not in their interest to go aggressive on, because it takes money away from something that’s higher margins.
-
Their words
And also this is where I believe the whole prompt engineering, trying to be a good prompt engineer is not going to be a long-term thing. I think you want to make products work where a user doesn’t even ask for something, but you know that they want it and you give it to them without them even asking for it.
15 June 2024
13 June 2024
From one piece Sara Walker: Physics of Life, Time, Complexity, and Aliens | Lex Fridman Podcast #433 2 beliefs, in the piece's order there
-
Their words
Or is it really that we’re building some super machine in a box that’s going to be smart and kill everybody? It’s not even a science fiction narrative. It’s a bad science fiction narrative. I just don’t think it’s actually accurate to any of the technologies we’re building or the way that we should be describing them.
-
Their words
I think large language models are kind of like the genetic system for language in some sense, where it’s allowing an archiving that’s highly dynamic.
10 June 2024
From one piece How to Build an AI Data Center 5 beliefs, in the piece's order there
-
korrents.com
Air cooling has run out of headroom for AI racks, so liquid cooling is now a requirement rather than an upgrade.Their words
Conventional air cooling is likely limited to around 20 to 30 kilowatt racks, perhaps 50 kilowatts if rear heat exchangers are used.
-
Their words
But many of these gains have already been achieved: the best data centers already use just 10% of their electricity for cooling and other non-IT equipment.
-
korrents.com
Available power, not land or capital, is what now limits how many data centres get built.Their words
In particular, operating a data center requires large amounts of electricity, and available power is fast becoming the binding constraint on data center construction.
+ 2 more
-
Their words
But there's also reason to believe that data center power consumption will nevertheless rise substantially.
-
Their words
Utility companies see major electrical infrastructure as a long-term investment to be built in response to sustained demand growth.
1 June 2024
-
Usesrcmnd.app
Google sheetsTheir words
Google sheets - for calculating expenses/income
25 May 2024
From one piece Charan Ranganath: Human Memory, Imagination, Deja Vu, and False Memories | Lex Fridman Podcast #430 3 beliefs, in the piece's order there
-
Their words
So if you remember this information in different times in different places, it’s more accessible at different times in different places because it’s not overfitted in an AI way of thinking about things. It’s not overfitted to one particular context. But that’s also why the memories that we call upon the most also feel like they’re just things that we read about almost.
-
Their words
I think a lot of the problems that come up with technology aren’t the technology itself, as much as the fact that people adapt to the technology in maladaptive ways. I mean, one of my fears about AI is not what AI will do, but what people will do.
-
Their words
I don’t think we’ve replicated human intelligence, unless I know that the simulator is making exactly the same kinds of mistakes that people do, because people make characteristic mistakes. They have characteristic biases, they have characteristic heuristics that we use, and those have yet to see evidence that ChatGPT will do that.
15 May 2024
13 May 2024
From one piece The Evolving Landscape of LLM Evaluation 2 beliefs, in the piece's order there
-
Their words
GPT models perform much better on coding problems released before their pre-training data cut-off.
-
Their words
The time when benchmarks lasted multiple decades has passed. Going forward, we will rely less on public benchmark results.
From one piece AI Drugs So Far 2 beliefs, in the piece's order there
-
korrents.com
A compound's AI origin story is not by itself a reason to expect it to do better in the clinic.Their words
For now, I am not convinced that issuing press releases about your compounds that talk about their discovery through AI techniques is sufficient to expect greater things from them.
-
korrents.com
The drugs advertised as having AI-discovered targets are aimed at targets people already knew about.Their words
What you will see is that in almost every case, these targets were already known to be implicated in the disease under investigation.
8 May 2024
-
Their words
Games are AI’s natural habitat.
7 May 2024
From one piece The case for ensuring that powerful AIs are controlled 5 beliefs, in the piece's order there
-
Their words
That is, labs should make sure that the safety measures they apply to their powerful models prevent unacceptably bad outcomes, even if the AIs are misaligned and intentionally try to subvert those safety measures.
-
Their words
The basic problem with evaluating alignment is that no matter what behaviors you observe, you have to worry that your model is just acting that way in order to make you think that it is aligned.
-
Their words
So when evaluating control, we should count catching an AI red-handed as a win condition.
+ 2 more
-
Their words
AI control (with only black-box techniques) seems like a fundamentally limited approach.
-
Their words
We're advocating that companies handle risk from scheming models in a similar way–striving to ensure that they'll be safe even if their alignment efforts fail to prevent models from scheming.
5 May 2024
22 April 2024
From one piece Sean Carroll: General Relativity, Quantum Mechanics, Black Holes & Aliens | Lex Fridman Podcast #428 3 beliefs, in the piece's order there
-
Their words
What a large language model is trying to do is to predict text. That’s what it does. And it is leveraging the fact that we human beings for very good evolutionary biology reasons, attribute intentionality and intelligence and agency to things that act like human beings.
-
Their words
And rather than trying to ask, how close is it to being a human-like intelligent, we should appreciate it for what its capabilities are, and that will both be more accurate and help us put it to work and protect us from the dangers better rather than always anthropomorphizing it.
-
Their words
I think this is one of the biggest things that physics can help with, and it’s an obvious kind of low-hanging fruit situation where the heat generation, the inefficiency, the waste of existing high-level computers is nowhere near the efficiency of our brains. It’s hilariously worse, and we haven’t tried to optimize that hard on that frontier.
18 April 2024
From one piece How to Make Off Grid Data Centers Affordable 5 beliefs, in the piece's order there
-
Their words
The cooling systems in most data centers are energy hogs and contribute no direct value.
How to Make Off Grid Data Centers Affordableaustinvernon.site
-
Their words
Efforts to improve efficiency and remove vestigial features pay off handsomely.
How to Make Off Grid Data Centers Affordableaustinvernon.site
-
Their words
Deleting the UPSs could knock off ~$750/kW after considering equipment, installation, and square footage reduction.
How to Make Off Grid Data Centers Affordableaustinvernon.site
+ 2 more
-
Their words
The 100-megawatt facility might have ten 10-megawatt blocks served directly by a 1500V DC feeder line without connections to other blocks that would require extra switches and routing.
How to Make Off Grid Data Centers Affordableaustinvernon.site
-
Their words
Some efforts, like nuclear-powered data centers, are reminiscent of Toyota's hydrogen push.
How to Make Off Grid Data Centers Affordableaustinvernon.site
15 April 2024
-
korrents.com
Retrieval-augmented generation is the most practical approach for reducing LLM hallucinations.Their words
Retrieval-augmented generation (RAG; Lewis et al., 2020), which conditions on the LLM's generation on retrieved documents is the most practical paradigm IMO.
12 April 2024
6 April 2024
4 April 2024
From one piece The Data Center is the New Compute Unit: Nvidia's Vision for System-Level Scaling 2 beliefs, in the piece's order there
-
Their words
The copper backplane in the data center rack is effectively the new advanced packaging in the system-level Moore’s Law race.
-
korrents.com
Air cooling has run out of headroom for AI racks, so liquid cooling is now a requirement rather than an upgrade.Their words
The critical change that makes this all possible is liquid cooling.
26 March 2024
-
korrents.com
Which products become visible is decided by distribution friction rather than by any contest of merit.Their words
Your product might be great, but how do you get it on the shelves of Walmart? Or how do you get it on the shelves of Google? Because if you're not on the shelves of Walmart, you're not on the shelves of Google, you might be invisible. And it's friction that kept you there, not some sort of merit contest.
18 March 2024
From one piece Sam Altman: OpenAI, GPT-5, Sora, Board Saga, Elon Musk, Ilya, Power & AGI | Lex Fridman Podcast #419 3 beliefs, in the piece's order there
-
Their words
I would heavily discourage any startup that was thinking about starting as a nonprofit and adding a for-profit arm later. I’d heavily discourage them from doing that. I don’t think we’ll set a precedent here.
-
Their words
That’s a theatrical risk. That is a thing that can really take over how people think about this problem. And there’s a big group of very smart, I think very well-meaning AI safety researchers that got super-hung up on this one problem, I’d argue without much progress, but super-hung up on this one problem. I’m actually happy that they do that, because I think we do need to think about this more. But I think it pushed out of the space of discourse a lot of the other very significant AI- related risks.
-
Their words
I continue to not want super-voting control over OpenAI. I never have. Never have had it, never wanted it. Even after all this craziness, I still don’t want it. I continue to think that no company should be making these decisions, and that we really need governments to put rules of the road in place.
27 February 2024
-
Their words
the embodied, interactive, and multi-modal nature of first language (L1) acquisition is challenging to replicate with current models.
20 February 2024
-
Their words
And oftentimes it's more important to them to have the public perception that they're good directors so they get the next best deal. If they have a reputation for taking on management too aggressively, word will get out in the small community of founders and they'll miss the next Google.
13 February 2024
12 February 2024
-
Their words
This lack of knowledge sharing may impede progress in AI development.
6 February 2024
From one piece Encyclopaedia Automatica 2 beliefs, in the piece's order there
-
korrents.com
AI-generated writing is already fairly good but still lacks the direction and insight of human editors.Their words
As of today, computers write pretty good articles but lack the direction and insight of human editors.
-
korrents.com
AI should be approached as a collaboration between humans and computers, not a forced choice between them.Their words
We need to find ways to work with this new tech to get the best of humans and the best of computers, together, rather than thinking in terms of one or the other.
5 February 2024
-
korrents.com
High-quality data collection depends more on careful human execution than on machine learning techniques alone.Their words
Lots of ML techniques in the post can help with data quality, but fundamentally human data collection involves attention to details and careful execution.
29 January 2024
24 January 2024
17 January 2024
-
korrents.com
Expecting AI or longer lives to arrive in time makes people skip having a plan for falling birth rates at all.Their words
And they don’t see a need for a plan B, in case their forecast fails.
16 January 2024
-
Recommendsrcmnd.app
SupervisedTheir words
Longtime tech reporter Matt Lynley offers an uncommonly technical assessment of new AI developments in his newsletter Supervised. Original reporting and a fast cadence help this one stand out from other AI newsletters.
13 January 2024
7 January 2024
3 January 2024
-
Mixed onrcmnd.app
SuperintelligenceTheir words
the back half I think it goes off the rails and makes a ton of assumptions
26 December 2023
-
Recommendsrcmnd.app
Neural Network Methods for Natural Language ProcessingTheir words
I also read a ton of technical books last year, but the most impactful one for me was Neural Network Methods for Natural Language processing by Yoav Goldberg
21 December 2023
From one piece How Effective Altruism Lost Its Way 2 beliefs, in the piece's order there
-
Their words
Diverting attention and resources from global health and poverty is an enormous gamble, as it will make many lives poorer, sicker, and shorter in the name of fending off threats that may or may not materialize.
-
Their words
Unlike other interventions EA has sponsored, there are scant metrics for tracking the success or failure of investments in existential risk mitigation.
20 December 2023
14 December 2023
From one piece Jeff Bezos: Amazon and Blue Origin | Lex Fridman Podcast #405 3 beliefs, in the piece's order there
-
Their words
We do know that humans are doing something different from these models, in part because we're so power efficient. The human brain does remarkable things and it does it on about 20 watts of power. And the AI techniques we use today use many kilowatts of power to do equivalent tasks.
-
Their words
And so the only way to improve safety is to have an escape system. And historically, human-rated rockets have had escape systems. Only the space shuttle did not, but Apollo had one. All of the previous Gemini, etcetera, they all had escape systems.
-
Their words
It's interesting to me that large language models in their current form are not inventions, they're discoveries. The telescope was an invention, but looking through it at Jupiter, knowing that it had moons, was a discovery.
13 December 2023
-
Their words, before
precisely because smart people do devote brain-cycles to these possibilities, the rest of us have correspondingly less need to.
Their words now
I accepted what’s turned into a two-year position at OpenAI, thinking about what theoretical computer science can do for AI safety.
-
Their words, before
If I were forced at gunpoint to guess, I'd say that human-level AI seemed to me like a slog of many more centuries or millennia
Their words now
I was wrong, of course, not to contemplate more seriously the prospect that AI might enter a civilization-altering trajectory, not merely eventually but within the next decade.
-
Their words, before
If I were forced at gunpoint to guess, I’d say that human-level AI seemed to me like a slog of many more centuries or millennia (with the obvious potential for black swans along the way).
Their words now
I was wrong, of course, not to contemplate more seriously the prospect that AI might enter a civilization-altering trajectory, not merely eventually but within the next decade.
11 December 2023
3 December 2023
-
Their words
Large language models are more or less generalizations of stuff that we have. There’s still breakthroughs in AI waiting to happen, and maybe they are happening and maybe they’ll be good, maybe not, but that’s not quite the same.
28 November 2023
From one piece In Continued Defense Of Effective Altruism 2 beliefs, in the piece's order there
-
Their words
And I notice that the tiny handful of people capable of caring about 200,000 people dying of neglected tropical diseases are the same tiny handful of people capable of caring about the next pandemic, or superintelligence, or human extinction.
In Continued Defense Of Effective Altruismastralcodexten.com
-
Their words
EA has done a great job working on this (see list of accomplishments above), and I think the AI and x-risk people have just as much to be proud of as the global health and animal welfare people.
In Continued Defense Of Effective Altruismastralcodexten.com
10 November 2023
9 November 2023
From one piece Elon Musk: War, AI, Aliens, Politics, Physics, Video Games, and Humanity | Lex Fridman Podcast #400 2 beliefs, in the piece's order there
-
Their words
I think it would be wise for us to have at least an objective third party who can be like a referee that can go in and understand what the various leading players are doing with AI, and even if there’s no enforcement ability, they can at least voice concerns publicly.
-
Their words
If an AI cannot figure out new physics, it’s clearly not equal to humans, nor has surpassed humans because humans have figured out new physics.
8 November 2023
28 October 2023
26 October 2023
From one piece Managing extreme AI risks amid rapid progress (with 24 co-authors) 4 beliefs, in the piece's order there
-
Their words
Despite evaluations, we cannot consider coming powerful frontier AI systems "safe unless proven unsafe". With current testing methodologies, issues can easily be missed. Additionally, it is unclear if governments can quickly build the immense expertise needed for reliable technical evaluations of AI capabilities and societal-scale risks. Given this, developers of frontier AI should carry the burden of proof to demonstrate that their plans keep risks within acceptable limits.
-
Their words
Without sufficient caution, we may irreversibly lose control of autonomous AI systems, rendering human intervention ineffective. Large-scale cybercrime, social manipulation, and other harms could escalate rapidly. This unchecked AI advancement could culminate in a large-scale loss of life and the biosphere, and the marginalization or extinction of humanity.
-
Their words
For AI to be a boon, we must reorient; pushing AI capabilities alone is not enough. We are already behind schedule for this reorientation. The scale of the risks means that we need to be proactive, as the costs of being unprepared far outweigh those of premature preparation.
+ 1 more
-
Their words
Society's response, despite promising first steps, is incommensurate with the possibility of rapid, transformative progress that is expected by many experts. AI safety research is lagging. Present governance initiatives lack the mechanisms and institutions to prevent misuse and recklessness, and barely address autonomous systems.
25 October 2023
18 October 2023
28 September 2023
From one piece Mark Zuckerberg: First Interview in the Metaverse | Lex Fridman Podcast #398 3 beliefs, in the piece's order there
-
korrents.com
Building an AI that embodies a real person is a much harder problem than inventing a new AI character from scratch.Their words
So that's a lot of what I think we need to nail for the creators, and that's why that one is actually a much harder problem, I think, than starting with new characters that you're creating from scratch.
-
Their words
So at some point, I think making it so that you could build an AI version of yourself that could interact with people not after you die, but while you're here to help people fulfill this desire to interact with you and your desire to build a community.
-
Their words
I don't think we necessarily want there to be one big super intelligence. We want to empower everyone to both have more fun, accomplish their business goals, just everything that they're trying to do. We don't tend to have one person that we work with on everything, and I don't think in the future we're going to have one AI that we work with.
15 September 2023
-
Recommendsrcmnd.app
ChatGPT Custom InstructionsTheir words
Using Custom Instructions properly can completely transform your experience with ChatGPT.
13 September 2023
From one piece Self-exfiltration is a key dangerous capability 2 beliefs, in the piece's order there
-
Their words
If a model was capable of self-exfiltration, it would have the option to remove itself from your control.
Self-exfiltration is a key dangerous capabilityaligned.substack.com
-
Their words
Moreover, model exfiltration is likely impossible to reverse.
Self-exfiltration is a key dangerous capabilityaligned.substack.com
1 September 2023
-
Their words
What we don't want to happen with AGI, we want to happen with synthetic biology. What we don't want to happen online and software with language, we want for it to happen with bio-based materials.
29 August 2023
From one piece Language models surprised us 3 beliefs, in the piece's order there
-
Their words
Most importantly, ML experts and superforecasters both seem to be massively underestimating future spending on training runs.
-
Their words
Massively underestimating near-future progress could be very risky.
-
korrents.com
AI progress is faster than people expect, and ordinary scaling can be enough to solve problems that looked very hard.Their words
This rapid scaleup will probably drive another qualitative leap forward in capability like what we saw over the last 18 months.
12 August 2023
-
Their words, before
Reading the book had not changed my fundamental belief that, in balance, we were on a good trajectory with AI research: good for science and good for society with expected positive impacts in many domains.
Their words now
I now believe that I was wrong and short-sighted to ignore that dual-use nature. I also think I was not paying enough attention to the possibility of losing control to superhuman AIs.
-
Their words
Instead of decades to centuries, I now see it as 5 to 20 years with 90% confidence.
10 August 2023
-
Their words
ChatGPT is fast-tracking the commodification of the human spirit by mechanising the imagination. It renders our participation in the act of creation as valueless and unnecessary.
28 July 2023
From one piece Microincentives and Enshittification 2 beliefs, in the piece's order there
-
Their words
The only way for Google Search to grow is to make itself worse.
-
korrents.com
Ranking first in a search has become near enough to being true, which is why search and spam are permanently at war.Their words
Google’s the first — and often the last — place we go to for answers, so snagging top billing in a Google search results page is, approximately speaking, equivalent to being “true.”
29 June 2023
From one piece George Hotz: Tiny Corp, Twitter, AI Safety, Self-Driving, GPT, AGI & God | Lex Fridman Podcast #387 5 beliefs, in the piece's order there
-
Their words
Of course, when you talk to an AI that’s made by a big company in the cloud, the AI fundamentally is aligned to them, not to you. And that’s why you have to buy a tiny box. So you make sure the AI stays aligned to you.
-
Their words
But the real thing that I want is not something that like tab completes my code and gives me ideas. The real thing that I want is a very intelligent pair programmer that comes up with a little popup saying, “Hey, you wrote a bug on line 14 and here’s what it is.”
-
Their words
I think things like MuZero and AlphaGo are so much more impressive because these things are playing beyond the highest human level. The language models are writing middle school level essays and people are like, wow, it’s a great essay.
+ 2 more
-
Their words
I think future LLMs are going to be smaller, but are going to run looping on themselves and are going to have retrieval systems. And the thing about using a retrieval system is you can cite sources, explicitly.
-
Their words
What’s ironic about all these AI safety people is they’re going to build the exact thing they fear. We need to have one model that we control and align. This is the only way you end up paper clipped. There’s no way you end up paper clipped if everybody has an AI.
26 June 2023
-
korrents.com
Half the population in rich countries is not articulate enough in writing to use prompt-driven AI well.Their words
For sure, half the population is insufficiently articulate in writing to use ChatGPT well.
23 June 2023
18 June 2023
-
Likedrcmnd.app
You Look Like a Thing and I Love YouTheir words
A funny book explaining the basics of AI! The subtitle is How Artificial Intelligence Works and Why It's Making the World a Weirder Place. A great introduction to AI. With a cute cartoon mascot. The title is from her training an AI to write romantic greeting cards.
6 June 2023
From one piece Why AI Will Save The World 4 beliefs · pmarca.substack.com
-
Their words
My response is that their position is non-scientific – What is the testable hypothesis? What would falsify the hypothesis? How do we know when we are getting into a danger zone?
-
Their words
I even think AI is going to improve warfare, when it has to happen, by reducing wartime death rates dramatically. Every war is characterized by terrible decisions made under intense pressure and with sharply limited information by very limited human leaders.
-
Their words
My view is that the idea that AI will decide to literally kill humanity is a profound category error. AI is not a living being that has been primed by billions of years of evolution to participate in the battle for the survival of the fittest, as animals are, and as we are. It is math – code – computers, built by people, owned by people, used by people, controlled by people.
+ 1 more
-
Their words
The single greatest risk of AI is that China wins global AI dominance and we – the United States and the West – do not.
9 May 2023
-
Likedrcmnd.app
CronTheir words
Cron is completely free and only works with Google Calendar, but it’s super fast and reliable.
-
Recommendsrcmnd.app
PeteyTheir words
The app costs a few dollars up front and then has an optional subscription for unlimited requests, but I would recommend going directly to OpenAI’s developer dashboard, creating your own account, and copy/pasting your own API key into Petey.
4 May 2023
-
korrents.com
AI will soon let anyone consume any content reshaped into the timeframe, tone, voice and bias they choose.Their words
This isn't perfect, but soon it will be, and you will be able to listen to or read any content you want in the timeframe, tone, voice and bias of your choosing.
1 May 2023
From one piece Why Chatbots Are Not the Future 3 beliefs · wattenberger.com
-
korrents.com
Chatbots are a terrible interface for large language models, because a text box has no affordances.Their words
Hopefully I've convinced you that chatbots are a terrible interface for LLMs. Or, at the very least, that we can add controls, information, and affordances to our chatbot interfaces to make them more usable.
-
Their words
I want to see more tools and fewer operated machines - we should be embracing our humanity instead of blindly improving efficiency. And that involves using our new AI technology in more deft ways than generating more content for humans to evaluate. I believe the real game changers are going to have very little to do with plain content generation.
-
Their words
Good tools let the user choose when to switch between implementation and evaluation. When I work with a chatbot, I'm forced to frequently switch between the two modes.
21 March 2023
-
korrents.com
An AI can already earn an A on a university economics midterm, years earlier than informed forecasters expected.Their words
To my surprise and no small dismay, GPT-4 got an A. It earned 73/100, which would have been the fourth-highest score on the test.
15 March 2023
17 February 2023
-
Their words
The biggest issue is probably that we don’t control neutral networks enough to be able to ensure AI doesn’t harm humans. We can’t even control AI to not reveal internal prompts.
-
korrents.com
Liberal societies currently face an existential risk that must be addressed to reach a better future.Their words
This book is my best crack at explaining what I think is an existential risk to liberal societies and what I think we need to do to get to that awesome future I used to be so excited about.
1 February 2023
17 January 2023
16 January 2023
-
Their words
What ChatGPT is, in this instance, is replication as travesty. ChatGPT may be able to write a speech or an essay or a sermon or an obituary but it cannot create a genuine song.
14 January 2023
19 December 2022
7 December 2022
-
Their words
It terrifies me, because these data repositories are not only a risk to individual user privacy, they’re effectively a surveillance super-weapon.
Why encrypted backup is so importantblog.cryptographyengineering.com
13 October 2022
-
Likedrcmnd.app
In the Plex: How Google Thinks, Works, and Shapes Our LivesTheir words
I learned a great deal from this book about Google, which put some of my own experiences with Google products in context.
8 October 2022
-
korrents.com
The three-year bet about whether AI image models could handle compositionality was won in three months.Their words, before
In fact, not only did they reach this level in three months, but probably they were at this level before the bet was even made
Their words now
I retract my claim to have won and will continue to see how AI progress advances over the next three years.
12 September 2022
-
korrents.com
AI progress is faster than people expect, and ordinary scaling can be enough to solve problems that looked very hard.Their words
I think this matches the general finding that AI progress is faster than expected, and increases my certainty that scale and normal progress can sometimes be enough to solve even very difficult problems.
8 September 2022
7 September 2022
-
korrents.com
AI will out-think us, but it will not become conscious, because consciousness is a property of life.Their words
But in terms of what we value the most as humans, which is to say our feelings, our emotions, our sense of what the world is in a very personal way that I think means as much or more to people than their information processing. And that’s where I don’t think that AI necessarily will become conscious because I think it’s the property of life.
26 August 2022
17 June 2022
-
Their words
In particular, most EA careers and most careers to do with AI are competitive as fuck.
10 June 2022
From one piece AGI Ruin: A List of Lethalities 5 beliefs, in the piece's order there
-
Their words
The best and easiest-found-by-optimization algorithms for solving problems we want an AI to solve, readily generalize to problems we’d rather the AI not solve; you can’t build a system that only has the capability to drive red cars and not blue cars, because all red-car-driving algorithms generalize to the capability to drive blue cars.
-
Their words
None of this is about anything being impossible in principle.
-
Their words
Many alignment problems of superintelligence will not naturally appear at pre-dangerous, passively-safe levels of capability.
+ 2 more
-
Their words
unaligned operation at a dangerous level of intelligence kills everybody on Earth and then we don’t get to try again.
-
Their words
2 years after the leading actor has the capability to destroy the world, 5 other actors will have the capability to destroy the world.
4 March 2022
-
korrents.com
Fine-tuning with human feedback is a promising direction for aligning language models with human intent.Their words
Even though InstructGPT still makes simple mistakes, our results show that fine-tuning with human feedback is a promising direction for aligning language models with human intent.
-
Likedrcmnd.app
The LoopTheir words
Science journalist Jacob Ward warns about a future in which AI technology forms a tight cybernetic feedback loop with the biases ingrained into the human brain, pushing our day-to-day existence in frightening directions. It's sort of like a version of The Terminator in which Danny Kahneman plays a starring role. As longtime readers and listeners of mine know, a big theme in my techno-criticism is the under-appreciated degree to which technologies exert powerful, unintended consequences on our personhood and culture, so Ward's warning hits a sweet spot with me.
23 February 2022
25 January 2022
-
Their words
I I would I would not say that about Google. I would just say that more generally like that is the incumbent temptation. Um it is is basically is basically go from attack mode to defend mode, right? Go from being the pirate to being the navy.
23 November 2021
-
Lovedrcmnd.app
The Alignment Problem: Machine Learning and Human ValuesTheir words
I just finished this book a few weeks ago and it is still reverberating in my mind
-
Mixed onrcmnd.app
The Precipice: Existential Risk and the Future of HumanityTheir words
I wouldn’t say that this is the most compelling book I’ve ever read in terms of the prose style or storytelling, but it does provide a very helpful, almost quantitative overview of all the potential threats looming out there
19 June 2021
27 March 2021
1 February 2021
-
Likedrcmnd.app
The Moon is a Harsh MistressTheir words
AI was in the air in the mid 1980s, but there were two things especially that made me want to work on it: a novel by Heinlein called The Moon is a Harsh Mistress
28 October 2020
-
Likedaffiliate linkrcmnd.app
Work Rules!: Insights from Inside GoogleTheir words
If you're curious how Google built it's culture and the processes thanks to their extremely data & engineering driven nature, this is a great book. What held it back was being ~100 pages too long and Bock didn't always understand where what they did only fit at a $100Bn+, mega-profitable company. Still, the insights on the studies on their 50,000+ employees is well worth the read since so few of us can get similar statistical significance to apply to our teams.
-
Likedaffiliate linkrcmnd.app
Mastering the VC GameTheir words
The interests of a Venture Capitalist are different than those of the entrepreneurs building a company they've invested in. Jeff does an awesome job of helping explain how you can get misaligned in your goals versus your investors. Fortunately, he also covers how to avoid it.
2 October 2020
-
Usesrcmnd.app
Google KeepTheir words
Google Keep - I use this primarily as a shared shopping list and "wish list," and for saving web links and lists I want to add to/come back to later.
1 August 2020
-
Usesrcmnd.app
nativefierTheir words
For the rest (e.g., oddly, most Google web apps), I use a command-line tool called nativefier to turn them into desktop apps.
17 July 2020
1 June 2020
-
Recommendsrcmnd.app
Welch LabsTheir words
this channel is full of high production quality and well-written videos. There are also several series on machine learning, the topics underlying self-driving cars, so this is certainly one of the more applied math channels out there.
28 May 2020
-
Their words
Here we show that scaling up language models greatly improves task-agnostic, few-shot performance, sometimes even reaching competitiveness with prior state-of-the-art fine-tuning approaches.
7 February 2020
-
Lovedrcmnd.app
Gödel Escher BachTheir words
This book stretched my mind more than almost any other book I’ve read. It’s tough at parts, it’s long, but you’ll come out of it thinking about brains, minds, intelligence, and AI in an entirely new way.
30 January 2020
-
Usesrcmnd.app
ChromeTheir words
My browser of choice is Chrome, mainly because I use Google's tools (Gmail, Docs, Sheets, and so on) on a daily basis.
10 December 2019
-
Usesrcmnd.app
Google ColabTheir words
spending an increasing amount of my free time working with tools like Google Colab, Runway ML, TensorFlow, and Hugging Face to play around with machine-generated text, audio, imagery, and video.
5 November 2019
-
Their words
We argue that ARC can be used to measure a human-like form of general fluid intelligence and that it enables fair general intelligence comparisons between AI systems and humans.
15 October 2019
-
Dislikedrcmnd.app
Microsoft WordTheir words
When I'm writing articles etc that need to be shared with an editor, I typically write in Microsoft Word. I hate all word processing software, and anyone who insists that Google Docs is so much better than Word is a liar.
7 October 2019
-
Lovedrcmnd.app
The AI Does Not Hate You: Superintelligence, Rationality, and the Race to Save the WorldTheir words
Briefly, I think the book is a triumph.
16 September 2019
-
Recommendsrcmnd.app
The Creativity Code: Art and Innovation in the Age of AITheir words
It's increasingly coming to the fore and Marcus deals with it in a really interesting way. He takes us through lots of different areas where AI is being used to mimic creativity, which some people would argue is the essence of being human. It's interesting to see how close to being human AI is getting.
22 August 2019
-
Lovedrcmnd.app
Google Meet speakermicTheir words
so we use Google Meet speakermics, which allow for full-duplex conversations, which makes conversation far more organic. That device turned Google Meet from something exhausting to something really good.
-
Usesrcmnd.app
Google Pixel 3Their words
My phone is a maxed-out Google Pixel 3, which I use for phone things: Email, reading, web browsing, messaging, music, and taking pictures
20 June 2019
-
Likedrcmnd.app
PDF ExpertTheir words
In terms of iOS apps, I use PDF Expert, which is a great PDF reader and annotator (using Apple Pencil), Notability as a virtual whiteboard (again with Apple Pencil), Google Docs for document editing, Google Calendar, and Gmail.
28 May 2019
-
Recommendsaffiliate linkrcmnd.app
Trillion Dollar Coach: The Leadership Playbook of Silicon Valley's Bill CampbellTheir words
Eric Schmidt, Jonathan Rosenberg and Alan Eagle, Trillion Dollar Coach: The Leadership Playbook of Silicon Valley’s Bill Campbell: I understood Bill Campbell was a behind-the-scenes guy in Silicon Valley, but I had no idea just how influential he was. Bill Gurley of Benchmark noted “I would argue that Bill has had a bigger impact on Silicon Valley than any other single person simply because his reach was so amazingly wide.” That’s a story I want to read.
21 May 2019
-
Usesrcmnd.app
Visual Studio CodeTheir words
For coding, I use Visual Studio Code. I use Git for source control, Photoshop for 2D art, Audition for audio editing, Premiere for video editing, and our team coordinates on Google Docs and Skype.
4 May 2019
25 April 2019
27 February 2019
23 January 2019
-
Their words
What we are actually listening to is human limitation and the audacity to transcend it. Artificial Intelligence, for all its unlimited potential, simply doesn’t have this capacity.
19 October 2018
-
Likedrcmnd.app
Google DocsTheir words
Now, almost everything happens in Google Docs, except for when I write straight into the Axios or Substack CMS. (Both of which are lovely, WYSIWYG, very simple and easy to use.)
11 October 2018
From one piece BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding 2 beliefs, in the piece's order there
-
Their words
Such restrictions are sub-optimal for sentence-level tasks, and could be very harmful when applying fine-tuning based approaches to token-level tasks such as question answering, where it is crucial to incorporate context from both directions.
-
korrents.com
Current techniques restrict pre-trained representation power because standard language models are unidirectional.Their words
We argue that current techniques restrict the power of the pre-trained representations, especially for the fine-tuning approaches. The major limitation is that standard language models are unidirectional, and this limits the choice of architectures that can be used during pre-training.
From one piece BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding 2 beliefs, in the piece's order there
-
korrents.com
Current techniques restrict pre-trained representation power because standard language models are unidirectional.Their words
We argue that current techniques restrict the power of the pre-trained representations, especially for the fine-tuning approaches. The major limitation is that standard language models are unidirectional, and this limits the choice of architectures that can be used during pre-training.
-
Their words
Such restrictions are sub-optimal for sentence-level tasks, and could be very harmful when applying fine-tuning based approaches to token-level tasks such as question answering, where it is crucial to incorporate context from both directions.
From one piece BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding 2 beliefs, in the piece's order there
-
Their words
Such restrictions are sub-optimal for sentence-level tasks, and could be very harmful when applying fine-tuning based approaches to token-level tasks such as question answering, where it is crucial to incorporate context from both directions.
-
korrents.com
Current techniques restrict pre-trained representation power because standard language models are unidirectional.Their words
We argue that current techniques restrict the power of the pre-trained representations, especially for the fine-tuning approaches. The major limitation is that standard language models are unidirectional, and this limits the choice of architectures that can be used during pre-training.
From one piece BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding 2 beliefs, in the piece's order there
-
korrents.com
Current techniques restrict pre-trained representation power because standard language models are unidirectional.Their words
We argue that current techniques restrict the power of the pre-trained representations, especially for the fine-tuning approaches. The major limitation is that standard language models are unidirectional, and this limits the choice of architectures that can be used during pre-training.
-
Their words
Such restrictions are sub-optimal for sentence-level tasks, and could be very harmful when applying fine-tuning based approaches to token-level tasks such as question answering, where it is crucial to incorporate context from both directions.
9 August 2018
-
Recommendsrcmnd.app
The Algorithm Design ManualTheir words
To me, this book is an illustration of the power of names. Today, in the era of Google, if you know the name of something, you can find out about it with a simple search. But if you don't know of what you're looking for, it suddenly becomes much harder to find it. Having in the back of your head the names of common algorithms that help you solve problems is really powerful.
9 July 2018
3 April 2018
-
Usesrcmnd.app
Google ChromeTheir words
Google Chrome: What's a Web Developer without Google Chrome browser? The first thing I do with Safari is to get Google Chrome and install the latest version.
9 March 2018
-
Their words
Neural network pruning techniques can reduce the parameter counts of trained networks by over 90%, decreasing storage requirements and improving computational performance of inference without compromising accuracy.
-
Their words
Neural network pruning techniques can reduce the parameter counts of trained networks by over 90%, decreasing storage requirements and improving computational performance of inference without compromising accuracy.
7 March 2018
24 February 2018
From one piece Takeoff speeds 4 beliefs, in the piece's order there
-
Their words
I currently think a slow takeoff is significantly more likely.
-
Their words
Things are usually preceded by worse versions, even in cases where there are weak reasons to expect a discontinuous jump.
-
Their words
In particular, this means that incredibly powerful AI will emerge in a world where crazy stuff is already happening (and probably everyone is already freaking out).
+ 1 more
-
Their words
The main disagreement is not about what will happen once we have a superintelligent AI, it’s about what will happen before we have a superintelligent AI.
15 November 2017
24 October 2017
From one piece Why superintelligence is a threat that should be taken seriously 2 beliefs, in the piece's order there
-
Their words
One of the most commonly emphasized points in the AI safety literature is that one must never anthropomorphize AI—that is, don’t project human mental properties onto artificially intelligent systems.
-
Their words
A superintelligence whose goal system is even slightly misaligned with ours could, being far more powerful than any human or human institution, bring about human extinction for the very same reason that construction workers routinely slaughter large populations of ants.
22 June 2017
-
Usesrcmnd.app
REAPERTheir words
I use a ton of software. Here's a list: Xcode, Pages, Numbers, Keynote, Sublime Text, Corona SDK, Unity, Final Cut Pro, Versions, Perforce, VMWare Fusion, Messages, REAPER, Transmit, Coda, Dropbox, Skype, Dashlane, Slack, Terminal, Assembla, Airmail, Spark Mail, Google Docs, Pixelmator, Pixen, TexturePacker, Particle Designer, Tiled, iTunes + Music + Match, Screenium, Steam, Twitter, Facebook.
-
Usesrcmnd.app
UnityTheir words
I use a ton of software. Here's a list: Xcode, Pages, Numbers, Keynote, Sublime Text, Corona SDK, Unity, Final Cut Pro, Versions, Perforce, VMWare Fusion, Messages, REAPER, Transmit, Coda, Dropbox, Skype, Dashlane, Slack, Terminal, Assembla, Airmail, Spark Mail, Google Docs, Pixelmator, Pixen, TexturePacker, Particle Designer, Tiled, iTunes + Music + Match, Screenium, Steam, Twitter, Facebook.
28 February 2017
-
Usesrcmnd.app
emacsTheir words
For writing code, I use emacs and Google's internal distributed build system (a version of which was open sourced as Bazel) and our version control system
-
Usesrcmnd.app
LaTeXTheir words
For technical papers, I and my coauthors usually use LaTeX. For giving presentations, I almost exclusively use Google Slides.
-
Usestheir ownrcmnd.app
Google SlidesTheir words
For giving presentations, I almost exclusively use Google Slides.
8 January 2017
-
Recommendsrcmnd.app
Rationality: From AI to ZombiesTheir words
luckily I was aided by a few books that I recommend to anyone who wants to come to terms with this
1 October 2016
-
Mixed onaffiliate linkrcmnd.app
Site Reliability EngineeringTheir words
A description of how Google handles operations.
10 December 2015
-
korrents.com
Depth is not free: past a point, deeper neural networks are harder to train rather than simply better.Their words
Deeper neural networks are more difficult to train.
-
korrents.com
Depth is not free: past a point, deeper neural networks are harder to train rather than simply better.Their words
Deeper neural networks are more difficult to train.
14 November 2015
Nothing matches.
What is a korrent?
A korrent is a belief a person has stated in their own words: one sentence stating the claim, backed by a quote and a source, kept at korrents.com.
Under a name here, the quoted block is what they actually said. The korrent beneath it is the claim those words support, in korrents' wording — tap it to see the record, its source, and who else holds it.
Nobody here wrote their own korrents. They are compiled from public statements, and a person can change their mind, which is recorded too.
About the English under a post
Some people here publish in a language other than English. Where they do, this site shows a machine translation beneath the post, in this typeface — the site's own, not theirs.
The post itself is never changed, moved or hidden: what is set in the serif above is exactly what the person published, and it is what to quote them on. A translation can be wrong in ways that matter, especially about tone.
Only the post's own words are translated. A quoted post, a linked article and a belief on korrents.com are left in their original language.