What public figures publish and believe, in their own words.
About this feed
Latest: everything, as it happens, in the order it happened. Nothing ranked. Show highlights instead.
The quoted blocks are what people actually said; a beneath one is the belief those words support, in korrents' wording. Nobody here wrote their own page.
Top people are the people in this feed with the most beliefs on this site, then the most here. Choose an area and the row leads with the people whose beliefs are about it; tap a face for their feed.
Top people in AI
Showing Profile →
Hiding
Hiding
1 October 2024
-
korrents.com
Within a couple of decades there will not be many people who can write, because AI has removed the pressure to learn.Their words
I'm usually reluctant to make predictions about technology, but I feel fairly confident about this one: in a couple decades there won't be many people who can write.
From one piece Machines of Loving Grace (October 2024) 3 beliefs · darioamodei.com
-
Their words
It could be as simple as a large universal basic income for everyone, although I suspect that will only be a small part of a solution.
-
Their words
Unfortunately, I see no strong reason to believe AI will preferentially or structurally advance democracy and peace, in the same way that I think it will structurally advance human health and alleviate poverty.
-
korrents.com
Powerful AI will compress the biological and medical progress of the next 50-100 years into 5-10 years.Their words
To summarize the above, my basic prediction is that AI-enabled biology and medicine will allow us to compress the progress that human biologists would have achieved over the next 50-100 years into 5-10 years.
28 September 2024
21 September 2024
20 September 2024
-
Usesrcmnd.app
ChatGPTTheir words
This includes platforms like ChatGPT and Claude. These are my go-to for brainstorming, writing, problem-solving, and even some coding tasks.
-
Lovedrcmnd.app
ClaudeTheir words
What amazes me about these interactions is not just that Claude could help me solve the problems, but how it walked me through the process, explaining each step.
19 September 2024
From one piece AI and Biology 2 beliefs, in the piece's order there
-
Their words
So for these reasons, I (unfortunately) do not expect any big AI-driven breakthroughs in biological understanding any time soon.
-
Their words
I predict (with confidence bordering on arrogance) that whatever machine-learning progress can be made will correlate extremely closely with the quality of the data around any given problem
31 August 2024
From one piece Why A.I. Isn't Going to Make Art 5 beliefs, in the piece's order there
-
Their words
The task that generative A.I. has been most successful at is lowering our expectations, both of the things we read and of ourselves when we write anything for others to read.
-
korrents.com
A language model is not using language at all, because language requires an intention to communicate.Their words
But a large language model is not a writer; it’s not even a user of language. Language is, by definition, a system of communication, and it requires an intention to communicate.
-
Their words
The selling point of generative A.I. is that these programs generate vastly more than you put into them, and that is precisely what prevents them from being effective tools for artists.
+ 2 more
-
korrents.com
Generative AI appeals to people who want to express themselves in a medium without working in it.Their words
Generative A.I. appeals to people who think they can express themselves in a medium without actually working in that medium.
-
Their words
It is a fundamentally dehumanizing technology because it treats us as less than what we are: creators and apprehenders of meaning. It reduces the amount of intention in the world.
20 August 2024
-
Their words
They could have shipped ChatGPT for example, I heard, in 2019. And they never shipped it because they were so stuck in bureaucracy. But they had everything. They had the data, they had the tech, they had the engineers and they didn’t do it.
18 August 2024
15 August 2024
13 August 2024
8 August 2024
-
Their words
Right now, they can make simple social media posts for small companies and individual influencers. Two years from now, they can make simple campaigns and tradeshow collateral for mid-sized businesses. And in 10 years, I bet that even the richest brand will rely heavily on these tools.
7 August 2024
-
Usesrcmnd.app
RØDE NT1Their words
I have recently been recording using a RØDE NT1 with a RØDE AI-1 interface. RØDE is also responsible for attaching the mic to the desk using the PSA1 boom arm.
-
Usesrcmnd.app
SafariTheir words
For browsers, I use Safari for browsing and Google Chrome for development.
31 July 2024
29 July 2024
25 July 2024
From one piece Building A Generative AI Platform 2 beliefs, in the piece's order there
-
Their words
AI models are probabilistic, making their outputs unreliable.
-
Their words
Context construction for foundation models is equivalent to feature engineering for classical ML models.
18 July 2024
13 July 2024
-
Lovedrcmnd.app
ChatGPT Code InterpreterTheir words
ChatGPT Code Interpreter has been one of my favourite AI tools for over a year.
10 July 2024
7 July 2024
From one piece Extrinsic Hallucinations in LLMs 2 beliefs, in the piece's order there
-
korrents.com
Using supervised fine-tuning to teach a language model new knowledge risks increasing its hallucination rate.Their words
These empirical results from Gekhman et al. (2024) point out the risk of using supervised fine-tuning for updating LLMs' knowledge.
-
korrents.com
A language model avoids hallucinating only by being factual and admitting when it does not know the answer.Their words
To avoid hallucination, LLMs need to be (1) factual and (2) acknowledge not knowing the answer when applicable.
1 July 2024
27 June 2024
21 June 2024
-
Lovedrcmnd.app
Your AI Product Needs EvalsTheir words
Your AI Product Needs Evals by Hamel Husain remains my favourite piece of writing on how to go about putting these together.
19 June 2024
From one piece Aravind Srinivas: Perplexity CEO on Future of AI, Search & the Internet | Lex Fridman Podcast #434 5 beliefs, in the piece's order there
-
Their words
What makes humans special though, is our curiosity. Even if AI’s cracked this, it’s us still asking them to go explore something. And one thing that I feel like AI’s haven’t cracked yet, is being naturally curious and coming up with interesting questions to understand the world and going and digging deeper about them.
-
Their words
It’s less about access to a model’s weights, it’s more access to compute that is putting the world in more concentration of power and few individuals. Because not everyone’s going to be able to afford this much amount of compute to answer the hardest questions.
-
Their words
In Google, even though we call it 10 blue links, you get annoyed if you don’t even have the right link in the first three or four. The eye is so tuned to getting it right. LLMs are fine. You get the right link maybe in the 10th or ninth. You feed it in the model. It can still know that that was more relevant than the first.
+ 2 more
-
Their words
What is the weakness of Google is that any ad unit that’s less profitable than a link, or any ad unit that kind of disincentivizes the link click is not in their interest to go aggressive on, because it takes money away from something that’s higher margins.
-
Their words
And also this is where I believe the whole prompt engineering, trying to be a good prompt engineer is not going to be a long-term thing. I think you want to make products work where a user doesn’t even ask for something, but you know that they want it and you give it to them without them even asking for it.
15 June 2024
13 June 2024
From one piece Sara Walker: Physics of Life, Time, Complexity, and Aliens | Lex Fridman Podcast #433 2 beliefs, in the piece's order there
-
Their words
Or is it really that we’re building some super machine in a box that’s going to be smart and kill everybody? It’s not even a science fiction narrative. It’s a bad science fiction narrative. I just don’t think it’s actually accurate to any of the technologies we’re building or the way that we should be describing them.
-
Their words
I think large language models are kind of like the genetic system for language in some sense, where it’s allowing an archiving that’s highly dynamic.
10 June 2024
From one piece How to Build an AI Data Center 5 beliefs, in the piece's order there
-
korrents.com
Air cooling has run out of headroom for AI racks, so liquid cooling is now a requirement rather than an upgrade.Their words
Conventional air cooling is likely limited to around 20 to 30 kilowatt racks, perhaps 50 kilowatts if rear heat exchangers are used.
-
Their words
But many of these gains have already been achieved: the best data centers already use just 10% of their electricity for cooling and other non-IT equipment.
-
korrents.com
Available power, not land or capital, is what now limits how many data centres get built.Their words
In particular, operating a data center requires large amounts of electricity, and available power is fast becoming the binding constraint on data center construction.
+ 2 more
-
Their words
But there's also reason to believe that data center power consumption will nevertheless rise substantially.
-
Their words
Utility companies see major electrical infrastructure as a long-term investment to be built in response to sustained demand growth.
5 June 2024
3 June 2024
1 June 2024
-
Usesrcmnd.app
Google sheetsTheir words
Google sheets - for calculating expenses/income
27 May 2024
25 May 2024
From one piece Charan Ranganath: Human Memory, Imagination, Deja Vu, and False Memories | Lex Fridman Podcast #430 3 beliefs, in the piece's order there
-
Their words
So if you remember this information in different times in different places, it’s more accessible at different times in different places because it’s not overfitted in an AI way of thinking about things. It’s not overfitted to one particular context. But that’s also why the memories that we call upon the most also feel like they’re just things that we read about almost.
-
Their words
I think a lot of the problems that come up with technology aren’t the technology itself, as much as the fact that people adapt to the technology in maladaptive ways. I mean, one of my fears about AI is not what AI will do, but what people will do.
-
Their words
I don’t think we’ve replicated human intelligence, unless I know that the simulator is making exactly the same kinds of mistakes that people do, because people make characteristic mistakes. They have characteristic biases, they have characteristic heuristics that we use, and those have yet to see evidence that ChatGPT will do that.
16 May 2024
15 May 2024
13 May 2024
From one piece The Evolving Landscape of LLM Evaluation 2 beliefs, in the piece's order there
-
Their words
GPT models perform much better on coding problems released before their pre-training data cut-off.
-
Their words
The time when benchmarks lasted multiple decades has passed. Going forward, we will rely less on public benchmark results.
From one piece AI Drugs So Far 2 beliefs, in the piece's order there
-
korrents.com
A compound's AI origin story is not by itself a reason to expect it to do better in the clinic.Their words
For now, I am not convinced that issuing press releases about your compounds that talk about their discovery through AI techniques is sufficient to expect greater things from them.
-
korrents.com
The drugs advertised as having AI-discovered targets are aimed at targets people already knew about.Their words
What you will see is that in almost every case, these targets were already known to be implicated in the disease under investigation.
8 May 2024
-
Their words
Games are AI’s natural habitat.
7 May 2024
From one piece The case for ensuring that powerful AIs are controlled 5 beliefs, in the piece's order there
-
Their words
That is, labs should make sure that the safety measures they apply to their powerful models prevent unacceptably bad outcomes, even if the AIs are misaligned and intentionally try to subvert those safety measures.
-
Their words
The basic problem with evaluating alignment is that no matter what behaviors you observe, you have to worry that your model is just acting that way in order to make you think that it is aligned.
-
Their words
So when evaluating control, we should count catching an AI red-handed as a win condition.
+ 2 more
-
Their words
AI control (with only black-box techniques) seems like a fundamentally limited approach.
-
Their words
We're advocating that companies handle risk from scheming models in a similar way–striving to ensure that they'll be safe even if their alignment efforts fail to prevent models from scheming.
5 May 2024
22 April 2024
From one piece Sean Carroll: General Relativity, Quantum Mechanics, Black Holes & Aliens | Lex Fridman Podcast #428 3 beliefs, in the piece's order there
-
Their words
What a large language model is trying to do is to predict text. That’s what it does. And it is leveraging the fact that we human beings for very good evolutionary biology reasons, attribute intentionality and intelligence and agency to things that act like human beings.
-
Their words
And rather than trying to ask, how close is it to being a human-like intelligent, we should appreciate it for what its capabilities are, and that will both be more accurate and help us put it to work and protect us from the dangers better rather than always anthropomorphizing it.
-
Their words
I think this is one of the biggest things that physics can help with, and it’s an obvious kind of low-hanging fruit situation where the heat generation, the inefficiency, the waste of existing high-level computers is nowhere near the efficiency of our brains. It’s hilariously worse, and we haven’t tried to optimize that hard on that frontier.
18 April 2024
From one piece How to Make Off Grid Data Centers Affordable 5 beliefs, in the piece's order there
-
Their words
The cooling systems in most data centers are energy hogs and contribute no direct value.
How to Make Off Grid Data Centers Affordableaustinvernon.site
-
Their words
Efforts to improve efficiency and remove vestigial features pay off handsomely.
How to Make Off Grid Data Centers Affordableaustinvernon.site
-
Their words
Deleting the UPSs could knock off ~$750/kW after considering equipment, installation, and square footage reduction.
How to Make Off Grid Data Centers Affordableaustinvernon.site
+ 2 more
-
Their words
The 100-megawatt facility might have ten 10-megawatt blocks served directly by a 1500V DC feeder line without connections to other blocks that would require extra switches and routing.
How to Make Off Grid Data Centers Affordableaustinvernon.site
-
Their words
Some efforts, like nuclear-powered data centers, are reminiscent of Toyota's hydrogen push.
How to Make Off Grid Data Centers Affordableaustinvernon.site
15 April 2024
-
korrents.com
Retrieval-augmented generation is the most practical approach for reducing LLM hallucinations.Their words
Retrieval-augmented generation (RAG; Lewis et al., 2020), which conditions on the LLM's generation on retrieved documents is the most practical paradigm IMO.
12 April 2024
6 April 2024
4 April 2024
From one piece The Data Center is the New Compute Unit: Nvidia's Vision for System-Level Scaling 2 beliefs, in the piece's order there
-
Their words
The copper backplane in the data center rack is effectively the new advanced packaging in the system-level Moore’s Law race.
-
korrents.com
Air cooling has run out of headroom for AI racks, so liquid cooling is now a requirement rather than an upgrade.Their words
The critical change that makes this all possible is liquid cooling.
29 March 2024
26 March 2024
-
korrents.com
Which products become visible is decided by distribution friction rather than by any contest of merit.Their words
Your product might be great, but how do you get it on the shelves of Walmart? Or how do you get it on the shelves of Google? Because if you're not on the shelves of Walmart, you're not on the shelves of Google, you might be invisible. And it's friction that kept you there, not some sort of merit contest.
18 March 2024
From one piece Sam Altman: OpenAI, GPT-5, Sora, Board Saga, Elon Musk, Ilya, Power & AGI | Lex Fridman Podcast #419 4 beliefs, in the piece's order there
-
Their words
So part of the reason that we deploy the way we do, we call it iterative deployment, rather than go build in secret until we got all the way to GPT-5, we decided to talk about GPT-1, 2, 3, and 4. And part of the reason there is I think AI and surprise don’t go together. And also the world, people, institutions, whatever you want to call it, need time to adapt and think about these things.
-
Their words
I would heavily discourage any startup that was thinking about starting as a nonprofit and adding a for-profit arm later. I’d heavily discourage them from doing that. I don’t think we’ll set a precedent here.
-
Their words
That’s a theatrical risk. That is a thing that can really take over how people think about this problem. And there’s a big group of very smart, I think very well-meaning AI safety researchers that got super-hung up on this one problem, I’d argue without much progress, but super-hung up on this one problem. I’m actually happy that they do that, because I think we do need to think about this more. But I think it pushed out of the space of discourse a lot of the other very significant AI- related risks.
+ 1 more
-
Their words
I continue to not want super-voting control over OpenAI. I never have. Never have had it, never wanted it. Even after all this craziness, I still don’t want it. I continue to think that no company should be making these decisions, and that we really need governments to put rules of the road in place.
17 March 2024
14 March 2024
-
Their words
Several people have speculated that we'll see many very valuable one-person companies (see Sam Altman's interview and Reddit discussion). I think they might be right.
6 March 2024
3 March 2024
-
Their words
They will shift what cash they generate to HBM capacity, which will keep supply growth in DRAM and NAND low.
Why HBM is the Hottest Thing in Memoryfabricatedknowledge.com
28 February 2024
From one piece Predictive Human Preference: From Model Ranking to Model Routing 2 beliefs, in the piece's order there
-
korrents.com
Routing prompts to different AI models can improve response quality while lowering cost and latency.Their words
Model routing has the potential to increase response quality while reducing costs and latency.
-
Their words
With more and more models being developed, each with different capabilities and a cost structure, model routing has clear economic values.
27 February 2024
-
Their words
the embodied, interactive, and multi-modal nature of first language (L1) acquisition is challenging to replicate with current models.
20 February 2024
-
Their words
And oftentimes it's more important to them to have the public perception that they're good directors so they get the next best deal. If they have a reputation for taking on management too aggressively, word will get out in the small community of founders and they'll miss the next Google.
16 February 2024
14 February 2024
13 February 2024
12 February 2024
-
Their words
This lack of knowledge sharing may impede progress in AI development.
6 February 2024
From one piece Encyclopaedia Automatica 2 beliefs, in the piece's order there
-
korrents.com
AI-generated writing is already fairly good but still lacks the direction and insight of human editors.Their words
As of today, computers write pretty good articles but lack the direction and insight of human editors.
-
korrents.com
AI should be approached as a collaboration between humans and computers, not a forced choice between them.Their words
We need to find ways to work with this new tech to get the best of humans and the best of computers, together, rather than thinking in terms of one or the other.
5 February 2024
-
korrents.com
High-quality data collection depends more on careful human execution than on machine learning techniques alone.Their words
Lots of ML techniques in the post can help with data quality, but fundamentally human data collection involves attention to details and careful execution.
29 January 2024
24 January 2024
17 January 2024
-
korrents.com
Expecting AI or longer lives to arrive in time makes people skip having a plan for falling birth rates at all.Their words
And they don’t see a need for a plan B, in case their forecast fails.
16 January 2024
-
Recommendsrcmnd.app
SupervisedTheir words
Longtime tech reporter Matt Lynley offers an uncommonly technical assessment of new AI developments in his newsletter Supervised. Original reporting and a fast cadence help this one stand out from other AI newsletters.
13 January 2024
7 January 2024
3 January 2024
-
Mixed onrcmnd.app
SuperintelligenceTheir words
the back half I think it goes off the rails and makes a ton of assumptions
26 December 2023
-
Recommendsrcmnd.app
Neural Network Methods for Natural Language ProcessingTheir words
I also read a ton of technical books last year, but the most impactful one for me was Neural Network Methods for Natural Language processing by Yoav Goldberg
21 December 2023
From one piece How Effective Altruism Lost Its Way 2 beliefs, in the piece's order there
-
Their words
Diverting attention and resources from global health and poverty is an enormous gamble, as it will make many lives poorer, sicker, and shorter in the name of fending off threats that may or may not materialize.
-
Their words
Unlike other interventions EA has sponsored, there are scant metrics for tracking the success or failure of investments in existential risk mitigation.
20 December 2023
14 December 2023
From one piece Jeff Bezos: Amazon and Blue Origin | Lex Fridman Podcast #405 3 beliefs, in the piece's order there
-
Their words
We do know that humans are doing something different from these models, in part because we're so power efficient. The human brain does remarkable things and it does it on about 20 watts of power. And the AI techniques we use today use many kilowatts of power to do equivalent tasks.
-
Their words
And so the only way to improve safety is to have an escape system. And historically, human-rated rockets have had escape systems. Only the space shuttle did not, but Apollo had one. All of the previous Gemini, etcetera, they all had escape systems.
-
Their words
It's interesting to me that large language models in their current form are not inventions, they're discoveries. The telescope was an invention, but looking through it at Jupiter, knowing that it had moons, was a discovery.
13 December 2023
-
Their words, before
precisely because smart people do devote brain-cycles to these possibilities, the rest of us have correspondingly less need to.
Their words now
I accepted what’s turned into a two-year position at OpenAI, thinking about what theoretical computer science can do for AI safety.
-
Their words, before
If I were forced at gunpoint to guess, I'd say that human-level AI seemed to me like a slog of many more centuries or millennia
Their words now
I was wrong, of course, not to contemplate more seriously the prospect that AI might enter a civilization-altering trajectory, not merely eventually but within the next decade.
-
Their words, before
If I were forced at gunpoint to guess, I’d say that human-level AI seemed to me like a slog of many more centuries or millennia (with the obvious potential for black swans along the way).
Their words now
I was wrong, of course, not to contemplate more seriously the prospect that AI might enter a civilization-altering trajectory, not merely eventually but within the next decade.
12 December 2023
11 December 2023
10 December 2023
3 December 2023
-
Their words
Large language models are more or less generalizations of stuff that we have. There’s still breakthroughs in AI waiting to happen, and maybe they are happening and maybe they’ll be good, maybe not, but that’s not quite the same.
28 November 2023
From one piece In Continued Defense Of Effective Altruism 2 beliefs, in the piece's order there
-
Their words
And I notice that the tiny handful of people capable of caring about 200,000 people dying of neglected tropical diseases are the same tiny handful of people capable of caring about the next pandemic, or superintelligence, or human extinction.
In Continued Defense Of Effective Altruismastralcodexten.com
-
Their words
EA has done a great job working on this (see list of accomplishments above), and I think the AI and x-risk people have just as much to be proud of as the global health and animal welfare people.
In Continued Defense Of Effective Altruismastralcodexten.com
26 November 2023
10 November 2023
9 November 2023
From one piece Elon Musk: War, AI, Aliens, Politics, Physics, Video Games, and Humanity | Lex Fridman Podcast #400 2 beliefs, in the piece's order there
-
Their words
I think it would be wise for us to have at least an objective third party who can be like a referee that can go in and understand what the various leading players are doing with AI, and even if there’s no enforcement ability, they can at least voice concerns publicly.
-
Their words
If an AI cannot figure out new physics, it’s clearly not equal to humans, nor has surpassed humans because humans have figured out new physics.
8 November 2023
1 November 2023
28 October 2023
26 October 2023
From one piece Managing extreme AI risks amid rapid progress (with 24 co-authors) 4 beliefs, in the piece's order there
-
Their words
Despite evaluations, we cannot consider coming powerful frontier AI systems "safe unless proven unsafe". With current testing methodologies, issues can easily be missed. Additionally, it is unclear if governments can quickly build the immense expertise needed for reliable technical evaluations of AI capabilities and societal-scale risks. Given this, developers of frontier AI should carry the burden of proof to demonstrate that their plans keep risks within acceptable limits.
-
Their words
Without sufficient caution, we may irreversibly lose control of autonomous AI systems, rendering human intervention ineffective. Large-scale cybercrime, social manipulation, and other harms could escalate rapidly. This unchecked AI advancement could culminate in a large-scale loss of life and the biosphere, and the marginalization or extinction of humanity.
-
Their words
For AI to be a boon, we must reorient; pushing AI capabilities alone is not enough. We are already behind schedule for this reorientation. The scale of the risks means that we need to be proactive, as the costs of being unprepared far outweigh those of premature preparation.
+ 1 more
-
Their words
Society's response, despite promising first steps, is incommensurate with the possibility of rapid, transformative progress that is expected by many experts. AI safety research is lagging. Present governance initiatives lack the mechanisms and institutions to prevent misuse and recklessness, and barely address autonomous systems.
25 October 2023
18 October 2023
28 September 2023
From one piece Mark Zuckerberg: First Interview in the Metaverse | Lex Fridman Podcast #398 3 beliefs, in the piece's order there
-
korrents.com
Building an AI that embodies a real person is a much harder problem than inventing a new AI character from scratch.Their words
So that's a lot of what I think we need to nail for the creators, and that's why that one is actually a much harder problem, I think, than starting with new characters that you're creating from scratch.
-
Their words
So at some point, I think making it so that you could build an AI version of yourself that could interact with people not after you die, but while you're here to help people fulfill this desire to interact with you and your desire to build a community.
-
Their words
I don't think we necessarily want there to be one big super intelligence. We want to empower everyone to both have more fun, accomplish their business goals, just everything that they're trying to do. We don't tend to have one person that we work with on everything, and I don't think in the future we're going to have one AI that we work with.
15 September 2023
-
Recommendsrcmnd.app
ChatGPT Custom InstructionsTheir words
Using Custom Instructions properly can completely transform your experience with ChatGPT.
13 September 2023
From one piece Self-exfiltration is a key dangerous capability 2 beliefs, in the piece's order there
-
Their words
If a model was capable of self-exfiltration, it would have the option to remove itself from your control.
Self-exfiltration is a key dangerous capabilityaligned.substack.com
-
Their words
Moreover, model exfiltration is likely impossible to reverse.
Self-exfiltration is a key dangerous capabilityaligned.substack.com
1 September 2023
-
Their words
What we don't want to happen with AGI, we want to happen with synthetic biology. What we don't want to happen online and software with language, we want for it to happen with bio-based materials.
29 August 2023
From one piece Language models surprised us 3 beliefs, in the piece's order there
-
Their words
Most importantly, ML experts and superforecasters both seem to be massively underestimating future spending on training runs.
-
Their words
Massively underestimating near-future progress could be very risky.
-
korrents.com
AI progress is faster than people expect, and ordinary scaling can be enough to solve problems that looked very hard.Their words
This rapid scaleup will probably drive another qualitative leap forward in capability like what we saw over the last 18 months.
23 August 2023
12 August 2023
-
Their words, before
Reading the book had not changed my fundamental belief that, in balance, we were on a good trajectory with AI research: good for science and good for society with expected positive impacts in many domains.
Their words now
I now believe that I was wrong and short-sighted to ignore that dual-use nature. I also think I was not paying enough attention to the possibility of losing control to superhuman AIs.
-
Their words
Instead of decades to centuries, I now see it as 5 to 20 years with 90% confidence.
10 August 2023
-
Their words
ChatGPT is fast-tracking the commodification of the human spirit by mechanising the imagination. It renders our participation in the act of creation as valueless and unnecessary.
28 July 2023
From one piece Microincentives and Enshittification 2 beliefs, in the piece's order there
-
Their words
The only way for Google Search to grow is to make itself worse.
-
korrents.com
Ranking first in a search has become near enough to being true, which is why search and spam are permanently at war.Their words
Google’s the first — and often the last — place we go to for answers, so snagging top billing in a Google search results page is, approximately speaking, equivalent to being “true.”
29 June 2023
From one piece George Hotz: Tiny Corp, Twitter, AI Safety, Self-Driving, GPT, AGI & God | Lex Fridman Podcast #387 5 beliefs, in the piece's order there
-
Their words
Of course, when you talk to an AI that’s made by a big company in the cloud, the AI fundamentally is aligned to them, not to you. And that’s why you have to buy a tiny box. So you make sure the AI stays aligned to you.
-
Their words
But the real thing that I want is not something that like tab completes my code and gives me ideas. The real thing that I want is a very intelligent pair programmer that comes up with a little popup saying, “Hey, you wrote a bug on line 14 and here’s what it is.”
-
Their words
I think things like MuZero and AlphaGo are so much more impressive because these things are playing beyond the highest human level. The language models are writing middle school level essays and people are like, wow, it’s a great essay.
+ 2 more
-
Their words
I think future LLMs are going to be smaller, but are going to run looping on themselves and are going to have retrieval systems. And the thing about using a retrieval system is you can cite sources, explicitly.
-
Their words
What’s ironic about all these AI safety people is they’re going to build the exact thing they fear. We need to have one model that we control and align. This is the only way you end up paper clipped. There’s no way you end up paper clipped if everybody has an AI.
26 June 2023
-
korrents.com
Half the population in rich countries is not articulate enough in writing to use prompt-driven AI well.Their words
For sure, half the population is insufficiently articulate in writing to use ChatGPT well.
23 June 2023
22 June 2023
From one piece AI Is First New UI Paradigm in 60 Years 3 beliefs · jakobnielsenphd.substack.com
-
Their words
Thus, the 2nd UI paradigm will survive, albeit in a less dominant role. Future AI systems will likely have a hybrid user interface that combines elements of both intent-based and command-based interfaces while still retaining many GUI elements.
AI Is First New UI Paradigm in 60 Yearsjakobnielsenphd.substack.com
-
Their words
The third UI paradigm, represented by current generative AI, is intent-based outcome specification. The user tells the computer the desired result but does not specify how this outcome should be accomplished, such as the steps to be executed. Compared to traditional command-based interaction design, this completely reverses the locus of control.
AI Is First New UI Paradigm in 60 Yearsjakobnielsenphd.substack.com
-
Their words
I doubt that the current set of generative AI tools, like ChatGPT, Bard, etc., are representative of the UIs we’ll be using in a few years because they have deep-rooted usability problems.
AI Is First New UI Paradigm in 60 Yearsjakobnielsenphd.substack.com
18 June 2023
-
Likedrcmnd.app
You Look Like a Thing and I Love YouTheir words
A funny book explaining the basics of AI! The subtitle is How Artificial Intelligence Works and Why It's Making the World a Weirder Place. A great introduction to AI. With a cute cartoon mascot. The title is from her training an AI to write romantic greeting cards.
6 June 2023
From one piece Why AI Will Save The World 4 beliefs · pmarca.substack.com
-
Their words
My response is that their position is non-scientific – What is the testable hypothesis? What would falsify the hypothesis? How do we know when we are getting into a danger zone?
-
Their words
I even think AI is going to improve warfare, when it has to happen, by reducing wartime death rates dramatically. Every war is characterized by terrible decisions made under intense pressure and with sharply limited information by very limited human leaders.
-
Their words
My view is that the idea that AI will decide to literally kill humanity is a profound category error. AI is not a living being that has been primed by billions of years of evolution to participate in the battle for the survival of the fittest, as animals are, and as we are. It is math – code – computers, built by people, owned by people, used by people, controlled by people.
+ 1 more
-
Their words
The single greatest risk of AI is that China wins global AI dominance and we – the United States and the West – do not.
25 May 2023
-
Their words
But we do not have enough data and we do not have enough insight to use AI/ML to pick better targets that have a higher chance of succeeding in the clinic.
18 May 2023
9 May 2023
-
Likedrcmnd.app
CronTheir words
Cron is completely free and only works with Google Calendar, but it’s super fast and reliable.
-
Recommendsrcmnd.app
PeteyTheir words
The app costs a few dollars up front and then has an optional subscription for unlimited requests, but I would recommend going directly to OpenAI’s developer dashboard, creating your own account, and copy/pasting your own API key into Petey.
4 May 2023
-
korrents.com
AI will soon let anyone consume any content reshaped into the timeframe, tone, voice and bias they choose.Their words
This isn't perfect, but soon it will be, and you will be able to listen to or read any content you want in the timeframe, tone, voice and bias of your choosing.
1 May 2023
From one piece Why Chatbots Are Not the Future 3 beliefs · wattenberger.com
-
korrents.com
Chatbots are a terrible interface for large language models, because a text box has no affordances.Their words
Hopefully I've convinced you that chatbots are a terrible interface for LLMs. Or, at the very least, that we can add controls, information, and affordances to our chatbot interfaces to make them more usable.
-
Their words
I want to see more tools and fewer operated machines - we should be embracing our humanity instead of blindly improving efficiency. And that involves using our new AI technology in more deft ways than generating more content for humans to evaluate. I believe the real game changers are going to have very little to do with plain content generation.
-
Their words
Good tools let the user choose when to switch between implementation and evaluation. When I work with a chatbot, I'm forced to frequently switch between the two modes.
21 April 2023
15 April 2023
24 March 2023
22 March 2023
21 March 2023
-
korrents.com
An AI can already earn an A on a university economics midterm, years earlier than informed forecasters expected.Their words
To my surprise and no small dismay, GPT-4 got an A. It earned 73/100, which would have been the fourth-highest score on the test.
15 March 2023
26 February 2023
17 February 2023
-
korrents.com
Liberal societies currently face an existential risk that must be addressed to reach a better future.Their words
This book is my best crack at explaining what I think is an existential risk to liberal societies and what I think we need to do to get to that awesome future I used to be so excited about.
-
Their words
The biggest issue is probably that we don’t control neutral networks enough to be able to ensure AI doesn’t harm humans. We can’t even control AI to not reveal internal prompts.
1 February 2023
17 January 2023
16 January 2023
-
Their words
What ChatGPT is, in this instance, is replication as travesty. ChatGPT may be able to write a speech or an essay or a sermon or an obituary but it cannot create a genuine song.
14 January 2023
19 December 2022
15 December 2022
7 December 2022
-
Their words
It terrifies me, because these data repositories are not only a risk to individual user privacy, they’re effectively a surveillance super-weapon.
Why encrypted backup is so importantblog.cryptographyengineering.com
5 December 2022
1 December 2022
5 November 2022
13 October 2022
-
Likedrcmnd.app
In the Plex: How Google Thinks, Works, and Shapes Our LivesTheir words
I learned a great deal from this book about Google, which put some of my own experiences with Google products in context.
8 October 2022
-
korrents.com
The three-year bet about whether AI image models could handle compositionality was won in three months.Their words, before
In fact, not only did they reach this level in three months, but probably they were at this level before the bet was even made
Their words now
I retract my claim to have won and will continue to see how AI progress advances over the next three years.
27 September 2022
12 September 2022
-
korrents.com
AI progress is faster than people expect, and ordinary scaling can be enough to solve problems that looked very hard.Their words
I think this matches the general finding that AI progress is faster than expected, and increases my certainty that scale and normal progress can sometimes be enough to solve even very difficult problems.
8 September 2022
7 September 2022
-
korrents.com
AI will out-think us, but it will not become conscious, because consciousness is a property of life.Their words
But in terms of what we value the most as humans, which is to say our feelings, our emotions, our sense of what the world is in a very personal way that I think means as much or more to people than their information processing. And that’s where I don’t think that AI necessarily will become conscious because I think it’s the property of life.
26 August 2022
17 June 2022
-
Their words
In particular, most EA careers and most careers to do with AI are competitive as fuck.
10 June 2022
From one piece AGI Ruin: A List of Lethalities 5 beliefs, in the piece's order there
-
Their words
The best and easiest-found-by-optimization algorithms for solving problems we want an AI to solve, readily generalize to problems we’d rather the AI not solve; you can’t build a system that only has the capability to drive red cars and not blue cars, because all red-car-driving algorithms generalize to the capability to drive blue cars.
-
Their words
None of this is about anything being impossible in principle.
-
Their words
Many alignment problems of superintelligence will not naturally appear at pre-dangerous, passively-safe levels of capability.
+ 2 more
-
Their words
unaligned operation at a dangerous level of intelligence kills everybody on Earth and then we don’t get to try again.
-
Their words
2 years after the leading actor has the capability to destroy the world, 5 other actors will have the capability to destroy the world.
6 April 2022
26 March 2022
4 March 2022
From one piece Training language models to follow instructions with human feedback (with 19 co-authors) 3 beliefs, in the piece's order there
-
Their words
For example, large language models can generate outputs that are untruthful, toxic, or simply not helpful to the user. In other words, these models are not aligned with their users.
-
korrents.com
The next-token language modeling objective is misaligned with following user instructions helpfully and safely.Their words
This is because the language modeling objective used for many recent large LMs-predicting the next token on a webpage from the internet-is different from the objective "follow the user's instructions helpfully and safely" (Radford et al.,, 2019; Brown et al.,, 2020; Fedus et al.,, 2021; Rae et al.,, 2021; Thoppilan et al.,, 2022). Thus, we say that the language modeling objective is misaligned.
-
korrents.com
Fine-tuning with human feedback is a promising direction for aligning language models with human intent.Their words
Even though InstructGPT still makes simple mistakes, our results show that fine-tuning with human feedback is a promising direction for aligning language models with human intent.
-
Likedrcmnd.app
The LoopTheir words
Science journalist Jacob Ward warns about a future in which AI technology forms a tight cybernetic feedback loop with the biases ingrained into the human brain, pushing our day-to-day existence in frightening directions. It's sort of like a version of The Terminator in which Danny Kahneman plays a starring role. As longtime readers and listeners of mine know, a big theme in my techno-criticism is the under-appreciated degree to which technologies exert powerful, unintended consequences on our personhood and culture, so Ward's warning hits a sweet spot with me.
23 February 2022
25 January 2022
-
Their words
I I would I would not say that about Google. I would just say that more generally like that is the incumbent temptation. Um it is is basically is basically go from attack mode to defend mode, right? Go from being the pirate to being the navy.
23 November 2021
-
Lovedrcmnd.app
The Alignment Problem: Machine Learning and Human ValuesTheir words
I just finished this book a few weeks ago and it is still reverberating in my mind
-
Mixed onrcmnd.app
The Precipice: Existential Risk and the Future of HumanityTheir words
I wouldn’t say that this is the most compelling book I’ve ever read in terms of the prose style or storytelling, but it does provide a very helpful, almost quantitative overview of all the potential threats looming out there
19 June 2021
27 March 2021
1 February 2021
-
Likedrcmnd.app
The Moon is a Harsh MistressTheir words
AI was in the air in the mid 1980s, but there were two things especially that made me want to work on it: a novel by Heinlein called The Moon is a Harsh Mistress
28 October 2020
-
Likedaffiliate linkrcmnd.app
Work Rules!: Insights from Inside GoogleTheir words
If you're curious how Google built it's culture and the processes thanks to their extremely data & engineering driven nature, this is a great book. What held it back was being ~100 pages too long and Bock didn't always understand where what they did only fit at a $100Bn+, mega-profitable company. Still, the insights on the studies on their 50,000+ employees is well worth the read since so few of us can get similar statistical significance to apply to our teams.
-
Likedaffiliate linkrcmnd.app
Mastering the VC GameTheir words
The interests of a Venture Capitalist are different than those of the entrepreneurs building a company they've invested in. Jeff does an awesome job of helping explain how you can get misaligned in your goals versus your investors. Fortunately, he also covers how to avoid it.
2 October 2020
-
Usesrcmnd.app
Google KeepTheir words
Google Keep - I use this primarily as a shared shopping list and "wish list," and for saving web links and lists I want to add to/come back to later.
1 October 2020
1 August 2020
-
Usesrcmnd.app
nativefierTheir words
For the rest (e.g., oddly, most Google web apps), I use a command-line tool called nativefier to turn them into desktop apps.
17 July 2020
1 June 2020
-
Recommendsrcmnd.app
Welch LabsTheir words
this channel is full of high production quality and well-written videos. There are also several series on machine learning, the topics underlying self-driving cars, so this is certainly one of the more applied math channels out there.
28 May 2020
-
Their words
Here we show that scaling up language models greatly improves task-agnostic, few-shot performance, sometimes even reaching competitiveness with prior state-of-the-art fine-tuning approaches.
7 February 2020
-
Lovedrcmnd.app
Gödel Escher BachTheir words
This book stretched my mind more than almost any other book I’ve read. It’s tough at parts, it’s long, but you’ll come out of it thinking about brains, minds, intelligence, and AI in an entirely new way.
30 January 2020
-
Usesrcmnd.app
ChromeTheir words
My browser of choice is Chrome, mainly because I use Google's tools (Gmail, Docs, Sheets, and so on) on a daily basis.
27 December 2019
10 December 2019
-
Usesrcmnd.app
Google ColabTheir words
spending an increasing amount of my free time working with tools like Google Colab, Runway ML, TensorFlow, and Hugging Face to play around with machine-generated text, audio, imagery, and video.
5 November 2019
-
Their words
We argue that ARC can be used to measure a human-like form of general fluid intelligence and that it enables fair general intelligence comparisons between AI systems and humans.
15 October 2019
-
Dislikedrcmnd.app
Microsoft WordTheir words
When I'm writing articles etc that need to be shared with an editor, I typically write in Microsoft Word. I hate all word processing software, and anyone who insists that Google Docs is so much better than Word is a liar.
7 October 2019
-
Lovedrcmnd.app
The AI Does Not Hate You: Superintelligence, Rationality, and the Race to Save the WorldTheir words
Briefly, I think the book is a triumph.
16 September 2019
-
Recommendsrcmnd.app
The Creativity Code: Art and Innovation in the Age of AITheir words
It's increasingly coming to the fore and Marcus deals with it in a really interesting way. He takes us through lots of different areas where AI is being used to mimic creativity, which some people would argue is the essence of being human. It's interesting to see how close to being human AI is getting.
22 August 2019
-
Lovedrcmnd.app
Google Meet speakermicTheir words
so we use Google Meet speakermics, which allow for full-duplex conversations, which makes conversation far more organic. That device turned Google Meet from something exhausting to something really good.
-
Usesrcmnd.app
Google Pixel 3Their words
My phone is a maxed-out Google Pixel 3, which I use for phone things: Email, reading, web browsing, messaging, music, and taking pictures
20 June 2019
-
Likedrcmnd.app
PDF ExpertTheir words
In terms of iOS apps, I use PDF Expert, which is a great PDF reader and annotator (using Apple Pencil), Notability as a virtual whiteboard (again with Apple Pencil), Google Docs for document editing, Google Calendar, and Gmail.
30 May 2019
28 May 2019
-
Recommendsaffiliate linkrcmnd.app
Trillion Dollar Coach: The Leadership Playbook of Silicon Valley's Bill CampbellTheir words
Eric Schmidt, Jonathan Rosenberg and Alan Eagle, Trillion Dollar Coach: The Leadership Playbook of Silicon Valley’s Bill Campbell: I understood Bill Campbell was a behind-the-scenes guy in Silicon Valley, but I had no idea just how influential he was. Bill Gurley of Benchmark noted “I would argue that Bill has had a bigger impact on Silicon Valley than any other single person simply because his reach was so amazingly wide.” That’s a story I want to read.
21 May 2019
-
Usesrcmnd.app
Visual Studio CodeTheir words
For coding, I use Visual Studio Code. I use Git for source control, Photoshop for 2D art, Audition for audio editing, Premiere for video editing, and our team coordinates on Google Docs and Skype.
4 May 2019
25 April 2019
27 February 2019
19 February 2019
23 January 2019
-
Their words
What we are actually listening to is human limitation and the audacity to transcend it. Artificial Intelligence, for all its unlimited potential, simply doesn’t have this capacity.
20 November 2018
19 October 2018
-
Likedrcmnd.app
Google DocsTheir words
Now, almost everything happens in Google Docs, except for when I write straight into the Axios or Substack CMS. (Both of which are lovely, WYSIWYG, very simple and easy to use.)
11 October 2018
From one piece BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding 2 beliefs, in the piece's order there
-
Their words
Such restrictions are sub-optimal for sentence-level tasks, and could be very harmful when applying fine-tuning based approaches to token-level tasks such as question answering, where it is crucial to incorporate context from both directions.
-
korrents.com
Current techniques restrict pre-trained representation power because standard language models are unidirectional.Their words
We argue that current techniques restrict the power of the pre-trained representations, especially for the fine-tuning approaches. The major limitation is that standard language models are unidirectional, and this limits the choice of architectures that can be used during pre-training.
From one piece BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding 2 beliefs, in the piece's order there
-
korrents.com
Current techniques restrict pre-trained representation power because standard language models are unidirectional.Their words
We argue that current techniques restrict the power of the pre-trained representations, especially for the fine-tuning approaches. The major limitation is that standard language models are unidirectional, and this limits the choice of architectures that can be used during pre-training.
-
Their words
Such restrictions are sub-optimal for sentence-level tasks, and could be very harmful when applying fine-tuning based approaches to token-level tasks such as question answering, where it is crucial to incorporate context from both directions.
From one piece BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding 2 beliefs, in the piece's order there
-
Their words
Such restrictions are sub-optimal for sentence-level tasks, and could be very harmful when applying fine-tuning based approaches to token-level tasks such as question answering, where it is crucial to incorporate context from both directions.
-
korrents.com
Current techniques restrict pre-trained representation power because standard language models are unidirectional.Their words
We argue that current techniques restrict the power of the pre-trained representations, especially for the fine-tuning approaches. The major limitation is that standard language models are unidirectional, and this limits the choice of architectures that can be used during pre-training.
From one piece BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding 2 beliefs, in the piece's order there
-
korrents.com
Current techniques restrict pre-trained representation power because standard language models are unidirectional.Their words
We argue that current techniques restrict the power of the pre-trained representations, especially for the fine-tuning approaches. The major limitation is that standard language models are unidirectional, and this limits the choice of architectures that can be used during pre-training.
-
Their words
Such restrictions are sub-optimal for sentence-level tasks, and could be very harmful when applying fine-tuning based approaches to token-level tasks such as question answering, where it is crucial to incorporate context from both directions.
9 August 2018
-
Recommendsrcmnd.app
The Algorithm Design ManualTheir words
To me, this book is an illustration of the power of names. Today, in the era of Google, if you know the name of something, you can find out about it with a simple search. But if you don't know of what you're looking for, it suddenly becomes much harder to find it. Having in the back of your head the names of common algorithms that help you solve problems is really powerful.
9 July 2018
21 June 2018
3 April 2018
-
Usesrcmnd.app
Google ChromeTheir words
Google Chrome: What's a Web Developer without Google Chrome browser? The first thing I do with Safari is to get Google Chrome and install the latest version.
1 April 2018
9 March 2018
-
Their words
Neural network pruning techniques can reduce the parameter counts of trained networks by over 90%, decreasing storage requirements and improving computational performance of inference without compromising accuracy.
-
Their words
Neural network pruning techniques can reduce the parameter counts of trained networks by over 90%, decreasing storage requirements and improving computational performance of inference without compromising accuracy.
7 March 2018
24 February 2018
From one piece Takeoff speeds 4 beliefs, in the piece's order there
-
Their words
I currently think a slow takeoff is significantly more likely.
-
Their words
Things are usually preceded by worse versions, even in cases where there are weak reasons to expect a discontinuous jump.
-
Their words
In particular, this means that incredibly powerful AI will emerge in a world where crazy stuff is already happening (and probably everyone is already freaking out).
+ 1 more
-
Their words
The main disagreement is not about what will happen once we have a superintelligent AI, it’s about what will happen before we have a superintelligent AI.
2 February 2018
30 December 2017
10 December 2017
19 November 2017
15 November 2017
24 October 2017
From one piece Why superintelligence is a threat that should be taken seriously 2 beliefs, in the piece's order there
-
Their words
One of the most commonly emphasized points in the AI safety literature is that one must never anthropomorphize AI—that is, don’t project human mental properties onto artificially intelligent systems.
-
Their words
A superintelligence whose goal system is even slightly misaligned with ours could, being far more powerful than any human or human institution, bring about human extinction for the very same reason that construction workers routinely slaughter large populations of ants.
9 October 2017
22 June 2017
-
Usesrcmnd.app
REAPERTheir words
I use a ton of software. Here's a list: Xcode, Pages, Numbers, Keynote, Sublime Text, Corona SDK, Unity, Final Cut Pro, Versions, Perforce, VMWare Fusion, Messages, REAPER, Transmit, Coda, Dropbox, Skype, Dashlane, Slack, Terminal, Assembla, Airmail, Spark Mail, Google Docs, Pixelmator, Pixen, TexturePacker, Particle Designer, Tiled, iTunes + Music + Match, Screenium, Steam, Twitter, Facebook.
-
Usesrcmnd.app
UnityTheir words
I use a ton of software. Here's a list: Xcode, Pages, Numbers, Keynote, Sublime Text, Corona SDK, Unity, Final Cut Pro, Versions, Perforce, VMWare Fusion, Messages, REAPER, Transmit, Coda, Dropbox, Skype, Dashlane, Slack, Terminal, Assembla, Airmail, Spark Mail, Google Docs, Pixelmator, Pixen, TexturePacker, Particle Designer, Tiled, iTunes + Music + Match, Screenium, Steam, Twitter, Facebook.
26 March 2017
28 February 2017
-
Usesrcmnd.app
emacsTheir words
For writing code, I use emacs and Google's internal distributed build system (a version of which was open sourced as Bazel) and our version control system
-
Usesrcmnd.app
LaTeXTheir words
For technical papers, I and my coauthors usually use LaTeX. For giving presentations, I almost exclusively use Google Slides.
-
Usestheir ownrcmnd.app
Google SlidesTheir words
For giving presentations, I almost exclusively use Google Slides.
8 January 2017
-
Recommendsrcmnd.app
Rationality: From AI to ZombiesTheir words
luckily I was aided by a few books that I recommend to anyone who wants to come to terms with this
1 October 2016
-
Mixed onaffiliate linkrcmnd.app
Site Reliability EngineeringTheir words
A description of how Google handles operations.
2 August 2016
10 December 2015
-
korrents.com
Depth is not free: past a point, deeper neural networks are harder to train rather than simply better.Their words
Deeper neural networks are more difficult to train.
-
korrents.com
Depth is not free: past a point, deeper neural networks are harder to train rather than simply better.Their words
Deeper neural networks are more difficult to train.
14 November 2015
27 August 2015
-
Their words
In theory, RNNs are absolutely capable of handling such "long-term dependencies." A human could carefully pick parameters for them to solve toy problems of this form. Sadly, in practice, RNNs don't seem to be able to learn them.
16 March 2015
Nothing matches.
What is a korrent?
A korrent is a belief a person has stated in their own words: one sentence stating the claim, backed by a quote and a source, kept at korrents.com.
Under a name here, the quoted block is what they actually said. The korrent beneath it is the claim those words support, in korrents' wording — tap it to see the record, its source, and who else holds it.
Nobody here wrote their own korrents. They are compiled from public statements, and a person can change their mind, which is recorded too.
About the English under a post
Some people here publish in a language other than English. Where they do, this site shows a machine translation beneath the post, in this typeface — the site's own, not theirs.
The post itself is never changed, moved or hidden: what is set in the serif above is exactly what the person published, and it is what to quote them on. A translation can be wrong in ways that matter, especially about tone.
Only the post's own words are translated. A quoted post, a linked article and a belief on korrents.com are left in their original language.