AI has always been very jagged, and we are making models which are superhuman goal-seekers at math and software engineering, but they have massive limitations on intuitions, creativity, and other types of reasoning that humans are strong at.
A clear risk discussed throughout this year is to cybersecurity: the models are becoming superhuman in their ability to break in and out of computer systems.
I actually I do wanna die. I don't wanna do this forever. Like, I think the human li- lifespan of about 90 to 100 sounds about right. I'm embracing the finitude of life.
But if you need to reach superhuman levels of performance in a fully autonomous agent in a safety-critical environment, uh, just doing kind of that basic vanilla end-to-end is not enough.
However, if you are targeting full autonomy, and you're targeting superhuman, strongly superhuman performance, you find that weak sensing just leads to a safety curve that flattens out way too early.
I suspect that if you decided to be open-minded, then the Being would probably be extremely persuasive. But I don’t think it’s very common to do that.
Their words now
I take it back. Instead of being unsure, I now lean strongly towards the idea that the Being would in fact be very good at convincing people of stuff, and far better than any human.
And it struck me how the most well-known brands have stood for one clear thing. Like they have a clear position. And so in order for superhuman to be memorable, I believed that we needed to occupy a clear position that was unique and which was available and which reinforced our product strategy.
And number two, the superhuman opportunity deserves everyone who works at the company to spend as much time as possible in their zone of genius. And so that includes me as well as everybody else. So what I did is I hired a really great president. I went from eight direct reports to two.
A series of autobiographical essays exploring wandering, uncertainty, memory, desire, and place—embracing the unknown as a gateway to self-transcendence.
A nice personal + historical deep dive into finding your dharma by embracing both your gifts and limitations in service of something greater than yourself.
There's this very good quote from Sam Altman who... He can be a hyperbeast sometimes, but one of the things he said, and I think I agree, is that superhuman persuasion will happen before superhuman intelligence, right? And if that's the case, then these things before we get this AGI ASI stuff, we can embed superhuman persuasion towards our ideal or whatever the ideal of the model maker is, right?
A korrent is a belief a person has stated in their own words: one
sentence stating the claim, backed by a quote and a source, kept at
korrents.com.
Under a name here, the quoted block is what they actually said.
The korrent beneath it is the claim those words support, in
korrents' wording — tap it to see the record, its source, and who
else holds it.
Nobody here wrote their own korrents. They are compiled from public
statements, and a person can change their mind, which is recorded too.
About the English under a post
Some people here publish in a language other than English. Where they
do, this site shows a machine translation beneath the post, in
this typeface — the site's own, not theirs.
The post itself is never changed, moved or hidden: what is set in the
serif above is exactly what the person published, and it is what to
quote them on. A translation can be wrong in ways that matter,
especially about tone.
Only the post's own words are translated. A quoted post, a linked
article and a belief on korrents.com
are left in their original language.