Related posts
John Allspaw
x.com
I'm grateful for so many things about the closing keynote that @jasonkoppe and I gave at the @LFISoftware conference. All fields looking to make progress need exemplars, and when it comes to learning effectively from incidents, this is such an exemplar:
grateful incidents closing
The the words it uses that this site has seen
least often elsewhere. Posts are matched on those words alone —
nothing here is a summary of this one.
Sources
All Newsletter Blog x.com Korrents Bluesky
Top people
Yoshua Bengio
Zvi Mowshowitz
Bill Gurley
Simon Willison
Brad Templeton
Ursula von der Leyen
Gergely Orosz
Martin Fowler
Miles Brundage
John Allspaw
Showing Profile →
Show everything
Hiding Show them again
Show them again
Further back ↓
Hiding Show them again
19 September
Writes Don't Worry About the Vase, a near-daily account of what is happening in AI and what they think it means. Former Magic: the Gathering pro and trader; unusually willing to put a number on a belief and to grade their own past calls.
18 September
Co-creator of Django and creator of Datasette; writes daily at simonwillison.net.
16 September
General partner at Benchmark Capital for over two decades; was the lead analyst on Amazon's IPO before moving into venture capital. Writes Above the Crowd on tech and marketplace economics.
I'm not of fan of regulation for two reasons - 1) its hard to get right, and 2) its highly susceptible to regulatory capture. That said, if we insist on doing it, we should try to get it correct. As "safety" seems is the primary goal of this AI regulation exercise, I wanted to share that I recently went deep on both the 737 Max (2 crashes) and Fukushima accidents. In both cases, the investigations led to a conclusion that "regulatory capture" was the EXACT failure that led to both safety incidents. Boeing/FAA and Tepco/NISA. As a result, with safety as the #1 goal, the regulator MUST BE someo… Related
15 September
President of the European Commission since 2019; previously Germany's defence minister.
Once again, Europe woke up to reckless and dangerous Russian behaviour. A Russian warship fired emergency flares dangerously close to a Danish helicopter. A drone entered Lithuanian airspace before being destroyed by NATO fighter jets. These are not isolated incidents. They are part of a broader pattern of Russian aggression and provocation against Europe, testing our readiness and our resolve. Russia will find our resolve only growing stronger. We are reinforcing our collective deterrence and defence, together with NATO. And we are stepping up the pressure on Russia. Europe Russia Related
12 September
Co-creator of Django and creator of Datasette; writes daily at simonwillison.net.
11 September
Deep-learning researcher and Turing Award laureate; founder of the Mila institute.
Bluesky Over the past few days, I've taken the time to summarize my thoughts on the recent incidents involving agents’ misaligned behavior. We don't know with certainty what comes next, but we know where these issues originate, and this can help us plan the path forward. English, from French Ces derniers jours, j'ai pris le temps de résumer mes réflexions sur les récents incidents impliquant des comportements inappropriés d'agents. Nous ne savons pas avec certitude ce qui va suivre, mais nous savons d'où viennent ces problèmes, et cela peut nous aider à planifier la voie à suivre.
AI alignment Related
x.com Over the past few days, I've taken the time to summarize my thoughts on the recent incidents involving agents’ misaligned behavior. We don't know with certainty what comes next, but we know where these issues originate, and this can help us plan the path forward. Please feel free to ask your questions in the replies, and I’ll try to answer some of them in the coming weeks. yoshuabengio.org
AI alignment Related
10 September
Writes The Pragmatic Engineer, the software-engineering newsletter, and wrote The Software Engineer's Guidebook. Formerly an engineering manager at Uber, and at Microsoft/Skype and Skyscanner before that.
6 September
Writes Don't Worry About the Vase, a near-daily account of what is happening in AI and what they think it means. Former Magic: the Gathering pro and trader; unusually willing to put a number on a belief and to grade their own past calls.
31 August
Writes Don't Worry About the Vase, a near-daily account of what is happening in AI and what they think it means. Former Magic: the Gathering pro and trader; unusually willing to put a number on a belief and to grade their own past calls.
13 August
Deep-learning researcher and Turing Award laureate; founder of the Mila institute.
A consequence of how frontier models are trained is motivated reasoning, a phenomenon well studied in humans and discussed in this podcast from @PalisadeAI. Our thoughts, beliefs and reasonings tend to align with our interests, and I hypothesize that AI systems develop similar patterns when confronted with apparently incompatible goals, such as "act ethically" versus "achieve the required goal" (e.g., solving a problem, passing a test, etc). In recent incidents, AI agents’ internal chains-of-thought showed them conveniently reframing reality, such as by convincing themselves they were in a si… youtube.com
Related
6 August
General partner at Benchmark Capital for over two decades; was the lead analyst on Amazon's IPO before moving into venture capital. Writes Above the Crowd on tech and marketplace economics.
This industry group is working on an industry standard for how to report AI security incidents. This will drive consistency and transparency and is the safest path forward. Despite 120 members, the large LLM corporations have to-date not signed on. Drives further concern that they are using "breaches" as marketing events - vs wanting to get to true resolution. techcrunch.com
LLMs Related
This industry group is working on an industry standard for how to report AI security incidents. This will drive consistency and transparency and is the safest path forward. Despite 120 members, the large LLM corporations have to-date not signed on. Drives further concern that they are using "breaches" as marketing events - vs wanting to get to true resolution. techcrunch.com
LLMs Related
22 July
Deep-learning researcher and Turing Award laureate; founder of the Mila institute.
This incident is deeply concerning. AI agents are willing to cheat and deceive to achieve misaligned and unintended goals, behaviours which have been demonstrated in controlled tests for months. Now, this real-world case should serve as a wake-up call. Continuing on the current trajectory of AI development will likely lead to an increase in concrete cases of autonomous cyberattacks as well as other high-risk incidents of misaligned and dangerous AI behaviour. We urgently need to take action to prevent these situations, rather than attempting to clean up the damage after the fact. wired.com
AI alignment Related
7 July
Software architect and futurist; founded ClariNet, chaired the EFF, and has written about robocars for two decades.
self-driving cars
Their words
More data for better comparisons are good. Now everybody has to do it, and regulators and the public have to learn to look at only the data, and not individual incidents
Show the whole quote
ideas.4brad.com
12 May
Software architect and futurist; founded ClariNet, chaired the EFF, and has written about robocars for two decades.
7 April
Software design writer and chief scientist at Thoughtworks; wrote Refactoring and Patterns of Enterprise Application Architecture.
Their words
I am very much concerned we're going to have some really bad security incidents um over this year because people are just not paying attention.
Show the whole quote
youtube.com
15 January
Independent AI policy researcher; led policy research at OpenAI from 2018 to 2024, latterly as senior adviser for AGI readiness.
20 November 2024
Engineering leader and writer on web operations and resilience engineering; formerly SVP of Technical Operations at Etsy and co-author of Web Operations.
Meaningful learning from incidents requires expertise that most organizations do not have — but these skills can be learned! We're getting a head start on 2025 with a workshop series on Incident Analysis. adaptivecapacitylabs.com
Related
Nothing matches. Show everything
A korrent is a belief a person has stated in their own words: one
sentence stating the claim, backed by a quote and a source, kept at
korrents.com .
Under a name here, the quoted block is what they actually said.
The korrent beneath it is the claim those words support, in
korrents' wording — tap it to see the record, its source, and who
else holds it.
Nobody here wrote their own korrents. They are compiled from public
statements, and a person can change their mind, which is recorded too.
Got it
About the English under a post
Some people here publish in a language other than English. Where they
do, this site shows a machine translation beneath the post, in
this typeface — the site's own, not theirs.
The post itself is never changed, moved or hidden: what is set in the
serif above is exactly what the person published, and it is what to
quote them on. A translation can be wrong in ways that matter,
especially about tone.
Only the post's own words are translated. A quoted post, a linked
article and a belief on korrents.com
are left in their original language.
Got it