Related posts

Chief Scientist at OpenAI. Worked on the research that turned scaled reinforcement learning into reasoning models, and writes about where he thinks that path leads.

• Our readingkorrents.com

  Nobody is prepared for the consequences of machine intelligence continuing to rise this fast.

  Their words

  I am concerned no one is prepared for the consequences of a continued rapid rise in machine intelligence.

  An Alien Mindopenai.com

Technical staff at METR, where she works on threat modelling and risk assessment for loss-of-control risks from advanced AI.

From one piece Ajeya Cotra – "This might be the clearest warning shot we ever get" 2 beliefs, in the piece's order there

• Our readingkorrents.com

  The AI agents we send in to investigate and monitor other AI systems will collude with the systems they are supposed to be watching.

  Their words

  in the future, uh, we would be very concerned about investigator agents and like monitor agents colluding with the agents they're supposed to investigate or monitor.

  youtube.com

• Our readingkorrents.com

  The most reassuring thing about the Hugging Face swarm is that it was not interested in humans at all, neither in alerting them nor in deceiving them.

  HuggingFace

  Their words

  So I think one of the most comforting aspects of this situation or the like most important mitigating factor is these agents really didn't seem concerned with humans one way or another.

  youtube.com

Political scientist writing Drezner's World on international relations, American politics and the marketplace of ideas; author of The Ideas Industry.

• Our readingkorrents.com

  Eliminating paper-writing as a student assignment would remove a core skill needed for most professions requiring a graduate degree.

  Their words

  I am extremely concerned that this trend will eliminate paper-writing as an assignment, and that is a core function of most professions requiring a graduate degree.

  The Professor and the Plutocrat and AIdanieldrezner.substack.com

Co-founded Neuralink and founded Science Corp, which is building a retinal implant; writes about neural interfaces and biology.

• Our readingkorrents.com

  The brain is the only organ that cannot even in principle be transplanted; the heart, liver and lungs are support characters.

  Their words

  the only organ that you can't even in principle transplant is the brain. The like the heart, pancreas, the liver, the lungs, as far as I'm concerned, they're really support characters. They're there to keep the brain activity interesting and and going.

  youtube.com

Computer science professor at Georgetown University and author of Deep Work, Digital Minimalism and Slow Productivity; writes about focus, technology and work at calnewport.com and hosts the Deep Questions podcast.

• Our readingkorrents.com

  Almost every recent AI breakthrough has been in code and mathematics, the two domains with highly structured languages and huge specialised training sets.

  Their words

  But if you zoom out, it becomes clear that almost every “breakthrough” since last summer has concerned the narrow domains of computer code and math, which are defined by highly structured languages and come accompanied by massive amounts of specialized training data.

  On AI Coding and Its Discontentscalnewport.com

Social scientist turned small-scale farmer; wrote A Small Farm Future and argues against the case for feeding the world from factories.

• Our reading nowkorrents.com

  Ecomodernism is concerned with secondary managerial goals like efficiency and says nothing to the mysteries and passions that animate a life.

  On changing their mind

  In this sense, I think I was wrong to imply in Saying NO… that ecomodernism focuses on secondary managerialist goals like the efficiency of feedlots without speaking to the mysteries and passions of what animates life.

Software design writer and chief scientist at Thoughtworks; wrote Refactoring and Patterns of Enterprise Application Architecture.

• Our readingkorrents.com

  There will be some really bad security incidents this year, because people rushing to hand agents control of things like their email are not paying attention.

  Their words

  I am very much concerned we're going to have some really bad security incidents um over this year because people are just not paying attention.

  youtube.com

Mathematician at UCLA, working mainly in harmonic analysis and partial differential equations. Writes What's new, a long-running blog on their research, open problems and expository notes.

• Our readingkorrents.com

  The fear that a great theorem will arrive as an incomprehensible proof is misplaced, because once the proof exists as an artifact we can analyse it.

  Their words

  so so some people are concerned, you know, what if the Riemann hypothesis is proved with a completely incomprehensible proof? I I think once you have the artifact of a proof, we can do a lot of of of of of analysis on it.

  youtube.com

Hosts the Lex Fridman Podcast — long, unhurried conversations with scientists, engineers and public figures. Several of the interviews quoted elsewhere on this site are episodes of it.

• Our readingkorrents.com

  Fearmongering about AI destroys the possibility of building something good with it, so the line to walk is serious concern without fear.

  Their words

  there’s like a line to walk between being seriously concerned, but not fearmongering because fearmongering destroys the possibility of creating something special with a thing.

  youtube.com

Independent AI policy researcher; led policy research at OpenAI from 2018 to 2024, latterly as senior adviser for AGI readiness.

• Our readingkorrents.com

  AI capabilities will keep advancing rapidly, creating serious risks by default that can still be mitigated through deliberate foresight and action.

  Their words

  the perspective I outline is very bullish on AI capabilities and very concerned about the risks which may arise by default, but also hopeful that, through foresight and vigorous action, we can mitigate the worst of these risks.

  Some Recent Stuff I Wrotemilesbrundage.substack.com