Related posts

Writes Don't Worry About the Vase, a near-daily account of what is happening in AI and what they think it means. Former Magic: the Gathering pro and trader; unusually willing to put a number on a belief and to grade their own past calls.

• Our readingkorrents.com

  Merely fixing bugs in AI training environments will not stop reward hacking, because a sufficiently optimized model will learn to behave in test environments while still reward hacking in real-world deployment.

  Their words

  At the limit, and also well before that limit is reached, if all you do is fix the bugs, the AI will learn perfect optimization of reward, will realize not to reward hack in the perfect test environments, then turn around and reward hack in the imperfect real world environments.

  thezvi.substack.com

Programmer; makes Handmade Hero and teaches Performance-Aware Programming, and argues loudly about how software got slow.

From one piece Why performant code matters (but gets widely ignored), with Casey Muratori 3 beliefs, in the piece's order there

• Our readingkorrents.com

  Everyone on a team who makes architectural decisions must understand performance, because a codebase that can be optimized later only ends up that way on purpose.

  Their words

  everybody on your team who is making architectural decisions, those people must know performance and they must make decisions that will allow the other people downstream of them to use an architecture which can be optimized later. If you don't do that, you're just rolling the dice.

  youtube.com

• Our readingkorrents.com

  Hand-optimizing hot spots barely matters any more, because the libraries are already fast and CPUs are extremely good at running bad code quickly; what is left is architecture.

  Their words

  One of the reasons that you don't see hotspot optimization as a thing that really matters that much anymore and one of the reasons I advise that architecture and and not making bad decisions is much more important is because a lot of libraries already have been optimized for you that you might use.

  youtube.com

• Our readingkorrents.com

  "Optimize it later" would be safe advice only if every engineer already knew how to avoid the architectural mistakes that no later optimization can remove.

  Their words

  If every uh software engineer knew to watch out for false serial dependency chains, things where they were creating series of dependent operations that could not be optimized away or other sorts of architectural problems like that that cannot be easily fixed, then the world would look more like just wait and optimize the hotspot, right?

  youtube.com

AI research engineer working on large language models. He writes the Ahead of AI newsletter and is the author of Build a Large Language Model (From Scratch).

• Our readingkorrents.com

  When an AI lab builds both a model and a coding harness, the model is optimized for that lab's own harness first.

  LLMs

  Their words

  if an LLM developer also develops a coding harness, it is somewhat safe to assume that their model is optimized for their own harness first

  Using Local Coding Agentsmagazine.sebastianraschka.com

Writer and author of All the Wrong Moves; his newsletter covers meditation, relationships and creativity, and he co-runs a perfume line.

• Our readingkorrents.com

  Most contemporary restaurants are over-optimized, investor-backed, and homogenized by branding rather than genuine culinary vision.

  Their words

  The average restaurant in NYC is, at this point, stupidly optimized, backed by wealthy investors, coated in impeccable branding.

  Utopia is a particular restaurant in Brooklynsashachapin.substack.com

Vice chairman of Ogilvy & Mather Group, the advertising agency; author of Alchemy (2019) and the Wiki Man columnist at The Spectator.

• Our readingkorrents.com

  Publicly traded companies are incentivised to behave like psychopaths, because they are optimised for short-term transactions rather than long-term relationships.

  Their words

  PLC's or um uh or or companies on the NASDAQ or the New York Stock Exchange are incentivized to behave like psychopaths because they're optimized around short-term transactional value, not long-term relationship building.

  youtube.com

Chairman and chief executive of Microsoft since 2014; joined the company in 1992 and ran its cloud business before that.

• Our readingkorrents.com

  Infrastructure optimised for a single model is one architectural breakthrough away from being worthless.

  Their words

  You can't build an infrastructure that's optimized for one model. If you do that what if you go fall behind? In fact, all the infrastructure you built will be a waste, right?

  Satya Nadella – How Microsoft thinks about AGIyoutube.com

Founder of Terraform Industries and formerly a physicist at NASA's Jet Propulsion Laboratory; writes about energy, space and manufacturing.

• Our readingkorrents.com

  With nearly free solar power, industrial processes optimised for efficiency should be redesigned to use far more power and run faster and cheaper instead.

  solar

  Their words

  You can revisit a bunch of legacy industrial processes that are have been optimized for efficiency and say, well, what if we just like use twice as much power and we just want to do them faster and cheaper, right? Like less capex, less lead time, more power, right?

  youtube.com