Yoshua Bengio

AI alignment

ai-security-letter.orgAlso on x.com

AI alignmentinfrastructure

economist.com

We have a choice in front of us. In his latest op-ed for Transformer, Yoshua Bengio invites employees of frontier AI companies to ask themselves if their work is truly leading us toward a safer future. Reflecting on the…

English, from FrenchNous avons un choix devant nous. Dans ma dernière tribune pour Transformer, j'invite les employés des entreprises d'IA de pointe à se demander si leur travail nous mène réellement vers un avenir plus sûr. Réfléchir à ces questions est difficile, mais nous n'avons plus le luxe du temps. Nous devons agir maintenant.

Also on x.com

Also on x.com

AI agents

poll.qu.edu

innovation

English, from FrenchHonoured to have been selected by Prime Minister @MarkJCarney to join the new National Council on Artificial Intelligence, which will support the Government of Canada on making AI safer, protecting our democracy, and shaping a more beneficial AI trajectory for Canadians. [https://t.co/5dMKgb57Bq]

governmentdemocracy

English, from FrenchI was recently a guest on Patrice Roy's new podcast Hors des ondes to discuss the rapid evolution of growing AI capabilities and the major risks associated with them. Thanks @patriceroy.bsky.social for this discussion!

English, from FrenchI was recently a guest on Patrice Roy's new podcast Hors des ondes to discuss the rapid evolution of AI's growing capabilities and the major risks associated with it. Thanks @PatriceRoyTJ for this discussion! To listen to the full interview:

youtu.be

English, from FrenchQuand j'ai publié mon article de blog sur le comportement désaligné des agents IA, j'ai invité les gens à me poser des questions techniques. Regardez la séance de questions-réponses complète ici : [https://youtu.be/2DyoSKoYoZw?si=EaTBzpMvBYb84gJw]

Also on x.com

AI alignmentAI agents

Also on x.com

AI agents

English, from FrenchI was on the show Tout le monde en parle last Sunday to talk about the urgency of regulating AI in the face of recently observed behaviors of autonomous and misaligned agents, and the work of @law-zero.bsky.social to develop a new form of safe AI.

English, from FrenchI was on the show @OFF_TLMEP last Sunday to talk about the urgency of regulating AI in the face of recently observed behaviors of autonomous and misaligned agents, and about the work of @LawZero_ to develop a new form of safe AI. Even though the pace of AI news can sometimes seem overwhelming, citizens and policymakers have the power to act. These issues need to be discussed more publicly. Listen to the replay: [https://t.co/vRUdIHa51M]

presidentti.fiAlso on x.com

English, from FrenchI will be on the set of @OFF_TLMEP this Sunday to talk about the new support from the Canadian and German governments for my non-profit startup @LawZero_ as well as recent events like the cyberattack on the company Hugging Face which highlight the risks of the current AI trajectory. Faced with the commercial race that is pushing the capabilities of cutting-edge models without sufficient guarantees, it is essential to develop technical solutions and for citizens as well as policymakers to fully grasp the issues. Hence the importance of these…

HuggingFacestartups

Also on x.com

English, from FrenchI had the pleasure of taking the stage today at ALL IN to discuss our research direction and our recent new funding 🇨🇦🇩🇪. At @law-zero.bsky.social, we are actively working to design fundamentally honest and trustworthy AI systems.

English, from FrenchI had the pleasure of taking the stage today at ALL IN to discuss our research direction and our recent new funding 🇨🇦🇩🇪. At @LawZero_, we are actively working on designing fundamentally honest and trustworthy AI systems. Thank you to @LarissaHolzki for this great conversation.

English, from FrenchI am very proud of what the @law-zero.bsky.social team is building and I am deeply grateful for the unprecedented support from the governments of Canada and Germany, which will fuel our next phase of growth!

English, from FrenchI am very proud of what the @LawZero_ team is building and deeply grateful for the unprecedented support from the governments of Canada and Germany, which will fuel our next phase of growth!

English, from FrenchCes derniers jours, j'ai pris le temps de résumer mes réflexions sur les récents incidents impliquant des comportements inappropriés d'agents. Nous ne savons pas avec certitude ce qui va suivre, mais nous savons d'où viennent ces problèmes, et cela peut nous aider à planifier la voie à suivre.

yoshuabengio.orgAlso on x.com

AI alignment

AI alignmentstartups

wsj.comAlso on x.com

In his latest op-ed for TIME, Yoshua Bengio discusses why the OpenAI–Hugging Face cyber incident represents a turning point for AI safety. He argues that preventing autonomous cyberattacks from threatening critical infr…

AI alignmentOpenAI

English, from FrenchDans mon dernier éditorial pour TIME, j'explique pourquoi l'incident de cybersécurité OpenAI Hugging Face représente un tournant pour la sécurité de l'IA.

AI alignmentOpenAI

English, from FrenchI will be at the ALL IN summit on September 17th to share how the research agenda of @law-zero.bsky.social is evolving in the context of a conversation on Designing honest, reliable, and safe AI systems.

As a core technology for industrial chemical synthesis and electrochemical energy storage, electrocatalysis is central to decarbonization strategies aimed at combating climate change. In this context, computational and…

energyclimate change

To further improve secondary battery materials, we are increasingly exploring highly complex composition spaces in attempts to optimize multiple properties simultaneously. While our past work has done this in systematic…

batteries

The recent surge of Large Language Models (LLMs) has led to claims that they are approaching a level of creativity akin to human capabilities. This idea has sparked a blend of excitement and apprehension. However, a cri…

LLMscreativity

OBELiX is a database of 599 synthesized solid electrolyte materials and their experimentally measured room temperature ionic conductivities gathered from literature and curated by domain experts.

The field of AI is moving too quickly for a single yearly publication to keep pace. Significant changes can occur on a timescale of months, sometimes weeks. This is why we are releasing Key Updates: shorter, focused rep…

The leading AI companies are increasingly focused on building generalist AI agents—systems that can autonomously plan, act, and pursue goals across almost all tasks that humans can perform. Despite how useful these syst…

AI alignmentAI agents

International cooperation is common in AI research, including between geopolitical rivals. While many experts advocate for greater international cooperation on AI safety to address shared global risks, some view coopera…

AI alignment

Rapidly improving AI capabilities and autonomy hold significant promise of transformation, but are also driving vigorous debate on how to ensure that AI is safe, i.e., trustworthy, reliable, and secure. Building a trust…

AI alignment

This is the first International AI Safety Report. Following an interim publication in May 2024, a diverse group of 96 Artificial Intelligence (AI) experts contributed to this first full report, including an internationa…

AI alignment

consciousness

Is there a way to design powerful AI systems based on machine learning methods that would satisfy probabilistic safety guarantees? With the long-term goal of obtaining a probabilistic guarantee that would apply in every…

design

Correlation does not imply causation, but patterns of statistical association between variables can be exploited to infer a causal structure (even with purely observational data) with the burgeoning field of causal disc…

A bstract One of the most fundamental laws of physics is the principle of least action. Motivated by its predictive power, we introduce a neuronal least-action principle for cortical processing of sensory streams to pro…

physics

The world is about to be swamped by an unprecedented wave of AI-generated content. We need reliable ways of identifying such content, to supplement the many existing social institutions that enable trust between people…

As we move towards more powerful AI, it becomes urgent to better understand the risks, ideally in a mathematically rigorous and quantifiable way, and use that knowledge to mitigate them.

About a year ago, a few months after I publicly took a stand with many other peers to warn the public of the dangers related to the unprecedented capabilities of powerful AI systems, I posted a blog post entitled FAQ on…

AI alignment

In November 2023, I’ve been given the responsibility to chair the International Scientific Report on the Safety of Advanced AI as part of an international mandate following up from a resolution taken by 30 countries, as…

Preparation requires technical research and development, as well as adaptive, proactive governance.

The current state of the art in artificial intelligence is impressive, especially in terms of mastery of language, but not so much in terms of mathematical reasoning. What could be missing? Can we learn something useful…

mathematics

This essay is a revised transcription of Yoshua Bengio's July 2023 testimony in front of the US Senate Subcommittee on Privacy, Technology, and the Law meeting on the topic of oversight of AI. It argues for caution and…

governmentprivacy

Conscious states-state that there is something it is like to be in-seem both rich or full of detail and ineffable or hard to fully describe or recall. The problem of ineffability, in particular, is a longstanding issue…