-
korrents.com
Retrieval-augmented generation is the most practical approach for reducing LLM hallucinations.Their words
Retrieval-augmented generation (RAG; Lewis et al., 2020), which conditions on the LLM's generation on retrieved documents is the most practical paradigm IMO.
Sebastian Ruder
Everything, newest first — across every channel. Their profile →
Hiding
15 April 2024
19 December 2023
-
Their words
recent LLMs are reaching the limits of text data online and repeating data eventually leads to diminishing returns
5 December 2023
From one piece EMNLP 2023 Primer 3 beliefs, in the piece's order there
-
Their words
Full fine-tuning of LLMs has become prohibitive and requires parameter-efficient methods instead.
-
Their words
LLMs are still limited in non-English settings and that making LLMs more multilingual is an important direction.
-
Their words
In light of the increasing number of closed-source LLMs, it is important to continue to promote an open culture of sharing knowledge, data, and software, from which the NLP community has benefited greatly.
1 December 2023
From one piece NeurIPS 2023 Primer 2 beliefs, in the piece's order there
-
Their words
Overall, while initial plans of LLMs can be useful as a starting point, LLM-based planning currently works best mainly in conjunction with external tools.
-
korrents.com
Current large language models still struggle to compose operations into correct multi-step reasoning paths.Their words
Overall, current LLMs still struggle with composing operations into correct reasoning paths.
Nothing matches.
What is a korrent?
A korrent is a belief a person has stated in their own words: one sentence stating the claim, backed by a quote and a source, kept at korrents.com.
Under a name here, the quoted block is what they actually said. The korrent beneath it is the claim those words support, in korrents' wording — tap it to see the record, its source, and who else holds it.
Nobody here wrote their own korrents. They are compiled from public statements, and a person can change their mind, which is recorded too.
About the English under a post
Some people here publish in a language other than English. Where they do, this site shows a machine translation beneath the post, in this typeface — the site's own, not theirs.
The post itself is never changed, moved or hidden: what is set in the serif above is exactly what the person published, and it is what to quote them on. A translation can be wrong in ways that matter, especially about tone.
Only the post's own words are translated. A quoted post, a linked article and a belief on korrents.com are left in their original language.