Aravind Srinivas

Their words

Does the user care if Perplexity has the most dominant model in order to come and use the product? No. Does the user care about a good answer? Yes. So whatever model is providing us the best answer, whether we fine-tuned it from somebody else’s base model or a model we host ourselves, it’s okay.

Their words

In Google, even though we call it 10 blue links, you get annoyed if you don’t even have the right link in the first three or four. The eye is so tuned to getting it right. LLMs are fine. You get the right link maybe in the 10th or ninth. You feed it in the model. It can still know that that was more relevant than the first.

Their words

There is an algorithm called BM25 precisely for this, which is a more sophisticated version of TF-IDF. TF-IDF is term frequency times inverse document frequency, a very old-school information retrieval system that just works actually really well even today. And BM25 is a more sophisticated version of that, that is still beating most embeddings on ranking.

Their words

What makes humans special though, is our curiosity. Even if AI’s cracked this, it’s us still asking them to go explore something. And one thing that I feel like AI’s haven’t cracked yet, is being naturally curious and coming up with interesting questions to understand the world and going and digging deeper about them.

Their words

It’s less about access to a model’s weights, it’s more access to compute that is putting the world in more concentration of power and few individuals. Because not everyone’s going to be able to afford this much amount of compute to answer the hardest questions.

Their words

I think if we can achieve that amount of inference compute, where it leads to a dramatically better answer as you apply more inference compute, I think that will be the beginning of real reasoning breakthroughs.

Their words

But any breakthrough can disrupt that. If you can decouple reasoning and facts and end up with much smaller models that can reason really well, you don’t need a million H100 equivalent cluster.

Their words

I think there’s an interesting thought experiment here that, we’ve been spending a lot of compute in the pre-training to acquire general common sense, but that seems brute force and inefficient. What you want is a system that can learn like an open book exam.

Their words

And without good post-training, you’re not going to have a good product. But at the same time, without good pre-training, there’s not enough common sense to actually have the post-training have any effect.

Their words

And that is the, I would say, it’s almost like the last answer. Nothing has changed since 2017 except maybe a few changes on what the nonlinearities are and how the square descaling should be done. Some of that has changed.

Their words

And it gives hope for a world where we can have more players instead of two or three companies controlling the most capable models. And that’s why I think it’s very important that he succeeds and that his success also enables the success of many others.

Their words

There is a skill to asking good questions, and everyone’s curious though. Curiosity is unbounded in this world. Every person in the world is curious, but not all of them are blessed to translate that curiosity into a well-articulated question.

Their words

And also this is where I believe the whole prompt engineering, trying to be a good prompt engineer is not going to be a long-term thing. I think you want to make products work where a user doesn’t even ask for something, but you know that they want it and you give it to them without them even asking for it.

Their words

You can set out to build a good business and it’s still fine. Maybe the long-term business model of Perplexity can make us profitable in a good company, but never as profitable in a cash cow as Google was. You have to remember that it’s still okay.

Their words

What is the weakness of Google is that any ad unit that’s less profitable than a link, or any ad unit that kind of disincentivizes the link click is not in their interest to go aggressive on, because it takes money away from something that’s higher margins.

Their words

We would rather take a more dramatic position, that the best way to actually make a dent in the search space is to not try to do what Google does, but try to do something they don’t want to do. For them to do this for every single query is a lot of money to be spent, because their search volume is so much higher.

Their words

The principle in Perplexity is you’re not supposed to say anything that you don’t retrieve, which is even more powerful than RAG because RAG just says, “Okay, use this additional context and write an answer.” But we say, “Don’t use anything more than that too.” That way we ensure a factual grounding.