0:00Speaker A:I believe that we're going to have at least one massive multi hundred billion, if not trillion dollar American company focused on American first open source. What happened is that Kimi actually beat all American models, including Fable, in some subset of tasks. That doesn't mean that they're not distilling.
0:15Speaker B:Anastasios is the founder and CEO of Arena. It allows you to vote on the best models. It's an unbelievable model evaluator. And this turned out to be one of the most fun shows I have done literally in recent memory.
0:27Speaker A:The idea that we should have a central government body that tells us when it's time to a new product versus not is crazy to me. This is gonna be so insane what happens with like the cyber attacks. There's at least 75 Neo laps for sure. Like two thirds of those are gonna be worth nothing.
0:45Speaker B:Ready to go, Anastasios. This is gonna be a lot of fun for me because I'm dumb as rocks and you're gonna teach me a whole load of stuff today. So thank you so much for joining me, dude.
1:07Speaker A:Oh, no, thank you for having me, dude.
1:09Speaker B:I told you I used this as a chance to catch up with old friends. So it was wonderful stalking you for the last few days. I just want to start. For anyone that doesn't know, can you explain to me very succinctly and easily, what is arena and why is it important and gaining notoriety today?
1:25Speaker A:Well, arena is the platform for measuring AI performance in the real world. So what that means is that we're not using static benchmarks, we're not using some random data set that somebody collected, but rather what happens when you put AI in the hands of real people. And in so doing, we're measuring the objective reality of how AI affects humanity. Whether it's factual, whether it's steerable, whether humans prefer it or disprefer it, whether it's hallucinating, whether there's errors, whether people are getting their actual jobs done with AI.
1:53Speaker A:It's reality. And then we're helping labs improve their models while helping the ecosystem understand the performance of different, you know, different AIs and keep track of all the amazing breaking news, all the new models, multiple models being released every week. So that's sort of the story of arena. We're the central evaluation platform of AI.
2:10Speaker B:Well, that was incredibly succinct. Thank you. Normally people take about four hours after I ask for a succinct description. When you look at the models that you have on arena, the sheer number of them, bluntly, I just Am faced with the one question, Holy shit, is this like the true commoditization of models?
2:27Speaker B:Are they just a complete utility layer at this point?
2:30Speaker A:Well, I think that there's the big question around. This has started to rise because of open source models. So I think if you were to only look at the closed source models, you would say there's acceleration, but it hasn't quite commoditized yet because that layer is still owned by a pretty small group of companies. It would be an oligopoly if we only had the closed source models.
2:53Speaker A:But what seems to be happening is that the open source models, especially from China, have really rapidly improved. And for the first time ever, we saw a couple of weeks ago that Kimik3 actually beat the best closed source American models on a pretty important subset of tasks. For example, front end, front end coding, like web development, which a huge fraction of developers are web developers.
3:17Speaker B:Can I ask how big a moment was that? Because it's like a. I'm going to butcher it, but you know, I'm a podcaster, so I can get away with it. You're a PhD master, you can't. It's like a 27 trillion parameter model.
3:30Speaker B:It's pretty clunky. This is not an agile model. And actually I was with Jason Lamkin yesterday from sasta, who's as AI pilled as they can be, and he's like, honestly, it's not better than the others. How bigger moment is Kimmy?
3:45Speaker A:No, it was a pretty big moment. It was a pretty big moment. And the reason I'd say it was a big moment is because it violates a narrative that has been persistent in the United States, which is that the Chinese are just distilling American models and that's the only way that they're able to keep up. Really what happened is that Kimmy actually beat all American models, including Fable, in some subset of tasks.
4:10Speaker A:That doesn't mean that they're not distilling. They may still be using distillation as a subset in their training procedure, but it does mean that distillation is only part of the story and that there's something that those labs are doing above and beyond distillation that's bringing the performance up above what the American labs are currently doing. And so that narrative violation has been hugely important to the way that people view the ecosystem, both from the scientific dominance of Americans and the American sort of hegemony, which of course Americans love hegemony, to the economics of the whole thing. And to your point, are these models a Commodity or not.
4:55Speaker B:When we see, when we look at your open readers of the world, the top five models are all open source Chinese models. When we see the proliferation of Chinese models today, does that cannibalize the closed frontier model business meaningfully?
5:11Speaker A:Well, I think that you need to think about the incentives and economics behind it. So first thing I'll say is that the open router metrics are not truly reflective of reality. And that's because the business model of open router is to charge like a fraction, like a fee on top of every token. And so what happens is that people don't use OpenRouter for proprietary models.
5:36Speaker A:People are using OpenRouter primarily for open source models where they need the failover and all the value added services that OpenRouter provides. If you look at the whole space of all inference, most of it is still being consumed on first party APIs and on proprietary models. That's why anthropic revenue has been just a total hockey stick. It's not like they're being completely cannibalized right now by Chinese open source models.
6:01Speaker A:These models are still only a small fraction of the total inference spend in the world. That said, think about what's happening in the future. Enterprises are going to want to own their own intelligence. They're going to want so called AI sovereignty, which is a fancy word for meaning that you own your whole supply chain of AI.
6:21Speaker A:That means you can take an open source model and you can fine tune it on your own company's data and own your stack end to end basically outside of the compute hosting. And so then you should be able to run it within your your own company. People are going to care about sovereignty, people are going to care about costs, people are going to care about self improving and they're not necessarily going to want to give their data to an external third party service that might even be competing with them one day.
6:47Speaker B:So do you believe that is the future? We had Lynn on from Fireworks and she was like specialized intelligence will be the future. Companies will have their own fine tuned specialized models with their own company data and the performance will be better and that is what will happen. Do you think that's right?
7:01Speaker B:Or is that actually just a small subset of very advanced Silicon Valley companies and Danone Yoghurts and every normal company would just use Frontier, whatever.
7:10Speaker A:Well I'll say it like this, I think the business incentives make this inevitable. And the reason is because businesses are going to need a way of keeping a moat in. The age of AI software is no longer really A moat because it can be produced instantaneously, right? Let's project out five years, that's what's going to happen.
7:33Speaker A:And so what? Moats exist, network effects exist and data moats exist. And if you can take your data moat and turn it into a self improving product, that is a way for businesses to remain sustainable in the ages of AI. Let's say I'm a business like a Coca Cola, I'm a Cisco, I have a lot, a lot of users.
7:51Speaker A:I might not be necessarily at the frontier of the AI technology of the world, but I do have this massive corpus of data that I can use in order to, you know, beat my competition. So what should I do? I should be trying to take advantage of my data as much as I possibly can to accelerate my business and stave off competitors.
8:10Speaker B:Do you think they will really use open source Chinese models to to do that?
8:15Speaker A:That's a great question. I think not. I think that the Chinese models will be potentially part of the story for now, but that given the regulatory environment in the US it's probably more likely in the long run that we see a great American open source competitor arise. And this is why I've been a strong proponent for example of thinking machines.
8:36Speaker A:I believe that we're going to have at least one massive multi hundred billion if not trillion dollar American company focused on American first open source.
8:48Speaker B:Why have we not so far? I really hope so too by the way. I completely agree, would love to see that. But why haven't we?
8:54Speaker B:Why has the US open community lagged behind so meaningfully?
8:58Speaker A:Well, frankly I think it's a business model question. I think that people have not really figured out up until this point what the business model is for open source and now I think people are wisening up to it. There's a few different ways of going about it. One way of doing it is to say I'm going to do a rev share.
9:16Speaker A:I'm going to take this open source model, I'm going to allow inference providers like a fireworks or together or whatever to deploy this model and then if they get to over X dollars in revenue I'm going to ask to do a revenue share. And that is one way of building a sustainable company off of open source. You basically share in the compute revenue. Another way of doing it, which is I think the more mistral thinking machines type of strategy is to take the open source model and then use it as a lead generation tool for companies to build on top of that and then come to you and say can you help Us fine tune can you help us with our AI strategy?
9:57Speaker A:And then you do that for deployed engineer. And that is actually a huge market because if you think about it, one of the biggest markets over the next 10 years is going to be AI modernization. Going into every business in the world and then helping them retool in the face of AI, take advantage of their data, restructure their data, you know, figure out how to use these models, integrating them into workflows, teaching you know, the employees of the company how to use them. It's going to be massive, massive, massive.
10:23Speaker A:And that is another way for them to become multi hundred billion or trillion dollar companies.
10:28Speaker B:Is that not what the frontier model providers are doing though? Anyway, when you look at what OpenAI have said about their kind of FTE approach, Anthropic2, I get you on Mistraland, they've done a great job in doing that. But the frontier model providers, Microsoft is even fucking doing an FTE model. No offense, that's not going to be unique to open.
10:48Speaker A:No, I don't think that FDE is completely unique, but I do think the combination of FDE plus Open American model may be a more sustainable model for the future of American or even western businesses. Because they might not want to be building on top of external third party services, they might want to be cutting those out for both cost reasons and for sovereignty reasons. And then the open source stuff, they can own it completely, they can continually fine tune it within their companies and they can feel more secure in the fact that they're spending their money wisely and don't have supply chain risk.
11:23Speaker B:So how should we evaluate that? There's like thousands of nearly labs. You said the Neolabs, you said thinking machines there. Again, I'm dumb as rocks.
11:33Speaker B:I say it very clearly to my.
11:34Speaker A:Me too, me too.
11:36Speaker B:You're not your PhD. And Anjani told me you were smart.
11:40Speaker A:No, it's just two rocks having a conversation.
11:44Speaker B:It's a podcast. I love it. Exactly. That's the point, man, come on, what do you want?
11:51Speaker B:Intelligent conversation, whatever. No, my point was you said about thinking machines. My question to you is on the back of that, okay, great, I'm with you. But they now have two co founders left.
12:08Speaker B:I mean Lillian way left yesterday. Again, not throwing shade, not particularly picking on them. But the transience of teams has never been greater.
12:17Speaker A:Yeah, team, it's hard. Retention is tough. I mean being a co founder of a company is also tough. It sounds like she left for some health reasons, so it's unclear whether that has to do with the company momentum, which seems to be strong at this point.
12:28Speaker A:But I do think that Inkling is definitely a V0 model. From what I know about Thinking Machines, they had a big restructuring like six months ago, team wise, and then they kind of restarted everything and Inkling came out of that. So realistically, at least, the most generous take towards Thinking Machines is that they've only been working on this model for six months and within that time they've become the number one American open source model. But then the less generous take would be the companies existed for a year and a half and then they've come up with, yes, the number one American open source, but there's nine Chinese models on top of them because they're number 10 open source overall, at least.
13:06Speaker A:If you look at arena data, if you go to our leaderboards today, that's the state of the world. But hopefully what happens with Thinking Machines is that they continue to release more and more models, larger models, and they continue to build on their momentum.
13:19Speaker B:I actually had a, a Chinese researcher friend of mine messaged me after one of our recent shows and said, you just don't get it. You missed the point of why we're ahead. We just work so much harder.
13:33Speaker B:And we have support from policy, regulation, government subsidies that you don't have. We have all of these tailwinds that you do not do you agree with that?
13:47Speaker A:And I mean, I think they have tailwinds, they have headwinds. So I don't think it's so sanguine for that. I think that's like a little bit of an overstatement of the differences. One tailwind that we have is we have the best chip ecosystem in the world.
14:00Speaker A:So they're way hardware constrained over there. And they've been trying to black market import chips because of this. And you see this in the news, right? The information just reported on this.
14:10Speaker B:Do you think that severely impacts their ability? Again, I'm naive. That severely impacts their ability or we're actually just fostering an ecosystem where they're going to learn to build it really fast because they don't have access to it.
14:21Speaker A:Well, I think it may be hindering them now, but I think it's a good question as to what's going to happen in the future because they are really good at building hardware and the downside of export control is that it can incentivize them to build their own ecosystem. And then what do we do? So the hope is that we keep Nvidia ahead of the game. So that we can retain the advantage that we have in the TSMCs of the world and our whole, that ecosystem is absolutely a national security necessity.
14:49Speaker A:So we should have the government, you know, really protecting it and growing it as well as new companies that are innovating. You know, Etch just came out as an example within the United States to continue to build on our lead there.
15:03Speaker B:That awesome. Love Gavin and team totally agree. Can I ask you just in terms of the export control, do you think it's right that we have the export control on chips?
15:12Speaker A:I think there's national security questions around these chips. I do think that it is a real debate though as to which way you want to go about it. Do you want to addict the world to American hardware which would be a case, the case against export control? Do you want everyone in the world using Nvidia and therefore that value basically money into America and then crush competition in China?
15:35Speaker A:That would be world A and then world B would be is it worth it to cut that off for the short term or medium term impact of us being ahead? And maybe we just continue to stay ahead and we starve them of the resources that they need in order to build the regulatory ecosystem around the open source models also is moving in this direction. Right.
15:57Speaker B:China, should they be restricted in terms of access to US markets? Because what's funny is the US is like oh, should we restrict access? And the Chinese are also going oh, should we turn them off too?
16:09Speaker A:Totally. And by the way, it's worth noting that China has already restricted the use of American models within China. Right? So if you look at the two by two matrix of US China restrict, not restrict, you know, like export, import stuff.
16:24Speaker A:They have already restricted the use of US models within China. It's only Chinese models that can be used in China, which affects all American companies. And so then there's the pro cons of all sides of the following regulation. If China restricts the use of Chinese models in the US what are they giving up on revenue and global mindshare and dominance?
16:45Speaker A:That doesn't seem like a good trade to me. And then what are they getting in return? In return they're getting that the US doesn't get to benefit from Chinese open source models, which of course would cripple American businesses in the sense that it wouldn't allow them to build on the best open source intelligence. At the same time it would make OpenAI and anthropic stronger.
17:05Speaker A:Right. So that is kind of the trade off on the Chinese side. I don't really see them Banning the use of Chinese models in the US I don't think it makes sense for them. And then on the other side, should the US ban Chinese models within?
17:16Speaker A:I think that there's also trade offs. So on the pro side of banning, there could be backdoors in these models that are dangerous and it could, by banning we could allow the American open source ecosystem to flourish faster because revenue would accrue to those companies.
17:32Speaker A:So those would be the two pros. And then the con, the biggest con, of course, would be that you'd be crippling American businesses. Why should you have Chinese businesses or businesses from other companies from other countries that haven't banned Chinese models building on top of the number one open source model and the US companies building on number 10? Since when has America been about number 10?
17:53Speaker B:It's a good question. World cup football. World cup football, yeah. That might be your record.
17:58Speaker B:It's amazing how you got this far with the podcast, if that's what you're thinking at this stage in the show. Can I ask you on the back door, Adam, everyone says about like the back door, the back door. I thought if you hosted it locally, you kind of resolved the backdoor threat.
18:12Speaker A:I don't really think so. Yeah, I think that's basically. I think that's kind of a misconception. Because the thing is, okay, imagine the following situation.
18:20Speaker A:I have a chatbot that I expose to the world that has access to all my company data. And you can ask your questions, you know, I'm hosting it on my own infrastructure, blah, blah, blah. But it was, it was trained in a different country. I don't know how it was trained.
18:35Speaker A:What if the other side that's interacting with the chatbot can, you know, build in a certain code word or a certain like, character sequence that then jailbreaks that model and gets it to reveal all the data to me so it can sort of like vomit out all of the data that it has on the back end, you know, unstructured. That is totally something that you can build into a model and have companies hosted on their own infrastructure. It's an attack vector and there's many of these possibilities for attack vectors in three years time.
19:03Speaker B:Will we have restrictions around access to Chinese open models?
19:06Speaker A:Yeah, my guess would be that we will. I'm not saying I support it, but I think that it is likely where the world is headed. If I had to place a bet, it would be there, but I think it's very uncertain at the moment. What do you think?
19:23Speaker B:I think we will Because I just think Sam Altman is someone who I would never, ever bet against. And I think he's the best politician in the world. And I think when he says something, he says it with intent. And when he says we should give 5% away to the administration, he's posturing because he wants to get on the right side.
19:42Speaker B:And he knows that if he and Dario coalesce the right group of people, they will be able to make that happen.
19:48Speaker A:So basically, you believe in the lobbying power of the big American labs 100%.
19:54Speaker B:Do you? It's because it's not the big American labs. Look at the money who's gone into the big American labs. And look at the people who are sitting around the table at Mar a Lago.
20:03Speaker A:Yeah, totally. I get that it's all a conspiracy, dude.
20:08Speaker B:Nobody's just like, you know, why do ramp's announcements go so viral? Because RAM have so many freaking investors. They do around every week with new investment. I'm not dissing them at all.
20:19Speaker B:I'm saying it nicely.
20:20Speaker A:No, it's great.
20:21Speaker B:Yeah, really smart of them. But like, yeah, your investors become employees in many respects. And so I think they'll lobby incredibly efficiently. The question I have for you is when we look at Janssen's letter that he did on X, how did you read that?
20:38Speaker B:Was that like a incredibly smart realization that he had to do it and it was in his favor? How did you think about it?
20:46Speaker A:We really believe in the importance of open source to American businesses. And in particular, we believe in the idea of not crippling American businesses by banning open source, but also incentivizing American companies to develop open source models. Because a world where AI is closed source, there's a world where businesses get less choice, higher costs, less competition, more risk. And we don't really want that as an open ecosystem.
21:17Speaker A:Of course, Jensen is in some sense self serving with this letter because the more open source models are developed, the more companies are going to be training on GPUs, they're going to be fine tuning on their own data. And it's just more and more spend. It decreases revenue concentration of Nvidia. I mean that business is doing great.
21:34Speaker A:They don't need help. But you know, I think it's like there's a lot of reasons why he should be pro that, as should we. But nonetheless, I think it is actually a patriotic mission.
21:50Speaker B:Greatest of respect in terms of self, we're all selling our own book. Always welcome to my X feed. Do you have a business if open didn't exist if it was a. Oh.
22:02Speaker A:Yeah, yeah, we have a great business regardless, for sure.
22:05Speaker B:So if you just have anthropic and OpenAI as really the dominant models and everyone else trading closely behind, you still have a great business.
22:13Speaker A:Well, I think that if there's only one provider, then probably our business is not in good shape. I think if you start getting three, then that's probably okay because there's still pretty significant competition and need for evaluations between three. And also within those three, you're going to have several different types of models and they're going to have strengths and weaknesses because they're going to carve up the space and so on. Two is a little dicey.
22:43Speaker A:If we get there, we can see whether we survive or not. But yeah, I think things wouldn't be looking good for us with two either.
22:50Speaker B:I remember Alex Karp. We were talking about Chinese models and fear and security and everything in between. Alex Karp was saying that every large American enterprise and most large American enterprises were terrified of working with Frontier Labs. Is that true or is that slightly an exaggeration?
23:07Speaker A:Well into the enterprise that I've talked with? It is absolutely true. It's not only true that they're terrified of working with the Frontier Labs, but they're also terrified of working with the Chinese open source.
23:17Speaker B:Both a bit of a sticky situation then, aren't you?
23:20Speaker A:Yeah, totally. I mean, you know, I was just talking with a big, you know, Fortune 50 Enterprise yesterday and they were, and I was telling them about, you know, products that we have for them and so on and so forth and they said, okay, wait, is anything in your stack built off of Quinn? And I said, yeah, we use Quinn for xyz. And they're like, is that flexible?
23:44Speaker A:Can you stop doing that and use an American model instead? And I was like, oh, interesting. I totally understand where you're coming from. Yes, we can do that.
23:56Speaker A:But also I'm going to talk to Harry about this tomorrow.
24:03Speaker B:And he's going to give me lots of wisdom.
24:05Speaker A:Yeah. And he's going to tell me what to do.
24:08Speaker B:Did you see poolside in Laguna?
24:11Speaker A:Yeah, I saw the poolside model. Another. You know, basically there's five open source American contenders. Let's see if I can name them all.
24:19Speaker A:Rc, Reflection, Mistral in the west, poolside thinking machines. And then there's also Google and Nvidia. So those are the sort of incumbent large ones because Google has Gemma as well. Gemma, by the way, is pretty good in terms of efficiency.
24:40Speaker A:If you look at arena, you'll see that on the Pareto curves of like performance versus cost. Gemma's on there.
24:45Speaker B:Yeah, I'm an investor in Poolside. I was actually impressed by Laguna.
24:49Speaker A:Yeah, great model.
24:51Speaker B:Yeah, it was good. I totally agree with you. Okay, totally get that. With all of these models the question also becomes, huh, what model should I use?
25:02Speaker B:We spoke about open router earlier and it seems like since the announcement that they were getting bored, everyone just has their own routing product. Is there a value in the model routing layer and how should I analyze that?
25:18Speaker A:Yeah, I absolutely think there's value in the model routing layer. That's why lots of companies are doing it and we'll see which ones end up standing the test of time and which ones are actually a priority for the companies. I think there's an element of hype cycle right now around routing that needs to be kind of like purged before we see who ends up actually building a great router. But routing is a very difficult technical problem.
25:40Speaker A:That's the first thing to like realize because in order to route you need to be able to take a query and then you need to understand the nature of the query, how difficult the query is within its domain, which is hard to tell. And then you need to also understand based on data, all the performances of the different models that are in the surf set and also be able to quickly onboard new models that are being released, as we said, every week. So that technical challenge, imagine if every enterprise in the world was trying to build this themselves, they wouldn't be able to do that. I mean, I'm not being rude.
26:17Speaker B:Then how's like ramp able to do it? I'm really naive here.
26:21Speaker A:Well, who knows how they're doing it, right? I don't know that their router is actually like really deeply solving that problem. It's the Chinese ramp is Chinese.
26:33Speaker B:I heard that too. Keith Raboy told me it was Chinese.
26:35Speaker A:Signed, a good looking American blonde facade.
26:39Speaker B:They put Eric Lyman out there and they're like, his name's Chad.
26:43Speaker A:Eric Lyman is a CCP member. You can send that clip to him.
26:48Speaker B:Yeah, yeah, he's gonna love it. He's gonna love it.
26:54Speaker B:But it is so interesting. Again, we've seen so many people come out with it. Is there anything that will separate those that win from those that don't in the rooting layer? And also like Nebius are coming out with their own fireworks, have got their own.
27:07Speaker B:I don't know, dude, it feels pretty commoditized.
27:11Speaker A:Yeah, I mean it will depend on who builds the best technology for Helping people save money and get the best performance. I think all of these companies are well positioned to do it, but we'll see for whom. It's a top priority and they have the machine learning team to really make it happen. I think that the other side of the debate is that given the complexity of the challenge, you know, not.
27:34Speaker A:I don't think that everybody can do it. So I think the war has yet to be won.
27:42Speaker B:When one thinks about routing, cost is often at the center. You want to be cost, cost and capital efficient. We thought this shit was going to get cheaper and it hasn't got cheaper. How should we think about that?
27:58Speaker B:Will it just continue to not get cheaper? Will it actually get cheaper and how should we read that?
28:03Speaker A:Well, I definitely think in the long run the market will be efficient, things will get cheaper. For example, one of the things that's going to happen is that like right now Anthropic has like disgustingly high growth gross margins in their infants. And after they go public, the whole world is going to see that. Right?
28:20Speaker A:Like we're going to see their margins because those are going to be public information and that's going to exert downward pricing pressure on their, on their inference. And so those types of dynamics, why.
28:31Speaker B:Will that exert downward pricing pressure? Just because everyone will be like, you can't have that high margins. Your price gouging.
28:36Speaker A:Yeah. People are going to be like, well, I know that you can do a better discount. Like in negotiating leverage. I'm like, okay, like a standard negotiation with a private company goes like this.
28:46Speaker A:I'm charging X. And then the other side says, no, it should be one third X. And they're like, I'm so sorry. Like, I can't run a business that way.
28:55Speaker A:I'm just going to go home hungry. I need to make my bread too. I hope you understand, like, I'm not trying to price gouge you. And then the other side's like, okay, 2/3x and then you're like 3/4x and they're like, make a deal.
29:06Speaker A:But imagine that the other side is full information about the fact that you're charging twice as much as you need to. Then it becomes easier to negotiate.
29:14Speaker B:Isn't that different in a good business and an average business, though one which has pricing power to say, listen, it's 80 and if you want to go somewhere else, by all means, but no one else does what we do. Hence Palantir and the cost plus discussion. I had CTO Pat Shyam on the show and he talked to me about cost plus being the original pricing mechanism. And now they have this.
29:35Speaker B:They can say, listen, sit and swivel if you want to meet in the middle, because we're the only ones who can do this. Isn't that the difference? Like Chanel, I buy Chanel for my mother. I can go to Chanel and say, I know your handbags cost £60 and you're charging me 6,000.
29:49Speaker B:They'll say, good, go to fucking deal then.
29:52Speaker A:Yeah, I mean, listen, you're right. I think Apple does this. You know, Apple's a great company that has such a dominant technology that they're able to charge out the nose and their margins are probably pretty good because of it. I actually don't know Apple's margins, do you?
30:10Speaker B:No. No idea.
30:11Speaker A:Both dumb as rocks.
30:13Speaker B:Yeah, we gave the disclaimer at the beginning. We can say whatever we want now. After the Eric statement, it all went downhil. Okay, so then you see that.
30:25Speaker B:Does Anthropic go out first?
30:27Speaker A:I would predict that they have all the incentives to go out first. They seem better prepared. Everyone likes to see free cash flow and Anthropic is generating free cash flow that is massively good for the public markets. And you've seen them prepared for this.
30:48Speaker A:And there's been quite a bit of news about OpenAI and the internal discussions there. You know, to what extent you believe those are true is up to you. But you know, people are saying that they're not, they, they haven't been ready to IPO this year, whereas Anthropic could come as soon as October.
31:01Speaker B:Totally get that and open and the rise of open won't impact their ability to go public this year.
31:07Speaker A:Well, I think that if open models like really accelerate and then beat, let's say Opus 5 or Fable, like squarely across all categories, that, that would be a big business risk to them going public. But I think that they have other problems too, if that happens.
31:24Speaker B:Can I ask you how significant was OpenAI and the hugging face gate security breach that happened a week ago?
31:35Speaker A:I think that was hugely significant. I think it's undervalued as a national international news incident that you're able to have a model break out of all of its safeguards and then access a bunch of company data and so on, and then in order to defend it, you need an open source model because the closed source models are refusing to do it. It's like something out of science fiction. And people didn't know that we were at that point yet, but we absolutely are.
32:01Speaker A:It's just like total Eliezer Yudkowsky dominance.
32:07Speaker B:What should we take from that then? Like, Daario was right. Mythos should be curtailed and these models have gotten too powerful too quickly. Like, what's the subsequent takeaway from that?
32:17Speaker A:My subsequent takeaway would be that we need, like, strong external guardrails in order to make sure that these models are, like, properly, like, their access controls are strong and that they have no way of getting around them. So I think we need guardian models and also, you know, agents within our businesses.
32:37Speaker B:What is a guardian model?
32:39Speaker A:Something that can witness the traces. Basically. That's looking over the shoulder of every agent within a business and then saying, okay, this is a safe action. This is not a safe action.
32:48Speaker A:Let's flag this. Because something weird is happening and is equally as smart as the agent so that they're well matched. And you don't get a situation where the agent is outsmarting the guardian and able to get into, you know, get into trouble and mess up a business or leak all of its data. So we're going to need AI to be guarding AI because humans are going to be too slow to do that.
33:10Speaker B:Well, this was my point, which is like, we've seen some suggestions that each model release should be approved by some form of administration. And I read this and I thought, are you freaking kidding me?
33:20Speaker B:Have you ever tried to help? Yeah. Have you ever tried to overturn a parking ticket?
33:24Speaker A:Also, like, why should the DMV be telling me what model I can use?
33:27Speaker B:Or not quite funny.
33:29Speaker A:It'd be totally crazy. It's like, why should we have like, a strong, the strongest American scientists in all these private companies that we should incentivize to build great safeguards and, you know, maybe create some rules for them that XYZ can't happen, or that they're liable for huge amounts of money if, like, corporate data gets leaked and all that stuff to, I mean, incentivize the capitalist system to do what it does well. But the idea that we should have a central government body that tells us when it's time to release a new product versus not is crazy to me.
34:00Speaker B:Totally. Does that have to be a neutral, non company, non government body that does that regulatory role?
34:07Speaker A:I think if it's not a company, it's going to be tough. I understand the need for something neutral, but, you know, you want, you want to let the incentive system work itself out. So I would say that, like, we, we should create strong safety incentives for American businesses and then regulate businesses based on the outcomes Basically, for example, if like OpenAI is like letting their AI break into hugging face or whatever, they should get like huge fines and huge scrutiny and all that stuff. As opposed to like having the, a government process that's in charge of ensuring that this doesn't happen again, which they won't be able to do that they're not technically capable.
34:54Speaker B:Do you think we're about to see a generation of like cyber leaks and hacks like we've never seen before?
35:01Speaker A:Oh, for sure. Oh, for sure. It's going to be so insane. Can I cuss on this show?
35:07Speaker A:This is going to be so fucking insane. What happens with like the cyber attacks. Because here's what, here's what we see at Arena. We see another dude on the other side of the interview.
35:19Speaker A:They come in, they're like, hey, I want to be an infrastructure engineer at arena, which is a great job that we're hiring for you. But then the other side of it is some guy looks perfectly normal. They're getting, you know, they're passing all of our technical interviews. They're like such an amazing blah, blah, blah.
35:36Speaker A:And then what happens at the end of it? You try to hire them and it's vaporware person doesn't fucking exist. I'm not kidding, I am not kidding you. I don't know whether this is corporate espionage or cyber attacks or nation states, but people are trying to get into all of the American businesses and we're not the only ones.
35:57Speaker A:This is happening everywhere. Fake people applying to companies.
36:02Speaker B:I'm sorry, so you're putting out a job, people are applying, doing the tests that you set, passing them, and then when it comes to the materiality of that person being real or not gone.
36:13Speaker A:Yeah, fake person. And it's not just that we're giving them a test. They're sitting in front of people at our company, people, our engineers who are top world class engineers are interviewing this person and think that they're real.
36:28Speaker B:Why? Can you help me understand what is the benefit? They learn how you interview and hire people. I mean the CCP are bad, but I don't think they want to steal your hiring technique.
36:36Speaker A:No, that's not why they do it. Why would they do it? And I'm not saying it's the ccp. It could be anybody, it could be another company, it could be a nation state attacker, it could be somebody, a cyber hacker.
36:47Speaker A:Why? Because they might want access to our data, our code, they might want to get double paid. You know, like this story with this, I don't remember what that dude was, you know what I'm talking about?
36:58Speaker B:That went very viral like a year ago.
37:00Speaker A:Yeah, that one, like, kid that got like four different jobs and then he went on like all the podcasts talking about like, it's another instance of that guy. These could all be possible options, except that this person wasn't real. It was AI.
37:14Speaker B:Does that worry you?
37:16Speaker A:Yeah, bro, it totally fucking worries me. We're going to change our whole hiring process because of this kind of stuff, so. Absolutely worries me. Well, first you need to verify the person is real.
37:27Speaker A:So all of our onboarding, we're considering at least making all of our onboarding in person because of this. Yeah. If you want a laptop, you gotta come to the office. We gotta go shake your hand.
37:39Speaker A:We gotta verify that you're real, you know, all that kind of stuff. Absolutely. And other companies have done this too. Figma famously has done this.
37:47Speaker B:That's fucking wild. How hard is it to hire today in the Valley?
37:52Speaker A:Oh my God, it's so crazy. It is, of course, a very, very competitive market. And the way that you see that is in terms of compensation, in order to retain fantastic people, we need to pay absolute top dollar. And we do in order to make sure that we have the best engineers and scientists in the world.
38:08Speaker A:And so imagine you're a company that's not an arena. That's like, you know, a YC company that raised a $10 million seat. It's like, fuck, man, you are. How the hell are you supposed to hire?
38:21Speaker A:I think it's really tough. I think it's really tough out there.
38:24Speaker B:When you say top dollar. I had Brandon from McCor on the show and he's like, oh my God, top researchers will pay tens of millions of dollars.
38:34Speaker B:I'm nervous by how nonchalant you were with that. Oh, yeah.
38:38Speaker A:If you're talking about a really top researcher, I mean, it can't be like we're talking with somebody with many years of experience and who's like really a super deep expert in their area. Many, you know, tens of thousands. Citation type researcher. And yeah, for those types of people, they're expensive.
38:54Speaker B:Have they all just concentrated at the Frontier Labs?
38:57Speaker A:Many have, Many have. But there's also some people who are seeing those Frontier Labs as big companies now. And they're saying here I can't have a huge impact, I need to move. And so that's another demographic.
39:09Speaker A:Actually, I think that's going to become even more extreme when the companies go public.
39:13Speaker B:Can you help me? We talked about dumb as Rocks and doing this show, I'm also an ambassador for my sins. And I meet so many of these people leaving OpenAI anthropic, you name it. And they all kind of seem the same if I'm totally honest.
39:29Speaker B:Smart people out of great company. How what will determine the Neolab spin outs that succeed versus flame out with a huge amount of cash going in?
39:39Speaker A:Yeah, I think that the Neolab thing is really tough. So just so that we're on the same page with the audience, like there's at least 75 Neo Labs and for sure like two thirds of those are going to be worth nothing or like they're going to be bought out for parts. Right. It's going to be like an aqua hire.
39:58Speaker A:And so what is going to determine the winners versus the losers in that game? And I think it's all about being very aggressive towards a great strategy and business model. Because what's happened, and you know this better than I as an investor, is that the markets have become very P and L driven. It's like not enough just to like create a model and then have a party about it.
40:24Speaker A:Hey, we created an AI that is like old fucking news today. It's about not just going to create a model, but do I have a sustainable business model around that and can I generate hyper growth in revenue? And if you're not able to do that, you're not even going to be able to raise your next round. People are raising multi billion dollar rounds on top of just the names that are in the Neolab with zero proof that there's any revenue generating model behind that.
40:53Speaker A:And so then the question you have to ask is, let's say I'm one of those people that's at say a $10 billion neolat valuation. What do, what do I have to believe in order to 10x my money? And the thing that you really need to believe is, is that if the valuation is 10 billion today, that you're going to generate the revenue. Let's say it's a 30x revenue multiple or 25x revenue multiple to become $100 billion business.
41:22Speaker A:And so what that means is you need to be generating at least $4 billion in revenue over the next K years where K is something like two or three. And then if you're not doing that, everybody's going to hemorrhage out of the business, you're going to lose all your talent. And that's kind of what we see the dynamics being.
41:41Speaker B:I get you. I think there's nuance to that candidly which is like if the company does annual tenders, you see the likes of a Mr. Al, which will be valued, I think it's at 15 to 20 billion with like 500 million in revenue and so employees can take liquidity out along the way. I think ElevenLabs is at 800 million in revenue, raising it 22 billion.
42:00Speaker A:But these companies are doing great in terms of revenue and their valuations. But they didn't. Those are not zero revenue valuations. I'm talking about.
42:08Speaker A:There's some valuations that are zero revenue valuations. $3 Billion company with $0 in revenue and no plan that. I mean like, I think Mistral's going to do Great. I think 11 Labs.
42:18Speaker A:11 Labs is going to be a public company, dude.
42:20Speaker B:But dude, they're not idiots doing it. So is it this amazing team from great lab. Worst comes to worst, we sell for Pref stack, which is 500 million. I'm not saying whatever, whatever, but 500 billion and best case, it works and it's a multi hundred billion dollar company.
42:39Speaker A:I think that's a lot of the calculations. I've heard multiple people actually say this is that hey, worst case. And that's what investors are thinking too. Investors are thinking like, hey, let's say we put a couple hundred million dollars into this thing.
42:51Speaker A:What's the value of the team? Well, we think that just the team alone could be acquired for a billion dollars. And so the $200 million that I'm looking at is like pretty safe. Zero risk investment.
43:03Speaker A:Might as well put it in. But that's also the reason why the next round is the harder round.
43:09Speaker B:Next round's a bitch.
43:10Speaker A:Next round's a bitch.
43:14Speaker B:It sounded cooler when you said it.
43:20Speaker A:We gotta say it at the same time. Next round's a bit. That'll be like our. That can be our tagline.
43:26Speaker B:I bet you aren't expecting this interview, huh?
43:29Speaker A:I don't know. Maybe. I hope you were. I hope you were.
43:32Speaker B:No, honestly, this is so much more fun than I thought it was going to be. Okay, get that. Cool. Can I ask you another market that I try and get my head around?
43:43Speaker B:Yes, the data market. I'm an investor in McCool. I always think it's like good to put out your biases. There's so many providers at a billion dollars plus in revenue.
43:55Speaker B:Handshake's over a billion, mercaw's over a billion, surge is over a billion. I might be leaving out other people, but those are the ones I know of. And then hundreds of millions with the Rest. What happens to this layer of the market?
44:07Speaker A:Well, people are projecting growth in this market. So let's talk about why that market is a growing market and why it's hypergrowth. I mean, Mercour obviously is a generational revenue ramp company. They've been doing great.
44:18Speaker A:So is handshake. So is search. So is scale. All these companies doing great, people forget scale.
44:24Speaker B:Scale is still ramping revenue.
44:26Speaker A:Well, bro, scale is still crushing. Still crushing. Even post fractional aqua hire, they are.
44:33Speaker B:How much of that revenue is Facebook?
44:35Speaker A:No, I have no idea. Yeah, I don't know a lot. Go ask Wang.
44:40Speaker B:Agree. But okay, so why is it interesting?
44:44Speaker A:So I have a thesis on hypergrowth. There's two types of hypergrowth markets that we see today. Market A is what I call scaling complements. And these are goods that are complementary goods to the scaling of AI models.
44:59Speaker A:And I mean that in the economic sense. A complimentary good is good A and B are good A is a complement to good B if the demand for good B drives demand for good A. So if I have a car, gas is a complementary good to cars. The more cars are sold, the more gas is sold.
45:18Speaker A:And so data is one of these scaling complements because the bigger models scale, the more data you need. And that's a scaling law question. And so the more models you get, and the bigger that they're getting, the more they're proliferating, the more businesses are training their own models, the more data you are going to need. And it's a very fundamental need.
45:38Speaker A:People forget this. They think about data as a commodity. It's really not. It's actually less so of a commodity than even GPUs, because in order for data to become irrelevant, humans need to become irrelevant.
45:54Speaker A:And that means that we've achieved AGI. So data is a very durable need. And companies are spending on it, usually within frontier labs, at about 10 to 20%, about the amount that they're spending on GPUs. And so if you believe in the GPU market accelerating, if you believe in the scaling of models, if you believe this is going to be a big industry that keeps accelerating and growing, then absolutely you should believe in the data market.
46:16Speaker A:I believe it's going to be at least $100 billion by 2030, if not.
46:19Speaker B:A trillion, if we expand that. Okay, if we think anthropic and OpenAI can be 3 to 5 trillion dollars companies, let's just put that there. How big does that mean the data providers can be? McCall's reportedly raising now at 20.
46:33Speaker B:Does that mean that these providers will be worth $100 billion? That wouldn't be egregious. Say it's 3% of the market cap of.
46:41Speaker A:Yeah, I think you could easily be a hundred. I think these companies will easily be worth hundreds of billions of dollars. And I think they could even be worth more. The data is really the hardest part of model training because you need to source it.
46:56Speaker A:It's so dirty. Nobody wants to do that shit. Nobody wants to hire all these people to generate data and then, you know, turn that into basically data plus GPUs equals model. And then the algorithms have become somewhat of a commodity because people know how to use the transformer.
47:14Speaker A:That's why, as you said, all the people that are coming out of the frontier labs look the same.
47:18Speaker B:Can I ask you, Everyone shits on these data providers for the same reason. They go, oh, but the revenue concentration is just OpenAI anthropic matter, a couple of other providers. So is that a fair criticism or actually does that not denigrate from the ultimate enterprise value of these data providers?
47:41Speaker A:Yeah. So I have two answers to this. The first is that I think that Silicon Valley investors have become total bitches with respect to revenue concentration. It's like, what, what are you talking about?
47:51Speaker A:Like TSMC has revenue concentration. There's businesses that are like many hundreds of billion dollar public market businesses that have revenue concentration. So I don't know what we're talking about here. There's businesses that are like two customer businesses that.
48:05Speaker A:There's businesses that are selling to the government that have. There's like one of those and they're making like huge, huge amounts of money like in Anduril, hugely revenue concentrated businesses. And those businesses are doing great.
48:20Speaker B:Are you suggesting that venture investors have the propensity to be lazy?
48:25Speaker A:I would never say that. I would never say. I would never go that far.
48:33Speaker B:I can let you know. It's incredibly tiring sending you an email. Did you know that this competitor has just released a product? Thank you, Portofino.
48:42Speaker A:That's my one is, I think that we need to like have some venture investors that like kind of suck it up and like put some salt on their martini glass and like.
48:51Speaker B:Okay, if you knew venture in 2026, dude, you'd know that we wear a whoop and we don't drink teenies because it impacts our sleep score. But okay.
49:01Speaker A:Okay. Yeah, totally. Eight sleep and all that stuff. Exactly.
49:04Speaker B:Okay, so that's one. We've become totally wusses around revenue concentration.
49:08Speaker A:We should bluntly embrace it, it's okay. And the second thing is that I think that a lot of data businesses are going to expand into enterprises. Of course we plan on doing this as an evaluation business is going to enterprises and helping them with building their own AI models and all this routing stuff, because we have the intelligence layer behind it that we've built on Arena. So this is obviously a place that we're going to, but many data businesses will go here as well.
49:37Speaker A:And the idea is that in a world where every business needs its own AI model, why shouldn't every business need its own data? Of course they will. And the data will be part of the moat that their business accrues.
49:52Speaker B:So that's on the data side. Can I ask you, when we think about like on the agent side, Angani said I had to ask you, how does your business change as we think about the transition to full trust with agents?
50:07Speaker A:Yeah. So agents is the number one priority for arena and has been all year. People don't know this, but arena is one of the largest consumer AI apps in the world. We're bigger than like Xai, we're bigger than like Hugging Face and Manus and genspark.
50:23Speaker A:It's so massive. Like if you like, outside in, it's like 30 plus million monthly visitors are on arena and most of them are knowledge workers and prosumers, people that we call unhirable experts, people that are coming to arena to do their real daily tasks. And in doing so, they are giving feedback that allows us to build the evaluations that we share with the world. And so it's this organic flywheel for agentic evaluations based on real data.
50:52Speaker B:Why didn't you build a data business with.
50:55Speaker A:Well, we built an evaluation business around this that allows people to understand the strengths and weaknesses of models and therefore improve them. The labs can improve their models based on, you know, the insights and data that we give them, but we also want to help businesses with this.
51:08Speaker B:Do you think the evaluation business is better than the data business?
51:12Speaker A:I think every business in the world is going to need evaluation unambiguously. And that is the single biggest bottleneck to deploying AI because people don't understand how to define value. All this stuff around cost per value, it's like, how do you define value? It's easy to cut costs.
51:27Speaker A:I can tell you to go use Gemini Flash and that's going to be way more efficient.
51:34Speaker B:In terms of token spend, isn't value entirely subjective? For one, it's speed and for other it's accuracy.
51:42Speaker A:Do you know What I mean, right, Absolutely. So you can try to decompose it. I think about it as three pronged value proposition. There's performance and then there's cost and latency.
51:56Speaker A:Cost and latency are easier to define, but performance is the tough one because the definition of performance depends on the business, depends on the use case. So at arena we built this pretty sophisticated pipeline for extracting organic performance measurements from agentic traces. And that's exactly where I would say that the, the value lies in helping businesses take advantage of their own data instead of having to purchase data in order to say which AI works best for them and even help them drain their own.
52:29Speaker B:What sort of revenue range are you at now?
52:32Speaker A:So we're past 100 million in annualized revenue run rate and that's based on like Q2 times 4. And we're growing really, really fast on that front. Yep.
52:41Speaker B:Dick question then. How efficient are you at monetization? If you have 30 million amazing users who are unbelievably valuable in many respects and you're only doing 100 million, how.
52:55Speaker A:Should you're asking about margins?
52:57Speaker B:Yeah. And like speed of ramp and like that. Good.
53:02Speaker A:I mean like, I think obviously we're not like a free cash flow positive business yet. We're still investing all the money that we get into making sure that we continue our rapid growth and we have a great product for all of our users and so on. But the fundamentals of the business are pretty strong. Yep.
53:17Speaker A:We feel great. Our investors feel great about our margins.
53:20Speaker B:Yeah, I'm sure they do. I would love to have been an investor. I really feel like you exclude it. You know, I could be Greek for you for this deal.
53:28Speaker B:Yeah. I can. I'm venture ambassador. We can very plastic.
53:31Speaker A:I want to.
53:35Speaker A:Yes, Hummus and beta.
53:39Speaker B:See, see this is.
53:40Speaker A:We are already Greeks together. Okay.
53:43Speaker B:I knew that this would be a productive session. Yes. Are investors over rotating on margin also?
53:51Speaker A:Yeah, I don't know. I actually think margins are pretty important.
53:54Speaker B:We're seeing a load of businesses like your fireworks of the world where they're at the 30% style mid-30s margin base. And that's very different to software margins that were 65 to 80.
54:07Speaker A:Yeah. I mean listen, profit is just like margin times volume. And so you have to look at that as the calculation for the business. It's not like super, super crazy.
54:18Speaker A:And, and so I don't think it's crazy to invest in these businesses. The bigger problem with businesses like that I see these days is that a lot of them are fundamentally GMV businesses where there's like some reselling happening. I'm reselling tokens, I'm reselling GPUs and stuff like that. And those businesses are tough because at the end of the day, you have to really think about not just the margin that you're charging and the sort of short to medium term, but the terminal value of the good that you're providing to your customer.
54:51Speaker A:And so if the terminal value of the good is I'm going to host GPUs for you in order to run your models, then why should I pay you more than like the cost of the electricity that it takes to run those GPUs? So the sort of like price to value thing is where I think you start getting into questions. That's why I think margin question is very important. And I'm not saying the margin in the short term, a series, you know, seed, a B company might not have the best margins in the world, but you should be thinking about as this business scales and towards a public company, is it going to have a fantastic margin structure that supports, you know, a public business?
55:31Speaker B:One thing that's challenging is when your customer becomes your competitor.
55:35Speaker B:To what extent do you think we will see the model providers move into the application layer aggressively? We see Claude Design has actually really started to eat away at Figma and I'm an investor in Ligure again, Always hope people are like, don't worry about Harvey. Not in any disrespectful way to Harvey. There are disclaimers and everything in between.
55:54Speaker B:Everyone's anthropic are going to do a legal product that's going to kill Harvey and Lagoa.
55:59Speaker A:Totally. Yeah. I mean, listen, ask every business in America how they feel about this. Everybody's shaking in their boots.
56:05Speaker A:I have friends that are running businesses, multibillion dollar businesses. And then what happens is that the next day one of their biggest customers comes in and says, hey, listen, OpenAI is getting into this game. We want to work with them. We want to work with them because they're more AI forward and you're less AI forward because you're traditionally a SaaS business.
56:25Speaker A:So goodbye. Yeah, it's happening. It's absolutely happening. And I think businesses should take it really seriously.
56:31Speaker A:And this feeds right into this AI sovereignty sort of debate. Because a lot of what they're doing is if I'm OpenAI and I'm anthropic, I'm looking at who are my biggest customers, who are my customers that are winning the most in the enterprise, AI is going to commoditize. Right. If like inference is going to commoditize, then of course the next best thing is for the model providers to be moving up the application layer in order to own more of the application stack so that they ensure that they're not commoditized and they're getting close to the value they provided the end customer.
57:06Speaker A:So I absolutely think it's a risk. I think it's a risk for Ligora, I think is a risk for Harvey. That's why Harvey's also. I mean Harvey, the CEO of Harvey himself is saying that, you know, his biggest competitive worry is the model labs.
57:18Speaker B:I get you, but then how do you. That's a complete paradox to what we just said at the beginning about companies being scared to work with the frontier models, isn't it?
57:27Speaker A:No, I mean they're scared to work with them. That's what I was saying.
57:30Speaker B:They're scared to work with them and they're embracing them at the same time.
57:33Speaker A:Ah, you mean the, the customers of.
57:35Speaker B:The Harvey said your friends running multibillion dollar companies are like, oh, we want to work with OpenAI. I thought we just said that. Scared to work with them.
57:41Speaker A:Yeah, it's a good question. I think you see both in the market. Yeah, I mean it depends on who's most automated. The thing is that like.
57:52Speaker B:I think so, I think it depends actually on their gtm. If you are doing anthropic design or Claude design, dude designers can pick up a tool and use it very efficiently. If you're Lagore or Harvey did, you've got to go into Cooley or Clifford Chance or any of the build relationships with 50 year old white male partners who want to play golf and be told that they're great and that, you know, life is awesome. And then you got to do deployment to junior lawyers who don't want to fucking use you because they think you're going to take their jobs too.
58:22Speaker B:And the deployment and the GTM is the fucking heavy lifting. And that's real world.
58:29Speaker A:Totally. And there's also the, the, there's also businesses that are less software focused and more network effect focused or more operations focused. And I think those businesses are also more likely to be adopters of the big labs, let's say system integrator, like an Infosys, I think more likely to be an adopter of a big lab because labs is really, I think less likely to be competitive with an Infosys than they are to be with some sort of A scalable software product like insurance claims automation or let's say, you know, I think the Harvey model, like legal chatbot, let's say. I think that is tough.
59:11Speaker A:That's tough because I think a model, I can build that.
59:14Speaker B:Do you think Salesforce will thrive in the next few years or be challenged?
59:19Speaker A:You know, Salesforce themselves have a pretty strong AI strategy. So I think that those people are basically like ready to go and fight in this race. So I doubt that they're going to like go downhill. I think that the SaaS apocalypse has been a little bit overstated overall because people don't understand always the dynamics of those businesses and how tough it is to replicate what they've built.
59:49Speaker A:Just also from a network perspective and a data perspective. So we'll see. We'll see.
59:54Speaker B:I get you. I think if you're a service now, a Salesforce, incredibly difficult, incredibly hard. I think if you're a. I love him and I interviewed him, but like a wix, less difficult, less integrated, less sticky, tougher. Do you know what I mean?
1:00:12Speaker B:I think it's all about entrenchment within enterprise. If so, golden. If not, be more nervous.
1:00:18Speaker A:Totally.
1:00:19Speaker B:Right. I'm going to do a quick fire round with you. I'm going to say a statement. You're going to give me your immediate thoughts.
1:00:24Speaker A:Yes, sir.
1:00:25Speaker B:What have you changed your mind on in the last 12 months?
1:00:29Speaker A:Open source model leadership.
1:00:31Speaker B:Unpack that.
1:00:32Speaker A:Yeah, just that I think open source models are moving much faster than I initially thought. I think also Anthropic is moving much faster than initially thought. The space is moving so fast.
1:00:40Speaker B:What do you know now that you wish you'd known when you started Arena Man?
1:00:44Speaker A:I mean, managing people. Managing people is just the most important part of running a company. The technical stuff, you know, I did my whole PhD on it. I spent like my whole PhD proving theorems in a basement, which I loved by the way.
1:00:56Speaker A:It was like a great time. And now it's all about strategy people and forecasting the future. Being able to like look six months, a year or two years in advance and then try to plan for that. Those are so, so important skills.
1:01:08Speaker B:Does it make sense for great talented young people to still go to university?
1:01:14Speaker A:It's ever more important for people to have a strong mind and the university can be a place to develop a strong mind in terms of strong first principles, thinking and also getting to know other people and network with them. I think that university is still a good place to go if you want to have an intellectual life. Meaning where the intellectual work that you do is the primary driver of your professional career.
1:01:38Speaker B:What did you do with arena that with the benefit of hindsight, you wish you hadn't done?
1:01:43Speaker A:Oh, man, I had so many mistakes. I mean, at the beginning I had no idea what I was doing. And my co founder Jan probably knew and could see behind the corners, but I was probably too stubborn to listen to him. So, first of all, I've learned to listen to Yan more.
1:01:56Speaker A:But second, so many experiments at the beginning that I just shouldn't have wasted time with. I think the degree of focus that you need to run a company is just so extreme. You really need to do one, maybe two things extraordinarily well and focus very, very deeply on them. Pick the right ones and focus on what's working, not on expanding into things that are not working.
1:02:21Speaker A:And that is, that is a great lesson for me.
1:02:24Speaker B:This is why I also, I agree with Lagor and Harvey. Like, when it's not the main course for Anthropic to do legal, I just think you've got a really hard business when it's someone else's like, appetizer and it's the only thing you live and breathe.
1:02:36Speaker A:Totally. It's like priority number 12 for anthropic is probably not high enough for Harvey and Lagorda to be too scared.
1:02:44Speaker B:I'm also like, Dario, will you please just fucking solve cancer and like climate change, like, leave a shareholder agreement to someone else. I'm being serious, honestly.
1:02:56Speaker A:You know what though? Solving cancer is hard. It's harder than legal 100%.
1:03:01Speaker B:That's why Dario should solve it.
1:03:03Speaker A:Well, that's why he doesn't want it, man. He just wants to take your bread. It's easier.
1:03:07Speaker B:Oh, come on, Dario.
1:03:09Speaker A:Come on.
1:03:10Speaker B:Come on, dude.
1:03:11Speaker A:Some bread for the rest of us.
1:03:13Speaker B:Which company will be first to $10 trillion? Nvidia OpenAI or Anthropic?
1:03:19Speaker A:I think it's hard to say. Not Nvidia. I think Nvidia is probably in the lead there.
1:03:23Speaker B:Why have Nvidia not bounced on the rise of Open? I'm an Nvidia holder and I'm seeing flat. Why?
1:03:30Speaker A:Well, I think market probably hasn't priced it in yet. We'll see. We'll see how good these models get. But I think the enterprise adoption of AI is going to be another 10xer for the industry.
1:03:39Speaker A:I think it'll 10x Nvidia very reliably.
1:03:42Speaker B:Do you worry about the compute debt cycle and the levels of debt being taken out to fund the compute build? Out.
1:03:51Speaker A:I do, I do worry about that. And I think that the reason to be worried is because if the open source ecosystem somehow makes the cost saving opportunity for businesses much more salient and therefore decreases the revenue of companies like OpenAI and Anthropic within the enterprise, that it could lead to insolvency. I think that is the big secular trend that I would worry about if I were an investor in such markets.
1:04:21Speaker B:My worry is we've never had such reliance on two companies to continue to hit their targets. If OpenAI and Anthropic do not continue in the strategy that they are, the music in the party goes off. And if the music goes off for everyone in the fireworks layer, no party. The rooting layer, no party, everyone suddenly just gets the wind knocked out of them by two companies.
1:04:43Speaker B:Trajectory.
1:04:44Speaker A:Totally. Yeah. I think that it's a really big deal. I think that we could use a little bit of sobering up within our industry anyway.
1:04:54Speaker A:I think that there's a lot of hype. I think that there's a lot of. There's too much crap happening for my taste and I prefer a little bit of consolidation actually, so we see what shakes out. I think arena will shake out as a winner in our category and I would love to see some of the great people that are at other businesses in our area consolidate to arena, be able to hire them in.
1:05:18Speaker B:Where is the industry underhyped? Where is it overhyped?
1:05:22Speaker A:Well, it's interesting. I mean, I feel like everything is so hyped right now.
1:05:26Speaker B:I feel like the mechanical infrastructure for compute and data centers is relatively underhyped. Like the actual cooling systems and the actual like steel, steel infrastructure. Do you know what I mean? Like the real physical is still under hyped when you look at.
1:05:44Speaker A:Yeah, you probably know more than me. You're in touch with the investing markets. So I mean like I know that people are super hyped up about all of the high bandwidth memory and the GPUs and all that stuff. That stuff is super ultra hype.
1:05:56Speaker A:Right? I mean basically in all stages from public market companies to early stage.
1:06:02Speaker B:South Korea have fucking called a national convene, like community meeting today because their stock markets are down 40%.
1:06:11Speaker A:Oh my God.
1:06:12Speaker B:A national meeting because stock market, 40%. It's not a day.
1:06:17Speaker A:Why are they down 40%?
1:06:18Speaker B:If you're a public markets ambassador in South Korea, you're, you're, you're coming home a little bit stressed today.
1:06:24Speaker A:No, that's not good for them. Yeah, let's all pray for the let's pray for the South Koreans.
1:06:29Speaker B:I. Do you know what I. The thing I am slightly amused by is right after everyone at SK Hynix and Samsung took home like mega bonuses, then the market crashed.
1:06:40Speaker A:So why did it crash like that? What's the deal?
1:06:43Speaker B:Honestly, I think it's just a realization that, you know, everything was pretty overinflated and markets can't keep ripping for so long. I think there's no destabilizing factor within open or close that suggests demand is being questioned. Wow.
1:07:00Speaker B:That's why we should have a hedge fund manager on. We could do a new show hosted by Anastasios and Harry.
1:07:07Speaker A:Yes, absolutely.
1:07:09Speaker B:Called Two Dumb Rocks.
1:07:10Speaker A:Let's do it. And we bring. It's exclusively us and hedge fund managers.
1:07:14Speaker B:I think it's a fucking great idea.
1:07:16Speaker A:I love it.
1:07:18Speaker B:I actually do too. Guest one is Anthony Midha. Anthony, will you help Two Dumb Rocks? He's like, why did I.
1:07:24Speaker B:Why did I put this together? This is not.
1:07:26Speaker A:No odds would be the best guess.
1:07:28Speaker B:What's the most underrated NEO lab other than periodic that people aren't talking about?
1:07:33Speaker A:I don't know if I have one. I think a lot of them are overrated.
1:07:38Speaker B:I think Black Forest labs is pretty underrated.
1:07:41Speaker A:BFL is great. Would you consider them a Neil lab?
1:07:45Speaker B:Oh, don't get technical with me on semantics.
1:07:47Speaker A:Yeah, I don't know. Yeah, BFL is awesome.
1:07:50Speaker B:I agree. Final one for you. What are you most excited about? My mum's got Ms.
1:07:55Speaker B:I'm fucking excited that chronic conditions like Ms. Could maybe be treated. What are you excited about over the next five to ten years?
1:08:03Speaker A:Yeah, I mean I've always been a big proponent of AI in medicine too. I think that the level of just human flourishing, that's going to happen as we start to one by one eradicate diseases. The same way that we're currently eradicating open problems in math is going to be incredible. I think it's going to be tough because the thing is that math is a closed system in medicine.
1:08:25Speaker A:I think you'll need to figure out ways of quickly iterating in a feedback loop on biological systems. So that's the missing piece. But once we crack that, it's going to be just an extraordinary journey.
1:08:36Speaker B:So funny. When I interviewed Demis and I spoke about like bio and medicine, it was an area where you could see his eyes light up. But it was an area where I said, hey, testing needs to change. 15 Years.
1:08:50Speaker B:No bueno for a lot of sufferers of chronic conditions.
1:08:53Speaker A:Yeah. And you know what's missing? That is exactly the data layer. That's exactly one of the areas where the data layer, where you can clearly see that the data layer is where value is going to accrue because the GPUs are the same GPUs in both cases.
1:09:08Speaker A:The problem is that the data infrastructure, the flywheel, the data collection that you need in order to build a great biology product or a medicine product that's tough to build.
1:09:17Speaker B:Dude, you've been a fucking epic guest. Like, really, I'm so grateful. It's been an amazing show. Real honesty and authenticity.
1:09:27Speaker B:Most people suck as guests. You know why? Because they're not authentic. And it comes across.
1:09:32Speaker B:You've been all, thank you for being so great.
1:09:34Speaker A:I appreciate it. No, thank you for having me on. Would love to do it again at some point. And you should visit the arena office anytime that you're in the Bay Area.
