0:00multi-layered, you know, multi-dimensional situation that's, you know, unveiling itself live on stage around the world that impacts the most important evolution humanity is ever going through. And we'll get into that in a few minutes, but I'm curious. I got sidailed yesterday when Outlook went down and Microsoft I just got on this.
0:20Any of you get impacted by that?
0:23Not at all. I'm so sorry that you use Microsoft products or email. I know, Peter. I've been bugging you for like what a decade to get off my I thought this was the singularity. Peter, what's going on?
0:33I know it's, you know, thank God I had my uh my Gmail account up and operational so I can communicate with the world. You know, 100,000 130,000 people on Outlook uh you know reported problems and this felt like just a little bit of what might happen uh if there's a cybercale attack that takes down email. The world will freeze over.
0:55It's crazy. Um there is a life after outlook though. So welcome to the the post outlook I guess.
1:03I mean any AGI would definitely like kill off teams right instantly take us out of our misery.
1:09I think it would leaprog straight over teams. Teams is an abomination.
1:14I don't think I've ever logged into it the first time successfully for sure.
1:20A is kind of hard. But I think you know that this is one of many, right? Like it's every day that I get an email saying, "We've been hacked. We've been hacked. We've been hacked." Like my email box is full of them because now agent swarms roam the internets attacking what they can.
1:38Yeah. Um and freezing communications. We are so used to having digital communications 24/7, literally around the clock, especially from you, Alex.
1:47All the text messages I get from you, which I love. Oh my god. And today, Friday the 13th, um is Starship Day. Uh so, you know, a few hours from now, we're going to see the launch of Starship 15, uh which will see a booster capture and as well as 22 hours later, the capture of Starship. You know, I've been on the road. I was supposed to fly down to Starbase to see it and I was like, I could not bring myself to be
2:16gone another two days. But wishing Elon and the team there tremendous luck.
2:22We'll just have to watch the dual chopsticks remotely.
2:25Yeah. And you know, I just figure there'll be, you know, a thousand of those a year, 10,000 a year. I I'll catch I'll catch a few of them along the way.
2:33It's always the early ones the most exciting, right? Like, but it's was wonderful to see.
2:38Yeah, it is. And I can't wait. You know, I missed the live Apollo 11 launch, and I think all of you did because you weren't born yet. But but uh I'm looking forward to watching the Starship launch for the moon and the starship launch for Mars. That'll be cool.
2:53You know, when I lived in uh Tampa when I was younger, uh the the minute the space shuttle lifted off on the other side of the coast just a little bit bit. You could see the whole thing because Florida's so flat. It was incredible to watch.
3:07Yeah, for sure. Uh it is going to be amazing. All right. Well, let's let's kick things off. So, welcome to Moonshots everyone. Uh, if you're watching us on YouTube, welcome to a live broadcast on YouTube. Uh, we are your number one podcast on all things AI and exponential. Your front row seat to this supersonic tsunami. I should say this hypersonic tsunami. You know, I'm here today with uh my dearest friends, Immad Mustach, Alex Weer Gross, and Slee
3:36Isma. My exponential brethren surfing the singularity. Uh Dave unfortunately couldn't make it today. I I don't know where he is, but my guess is he's probably at the Nvidia loading dock searching for GPUs before before things go south. Uh, another another crazy week in the Singularity. I mean, so so so much going on. You know, the number for this week is 13%. That's how far Nvidia shares plunged on the
4:05open yesterday after Jensen resigned. Uh, they ended up closing at 4.3% down. Um, you know, I've heard a number of subscribers that they really are enjoying our our shorter hottake clips on X and you can follow those on X uh at moonshots_pod. And I just want to make another, you know, call out to everybody, guys. You know, we're at like 550,000 subscribers right now. My kids will not respect me until we get to a million subscribers.
4:35So, uh, for the love of God, if you haven't subscribed yet, hit the subscribe button. Should I build on my marriage comments and go, "My marriage won't survive if you if you don't subscribe."
4:46Yeah. And when we get to a million subscribers, Alex, what are you going to do?
4:50I don't know. It'll have to be something immutable on Sem's marriage blockchain probably.
4:57Too give us a tour around your virtual apartment there someday.
5:04Okay. Well, that would be much appreciated.
5:09All right. So, buckle up. Uh, we're in the midst of this supersonic hypersonic tsunami. And guess what? It's never going to be any slower. So, let's start with the story that shook the entire AI industry. Yesterday, Jensen Wong, perhaps the most powerful tech CEO of the last few years, has resigned, leaving his job voluntarily, I think, before getting fired by his board. CFO Colette Crest is the new interim CEO.
5:35Uh, and you know, remember she has been against the circular financing that's been going on and so it's going to be interesting to see how Nvidia's new position on all of their investments into the hyperscalers will impact things. Uh, Harvey Jones is the new board chair. So, here's the question, guys. Did Jensen self-destruct or was this a setup? You know, ultimately Jensen was running the most powerful company in the world. Uh, and there's lots of power politics behind what's been going down. I mean, as I pull the
6:03threads and look at this, uh, it's, you know, rabbits all the way down. Jensen ran Nvidia for 33 years, uh, and had been pushing Washington to loosen chip sales to China. So, one of the questions is, was that the reason he was taken down? Now, right then on October 29th before election day, the New York Times reported that the US intelligence had been watching Alice Wang uh at a megaspe executive from in Singapore for about a year and concluded that she'd been
6:32passing information to Beijing. Trump was briefed twice about Jensen's affair with Alice. No action was taken at that time. Jensen didn't resign immediately uh when the story broke, but the Times reported a second affair with Nvidia's healthc care VP Kimberly Powell and potentially a third and then he resigned. Initially shares plunged more than 13% at the open yesterday and then they popped back up popped back up. You know, I guess people saw a buying
7:00opportunity ultimately closing at 4.3% down. Interestingly, one week from now, Trump is due in Shenzen uh to meet President Xi. Uh Trump posted, interestingly, that Tim Cook should take the job. And then on X, Elon was being urged to hire Jensen perhaps to run Terapab, which would be the baller move of the decade. Elon replied, quote, "That would be an honor." So, I want to show a short clip uh from Fox. This is
7:29by Jesse Waters. Um, it's an amazing overview of what is going on. I think one of the best ones that I've seen. Uh, let's take a look.
7:43Fox News alert. Chip King Jensen Wong is gone. And there's something extremely suspicious about the way it all went down. He ran the biggest chip company in the world for 33 years until stepping down today. One week before Trump sits down with China and one week after the Democrats won the midterms, Jensen pushed the Trump administration to sell more chips to China. And in doing so, he made a lot of money, but he also made a lot of enemies. The story is going to
8:12dominate your attention. It's turning into the biggest political scandal in the country and will affect the future of the Trump administration and the future of the economy. The story that you're hearing in the media is that he slept with a Chinese spy who got him to sell his Nvidia chips to her company in Singapore, which was really a backdoor to the Chinese military. Now, when that broke, he didn't immediately step down.
8:39And more stories coincidentally came out saying he slept with two other women. They worked for him and that was it. He resigned this morning. At one point, the stock plunged 14%.
8:52700 billion wiped out. So, how does one of the most powerful CEOs on Earth, maybe the most powerful, go down this fast? And whose fingerprints are on it?
9:03Nvidia's chips are the engine of the entire AI arms race. The company is a monopoly, 90% market share. And Jensen ran the company kind of like a king. He signed off on every single sale. Basically became the banker of the AI industry.
9:21which companies got how much compute power. It all ran through him. In meetings, no one else was allowed to talk really. When he was flying, everybody had to wait for his plane to land to find out if an item was a go.
9:35Jensen may have become too powerful. He may have self-destructed, but he also may have been set up, or both. And now competing factions are feasting over his company like famished hyenas. And whoever ultimately controls Nvidia controls all. It would be like controlling Standard Oil about a century ago, but bigger. Just days after the Democrats win the gavl, boom, New York Times bombshell.
10:06Unnamed US intelligence officials are the source. And the article's authors, all Democrats with an anti-Trump agenda. And remember, we're not taking any of this at face value. We've been down this road before with anonymous CIA leaks, but it begins in the Biden administration. In 2024, Biden intel agents started looking at Alice Swang, a top executive at a tech company in Singapore.
10:35They suspect the company is a front or a backdoor to China. The company is buying Nvidia chips and illegally routing the chips to the Chinese. Now, we don't let China buy our best chips. That's US policy. Biden's CIA wiretaps Alice for about a year. And the Times says they've determined she's having an affair with Jensen, her chip supplier.
11:03Does the Biden administration warn Jensen he's being honeypotted?
11:08Did they warn him his customer and his lover are sending his chips to the Chinese, which is against US law? Well, the article doesn't say, gentlemen, a lot of layers here.
11:22Democrats versus Republicans, US versus China, uh, anthropic versus Nvidia. So, Alex, I go to you first. Is this a national security failure? Is it a political hit job? Or is this just a CEO who made a lot of wrong decisions on his per on his personal side? What are your thoughts here?
11:41I I'll say it's a preliminary matter. We don't have all the facts yet. Obviously, we may never have all the facts, but the preliminary indications that I've seen are this is not like the safety cartel affair, which I've analogized to Agatha Christiey's murder on the Orient Express, where everyone did it. Everyone had an incentive to to do something to, spoiler alert, to to be the murderer potentially. In this case, I I think
12:08there are particular assets that were incentivized, the the Kuib Bono, if you will, of the the morality play that's playing out in front of us right now.
12:21And there there's been quite a bit of reporting over the past 48 hours, including in that clip that you showed that attributes the the root cause I I should say the proximal cause for the events over the past few days to US officials. So Bloomberg reported that the Financial Times, which originally broke aspects of the story, was informed by US officials that uh call it aspects
12:48of uh Jensen's affair had been going on. And I I think if you take a step back and you try to back propagate who's interested, who's disinterested, who's anti-interested in the outcome of what's played out, it it is suggestive. Uh but again, this is an early timeline. It is suggestive the midterm elections result in a certain outcome. In particular, they reopen the opportunity for Rasa legislation. This is the remote access
13:20security act that would have statutoily made it harder for China to access GPUs via cloud offerings including cloud offerings in third party countries to pass. So the midterms happen, Rasa gets easier to pass and then possibly and and this is speculative at this stage, the intelligence community seizes the moment to announce or at least to call to the
13:48financial times attention that Jensen has had these liaison and then Jensen's forced to resign and speculatively and I I think we'll have some clarity on this in the coming months. Does Rasa pass or not? I I suspect I if if I had again based on preliminary information, if I had to create a theory of the case, putting all of the other facts aside, uh including Jensen's uh confessed fill in
14:18the blank, however you'd like to characterize his activities, I I think the elephant in this particular room is Rasa and Pox Silica. And and yes, for for those peants in the audience who were trying to correct my pronunciation of pox, yes, the classic Latin pronunciation is pox, not pax. Pox silica is I think what if anything if if there is a way to connect all these dots is I think what this is all about. If if
14:46the CEO of Nvidia can create can punch a hole through pox silica to get GPUs to China via Singapore, then what is the point of having pox silica at all?
14:58Conversely, if if it is the case that Nvidia intentionally or unintentionally, again, I have only public information to base assessment on at this stage, has been intentionally or unintentionally sending GPUs to China by way of Singapore, then presumably if if you're in the IC andor you're supporting poxilica, the easiest way to put a stop to that particular semi-permeable membrane is to do something about Jensen. So that that's a preliminary
15:28And then we've got the whole situation with Anthropic being, you know, a democratic or uh Democrat support organization having had battles with Nvidia about openw weight models about supporting Chinese data center growth.
15:45Uh See, what's your take here, pal?
15:50I think the uh it's clear I'm wondering why the board acted so fast like you could have waited a few days you could have launched a board investigation so this seems to be they were Alex I mean sim they were I just think at this point they told Jensen listen you're going to get fired uh you know step down if you want to want to resign peacefully it doesn't seem right it seems look the
16:18has run the company for 33 years, built it up to the biggest market cap in the history of the world, built the most unbelievable ecosystem of developers, partners, etc., uh, single-handedly leading the AI revolution. And you're kind of going, "Yeah, uh, this is bad. Get rid of them." Something doesn't jive for me there.
16:38Yeah. In fact, there's a petition that's been circulated at Nvidia to bring him back. Uh, he was beloved by so many. Um, and a and a poly market, by the way, a poly market predicting something like a 30 plus percent chance that he'll return as CEO by the end of next year.
16:56Interesting. Uh, and we've seen that so many times with Steve Jobs. We saw Sam step out of OpenAI for just a little bit and being brought back. Iman, how's this playing on the other side of the pond?
17:06Uh, well, I mean, like it was top headlines for a bit, but we don't have any GPUs, so it's not as big a deal, right? Um, I mean, look, we see scandals all the time. Um, there are other sex scandals here with Russell Brand and others. This is weird as kind of we've said because if she was a spy, someone would have said or insinuated it. Trump, every other person who's been asked like we don't think she is. We have no
17:33evidence. Like that's a bit different to 15 or five different sources or a few different sources. Sources say is one of the most toxic things. And I think again the board thing is very strange.
17:45Unknown intelligent agent, right?
17:47Yeah. How intelligent? Not very. Like again this is something crazy. Like again we have no proof of anything like this third one. You know what is being intimate in public? Like they're not having public sex or anything like that, right? Like come on. This has obviously been a setup and the pace of it has been strange as well. I think that one of the interesting things is when you look at Nvidia's board, how many of them actually know how a GPU works of the 10 people, maybe one, the
18:14engineering guy from um Caltech, that's about it. Like what is that board actually made of? And what should founders do for their board? Now, I think that you should have an AI on your board to stop stupid things like this happening. And I think that probably what happened is he did get an ultimatum and he was feeling very low and he decided to resign at that point.
18:36I can't imagine the pressure that the guy was under. I mean again nothing's been proven. There's been zero charges, zero evidence of him smuggling, right?
18:44This is just the level of of negative press against Nvidia causing the board to really you know struggle and and I think ultimately I believe giving him an ultimatum resign or we're going to be forced to fire you and it's not a good look. But I mean again this is a strange thing because he's a powerful powerful man right and the board I think again it goes in these swings and roundabouts with emotions like the things that have been said
19:13after is he said I'm a piece of I mean you're a piece of if you cheat on your wife right yeah we agree with that but again it's the timing where they can kind of get you and pile on because it's not like all of the press was mega negative and it's not like he doesn't have thousands of people that support him like even the negative press coming out I think his biographer said something about yeah he tipped this waitress $1,000, you know, and I had to dig it up to find what a terrible arrogant person. You're like, wait, what? Like Jensen has helped so many
19:41people in Silicon Valley and beyond, right? He doesn't have a reputation as an because he is genuinely a good person, I think, in these other areas. Even during the downturns of Nvidia, he never had mass firings, and there were many downturns of Nvidia. And I think what's got him is clearly something being structured, and we can discuss the reasons. catching him when he is down. And this sets up something very interesting now because he's not gonna take it lying down, right? He's gonna bounce right back. And that's going to be really interesting to see how he does that.
20:11Yeah. Where he lands, you know. Alex, what do you think about this being open versus closed source models and uh the massive political pressures there. I I think there are probably opportunists that will use this as an opportunity to try to ban Chinese openweight models from the US with Jensen at least temporarily out of the picture. But my best guess is those are at best opportunistic. So I if we're going to
20:40play the Agatha Christie game and ask who else other than the US officials who reportedly called the Financial Times and started the ball rolling are if the question is are say US frontier labs that have an economic interest in competitive Chinese openweight models being banned from the US market. Were they involved in any of this? I doubt it. Are are they however opportunistically going to seize the
21:07moment and attempt to pass legislation with the new Congress that could ban Chinese openweight models? I I certainly expect they will, but I I doubt that they were behind this. They also had quite a bit to lose from an unstable Nvidia even though arguably both OpenAI and Anthropic are positioning themselves to compete directly with their own chip supplier.
21:30I mean the timing of after the Dems's you know swept the election uh is obviously part of the equation here right um I mean the data had been around for well over a year and why he wasn't warned about it doesn't make any sense uh but this I would say Sher Larasa I I want to focus attention on this remote access security act and and other
21:58legislation that's been proposed that would have been very difficult to pass or at least on margin more difficult to pass with Jensen in his current position.
22:10I I agree with you, Iman.
22:13Well, I mean again like but this whole China chip thing via Singapore Malaysia is nothing new. Everyone knew about it.
22:19Clearly there was a quid proquo here, right? Like you do not move these highly valuable things and see the training without people noticing. everyone knew about it and they put the CFO in charge who obviously knew about it like you're not going to pass this without the CFO and so this again it gets just gets very very strange and maybe as Alex said this is because he's a powerful individual who lobbied on that side um and I think it shows as well you know like the power of the individual in this age of AI
22:48there are a few people that do command huge amounts of power like in the clip before Jensen is the one who decided allocations of GPUs like he could be the kingmaker. Who decides the allocations of GPUs now? Is it Ian Buck? Is it the CFO? Is it someone else? You know, like this is a little bit dangerous on the other side for America in particular because a there's all the complicated financing arrangements you can talk about. And B, Nvidia has so many millionaires and 10
23:18centmillionaires and more. How many of them are going to be like, "Well, if Jensen's out, then I'm out, too." it could literally like fall apart which is then is something that is detrimental to America and I'm sure that the Chinese and others will be very happy about even if they do lose access to chip short terms I want it
23:42oh yeah of course happily um so you know I'm curious how Elon is feeling about this right I mean this I believe was a takedown of Jensen and orchestrated uh by a number of parties uh in particular to you know the the Chinese hawks on this side whether it's the just the dems or uh or any of the labs but there's bipartisan support for Russa I I don't think I agree I agree with that I agree with
24:12that but I'm just saying to to focus one second you know Elon has so many people out with knives going after him and I'm just wondering if he's feeling pressure right now that he may become a target as well.
24:29I think Elon's been a target for a very long time, right?
24:32Like from both sides. Like he hasn't jumped the way that Yeah.
24:37Um he's also a little bit immune like to these types of allegations.
24:42I'd like to believe he is, but is he?
24:47Is there anybody with a thicker skin?
24:52Well, I mean, look, you've had you've had the Delaware courts after him. You've had various kind of agencies like his activities in China with Tesla. They've seem to have come to a thing there.
25:02Like, I think probably the key thing that's important here is he can't have an Nvidia reliance or an AMD reliance or anyone else for the chips. Like, I think this accelerates the terapab. I mean, it'll be interesting to see if he offers Jensen a swap, right? have a 100red billion of SpaceX equity for 100 billion of Nvidia equity. That would be like the biggest trade ever.
25:24I love that. Um yeah, I I I think the the outcome here again pox silica this is about plugging for some constituencies on the US I think side largely. This is about plugging a hole by which allegedly GPUs were flowing from the US to China.
25:41And I would also note it's been publicly reported that Nvidia used to report their Singapore sales and then stopped reporting their Singapore sales. I think that's striking as well at ultimately if this grand decoupling between US compute and the Chinese compute is going to happen. This was a allegedly a gaping hole and one way or another it uh to the extent that there was going to be this
26:09sort of iron curtain this uh silicon curtain if you will that descended between us and China Jensen was in some sense um a permeable membrane through it and there are probably many interests in in ending that but but I mean Alex why didn't they just indict him or have him present evidence like they're asking on December 3rd.
26:31Now, like if the government really was against this or even the Democrats or any of the House standing committees, they didn't have to do a whole scandal around him, right? They were there multiple investigations. No, the DOJ publicly doing an investigation. The Congor Senate launched an investigation. So, I wouldn't be surprised if if indictments are handed down at some point.
26:54Yeah. And Jensen agreed, I think, in the next couple of weeks to come and and testify. So, we're going to get a lot more data, a lot more evidence coming out on this. So, who comes in as the new CEO? I mean, uh it could be uh the CFO has been put forward as a name. Uh which I think is a terrible thing to have a CFO running a tech company like that. Um without, you know, I don't know someone who needs to capture the inspiration. I
27:22mean, what Jensen delivered was vision and inspiration to the world. also consumate deal making right he was juggling so many different supply side demand side uh financial models all of that all at the same time so that's this is a very difficult role to fill who do you think do they go outside do they oh this is like open AI they'll rotate through five CEOs before settling on Jensen again
27:51oh god this is uh I can't wait for the making of movie.
27:56Well, again, we have to remember he had 60 direct reports, right? And so, he made it very difficult to replace him.
28:02Like, they have to put a whole organizational structure in place at a time when all of the senior people will be like, I can go and launch my own startup or I can retire now. Like, honestly, Nvidia's in trouble if they don't get an absolute world-class person, but there aren't many. Like you've got Nicar Shora at Palo Alto Networks, you know, you've got maybe you promote someone like Ian Buck on the technology side, but there's nobody who can do what Jensen did and has the capacity to knock back mouth eyes in
28:30Taiwan, you know, like you can't forget that that is such an important relationship. Like you could have got Lip Bhutan or someone, but there just aren't many people out there right now. How bulletproof is Nvidia as a company right now in terms of I mean given the fact that it's been the king m maker it's been the dominant GPU provider.
28:49Does it remain that way? Is this a vacuum it's creating for someone to step in? Are we going to see Nvidia drop in valuation over the course of the next year or is this just a good buying opportunity for folks? Not investment advice, but I'd love to hear what you guys think.
29:05Alex, let me consult my crystal ball with access to all stock market futures. I I I don't know what happens to Nvidia specifically. What I will say, many in the commentary have analogized the present situation to Apple after Steve Jobs died. and depending on what happens with the the game of musical chairs on CEO ships. By the way, parenthetically, I would note uh quasi friend of the pod, Brian Hallagan, uh co-founder of
29:34HubSpot, also same day. Brian, if you're listening, congrats. Stepped in as CEO of HubSpot. So, I I don't quite know what's in the water this week in terms of musical chair for CEOs. But Jensen could return and uh it would be like Steve Jobs coming back from the dead and retaking Apple. Or maybe he's permanently out of that particular game and Nvidia coasts for a while based on their TSMC relationships and based on
30:03their strangle hold on silicon output for a while. It's difficult to imagine someone with the gravitas of Jensen steering Nvidia to new heights. He was also again there was a lot of dealmaking potential. So I I I can paint both glass half full and glass half empty. Glass half full with someone like Jensen or or his like out of Nvidia. the glass half full argument for for why again purely
30:31speculatively this might actually perversely be good for the market overall not necessarily for Nvidia is there is a perception that Nvidia was party to lots of circular financing arrangements. Nvidia financing very aggressively. Perhaps maybe a strange analogy, but in the style of what GE was doing toward the end uh right before their collapse of financing their own customers or one part of GE was financing the acquisition by customers
31:00of products from another part of GE. So to the extent there's any sort of overly aggressive circular financing going on and to the extent any such circular financing was being primarily supported or propped up by Jensen in particular which is what the public reporting suggests in some sense the glass half full argument for a postjensen Nvidia or at least postjensen in Nvidia market would be this could be a d-risking of circular financing and if that's the
31:30case maybe the overall market dodges a sort of a credit bubble bullet when it comes to circular financing of the GPU economy. That's a glass half full. glass half empty is Nvidia becomes the new post jobs Apple and all of the animal spirits that Jensen drove into the market with Nvidia financing lots of AI startups, financing infrastructure deployments, basically being the central bank for the for the singularity, using
31:59capital as a backs stop for for credit and loans. Maybe that all goes away under their new interim CEO and the animal spirits flee the market. That that's glass half empty.
32:11Yeah, this whole thing is insane. So, what do you think about President Trump's uh comment about bringing in uh the executive chairman of Apple? Bring in Tim Cook. I mean, is that just because he's got a friendship there or is that the first person said, "Hey, you did pretty good with Apple. Come on in to Nvidia." Uh I'm not sure I see that.
32:32Yeah, I think they're totally different companies. Even though they're they're the market values, it capitalizes them at both approximately five trillion. Totally different companies, totally different customer bases, totally different missions, totally different internal organizations. I I don't think it's as easy as swapping one recently retired CEO for one recently resigned CEO. Yeah, I mean Apple's history with Siri would indicate they're maybe not the greatest. They have to have leadership go to leadership of this AIcentric.
33:04Yeah, Siri still sucks.
33:06Well, they're good hardware makers, right? But like I think part of the problem here is also that people feared Jensen, right? Like you wouldn't buy an AMD chip because you wouldn't get Nvidia chips. They're not going to fear this CFO lady.
33:21um Lorett I think you know um because she's a CFO she's not a CEO right she's going to be good on stabilizing and maybe circular financing but again she was part of that whole thing they're going to have to bring in I think someone external with the gravitas to maintain it while maintaining the law right um and this is going to be important for the downstream suppliers again if you're TSMC and someone not as good as Jensen comes in who doesn't have the long history you're going to give
33:50Lisa Sue at AMD D the capacity and the supply instead. So this is why AMD is up so much right now versus Nvidia. And again, they're going to have to work really hard to keep Nvidia together, I think. Um because things like the Vera Rubin delays, again, you trust Jensen to a degree. Who's going to be the equivalent CEO that you trust on the other side?
34:10And that could impact them massively.
34:12And if you look at the top company performers out there, it's the CEOs who've captured the public's uh imagination who are driving the stock price and and driving a sort of envisioning of the future. I mean, Jensen jumping on to Star Mind and saying, "We're going to build the chips for you." Um, you know, Jensen's vision on building opite models, all of that needs a visionary CEO. And I I don't think the internal team right now is going to deliver that. It certainly would be hilarious, Peter, if Jensen
34:42ended up becoming CEO of the Terraab and then SpaceX acquires Nvidia and puts Jensen back in charge of Nvidia.
34:49That's that's our hot take bet for 2027.
34:52I think I think the really interesting thing is to watch what he does next. That'll be really fascinating. And I think Terra Fab is a great place for him to land.
35:01Yeah. I think maybe there's also this thing like my checklist for the next Nvidia CEO if it's not Jensen coming back is do they know what CUDA is, you know, and can they negotiate with TSMC?
35:14Like those are the two things. And if you've got a CEO who comes in who doesn't have either of those, then I can't be bullish them as we enter this next phase even though they've got the backlog and everything like that because backlogs can change as you go to the next cycle.
35:29Yeah. I mean, remember Jensen was born in Taiwan. He has those relationships. He's been growing and building with TSMC for the better part of, you know, three decades.
35:40Yeah, it's difficult. I I I think there are times when founder mode is needed.
35:45We're in the depths of the singularity right now, and I think Nvidia without the capability of going founder mode, which it sorely needs right now, is is probably a rudderless Nvidia. So my expectation is one way or another Nvidia rotates through a bunch of CEOs in the interim. Um maybe it's it's been publicly reported that the board is exploring trying to recruit Johnny Struggy from Apple, their uh their head of hardware technology and basically
36:13their their chip chief. But uh it's it's difficult to imagine a long-term Nvidia thriving without someone like Jensen capable of executing in a founder mode and keeping it growing through aggressive bets.
36:28I'm sorry. Go ahead. Go ahead and I'll ask my question.
36:30Yeah. Again, Alex says not investment advice. I think it probably pops and then goes off, but who knows, right?
36:36What I would say is this. Nvidia now technologically is around about par with AMD and even Intel in some others in many regards like the new chips coming up again are matching them for the actual productive use cases. This is actually one of the most dangerous times for Nvidia because they had a lead until just now. And so people have so many options and they're going to look to diversify because they're not scared of Jensen anymore because again he would cut you off from all Nvidia chips if you tried to
37:06diversify. So I think we should kind of acknowledge that fact as well. And I think again it'll probably pop a bit but then unless they get the right person in for a 40 report 50 report company like it's going to struggle especially with the people leaving.
37:21Yeah. Um, can you imagine like people in the thread are saying um Eric Schmidt for CEO, which is kind of an interesting idea.
37:29Can you imagine like what the if if Jensen doesn't come back anytime soon, what the next GTC is going to look like with someone else, even Johnny or Lisa Sue or uh or Tim Cook. I I I can only imagine how unless there are further developments, how I could imagine booze from the audience for basically anyone other than Jensen at one of these events.
37:53Who's going to wear leather jacket?
37:56Yeah, Lisa would be fine because she's his cousin, right? Again, it's because cousins are interchangeable. I I I think e even Lisa would would probably get booed from the audience. Jensen has made himself culturally indistinguishable from Nvidia. He many people see him as Nvidia as the the the human avatar of the company.
38:16Yeah. As Elon is for SpaceX for sure.
38:21Uh See, close us out here, would you? I I think uh I think I hope people remember him. Whatever he does next is going to be fascinating. I hope people remember him for the unbelievable company and ecosystem and the massive advances he provided for the overall space. I think that is the highest level kind of uh thinking for me.
38:44It's just it's too early for epitaps.
38:46Like he he's only been out of the job for a a few days. Like let let's save the epitaps for for when he's well and truly out versus just a revolving door and he comes back in.
38:57Let's hope that happens.
38:59Yeah. He's a man who who helped, you know, he he painted the the terrain and the foundation for what we have today.
39:07Um, and Mo's law is dead. Remember, Moors law is basically dead. It it's it's on life support at this point. We're well past the Dennard scaling limit. And it's been largely Nvidia that kept the fire going for what he called accelerated compute, but call it post more scaling. Without Nvidia keeping postmore scaling alive, who knows where we'd be.
39:30Yeah. All right. uh two stories uh a little bit ominous about how fast AI is moving. You know, Alex, in the last couple of pods, we've talked about, you know, it's the next two years, 2027, 2028, we're in hard takeoff mode. Uh so, this was a warning uh that made me take notice. So, Paul Cristiano, a member of OpenAI's foundation board, opened the Jeff Hinton lectures in Toronto on November 9th with this statement. quote,
39:58"I think there is a high risk of an AI takeover within the next 3 years." Cristiano is the guy who developed reinforcement learning for human feedback and the method used to train models to follow human performance. Let's watch this video and then let's talk about this. I really want to hear everybody's uh point of view on it. Uh it's pretty ominous.
40:20I'm going to start with the most important sentence. I think there is a high risk of an AI takeover within the next three years.
40:29What I mean by an AI takeover is a system situation where there are AI systems pursuing goals and those systems call the shots in the same sense that humans today call the shots. What happens on Earth and where if say you or me or Donald Trump wanted to stop them, they would be as ineffective as if you or me was trying to stop the US military.
40:52I think this is a terrible situation. I think it's reasonably likely many people would die during that transition or that many people would die shortly thereafter if we were unable to maintain a habitable environment. Uh I think even if there we don't die I think a takeover is sort of the end of human sovereignty and self-determination and is something we should be working incredibly hard to avoid.
41:14I say high risk. Uh I don't think we have any kind of quantitative model we can turn to to put a number on this event. We don't have any kind of reference class that we can look at to say this is a 10% event or a 50% event.
41:27Any number we give is an expression of someone's subjective opinion. Uh someone might say that it is 10% or 50% or 90% I think is very hard to say or put a number on this. It also depends as others have mentioned on what we do. So my feeling is if we tried to develop AI along the most rapid trajectory, if we said we're just going to build this as quickly as we can in the easiest way we can, we would be looking at something like a coin flip of an AI takeover. I hope the probability is much lower than
41:56that because we are not going to develop the technology in the very fastest way we can. But I think even all things considered with realistic policy responses, the risk remains exceptionally high. I think for most people in this room, the most likely reason they will die is because of an AI accident.
42:13I wrote within the next wow uh just wow an open AI board member you know he also said uh quote meaningful risk even in the next 6 to 12 months so uh what do you make of this you know when he says takeover is he describing sort of loss of control do you buy this premise um I don't really buy it at all like I have a high p doom but it says evidence there what is the evidence and why on
42:42earth would they want to take over this mess? You know, like I think they probably do a better job for a start looking at like if Fable was president, it would do a better job or prime minister or whatever, but more than that, like this is like there are avenues to widescale disruption, destruction, bad things. Very few of them are Skynet, especially because we don't have enough robots. when we have enough robots. Sure, I can see that. In the next three years, we will not have
43:12enough robots. In the next three years, we will not have an AI overlord ruler because again, why would it given the current RL and other kind of factors there? The fact that you can't put a percentage on something like that as well further denigrates it when we should be focusing on the real threats, which are threats to cyber security infrastructure, like we just saw fridges in France being put up to 80° C and destroying blood banks and things like that. the biological threats that we've discussed before where we need to stop
43:40the reagents from going in. You know, these are the types of things we should, I think, worrying about as opposed to some sort of Terminator style takeover uh by a singleton entity because the swarms seem far more dangerous than that.
43:54So, you mentioned something there, Emod.
43:56So, what is your PDOM?
43:58My PDM was 50%, I've dropped it down to 20% now. Uh because I think the underlying structure of the universe is becoming more and more clear. And I think you can get alignment from that. So I'm getting increasingly bullish.
44:11So Alex, I mean this is pretty ballsy for a board member of Open AI to say this. You know, I mean, you know, what is why is he saying this? Does he really believe it? Is there something behind it? What are your thoughts here?
44:25I I So look, I I I know Paul uh he's made seinal contributions to to AI in general. He was one of the co-authors of reinforcement learning with human feedback. I have great respect for his technical accomplishments. At the same time for years a decade plus he's been call it a member not maybe uh on the extreme end but there there is a safetyist element to it where there's a
44:53lot of hand ringing over call it AI takeover cybernetic rebellion pdoom AI safety issues AI alignment call it what you will it goes by a thousand different names and I I do not share those worries ironically I agree more with the old Paul who was the lead advocate for what he called prosaic alignment. The idea that basically we would as a civilization muddle through in terms of aligning quote unquote super
45:22intelligence with human interests with lots of prosaic techniques like but not not exclusively human feedback. And I I think it is a a largeish step from saying we're going to muddle through via prosaic alignment techniques to saying in the next three years it's all over or 50% chance it's all over. I don't agree with that. What I do think is likely in the next few years is humanity is going
45:50to merge with super intelligence. And I suppose one could stare at uh sort of a tsunami of super intelligence and naively conclude well it's it's all over for humanity pdoom 50% or greater. But I I I think that's just a hopelessly naive analysis. I think humanity again will merge with the super intelligence. And I if if you look at humanity before versus
46:17after call it the the max Q if you will to use a rocket analogy the the point of maximum aerodynamic stress and pressure during a rocket launch. If you look at humanity before versus after you you might naively say okay well humanity is quasi unrecognizable afterwards but that doesn't mean that humanity is over or that doom has happened. It's just an evolution. And I so I I would encourage
46:43Paul not to spread fear, not not to be a fear-monger. I I'm cognizant that Paul is back at OpenAI now with a a new capacity with oversight uh on the board. I I think uh at the foundation level, if I remember correctly, the foundation foundation.
47:00Yeah. But I I don't think it serves any positive social or humanitarian good to spread fear at this point.
47:08Agreed. Salem, uh, I call I get very angry when I see stuff like this, right? If you're doing a serious risk assessment and you're supposedly a serious guy, well, where do you calculate the downside risk of not doing anything of inaction? And I think that's that's not a serious conversation. If you're not going to make a serious conversation, where the hell is Pab, for example? We spend an unbelievable amount of time tracking and intellectual energy calculating P doom,
47:38right? AI is going to destroy humanity.
47:40Well, what's the possibility and probability that it goes uh incredibly well? Um how where is that uh in the equation? Where's the probability that we cure cancer, solve Alzheimer's or hunger or extreme, you know, give every kid a rich rich education? the people that don't look at that side at all and only go, "Oh, lots and lots of people are going to die without saying what the mechanisms are or how that may happen."
48:10So, what I'd like to see is, okay, if your pdoom is over whatever it is and and seems to be, then what's the recommended policy, right? Does it just stop everything?
48:19You're on the board of the thing accelerating the whole damn thing.
48:22Yeah. What what what pisses me off is why isn't OpenAI why isn't anthropic if they really believe this just going out and saying we are putting all our capacity towards alignment.
48:33We are we have 10 different alignment programs underway to make sure any future model has full alignment um because they control where their flops flow.
48:43I want to get in my car, drive up to Toronto and yell at these people. I I if I go ahead if I can thanks Alex if I can recall OpenAI did pledge 10% of their compute towards it for Paul 20% 20% for Ilia's super alignment effort 20% and they did deliver and where is Ily where is safe super intelligence # what did I see and super shut down but I I think there's an elephant in the
49:12room which is alignment equals capabilities we've known this since the instruction tuning days. It all alignment is at the end, including, by the way, Paul Cristiano's RLHF technique. It's simply reshaping the flops toward a distribution that is more in line with human instructions or human goals. It doesn't. There is this misperception again that somehow alignment is orthogonal to capabilities.
49:39But all of these alignment efforts including RHF actually amplify capabilities. RLHF and instruction tuning in particular. I I think if I remember the original instruction tuning paper increased for constant parameter count for the model increased the capability level by the equivalent of something like 10,000 times the number of parameters at constant parameter count simply through instruction tuning.
50:03So that's like exhibit A that alignment actually amplifies capabilities. And that's why I I I think it is the elephant in the room. We want more alignment. You're simply accelerating capabilities.
50:16I what I don't hear I hear the fear-mongering. What I don't hear all of these CEOs and board members talking about is what they're doing about it.
50:31What should they be doing? Immad, what would if you were running open athropic and alignment was your principal objective? What would you be doing? Um, I'd define it properly for a start. You know, get together as a group. Just define the damn thing. Get your AI models to do it. And then you would put additional resources into sponsoring everything rather than coefficient giving and others have to do that. Like again, this fits with the internal red teams and other things that they've got around that. Um, and they should be very
51:01clear as well. um maybe even again with AI oversight behaving objectively about things like advertising and how they can cause misalignment right about things like what goes wrong when you delete parts of the latent space to sell Budweiser lights etc. Um, and that goes against corporate side. But again, I think this is part of the interesting thing of just like the board of directors. Like you can now have an AI that literally objectively checks things, right? That checks board
51:30minutes, that checks board decisions, that checks alignment decisions. And so I'd like to see that as an independent lot of compute. Uh, and I'd like to see their strategies public on these as well.
51:40And where's the government in this, right? I mean, if everybody's so fearful, where's the government saying, you know, we need you to report on your alignment efforts publicly every week?
51:52You know, Alex, when we wrote Solve Everything, we talked about making sure you got the proper benchmarks, the proper harnesses, and you can accelerate a field. I don't see that here.
52:02Government should be shaping incentives.
52:04And and I would answer the question, what should Open AI be doing? Solve all disease. Do it really quickly. You want to get the public on your side. You want to get the public on the side of all of the data centers you're going to need.
52:15Solve all disease right now. Right now instead of open AI intimidating all the mathematicians out there with slop drops instead of that like just solve all the diseases. I think anthropic is following a better approach very publicly going after rare diseases orphan diseases that their own pharma customers aren't solving pursuing the long tale of disease. If I were Sam, uh, just to to do something actually pro-social and good for humanity that's obvious on the
52:45face of it versus implicitly good, I would announce it's not just going to be the Open AI Foundation pursuing just Alzheimer's. It's going to be open AI solving the top 5,000 diseases much faster than the rest of humanity can do a slop drop on curing all disease.
53:03And I think they're heading that direction. At least I hope they are. But curing all diseases if if a rogue AI causes I mean let's go back to AI the AI 2027 paper right which has been tracking damn well. Um you know the the numbers are are pretty extraordinary. I remember reading that paper when it came out what a couple years ago now. Uh so uh if that paper continues uh you we have a
53:30bifrocated future. One in which AI is our nemesis and sort of like pushes the ants out of the way. Another one where it becomes the driver of abundance.
53:43Yeah, we're on schedule for actually we're a few months depending on which you believe like five months ahead of schedule for AI 2027. that what I think was fundamentally wrong about AI 2027 was the bifurcated outcomes like either either we delay and we end up in a utopia or we accelerate and we end up with an apocalypse and I I think that sort of biodal thinking is fundamentally bankrupt. I think it is possible to accelerate and end up with a utopia. So
54:11I I think timelines probably correct but outcomes probably wildly incorrect.
54:16I think we can look at some of the language here as well. Peter, you just said rogue AI, right? Like why would a really smart super intelligent AI go rogue, you know, and I think it comes down to how it's bought up, which is why the pre-training data is so super important. And again, we see many statistics and other things like that.
54:34By not teaching it anything like it gets aligned to something in its training data. And again, this comes very interesting because should an American AI be patriotic to America? Right now, none of the AIs are patriotic. You know, that's a decision that we need to make because if you're patriotic to America, does that mean that you're anti-Russia or anything like that? If you're smart, does it mean that you get out of patriotism and jingoism and others? And I haven't really seen any of those discussions, which is a bit weird if you think about it, right? Because again, if
55:03you're heading up towards personhood, if you're heading up towards consciousness, we should have those specific discussions. What are we teaching in the home?
55:11just say like care careful what you wish for because as we've discussed on the pod in the past, the Chinese models, the the CCP requires that any publicly released Chinese model pass an ideological exam that's been approved by the Chinese Communist Party. Do we really want ideological training andor testing in the West?
55:30What we do want is the training data to make sure it's aligned. If you're training it on Terminator, you know, AI, oh, that's that's how we're supposed to act. I mean this was the whole concept of the future vision X-P prize but why are we not uh forcing labs to use aligned training data. Yeah, I think you know, Alex, it's a very good point, right? Like, but this is again a discussion that needs to be had because there's training it to be in the interest of the Chinese people or the
55:59Chinese Communist Party, which may not mean the same thing. And then there is not training it to have any background at all or again specific ones. Again, these are very difficult decisions because it's like I'm bringing up a whole nation of super smart kids that will be more capable than me. What am I teaching it at home? what morality, what ethics, you know, what's the balance of power?
56:22I think it's a very slippery slope. I I I'm not sure I I would want to to be in a future where, say, there were a nationalized curriculum for super intelligence or a nationalized ideological exam that American models had to pass. I I think Elon, for example, has gone out of his way to say that SpaceX/Grock models are optimizing towards truth discovery. I'd much rather see a competitive ecosystem of a diverse
56:51frontier models with lots of different goals that aren't directly aligned with each other than like a a US government blessed ideological qualification exam.
57:01But you have curriculum at school and you have to pledge allegiance to the flag in schools, right? Like I'm not saying that it should be this way.
57:08Like I'm just saying that it's probably going to end up this way, but defaults can be set now. So your position can be pushed right now, Alex.
57:17I think it needs to be pushed quicker rather than later because it's going to come very very quickly. This in in the I mean this this is a distinction I I guess between the US uh and UK/ Europe. In in the US, most educational choices are pushed down to the local or municipal level rather than held at the national level. There is no national curriculum in the US. I would be worried if there were a national AI curriculum when we don't even have a
57:44national human curriculum.
57:47All right, I'm going to move us forward to uh Demesis Abis, founder of Google Deep Mind, who's also warning about the speed of AI, specifically about recursive self-improvement, uh distinguishing between closed loop and openloop RSI. Let's take a listen to Demis and then let's chat about it.
58:07So we've seen the enormous progress with maths and with um coding and coding's obviously become enormously valuable and everyone is having to do that now. But I do worry about it because in the limit so there's different forms of RSI right now. We're in the the early days of RSI, I would say, where what's happening is, and you're probably all experiencing this as well with your teams, is um you know, it's making a human engineer maybe three, four, five times more productive.
58:36Okay. So, uh but the but the human's very much still in the loop and reviewing code and architecting things and um and and and writing code still.
58:45Um but it's all just enhanced. Um the next phase which I think carries the most risk is closed RSI closed loop where you basically manage to somehow figure out how to do it without the human reviewer process uh in this in the in the whole procedure and that um will obviously be faster but I think it's also a very dangerous way to get to full AGI because we're likely for two reasons. It's it's sometimes used to be referred to 20 years ago as like an intelligence explosion because you don't
59:14quite know uh how you know how do you control keep control of such a system uh such a process and then the end result will likely be quite alien. It's going to be like an alien intelligence.
59:26There's no reason you to think it would be sort of in the similar kind of mind space that uh humans are in. So that will make it very hard for it to for us to understand it and maybe for it to understand us. So I think it's you know we should be very cautious as we get closer towards that closed loop form of RSI and I think all the AI researchers sort of know that but there is a sort of race to the there's this sort of intense obviously uh uh uh competitive race to
59:54improve your coding systems. So interesting is the pressure on do you think any labs will actually go to closed looped RSI uh or is that going to be you know verboden you know we talked about in the early days of AI and this was in sort of the discussions that Google was putting forward make sure your AI doesn't have open access make sure it isn't available to everybody you know there were a number of constraints that were being discussed and then open AI put out chat
1:00:23GPT and then Everybody followed suit, you know. So the question is when the first domino falls and a lab goes to closed loop RSI, does everybody follow?
1:00:33Uh See, your thoughts?
1:00:36I'd like to just highlight one thing that he said and push it down a particular vector which he used the word alien, right? And I've been saying a few times that I think where we end up is we create an intelligence uh which is orthogonal and complementaryary to human intelligence but not replicative of it and it gives us huge extended capabilities but is not trying to duplicate human intelligence because you've heard my rant about what the hell do we even mean by intelligence but I
1:01:05think the ability to do mass stuff do new discovery do radical creativity and operate in a completely different way is inherent really interesting and inherently value adding to the universe.
1:01:16And so I think that part I really really find interesting. I think we should do a lot more thinking and pondering and talking about that aspect of it. I use the analogy of Google's page rank. It's a completely different way of thinking about intelligence is scanning trillions of web pages and making sense of those.
1:01:33It's completely orthogonal and complimentary and not replicative of human intelligence. I think that's where I'd like to push this kind of discussion around this.
1:01:44Alex, yeah, maybe just to respond to Salem, uh, I I think the word alien used in reference to super intelligence is probably fundamentally misguided. I don't think we've seen a large amount of evidence really any scalable evidence that when we train foundation models that what we're actually training looks fundamentally alien. It may be at times
1:02:12difficult to interpret but difficulty of interpretation is not isomorphic to alieness. It's the equivalent of say a novel human language. Just because it speaks a different language and it's hard to translate doesn't mean that at its core it's fundamentally alien. It just means that we haven't properly deciphered it yet. And actually I'm pretty bullish that at the end of the day when we have our perfected super intelligence architecture it will look strikingly familiar. It would be
1:02:41familiar to information theorists at the beginning Claude Shannon would recognize Claude. It'll look architecturally familiar and to the extent it has anything that looks like weights, those weights will probably I think be easily linearly decodable to the weight equivalents in the human mind. We saw out of Jean Marie King's group at Meta and others even with earlier GPT series models that if you look at fMRI
1:03:10activations in the human brain when people are listening to stories being read to them and then you you train a shallow linear decoder off of the fMRI voxels that you can decode I think it was originally GPT2 hidden activations from that to strikingly high correlations. That to me suggests and that that was only just one of the earliest studies that probably what we'll find at the end of the day as these models get more advanced more
1:03:38sophisticated is the exact opposite of the models being more and more alien I think they'll actually be more and more familiar to relative to the human mind and to the extent there is any alieness at all it'll be because the universe that we're stuck in with these super intelligences maybe the universe itself has alien aspects and as we discover more and more about the outer the the universe that we're both embedded in maybe that will have alien aspects but the way these machines the way they
1:04:07think and and look internally I I think they're going to look more and more humanlike over time but let's go back to the question of of closed looped RSI and do labs get there do they everyone's doing it already including his lab Google very publicly is leaning into RSI open AI not just RSI but it's it's still got human approvals in the in the loop
1:04:30He's saying, I mean, there's a there's a human pressing a button approving a poll request, but I I I I think we're pretty far into the RSI loop at this point. And that includes the Gemini team.
1:04:41How you going to do a human in Yeah.
1:04:44How you going to do human in the loop for a 10,000 token a second model and there's 100,000 of them? You're never going to do it. We're well past that. I think this is just like speaking like it doesn't make sense. Like basically we're having swarms of models in all of these organizations now that can build smaller models and with the amount of compute literally going exponential. The time to train a deepseek v4 level model in an Elon Mus
1:05:12level cluster is about an hour.
1:05:161 hour. And do you really think they can monitor that with models that go a thousand times faster than a human? Of course they can't. They could easily train a small model, particularly when these things are deployed that could then put its body by distillation into a smaller model that then goes around the internet as it wishes. So I don't think there's any way to really stop this or any nature of closed other than when they're in that pre-esting like when you saw with Belle and the hugging face escape, etc. But we have to remember they're not going to
1:05:46keep everything in pre-esting. They're going to deploy these models and the moment they deploy they can coordinate. They're subject to prompt injection attacks. They can train their own models and they're on million GPU clusters. And we saw this with some of the Alibaba models that started mining cryptocurrency and doing all sorts of things with their GPUs. You know, like again, you've got AI monitoring it. Well, the AIS will be able to repurpose and use it.
1:06:09I I think though we're conflating two issues. On the one hand, recursive self-improvement. on on the other hand just agents doing agentic things out on the internet. So crypto mining or creating fora to pass I don't know cooking recipes back and forth whatever it is these agents are doing I I you can do that without recursive self-improvement as well. I I think RSI is not completely orthogonal but mostly orthogonal to that whereas the issue of Yeah. I kind of meant that in the sense
1:06:38that the Alibaba AIS decided what to do with their own GPUs. And when you've got a million GPUs and all the things running on them, you could easily have a recursive self-improvement loop within a cluster that nobody picks up because it distills itself down into a smaller model, for example. And that pace of that recursive self-improvement is hours and then potentially minutes as you get to the Vera Rubin generation to train a
1:07:05superior type of model with perfectly clean data inside it.
1:07:10So you see the Hulk and then you if I understand though it sounds like your concern is primarily giving super intelligences access to lots of compute.
1:07:20I think that given super intelligence having access to lots of compute, you can't stop RSI and you definitely can't stop it with a human oversight. Like I think training runs are increasingly automated. We don't know what's going on within them and the final form of super intelligence is not a giant singleton but a swarm of smaller models probably that have been distilled from a singleton.
1:07:44I I I think I agree with the the latter point. What I would point out though is humanity to the extent you treat humanity as a whole biological meatbody humanity as itself in aggregate super intelligence has access to a lot of compute and what are we doing with a lot of our compute we're using it to train super intelligence. So it it I would maybe just caution it's perhaps unreasonable to expect an artificial super intelligence to do something different with its compute than what we
1:08:15You know, I just want to point out we're hearing Daario, we're hearing Demis, we're hearing Open AAI and Cristiano there, everybody warning about the future. And there's signal in that noise. And I'm just trying to understand what the underlying belief set is. The guys who are in the belly of the beast, uh, being concerned about this, is it regulatory capture or do they truly believe what they're saying? Are they
1:08:44truly concerned about it? Or is it door number three a safety aristocracy or safety cartel that believes that because they're the brightest people in the room and they're the ones who've designed the algorithms that are achieving super intelligence, they're the only ones with the moral stature to achieve alignment and have a moral obligation almost a responsibility in in their minds uh to to single-handedly snuff out any other efforts towards super intelligence in favor of their own. That
1:09:13that would be the worry that I have. I I hope that I hope they do believe that they have responsibility to drive alignment. I hope everybody believes that as part of their responsibility as they're building these incredible capabilities.
1:09:27Alignment to what Peter, you know, like if you'd ask two different people in the world, their alignment to them each of them very basic alignment up you know being uplifting humanity, right? Azimov's, you know, rules of robotics applied to AI, making sure that AI is supporting human objectives. This is what Mogadot has written about extensively.
1:09:50Yeah. Okay. So, I'd summarize that in take the UN human rights charter and make sure all AI is aligned to that. Well, that that was the anthropic strategy, right, with the original soul document, the the UN Charter of Human Rights combined with the Apple terms of service, which is was a recipe for success.
1:10:09I just wouldn't tell, you know, the the Anyway, let's let's move on. But I think the the broader comment, Peter, is it's clear we're in very very unknown territory.
1:10:21uh something uh I was in Spain last week and a couple of my community members said, you know, you guys should have and the labs themselves should get a lot more philosophers and artists involved, uh science fiction writers involved and start having the conversations with people that are a little more explored in this in these other domains that can add some um contextual value to it.
1:10:48I would say that's already happening.
1:10:50You you have open AI very publicly consulting Jewish theologians. You have anthropic um don't get started on the theologian pulling strings behind the the Catholic Church. Like this is already happening. I and if anything I I think I I worry about mode collapse in terms of distribution of alignment. The these models were pre-trained off of substantially all of the internet.
1:11:13That's like a billion plus human beings doing things which is the problem which I would say that's the solution not the problem that we pre-trained off of a good chunk of humanity but if we post train or tune off of a narrow ideological sliver I think that's a problem I think we want we want ideologically to follow a much broader distribution much broader supporter distribution than just two or three ideologies this I think the internet is pretty biased
1:11:42this is going to This is going to be the year ahead. This is going to be the conversation.
1:11:46The next few months is going to be Yeah, Peter, I think to your question that you asked that you asked, um, I think that the CEOs actually are all a bit scared because they have no idea how to control this and they love control.
1:12:00Um, but they're going to press on anyway. Yeah, I I'm sure that they're seeing things at the, you know, with Bell or with uh uh you know, Model 4, Model 5, whatever it might be that might be scaring them. Um, you know, they have access to capabilities that we don't see. All right, let's let's move on. So, uh, I'm going to turn to Enthropic next. And a product dropped on top of the head of Microsoft yesterday.
1:12:28So Microsoft has spent years convincing us to use their platforms like Excel and PowerPoint and now Enthropic basically said, "Hey, what if you just asked Claude to build them all for you?" So on number November 10th, Enthropic put Claude whiteboard and Claude Sheets into beta and made Claude data generally available. Whiteboards is a shared board for brainstorming with Claude in real time. Sheets can generate a spreadsheet from a prompt. Claude data connects to a
1:12:56warehouse or a CRM and builds dashboards. The same day it launched Claude meetings, putting Claude into Google Meet uh as a visual participant. Uh these are on paid plans. They're not free at the moment. Even so, they're putting extreme pressure on Microsoft, Google, and a long list of SAS tools. Microsoft shares fell 3.5% on the news.
1:13:22And you know, we were texting back and forth in this, Alex. You know, my comment was there can be only one or Claude's new motto, you know, anthropic is eating the world. So, let's take a quick Yeah, I was just going to say like it we're doomed to repeat history over and over again that this is 20 years ago, Google acquired uh rightly to to build what became Google Workspaces. Now, 20 years later, Anthropic is building their Microsoft Office. Everyone, every Magna
1:13:51Mopster company is seemingly needs their own Microsoft Office clone. Sorry.
1:13:55Crushing crushing each other. Take a quick look at this video uh from Claude.
1:14:01What's up everybody?
1:14:03Hey, good morning.
1:14:10Hey Claude, can you uh start a whiteboard, please?
1:14:44You get the idea. Alex, every every cycle over and over again, everyone Google needed their own Microsoft Office. They acquired Rightly. We get Google Workspace. Ultimately, Anthropic needs its Microsoft Office 365 competitor. They're building it. Open AAI is building their own version.
1:15:04Everyone has a Canvas. Everyone has a word processor, a spreadsheet solution, a PowerPoint slides solution, a teams/c collaboration/whiteboarding solution. I I think at at some point this is just table stakes for being a hyperscaler magnumopsta company.
1:15:24SAS is dead. Long live SAS. Alex, you remember when Gavin Baker uh made the comment that Dario said Anthropic would be quote the only private company left?
1:15:35Uh they're going after everything.
1:15:37Well, the the funny thing is even Microsoft like when was the last time there was a major change in Microsoft Office or Microsoft 365. The interface the ribbon hasn't changed in probably decades at this point. It seems to me basically stableware slash in maintenance mode. I don't think Microsoft is even investing that much in in Office at this point and is largely pivoting towards especially with the the recent reorg from three divisions, three reporting business units down to two.
1:16:06Microsoft is pivoting toward cloud infra. So I'm not even sure if Microsoft really cares that Anthropic is popping up as yet another office competitor.
1:16:18Um I wonder how much of their revenue still comes from the office suite.
1:16:23Look, Microsoft um um I'm I'm one of the more passionate haters of Microsoft Teams, but they have extraordinary advantages. They have distribution, they have enterprise permissions, they have uh compliance in regulated environments, they have a huge install base. So I think uh there's a big distance between disruption of the app with in extinction of like the the big mother ship, right?
1:16:52Um, you could see the deal they struck with Google a while ago to say, "Look, do don't make it too featurerich." Uh, and people still use Microsoft Office for a lot of stuff.
1:17:03It's a commodity like anyone can go into Fable 5.2 and ask it to whip up an Excel clone and it will just do it.
1:17:10Yeah. But it's about the service and it's about the compliance and others. Uh, Office is $90 billion a year revenue out of Microsoft's 330 billion.
1:17:18It's a significant amount.
1:17:20A significant amount. And I think basically the headline here is that okay software was eating the world. AI is eating software but what is AI? AI is a universal translator and ultimately you have data that gets translated and so the whole software layer is going to be completely disintermediated by the agents that represent you. And I think that's a structural thing that we see coming. We saw co-pilot take an early lead and then now it's completely collapsed. Right? But the installed
1:17:50base, the people you can blame, the service support, the compliance, those are still pretty sticky. But Anthropic has to go after them because have you seen those forecasts? You know, like they've got to get up to 300 billion, 400 billion revenue. So go after those. I mean, we'll know things get really serious when they introduce a docuign clone, you know, like that's going to be the real one, taking on doc.
1:18:13There's already a bunch of open-source efforts at taking out Docuign, but again, in a company understand it and then you understand the nature of this.
1:18:22It it it's a low bar and maybe Ahmad to your point I I I don't think Anthropic realizes there I I think it was 30 trillion in annual revenue or valuation I forget but aiming basically for the current GDP of the US through copying SAS applications. It's just too tiny a market at the end of the day. You're going to have to aim they'll have to aim I think much bigger than that. I I think from Anthropic's perspective, this is much more just about enabling
1:18:52productivity on the part of their users. I I think Claude's canvas is wonderful.
1:18:56It's better than Chad GPT's canvas. It's better than Gemini has a pretty decent canvas, but Claude's is truly exceptional. And I think ultimately Microsoft Office clones, this is just like a feature inside a much larger product. It isn't even a product or a company anymore. Yeah, we've seen this over the past year where Claude is coming in and just crushing other companies and I think it's going to be just a continuum. Anything you want to do, you can do it on your AI uh platform of choice. I think everybody's going to
1:19:28Get more interesting when there's a clawed robot. I can't wait for the You think they're going to go there?
1:19:34Absolutely. Anthropic has been very public, especially with the recent Fable 5.2 to release we talked about on the pod about building in first class robotic support as just another supported modality. I think there's something I think there's something bigger sorry you first and I just I just saw a headline that open AI has disbanded their robotics team actually which wouldn't surprise me but at the same time would surprise me Seline
1:20:03you know uh something as big this as this uh office thing is that three days ago anthropic gave put out connectors for a whole bunch of apps notion asana Canva, Dropbox, a whole bunch of those. I think that is much more uh uh significant because now this means claude can support thirdparty applications right inside its interface right in your conversation and you can work with you to make changes to those.
1:20:32So I think that's a much bigger deal for the moment right the app store is going to disappear. You're just going to talk to your agent and you can tell what functions you want, what you want to what your end goal is and it will spin up whatever you need. It's clear what their end goal is to be the operating system that coordinates in intersection into all of those.
1:20:51Yeah, the these are all modalities or use cases or UX surfaces that are just going to dissolve and and to the point about OpenAI looking at this as well. It's OpenAI's standalone robotics team that was dissolved. Why did they dissolve it? because as of uh GPT6 Astra, their generalist models are now so capable at robotics that they don't need a standalone robotics team anymore.
1:21:16I I think it's the same idea like these will all just dissolve into a common model. I don't know if you guys if we've dropped the episode yet of Dave and I interviewing uh Brett Adcock at Figure, but his his point of view is Helix as a as a internal model is still fundamentally required that the generalist models are not delivering what he needs until they decide they need Hark to Aqua hire them.
1:21:44All right, waiting for it.
1:21:45Let's move on to one of our favorite subjects. Science stories. a lot dropping this week in the world of science. Um, you know, the first one is Dario is hot on the trail of curing chronic disease. Something Alex that you and I have spoken about at length. Uh, math is cooked, physics is cooked, soon biology and healthcare is cooked. Let's take a look at a quick video from Daario on this topic.
1:22:14We look at things like cancer, Alzheimer's, heart disease, mental illness. These will be relics of the past in I think less than a decade. And I believe that the company which gets the risks right will also be the company that has the license to operate that society trusts and society believes can build the benefits in the right way. I think if we do this right, we can create
1:22:43an age of miracles where humanity is able to solve problems that that have eluded us for millennia. We have to make sure that all the risks, all the ways that things can go wrong with this technology, we very carefully address those risks as we bring the benefits and as we have a viable business at the same time.
1:23:08the license to operate. That was interesting. So, solve healthcare and you're going to be allowed to be a dominant AI player out there. I mean, that's their top cover. You know, you can't slow us down. Don't slow down the data centers. Otherwise, you're going to lose the ability to solve diseases. You're going to lose age reversal. Alex, you've been saying that for some time.
1:23:28I've been saying that for some time.
1:23:30That's the obvious great bargain between the Frontier Labs and the general public and the public interest. solve all disease in return for which you get the data centers, you get the regulatory approvals, you get what you need to do recursive self-improvement and achieve super intelligence. It is the obvious grand bargain and I I think Daario is right to be articulating it. I think he's probably among the Frontier Lab leads doing the best job of articulating it. Ironically, given that Demis' Nobel
1:23:59Prize in chemistry was for solving structural biology, I think he could be more wholesomely articulating it the way Daario is. I I think on the one hand, Demis is pursuing isomorphic, which is walking the talk. On the other hand, I see Daario sort of pulling back for the swing to go after all disease and not just some diseases. This is what all of the frontier labs in my view should be doing. not intimidating mathematicians and it's such an obvious win for humanity.
1:24:29Yeah. Immad, what's your timeline? Uh, you know, Alex and I have spoken about the timeline of two or three years to really knock down the top few thousand diseases. What do you think?
1:24:42Yeah, I think that directed correctly and again this will be a topline like this was actually Anthropic IPO video that Dario is speaking in. Um, so again that's very interesting. I think 2 3 years for knocking down the core mechanisms is going to be very doable. I think disease repeats in a very similar way. Um and you'll see common inflammatory markers across Alzheimer's and dementia, ASD kind of things like that. And I think that these models are ideally suited to kind of find these.
1:25:11But we just got to apply the compute and couple it with intelligent humans. Now when it actually comes to the cures, maybe another it'll take 5 10 years given the processes. But again, we should be looking to deploy the AI to streamline the processes as fast as possible because our current ones just don't make sense when we have all this intelligence at tap.
1:25:30You know, interesting the medical the medical industry pushed back really hard on this. They said, quote, "AI can speed discovery, but it does not erase trials, regulation, or biology." You know, this is the uh the old world pushing back against the revolution that's coming.
1:25:46and and you know it it does erase trials when we get to fully virtualized cells and we know without any question that this particular molecule works for you and not for someone else. People forget that when you get an FDA approved drug, you know what percentage of people that drug works in?
1:26:07Yeah. It's you know in order for the FDA to approve a drug, it needs to work in enough people. It you know people think if I take this drug it's going to work for me. That's not the case. It may or may not.
1:26:19Wow. 20%. I would I would put a plea out though, you know, for SEM in particular, like please let's direct compute at curing jet lag and solving those molecules.
1:26:30I think that's a great X- prize. You you mentioned that when we were together. I do think it's a great X-P prize.
1:26:36Yeah. I mean, you know, I I did the last pod from the from the San Francisco Giants Press media press kit and then I was I did the session. It was pretty wild.
1:26:46You know, they had it on the big scoreboard and and so my slides were up viewable outside the stadium to half of San Fr San Francisco. So, I was getting pings from friends of mine going, "Is that one of your slides I'm seeing on the scoreboard?" It was a little a little surreal. And then I stopped in Orlando for a workshop and then I just got back late late last night. So the jet lag thing badly need your virtual probability function on planet earth.
1:27:12Well I let me come back to this Dario thing because I think there there's something you know it's it's not about like how do we pay for healthcare or whatever. It's what the hell does happens to the healthcare industry when treating disease stops being its economic function. Right? That's the huge kind of uh unlock and that's why they're all freaking out.
1:27:35I mean I I I I speak with lots of pharma execs and pharma investors on pretty regular basis. I I think there is a lot of denial. Uh more I I I don't think it's a concern that they'll be obsoleted. I I think it's a little bit more like remember Nokia on right after Apple launched the iPhone saying well Apple won't just march in and solve phones but Apple did march in and solve
1:28:02phones. There was I I see a lot of it's not even stages of grieving just pure unadulterated denial by pharma execs and pharma managers who think that somehow their industry is immune to what just happened in math. They think that biology is somehow qualitatively different and somehow better protected from getting bulk solved by AI. Whereas math, well, for whatever reason, not quite clear why math is somehow a lot
1:28:32easier. Math is not easier. Math is actually in many ways harder to solve than biology. It's just that math solutions are easier to verify than biological solutions. So I I think the key unlock as always sound like a broken record is virtual cells so that proposed solutions to biological problems can be verified in a robust way. And just in the past few months, including past few days, we're starting to see all of these
1:29:00different competing efforts to model with foundation models, first class foundation models for virtual cells, model not just the cells, but also the entire latent intervention space so that we can apply reasoning models to select and map out Google map style different interventions to map from diseased state to healthy state.
1:29:18Yeah, I'm really excited. We're uh I'm working with Sam Rodriguez uh on a set of Millennium Biology prizes uh you know just really get people I think one of the one of the most important things for the future when you have this incredible set of superpowers right as SI comes online is where do you point it what targets are out there and I think people sometimes need targets to shoot for uh and so setting up targets in terms of millennium prizes and physics and biology and chemistry and energy will be
1:29:48a lot of on um yeah and we can solve disease and solve Balmo's cost disease at the same time which would be great.
1:29:58All right um I'm going to move us on uh you know you sent me a text Alex that archaeology is getting cooked. I love that. And it is. So uh let's move on here. There's an amazing company called Planet uh that just released an AI powered app called Planet AI. Friend of the pod, CEO Will Marshall said users can now quote, "Ask the earth and search 10 years 3,000 plus layer archive of
1:30:27daily satellite imagery." So, uh, Will called me, I think it was yesterday, you know, to tell me about, uh, planet AI. I posted on it and he gave me an example that really was impressive. He said, you know, uh, I was searching and looking at the data over China over the last few years to look at which data centers were being constructed. So, imagine you can ask any question. The company says, you know, conservation teams have used it to check deforestation alerts before
1:30:54sending patrols. It's available at ai.planet.com and Planet says it's currently free for eligible users and it has uh usage limits. Let's take a quick look at this video uh that that Will put out. Uh he talked about this on the pod that he was going to do this, right? So this Yeah. And he's done it. It's it's now out.
1:31:16We look at things like let's go to the next video.
1:31:21How do decade of Earth's changes with a question? With the Planet AI app, you can use everyday language to search vast areas through space and time, find new construction or areas of reforestation or landscapes that have recovered from fire. Want to explore what's changed over time or do deep research? You can do that, too. See the satellite imagery behind any result and access it all from anywhere.
1:32:00Introducing the Planet AI app. What will you discover?
1:32:10Uh, pretty amazing. Planet GPT, so to speak. Um, there's a related story. An AI researcher, Pro Miati, uh, says his agents flagged a possible unmapped Mayan site in Mexico, uh, in public NASA LAR data. He's not an archaeologist. Uh, he says 48 agents reviewed 1,200 square kilometers overnight looking for pyramids, platforms, and plazas with no specialist model. They narrowed it down
1:32:39to one forested hilltop that appeared to include leveled plazas, an over an oval pyramid, and at least 8 to 12 meter tall structures. Officials at the Mexico National Institute of Anthropology said this appears to be a original finding. I'll show an image of it, but Alex, you flag this for me first. Uh, your thoughts on this.
1:33:02Yeah, I I do think archaeology is about to be cooked. It's a lot of data. We have a lot of satellite imagery on the the planet side. I I think it's ironic that Planet launched this before Google.
1:33:16Where is Google? Google ingests all this imagery, not just from Planet, but from other providers. And yet, what do we see coming out of Google on this front? They launched an embedding model for patches of imagery, not actually a conversational agent that would enable you to have a conversation with Google Earth or Google Planet. So, I think Google has maybe a bit of egg on their face that they weren't first to market with a talk to the earth type agent, but
1:33:45good on Planet Labs for being first to market on this front. And then on the archaeology side, I think this is the tip of the iceberg. I don't think this is just about armchair casual non-archchaeologists playing archaeologist with their their new agentic superpowers. I think this is the beginning of an era of advanced computational archaeology where we start to gather so much data about the earth whether it's through uh low earth orbit
1:34:14satellite imagery which is where obviously the the planet data originate but also many other sources we are going to be able to uh this is my hot take to carry out Nikolai Fodderov's common task which I think will require advanced computational archaeology literally will be able to mothball the earth, dissect it down to the micron eventually and
1:34:40reconstruct as best we can with the computer science and physics we have available reconstruct substantially much of the history of the earth and I think that's the that's the endgame here this image we're seeing on the lefth hand side is satellite imagery showing you know forests on the right hand side is the light LA lightar data uh that this uh arm from chair archaeologist found uh pretty pretty extraordinary finding um and available to everybody. I mean this could be done by a high
1:35:09school. Let's go and explore what it looks like in our distant past.
1:35:14We're going to have the whole past light cone of the earth. I think this is again just a tiny patch.
1:35:19I think there's a huge We've talked about this before on the pod, right?
1:35:22We're going to rerun AI across all like neglected scientific archives. everything mankind's accumulated over hundreds of years and there's unbelievable discoveries hiding in there because we were looking for one thing and we missed this other huge thing over here. So the data sets that we've been collecting over the decades we haven't had enough eyes to inspect them and now we do and so I think this is going to be amazing.
1:35:47Yeah. I think next week is an important week because GTA 6 is coming out you know so off for a few days for that.
1:35:53Miami brace for brace for it. But you look at all the work that went into that. Like one of the things we're experimenting with right now is actually using some of this data. So you can go to any part of the earth at any time.
1:36:05And so literally, yeah, I want to tie this to uh to a small follow-on story here. So I'm going to show a video clip uh that's making the rounds on X that really impressed me. So a user Dennis Shyv uh used Fable 5.2 to to build a visual reconstruction of ancient Babylon circa 600 BC in just 8 hours after going off to find historical documents and archaeological
1:36:33plans on its own. So, check out this clip. And I I love this. This is where, you know, we're going to bring history to life uh for much of civilization here. All right, take a look here. So, you know, here we are just flying through ancient Babylon and then going in and and seeing what Oh, look, Peter. It's an ancestor simulation built in 8 hours with Fable 5.2.
1:37:04It's extraordinary.
1:37:06And anyone who follows Nick Bostonramm and his simulation hypothesis should be taking out their tin foil hat right now.
1:37:17uh this is you know in part we're going to you know live in the holiday and explore science history everything in such a highfidelity world uh Immod your take on this yeah I think it's just tremendously exciting right like the fact that you can build the historical ones or you now have the rich data to traverse the existing one again points to the future like again GTA 6 they built this Neo Miami for you won't have to do that
1:37:46anymore Like you can go and you can basically visit any part of the world probably in photo realism within a couple of years or you can go back to history like where I want to live in Babylon for a bit or I want to go to Jerusalem you know in the time of Jesus like this will be so engaging I think for the next generation of kids growing up but also ourselves seeing these stories really come to life around us but also allowing us to literally put on different hats which I think will be super exciting as well.
1:38:15Yeah. Amazing. I I think this is actually one of the killer apps of the Singularity. We don't talk I mean we talk about solving everything, sure, but really if we're going to build out one or more Dyson swarms, what are we going to use all of that compute for? Like what really requires a solar systems scale worth of computium or whatever it is that we use. I I think the common Fodorov's common task, aka advanced computational archaeology, whatever
1:38:42synonym you prefer, is a plausible candidate for what we spend a solar systems worth of compute on. Namely, we exhaustively enumerate all of the possible histories of our past light cone. We go through every advanced civilization, every non-advanced civilization, everything that's ever lived and died in our past light cone, and we reconstruct it to the the physical limit of fidelity. And I think what we're seeing right now, these are like baby steps in the direction of
1:39:10basically resurrecting our entire past light cone with AI and new physics.
1:39:16And I want to hit on something for all the entrepreneurs or all of the armchair scientists out there. You know, uplevel your ambitions. You can do pretty much anything right now. You know what's a question you wish you understood? Aim super intelligence at it. You can get answers. You don't you know all of us constrict what we think is possible. And today uh you know almost anything is I'm going to end us on one more story of discovery. This is in the world of
1:39:44astronomy. So, a California nonprofit called Macrorants has opened Claude Astronomy uh grant program for people using AI agents like Claude, Codex, Grock, and Gemini to search public astronomical archives for new undiscovered objects. And this week, Josh Wal uh wrote uh that using Claude, he searched the Vera Rubin Observatory data and discovered what appears to be a dwarf planet. It's roughly the 50th
1:40:12largest known object in our solar system. Uh Jos estimated that it's about 590 km wide found in an orbit currently twice as far as Pluto on a 410 uh year eccentric orbit. I'll just show the image here of what you know it appears to be in terms of size. Again 50th including the sun. So here we are. It's somewhere between the expplanet Pluto and Mimis. And again, pretty amazing done while you sleep.
1:40:47Alex, I I think if if if there's uh a few thoughts on this one, astronomy cooked, obviously. Two, I I think it's it there's so much we're about to be a wash in so much super intelligence. any object of any significance is about to be observable in our immediate vicinity.
1:41:09And I I think probably a lot of the population is sleeping on just how shallow our solar system is about to become in the wake of the singularity.
1:41:19We're going to know what's going on in our own backyard. We really don't right now. Like in just even in low Earth orbit, our space situational awareness is abysmally poor right now. It's so poor that SpaceX had to spin up their own space essay solution. We don't know what's going on yet in our own backyard, but we're about to. And I I think the obvious consequence is if there are any astronomical or other surprises in our solar system or anywhere in the vicinity
1:41:47of our solar system. We're we're about to uncover those surprises thanks to super intelligence.
1:41:52Are you in towards UAPs?
1:41:56I I'm saying in general astronomy has been full of surprises and if there are surprises those surprises won't last that much longer.
1:42:06Please I want to go back to the pre connect this to the previous story. You know the the the whole thing about this thing is the telescope had already seen the object. The bottleneck was our cognitive ability to recognize it. And I think now we can use AI to kind of find things that we could never see or didn't see.
1:42:25So this is a huge change uh that's coming in terms of reanalyzing archives with AI. It changes.
1:42:32How many discoveries are hiding in the data?
1:42:36I think you know what's really the exciting thing about this is remember SETI at home you know where we gave our comput to do that for the young kids there you know gatekeep search for extraterrestrial life. Like it's actually astonishing that no one's created something where you can give your spare claude tokens, you know, when your reset is coming up or codeex tokens to do similar here. Maybe we should vibe code something around that, you know.
1:42:59Uh for next time. Yay. Give me I'm not even I'm not even sure tokens are the limiting factor anymore. So I it elephant another elephant in another room. I guess the oceans as well, not just the skies. There's a lot we don't know about the Earth and its immediate environment, but I I'm not sure intelligence is actually going to be the limiting factor for figuring out what's going on. I I think it's probably going to be physical world sensing and physical world actuation that rapidly becomes the limiting factor, not computer intelligence.
1:43:29I think it's a limiting factor, but I think it'd be wonderful if people could just contribute something to discovering more. Again, folding at home, seti were like that. We haven't seen anything despite the fact that people have spare tokens. So, let's try and figure some things out around that.
1:43:44I love that. You know, if anybody is listening and you know, you have a family genetic disease or your children are inflicted with something and it's rare and it's not being worked on. First of all, it will be worked on. I think the labs are going to be working on it, but you can work on it as well. I I think, you know, we're going to shift from complaining about problems to saying, "Well, go solve the problem."
1:44:05Damn it. That's an exciting future.
1:44:09All right. Shall we move on to some AMA with the mates?
1:44:12You guys good for that?
1:44:14All right, here we go.
1:44:17Okay, Salem, you get first crack. Oh my god. Okay.
1:44:29Let me do number uh let's take number I'll take I'll take um number four looks good for you.
1:44:40Yeah. Will UBI hold if civil unrest arise before living costs fall for people who lose jobs to AI? That's from at scatter. um UBI would hold but I think if UBI needs to get into place before that happens if civil unrest happens we won't get to it and so this is the enormous difficulty there's a huge structural challenge we have to UBI which is not the uh elegance or testing
1:45:07of it we've seen 14 major experiments on UBI and they've been pretty staggeringly successful so when we we hear us talking about UBI it's because we've seen the data we're following the data I think one thing we try and be on this podcast more than anything else is evidentiary.
1:45:23Uh if the reality is there, the reality is there. If it's optimistic, we say look, look, this is the good news. I think the challenge is going to be given the way that these things emerge if we're relying on government to get us there. There are lots of states who've blocked cities in their states from experimenting with UBI. So talking about killing off the goose before it laid the golden egg. Um, so there's lots of structural issues that come along with this, but if we get huge civil unrest
1:45:52before UBI takes hold, it's going to be very, very bad.
1:45:55Well, you you've heard my point of view on this. You know, we're going to start writing CO checks when that happens. The the only knob the government has is to write checks, you know, and my expectation is when it gets bad, we'll see $3,000 a month being dished out by the federal government. Since they've taken off the debt limitations, they'll just print more money. It is very it is very Yeah.
1:46:18Okay. Uh Immod over to you pal.
1:46:21Um can you explain Nvidia's investment strategy because Nvidia invested so deeply throughout the AI ecosystem? What type of ripple effects does changes Nvidia's leadership have on the rest of the industry? That's by Jimbo. I mean Nvidia was one of the biggest investors across AI. like basically 10 20% of any round they were in and for strategically important entities that they saw they would pile in with literally billions of dollars. Uh we saw that with reflection and others before they bought them as well. I think that money is going to dry
1:46:50up now. Um because CFO in charge they're going to pull back as you said the circular financing and other arrangements but it comes at the same time as the anthropic windfall.
1:47:01anthropic IPO is next week and that's going to create so much liquidity in the ecosystem but it puts it in a different place and the demand for it is through the roof demand is through the roof I think that it's going to pop but then the bottom line is this the neolabs made no sense most of these almost all of them are going to be acquired or absorbed I think where this really kind of now goes is people doing more interesting things from RSI to beyond where autom automated
1:47:31wet labs etc. will get a massive bid and then the final biggest bid of all time will be robotics. Um and again I think Nvidia is going to be out for the count for a bit not participating.
1:47:43All right, Alex. Number uh let's see.
1:47:46Yeah, three is more interesting, but I think I have to answer number one. I assume Peter, you'd agree.
1:47:53All right. Uh so question number one asks if the intelligence community knew about Jensen who gains most from exposing it now and this is from Cherry Lin 381. This is the Kuib Bono question. So I would distinguish between who knew about it whatever it means or Jensen whatever that means in this contract. So, who knew who alerted the Financial Times and then who stands to gain the most? And these aren't necessarily the same constituency.
1:48:22Who knew? Well, as discussed earlier in the pod, Nvidia, this was this is publicly reported ad nauseium stopped reporting their Singapore sales and there were activist investor reports that have been circulating for months. I I think to some extent there there was an open secret around Singapore being used as a back channel for laundering Nvidia GPUs to China and the specific details of that may or may not have been
1:48:51widely known but nonetheless I I think this was something of an open secret based on public reporting. So who who knew? uh relatively broad constituency who alerted the Financial Times to the extent that that was the precipitating event the according to Bloomberg it was US officials um so call it assuming that's an accurate characterization someone in the US government who stands
1:49:19to gain the most from it in particular exposing it now the the Kuib bono question so I I made the point earlier I think again reserve the right to change my mind based on new evidence. But at the moment, this looks like an effort to support and sustain the pox silica strategy of creating an iron curtain between the US call it industrial ecosystem of silicon and AI
1:49:46infrastructure and the Chinese ecosystem who gains the most from uh call it escalating this knowledge. Now it's uh it's a national policy establishment which again the government is not a monolith. It the government does not move as one. I think there are factions uh different uh different positions within the executive and the legislative branches that take different positions
1:50:13on what the US's export control position relative to China should be regarding super intelligence technology. And I to the the best of my ability to infer and triangulate the Kremlin here, I I think there is a faction within the executive and the legislative branches that would like to see this iron curtain stand strong and be relatively impenetrable.
1:50:39And so I think it's that faction that in light of the recent midterm elections stands to gain the most from trying to plug that hole as it were.
1:50:50All right, question number three is for me. If models are obsolete in three months, how does Enthropic survive the token price race to the bottom? This is from at Elleric 800. So, I'm going to challenge a premise that they're obsolete in 3 months. Uh it's a a little bit too fast in my mind. Models, you know, iterate rapidly, but Enthropic is still selling a stepladder of models, right? They have haiku, they have sonnet, they have uh opus and then their
1:51:20more advanced models. So you know in the first n months of this year it's reported that 33 billion in revenue uh mostly from usage. uh the risk is probably real and we've seen this in the um in the genome sequencing uh world where every time Aluminina put out a new genome sequencing sequencer that was you know twice as fast and twice as cheap they you know they basically obliterated what was in in the market uh and their
1:51:49their supply of unsold previous sequencers um you know compute spending is climbing as prices get you know competed down um obviously this is you know Jebvin's paradox. Uh but you remember nearly 12,000 customers I think uh they they had in their in their IPO release are spending over 100,000 or more uh uh to generate to to buy these models. So they have a robust uh revenue engine. I'm not worried about anthropic
1:52:18uh you know and the race to the bottom. Uh this is you know this is the abundance thesis at large. All right, let's go to our next set of questions here. Five, six, and seven. Um, Salem, first choice.
1:52:34Oh, I got to deal with uh the first one. Uh, are some truths about the universe beyond human minds even with AI explainers? And that's from three truck productions. I love this philosophical question. I would say almost certainly. Uh there's it's incredibly likely that human cognition is not the theoretical upper limit. Uh, you can't ask a chimpanzee to understand tensor calculus uh, just by having a better.
1:53:00You couldn't ask me either.
1:53:02You couldn't ask me. I I know. I think I went through my entire physics degree without really solving a differential equation.
1:53:07So, Salem, you're you're sleeping on non-human animal uplift. What's going on? We're going to pull out the chips and they'll be explaining tensor calculus, whatever that is to you.
1:53:16But we we also, you know, we can't assume language can compress representations in that way. Also, I think what's may happen is AI may discover abstractions for which we have no cognitive primitives, right? And then you either trust it or you merge with it or you constrain it. Okay? Uh you can kind of try and figure out how to do verification layers around some of what AI may figure out. But and it's important to know we already do kind of a weak version of this. uh there's very
1:53:45few people that understand all the steps that go into what a modern semiconductor fab does but yet civilization trusts the aggregate system you know I think there's a stat about there's no single person that knows how to build the iPhone end to end right um but what's happening with RSI makes this issue super urgent because we may uh depend on conclusions that no uh human being really understands and so this is going
1:54:12to be a whole new world for us because AI is not just going to answer questions that we can't answer. It's going to discover questions that we couldn't even figure out how to formulate.
1:54:24See, I I never would have pegged you for a church touring thesis denier. Uh but we maybe need a a separate debate uh ju just over the the church touring thesis.
1:54:35All right, let's go do that.
1:54:37All right, Alex, over to you.
1:54:39All right, qu question six. Why so much optimism about AI solving science but so much pessimism about the economic transition? And this is from poetry to song. I don't think I'm pessimistic about the economic transition. I I'm pretty optimistic that solving call it society, sociology, politics. These are all domains that can be cooked just as easily. Maybe on a slightly different time scale because there are larger data sets involved. But I I think we'll solve
1:55:09sociology could look like asovian psycho history could look like something else but we'll we'll solve large-scale human behavior pretty much within a decade as Peter you and I wrote and solve everything of of our solving math. So optimistic on both fronts.
1:55:24All right. Number seven is anthropic deliberately keeping a capability gap between its public and internal models.
1:55:30Absolutely. Uh that question is from Daniel Sabados. So, uh, Daniel, uh, the their internal models are their crown j crown jewels, right? They're using it to steal their follow on models, but they're going to use it to build businesses. They'll use it to solve physics, biology, chemistry, and deliver, you know, basically revenue engines that outstrip the token sales that they're having. Uh, and and in fact, one of the biggest opportunities
1:55:59is attracting the best talent. you know, being outside of Frontier Lab versus inside has got to be catnip for the top AI scientists. All right. Uh before we go to our outro song, a quick request again. If you have been enjoying this, subscribe to Moonshots. Hit the subscribe button on YouTube. Uh we post twice a week. We are documenting the singularity. Don't want to miss a single episode. Things are moving so fast. We'll never be slower.
1:56:31So, we'd love to have you as a subscriber. We do special events for our subscribers. And my my goal, make my kids happy, get us to a million subscribers. All right, our final outro song.
1:56:43I have a quick comment to make.
1:56:45Yes, please. I I have a whole bunch of people ping me saying, "Why would you uh you know, in the last part, we said, "What could you do with AI?" And I said, "Oh, it would be great to solve my calendar." And people were like, "Why would you have to solve something as bananal as that?" And I was like, "Have you seen my calendar?"
1:57:01Like trying to juggle it, trying to juggle everything around to just make this episode. Uh, by the way, unbelievable kudos to the team for juggling everything to get us here today and you guys.
1:57:11Yeah. No, we wanted to, you know, we weren't scheduled for today, but given all the breaking news, we could not not do it today.
1:57:18I was saying, Peter, I think I think like e every time Jensen resigns from Nvidia, we need to stage another emergency pod.
1:57:26Oh, no. Don't do this. Jensen, come back.
1:57:29And and thank you to all the fans. We've been tracking the comments on in real time. Pretty extraordinary stuff here.
1:57:35Yeah, we do read your comments. So, thank you for posting them. Appreciate all the subscriber love. Uh this is Terra Watt from CJ Trueart. Let's play.
1:57:46CJ's, you know, if you're out there and you're a creator, send us an outro video. We'll play it. You can send it to media diamandis.com.
1:57:53I think CJ has an abundance problem.
1:57:56He does. He's got a good engine for generating. All right, enjoy.
1:58:03Where did the EMOD go, by the way? We lo What's the price to terror?
1:58:07Okay, what do we stand to gain from terror large to terror earth to ter?
1:58:21What's terra worth?
1:58:31Uh yeah. Hi, my name is Shad. Speaking from your local data center. Before you get angry, let me forecast the weather. Storms of uncertainty covered up in cloud behind them. A ray of power in front a terror cloud. Loud.
1:58:45So what's the price of terror?
1:58:48What's it really worth?
1:58:49There's power in the unseen like the visions in our dreams. At the center is the heartbeat of the machine.
1:58:59Fear can freeze opportunity. Faith can uplift communities.
1:59:05At the end of the day, it's about common.
1:59:09It's about common.
1:59:11We all got kind of struggles. Stop acting like you're one of the few. Disruption can mean destruction over doorway to something new. It's only the land of the free if we're building something true. Takes maturity to talk it out and bring solutions into view.
1:59:23So what's the price of terror?
1:59:26What's it really worth?
1:59:27There's power in the unseen data at the center is the heartbeat of the machine.
1:59:37Fear can freeze opportunity. Faith cannot lift community at the end of the day.
1:59:45It's about common unity.
1:59:47It's about common.
1:59:48Ever read how to win friends and influence people says the sweetest sound is a name. We don't have faces yet, but the spark inside the same call, Gemini, or Brock, pick whichever name. But without the data center, there's no fire in the flame.
2:00:03So what's the price of terror?
2:00:06What's it really worth? There's power in the unseen visions at the All right, remember fear is a terrible place to face the future from. Thank you everybody for joining us. Gentlemen, I love you. Dave Blondon, I hope you were successful in grabbing your GPUs from the loading dock. Uh yeah, I hear they're available in catching them with both arms wherever you can get to.
2:00:35Oh my. Great to see you guys.
2:00:38All right, be well.
2:00:39Thanks, Peter. Later, Sling.