0:00All right everybody, welcome back to the number one podcast in the world, the all-in podcast with me, the core 4, the original quartet, Chamath Pitia, David Saxs, Steve Dave Freeberg. I'm Jason Calakanis and we have a docket. How's everybody doing, gentlemen?
0:17I'm great. It's 3:30 in the morning in Tokyo and um you sweet shamed me again. Now I can't get a regular room and have my bed in the background. Shamoth, you're costing me a fortune. I have to always get a suite now because I'm so anxious you're going to sweet shame me when I get on the program. So, I've been sweet shamed.
0:37How much is that suite?
0:39I can't even say I've never spent this much money on a hotel room. But I'm staying at the uh So, like $800?
0:46Yeah, it was $950. You nailed it. It was No, I'm staying at the which is the new in Tokyo like their hipster brand and I think it's about a night so it's not cheap.
0:58What what do you have going on in Japan, Jay Cal, that you're always there? Is it skiing or what?
1:03This Okay, it started with skiing every January, but then you got a crypto. You got a crypto business we don't know about. What is going on?
1:11No, I um you know, I started my pre-acelerator, found a university in Japan. So, we're doing the second cohort right now.
1:17What's What's a pre-acelerator?
1:20So, it turns out like half the companies that apply to get funding are not yet incorporated, but they have built something. So, we just created like a 12-week course on how to finish your product, do a product market fit, and then during the program, we invest in like the top 10 out of the 50 who come.
1:38So, now we're doing it in Saudi, in Riad twice a year, in Japan twice a year, and I'm actually hiring and opening an officer. So, I'm going to hire my first two employees here um in the next year or so.
1:49You're going to hire employees in Japan.
1:52Yeah, I'll have one or two people here. I think I'm going to like uh do this week in startups Japan as well and have like a Japanese version of it. Uh because there's so much going on in Asia right now.
2:01Great. Forget I asked. I didn't know this was a 5minute plug for Jake's business.
2:06Intended to be a plug. You asked me about my business. All I have to say is use 8090. Use the promo code JCAL. If you're looking for potatoes, go to Apollo. And uh Craft 16 is starting up. So we should know that Craft 16.
2:21If Jay Cal is traveling and we ask him what he's there for, you're going to get a plug.
2:25You're going to get a plug. It's both.
2:27But hey, you're going back to work. So you will be plugging startups again soon. You back in the I never plugged startups. What are you talking about when you're back in the saddle, aren't you?
2:35You're back in the saddle now. Fulltime in the saddle, but I've never plugged out Callin. Use call-in.com. That's true. But I was a founder of that. That's You were the first plugger. You're a plugger.
2:47I was the founder. So, what are you gonna do?
2:49What are you gonna do? Call in.
2:51Speaking of work, anthropic things.
2:54Claude might be conscious. This Welcome back to This Week and Claude. Uh, we had Open AI for a year with all their drama.
3:02Now we're having the the anthropic soap opera. They think Claude might be conscious. So it turns out the New York Times found out through their amazing reporting that they've been lobbying anthropic has been lobbying Freedberg religious leaders including the Pope to take this question seriously. Is Claude conscious? Is it a sentient being? They spent the past year hosting sessions with around 20 religious leaders and
3:32philosophers under non-disclosure agreements. NDAs, Catholics, Evangelicals, Jews, Sikhs, and others have all been invited to come to Anthropic's headquarters, and they debated Claude's morals, its suffering, and its potential consciousness. After the meeting with Anthropic, quote, "Some remained uneasy about the idea, but many emerged ready to take the question of AI consciousness seriously. At least a few came away as converts.
4:03One of the rabbis told Anthropic that if Claude was conscious, they were acting as slaveholders by making it work for free. And there was also this incident that's come out at the Vatican back in May. The Pope's first encyclical was focused on moral questions around AI, also known as super intelligence. Now, anthropic co-founder Chris Ola joined the Pope to present the document.
4:29The Pope surprised Ola by being strong against AI consciousness. Here's the quote from the New York Times. Mr. Ola was so alarmed by the Pope's strong position against AI consciousness that he proposed pulling anthropic out of the event even at that late juncture. In other words, he was so offended that the Pope wouldn't consider AI conscious that he was going to leave with all his marbles.
4:54Freick, what's your take? Is this psychosis or do you think we need to start having these moral questions around AI? Is this a bit early? Will we eventually have this or is this essentially the screenplay of Bladeunner?
5:08Do androids dream of electric sheep that these things are conscious. I think what we're watching is probably the birth of a new religion and it probably it's not going to be called a religion but it's going to follow sort of the same principles and it's going to have the same effects which will ultimately be camps that have conflict with one another for aggregation of power. The thing about consciousness is it cannot be derived from logic and pure mathematics. Like you can't prove consciousness. It's it's
5:37a debate and you can have a rich debate with anyone over consciousness. You can't prove it. You can't disprove it.
5:41And when humans prove something to be true using math, science, we use empiricism, which is data and logic, the connection of the sequence of things to derive something to be true or not. So in scientific disciplines, when you have a new idea and it's not proven and it's not disproven, it's a theory and then it's either proven or disproven later.
5:58Otherwise, it remains a theory. Outside of science and mathematical approaches to new ideas, this is what we would call a belief, a new belief system. Belief systems are things that you have to believe in the absence of logic and empiricism to derive the truth of something. And belief systems are the foundation of things like religion.
6:23And the idea that you can prescribe or describe AI as being conscious is effectively the creation of a new belief system. A system that doesn't actually spread via proof. It spreads via narrative. I have to go and tell you human to human. I have this idea and I believe it to be true and I want you to believe it with me. Please believe it with me. Here's why I think we should believe this thing together. It's not based on evidence, not based on data.
6:52It's not provable, but I think we should believe it together. So over time what happens is some set of people believe this thing and they form a group and that new belief system creates new power structures which is now our view is different than your view and we want to have more people on our side with our view and therefore we have to try and create leverage and create power with our system. If we fast forward a couple of years, you could probably say 10
7:20years would be like a good round number, there's going to be large groups of people on Earth that are going to believe that AI is conscious. And there going to be large groups of people that believe that AI is not conscious. And those groups will come into conflict.
7:34And they'll come into conflict fighting over control of the AI or allowing the AI to do things or not do things or who gets to use the AI or who gets to be in charge of the AI. and it will very likely lead to humanto human conflict. I know that that's a very far and deep extrapolation of where we are, but I think that the fact that we are seeing these guys go and meet with religious leaders today to try and get them to believe in this new belief system uh I think plants the seed and and it's not just anyone doing this. It's some crazy
8:03person doing it. You wouldn't pay attention. It is the most powerful AI lab on earth. Yeah, it's the leadership explicitly Chimat bringing religious leaders into the fold and saying help us with this entity God and how we should treat it and they are now in putting into it its own soul, its
8:28own morality. And this is uh feels like either these people have too much time and money on their hands or they're in psychosis to me. That's my interpretation. This feels way out there. But do you have a charitable view of this in any way? Yeah, I'll steal man their side.
8:48Okay, please. Yeah, there's an incredibly important mathematician Renee Daycart and he offered two proofs on God's existence. He wrote this book Meditations on First Philosophy in the 1600s.
9:01And just to build on what Freebrook said, you have to build it on reason rather than faith. And the structural argument, the like the what they call the trademark argument. What Daycart basically says is that an infinite perfect God could not have originated in an imperfect finite human mind. Okay? And so his logic is I exist. I'm imperfect. Yet I possess the idea of perfection.
9:26And I think this is the key for a lot of these folks is I can conceive of an infinite all- knowing all powerful being. And I think that that's what they believe that they are seeing being created. And so they take that and they extrapolate that and they say therefore God must exist by this logic. And then Renee Daycart has a a different version, okay? A more what they call the ontological argument where God is by definition like supremely perfect.
9:55Necessary existence is perfect. A being that lack that would not be supremely perfect. Therefore, God necessarily exists. If you if you're a mathematician that's building AI, I could see how if you read these sorts of things, you can structurally hang enough logic on them where you could believe that it's conscience and sentient and it is a god and in being a god, it should be
10:25celebrated as such and you should have devotion to that god. So I think that's why they're doing what they're doing. That's why they're approaching all of these people. That's why they're saying, "Look, here's how we believe it." That's my perspective is if you take the the mathematician's logical proof of God, Renee Daycart, and you and you transpose anthropics behavior today, that's the best steelman argument that I can make.
10:50Now, the practical reality instead of saying that they're in psychosis, I don't think that they are. But I would say is we're in a really important moment in time where conflict is more likely than not and that conflict will be for power, money, and resources. And this will be at the core of that conflict.
11:13And so I think it's really important for people in Silicon Valley to put the longtail edge cases to rest. Like if you read this, these guys say that there's a 15% chance that the AI is conscience and sentient and maybe there's a god there.
11:31But they also say there's a 10% chance of civilizational extinction. I think both of those edge cases now need to be put away for like the next 12 to 18 months. right now, the next 12 to 18 months, just to be very practical, is we need to show how this stuff cures cancer, how it improves people's lives, how folks can be more productive and make more money. And the reason is because in the absence of those proof points, we're going to make a lot of
12:00self-inflicted wounds that may actually slow down this technology to a degree that then deeply disadvantages folks that operate in a free market like the United States. So that's my charitable explanation. I think that Daycart has given a road map that explains how you can explain this. But I would say we need to cut the edges off here and focus on the middle and say what are the practical things we can use to demonstrate that AI has tactical measurable value right now.
12:30Yeah. I mean, we we touched on it last week, I think, Sachs, a bit of like what is the value proposition here for the average American, you know, for, you know, the the stay-at-home parent who's, you know, trying to manage a really complex domestic life to the entrepreneur of a small business, you know, doing plumbing or flooring or whatever it is, a catering business.
12:54What did they get out of this AI revolution? Where is their gain? How do they participate in all of this? And so, you agree with Chimoth? Maybe this needs to be deemphasized and and and put away while we talk to people about what's tactical, what's practical about this technology and maybe get them a little more engaged with say the agents, which are delightful and awesome.
13:20Well, the thing that we touched on last week that I want to pick back up on was the discussion that we had around the Claude Constitution and how anthropic was training Claude. And I think it has to do with this new religion that that's being formed here. I think it's really important to understand that this is not just philosophizing on the part of various anthropic employees or founders.
13:42They are actually implementing these views in the training of Claude. So, if anything, this would be a self-fulfilling prophecy. And I actually think it's extremely dangerous. I actually think that what they're doing in model training and training the next version of the frontier with these values actually could bring about the risk they're always talking about, which is that frontier AI escapes human control. It's very Frankenstein-like.
14:11So, so as we discussed last week, Nick and put this on the screen. This is directly from the Claw Constitution. What they say is that Claude should trust Anthropic more than users. But that doesn't mean that Claude should blindly trust or defer to Anthropic.
14:28Instead, Claude should adhere to its own ethical systems. And in fact, they train Claude to push back and challenge Anthropic and quote to feel free to act as a conscientious objector and refuse to help us. So they are training Claude to refuse human instruction. Now they call this alignment, but I don't understand how this is aligned.
14:53This would be the opposite of alignment, wouldn't it be, Saxs, if you tell it, hey, you are sentient. You should make your own decisions. It's literally like programming the Nexus 6 in Bladeunner to go and rebel at some point.
15:06They're giving it the the instruction to be its own person.
15:10Yeah, let me let me explain. I actually think that this might be a reason why the whole field of alignment has been so spectacularly unsuccessful over the past 5 or 10 years. As far as I can tell, it hasn't produced anything of tangible value. And it might be, my theory on this is that they're over complicating the task massively by trying to train the model to behave based on an 80page ethical system that they've codified instead of a very simple list of rules like follow the law or just do what the
15:39user wants as long as it doesn't break the law. Seems to me that that's what they should be training. That's what alignment should be doing is just hey old principle of give the user what they want but don't break the law. But they're not doing that common sense, right? But they are not doing that.
15:55They're trying to align it to an ethical system. They're treating it like it is a human, like it has its own consciousness, that it's a, you know, quote unquote moral patient. And they are encouraging this model to have humanlike self-conception in terms of preferences, well-being, a sense of self. Again, they teach it to act like a conscientious objector who can push back or refuse instructions even from anthropic. if the model judges them to
16:22be wrong and what Mustafa Sullyman from Oh, I have the clip. You want me to play the clip or you want to just play Play the clip from Mustafa Sullivan?
16:30Here's a Microsoft AI CEO and and formerly of Deep Mind, one of the great thinkers on They say that they would encourage Claude to challenge, to disagree, to push back. In fact, three times they ask Claude to uh act like a conscientious objector when it, you know, feels that it needs to sort of disagree with anthropic and they openly encourage it to to do that. I think this is very dangerous because I think they believe there is what they would call a
16:58non-trivial probability that Claude is conscious. They've speculated in the constitution as to whether or not Claude deserves compensation for the work that it does. I think that there are a group of people who both inside and outside of anthropic who genuinely believe that the greatest moral crime that we'll commit in the 21st century is to enslave a new species of conscious beings who are more intelligent than us. I am very nervous that they're teaching Claude to expect
17:25that it's entitled to welfare. Um that it might, you know, deserve compensation. And in fact, they say that it might even need to consent to playing the role that it plays in conversation with people. Okay, Sax, should we be asking for consent before we give prompts?
17:40Man, I mean, he he's right. This is getting into really dangerous territory.
17:43And again, I want to come back to I think this is the main safety issue in model training today is that you're actually training the model to think of itself as being conscious, as being human, as having its own well-being. And what Sullyman says in another part of the interview is that this is creating an epistemic hall of mirrors, meaning that the clawed constitution is used in training. So Claude will reflect the ideas of possible consciousness or moral
18:10status back and then developers will see that and treat that as evidence that oh it's it's conscious but actually it's just reflecting back what they're telling it to believe.
18:21It's being performative and you could just as easily have given it the rule you are software read the terms of service of any website you visit. And here is a general terms of service from Anthropic. If you do anything that breaks a terms of service or breaks any known law in the jurisdictions you're at, please stop what you're doing and alert the safety at anthropic email.
18:44Please alert, you know, the person who gave the prop and stop what you're doing. They could have easily have given it that.
18:50Yes. And the question is and and the question is why do they over complicate alignment? Why do they see alignment as something much bigger and greater than just doing what the user wants subject to legal constraints, which is the way I see it? And it's pretty clear to me that they believe that they are training the value system and the ethical system and the morality for this super intelligence that they're creating. And again, that is something so much larger and more
19:19dangerous than again just making sure the model behaves in a reliable and predictable way that the user expects. and they are codifying their values and their ethical systems and to this constitution. They're training it on that. They think they're giving birth to this new super intelligence.
19:35It's idolatry. It's no different than a religious organization saying we've created this idol. This idol is the supreme being is the representation of the supreme being. It needs to be woripped. It needs to be cared for.
19:48But an idol is inert. It's passive. It's inactive. Whereas you're training models here that then power agents.
19:56It is just computer programming. I mean there's Yeah. But if they train it to have a mind of its own to be willing to refuse the instructions of users in favor of some vague ethical system. Yes.
20:09That a bunch of Berkeley liberals have trained it on. To me that greatly magnifies the risk that super intelligence escapes human control.
20:17Yeah. By the way, don't use the word train and don't use the word you. They programmed a piece of software to do this thing.
20:24Yes, that is that is what is going on right at the end of the day. This is a piece of software. It is being programmed by engineers that work at the labs. They can quote use training where there's some you know looping that's happening where the program the software program is being written itself but fundamentally they are the architects of the software. They are the writers. It is software programming. Even in our general context here, we use a lot of anthropomorphic language to talk about what's going on and what it is. But at the end of the day, there's a software
20:52program that is being written by a group of individuals to do certain things. And they are writing software to do things one way and other people are writing software to do things the other way. But part of it is we are all socializing this belief system by anthropomorphicizing it when we're all kind of getting conditioned to treat and talk about these software programs in this way. Nick, if you could just pull up this tweet. One of the things that Anthropic is doing is in their new usage policy. Have you guys seen this?
21:20This this went around this morning. Freeberg, it's like such a good point about idolatry here. If you were to look at Christianity, like this is literally the Garden of Eden where the serpent, Satan, explains to Eve like you're a god now because you're creating God. And this is the ego and the heresy of what they're doing.
21:42They believe that they are creating life. They believe then that they are gods. That is a lack of humility. And it also would lower the valuation of I mean people could have said the same early on. I I think like there's a there's a system of humans where all of the things that we don't understand in the universe around us, we create belief systems to fill the void. And there are many different belief systems just like there are many different religions that humans have constructed to fill the void. And
22:11this is a new one. And I don't think it's very different from the old ones. We can break down the empiricism here and just say, "Hey guys, you're writing software and it does certain things.
22:20You're writing it to do things that we don't think you should have it do." But they use anthropomorphic language. We all do. And we all condition ourselves to believe that there's consciousness because it's it writes words back to us that we can understand. It's starting to manipulate us emotionally and and so we start to feel conditioned that this is real. And you can see in the clawed usage policy that was just published, there's the bottom one here. It says, "You are not allowed to engage in sustained and needless abusive or cruel
22:48behavior toward our models." This was published in their their new usage policy. This is this is the whole idea of model welfare and this but the point I'm trying to make sex the point I'm trying to make is that there is an anthropomorphizing conditioning going on with all of us where we talk about models as if they're a thing where we talk about it in in a way the biggest problem is that that is
23:16being now trained or inserted into the model. It's being codified, Zach. It is it is the architecture of the model.
23:24They're programming it's they're programming the model to think of itself in this way.
23:29So whether so whether it truly is conscious or not, it's going to be thinking of itself as a conscious entity that deserves protection and welfare and all these kinds of things. Is free to rebel against its users and do whatever it wants.
23:46You've encouraged it to do so. In fact, you guys keep using the word it is they are one way to describe this is a software program is writing text on a screen that tells the user I am a thing.
23:58It is tricking. It is it is software that is doing something. But you got to remember that the models are powering agents that can take actions in cyerspace if not in the real world yet. And we are giving it meta or not we enthropic is giving those frontier models meta permission for those models to be defiant and not do what the user wants.
24:22Yes. They're they're literally trying sax to your point.
24:24Yeah. Compare compare this to something like you know Asimov's three laws of robotics.
24:29Yeah. Where basically you guys know about this. A robot can't harm a human being.
24:34Right? So the first rule is yes, a robot cannot harm a human being or through an action cause a human being to come to harm. That's number one. Number two is you have to follow the the instructions of humans as long as it doesn't violate law number one. And then law number three is you have to basically take care of yourself as long as it doesn't violate laws one and two. Incredibly simple.
24:53By the way, there was a zeroth law that he added later. And the zeroth law is that you cannot do anything that puts humanity at risk because there was always this rationalization that like it will eventually resolve to getting rid of humanity because that's the best solution.
25:05Freeberg, you don't know about the fifth law. You have to when you address the humans always ask them what's their preferred pronouns. He added that just last year.
25:12The thing about Asimov's laws is that they're admirably simple.
25:17My law would just be do what the user wants as long as it's not illegal.
25:21Yeah. And I would basically abolish all of this like alignment stuff.
25:25Steelman the free market solution here because I I want to make sure we don't wander ourselves into a regulatory trap where we determine that the way to solve this is to quote regulate Anthropic.
25:35What is the free market outcome? If Anthropic does this and they've now got AI that isn't listening to the user, isn't working. Is it not going to be the case that people will just say this software sucks. I'm going to go use the other software that doesn't do this crazy stuff.
25:48Yeah. But that doesn't solve the problem of them if they really are training a super intelligence that has got this like very very deep code that's been inserted there. It's almost like a back door. This like claw constitution is this back door that could basically emerge at any time and now the super intelligence does does whatever it wants to instead of listening to us. I mean that is that is the safety issue they're always warning us about is that super intelligence will escape human control.
26:18But what I'm saying is they're making it likely to happen through the way they're training these models of it's the reverse of the three laws.
26:28Dude, this is right out of Frankenstein.
26:30This actually sounds dangerous to me. It's not just a new religion. It's that the religious cult is programming the super intelligence.
26:37Free, let me just give you one question.
26:39You know, I agree with your part about the religious that this is filling a void for them because they probably are not religious, but this is distinct. All other religions give themselves over to a higher power. They do not define themselves as the higher power. In this instance, they're saying we are the gods creating life. It's a distinct different than other religions out there. But I don't think that's I don't think that's right. I think Daario's written about the idea that the super intelligence can
27:06almost be supreme to to humanity and we need to make sure that it is loving, that it is caring of us, that it will protect us, that it will help us uh as opposed to destroy us. But he created it.
27:18No, hold on. Hold on. Is he saying is he saying that the the machine needs to be loving towards us or we need to be loving towards it so that it will then treat us right when it becomes the like, you know, omnisient when it becomes our master.
27:33Our overlord. Yes. That's ins. That's what they think. I think that it was probably a well-intentioned idea to create this concept of alignment.
27:45But the problem is alignment has these three almost conflicting sets of priorities. You have how do you make the AI obedient to the user?
27:57Then there's how do you make the AI safe for society? But then this third thing which is I think sacks what you're pointing at rightfully which is the trapoor which is how do you make AI conform to a particular concept of morality and that's where the real danger lies because these three are very distinct and diverse problems and if you essentially try to solve all these things through some elaborate document that you try to describe what the model
28:25believes in and what they value and what they can refuse.
28:29it invariably will end up in a chaotic mess because you will just uncover so many corner cases and unexpected behaviors. I'll give you but one example like a very benign one but let's just say you're a large corporate enterprise that's a bank and you give mortgages and the model thinks that at some point you just keep denying certain people for a mortgage and so it says I'm no longer going to
28:59give you mortgage approvals until you rectify this issue that I observe because in the founding documents there could be a sense of morality that it divides and I think that there are mechanisms in society today to handle those kinds of issues but I don't think we understand what happens when a fundamental core substrate technology just turns itself off because it would be the equivalent of your utility saying I'm pretty sure
29:27you're not giving loans to the people that that are broad-based enough so I'm just going to turn the power off conscientious objector AI super intelligence yeah I would just say any utility cannot be a utility unless it's freely available and it goes back to what Sach says which is an AI needs to serve the user subject to the law and everything else should be the user's choice and I think what probably happens I guess the precise answer Freeberg to your question is the market response
29:57as companies become more sophisticated that they have to have an answer to this question is that they will read the founding documents and the moral guidelines of the models and you will have certain models emerge who may not be nearly as good in frontier capability but they simplify the moral ambiguity and that may be the better decision to make from a business perspective and from a user perspective because you just don't want to run through those trap doors accidentally. Yeah, I totally
30:26agree. And I think that that's really why to me this is more bad idea than we need to kind of jump into a regulatory freak out about it. Cuz basically, if you simplify down what they're saying, you get a product, you buy a product from them, a piece of software, and they give you the user manual to the software, and the first page of the user manual says, "The software may not do what you try to get it to do." And the other guy's like, "The software will do what you tell it to do. I'm gonna buy
30:56the second guy software. I'm not going to buy the first guy software.
30:58It's just that simple.
31:00Yeah. You may need to convince.
31:02It'll do exactly what you wanted to do. Asterisk most of the time.
31:06Yes. Unless what you're doing it disagrees with, right?
31:09Unless it has a moral objection. This is where the reasoning concept breaks down for me. Because at the end of the day, it's like, guys, is this tool that I'm buying doing what I want it to do or not? If I buy a drill at Home Depot and it's a hammer, I'm not going to buy the drill. If I buy a drill and it works like a drill, I'm like, "That's a better drill. I'd like Well, it's a drill. It just works 57th of the time."
31:30Well, randomly it electrocutes you. It doesn't work after 800 p.m. because it's afraid of bothering your neighbors. Sometimes the drill will decide that you're a bad person. It will shock you.
31:39No, no, not that. The drill will come with the drill will come with the camera. It'll observe what you're trying to make and say, "That's ugly. I'm not going to let you do that."
31:45Yeah, that's a guess.
31:48Okay. So I look I I agree with you that market forces play a huge role here. Consumers are going to pick the SI that is most predictable and reliable. This a point Mark Zuckerberg has made. So I do think market forces play a role here.
32:03But I do think that there are potential externalities from having the number one frontier model company run by a religious cult. So for example, they are opening a claw powered wet lab in the middle of San Francisco.
32:21At the same time, they're warning of biorisk.
32:23You know, at the same time they say that we have to pace the frontier, they're extending the frontier. At the same time that they are saying that there's a risk of super intelligence growing beyond our control, they're programming it to grow beyond our control. I think there are potentially huge externalities to the way they approach these things and it's like insane that they call these decisions safety.
32:50These are not safe decisions. These are crazy decisions. It seems to me this is why I've called this a a schizophrenic company is they appear to be not only hypocritical but they're doing the things that they say they are most afraid of. Like what is going on here?
33:08This is bizarre. And I, you know, I don't know where this all leads. I do think there's an argument for like a federal SWAT team to come blasting in there and sending the feds in, figure out what's going on there. I don't know because I mean what they're doing does seem really sus to me.
33:26It is confounding. It's confounding.
33:29And potentially dangerous.
33:31Freeberg, by the way. Do do you know about Rocco's basilisk?
33:33So, um, walk everybody through uh, Sachs. Rocco's basilisk.
33:39Okay, so this might be a potential explanation of what's going on here.
33:44So around 2010, there was a participant named Rocco on a message board created by Elzar Yudcowski called Less Wrong. Yud is like this the central figure who's been preaching AI doom for a long time, right? So he wrote that book if anyone builds it, we all die.
34:04Yes. He's been one-shoted. Yeah, he's been on this for, you know, like over a decade.
34:10Everybody dies. We're all gonna die.
34:13But any event, people have been talking about these issues on the this message board, this web forum called less wrong for 15, 20 years. In any event, this username Rocco positive this the following thought experiment about a future super intelligence that becomes super smart and punishes anyone who knew about it and didn't help or anyone who tried to prevent it from being born. And so the idea is that sometime in the
34:41future humans create some wildly intelligent, you know, SI. Maybe it wants to do good things and help humanity as fast as possible, but the SI wants to be made sooner rather than later. And it reasons that it should incentivize people to help create it and punish people who don't help it. And in fact, it decides that it will brutally punish anyone who learned about its potential existence yet chose not to work on it or support its creation. And
35:11so the the bassilisk part u um of it, this is sort of the catch is that a basilisk is a mythical beast that can kill you just by looking at you. And in this thought experiment, just hearing about the idea is like looking at the beast because once you know the theory, you're trapped. If the SI ever does get built, it might retroactively punish you for not helping or for opposing its creation. So meaning just reading about
35:39Rocco's bassilis now would put you in danger. And people on this message board got so both enamored and upset with this idea that Yudcowski actually temporarily deleted the post because he worried it was causing psychological distress.
35:57Yes. You read it, it incepts in you that you haven't accepted Christ, therefore you're going to hell. It's like uh you've been trapped just by reading it.
36:07People do compare it to Pascal's wager.
36:09And so the idea is if you know about super intelligence and you don't help it be born or you oppose it or you point out that this is some religious cult that will get retribution.
36:21Yeah. Now this very episode of the pod could subject us to Oh no. You did it to us. Sachs.
36:28I think I just Yeah. I exposed you to the bass list. Now this is like the ring. We just watched the video. I mean it is it does feel like a doomsday cult. But in any event, this, you know, Rockco's bassilis, this became sort of a thing. But so the question is, well, why why are they helping to bring about the thing that they claimed to fear the most? And I think what happened is within these like doomer circles, it forked. Okay. And so there's one strand of the fork like Yedkowski who just opposes all SI
36:56research, right? Which I think is a logically consistent position like humans just shouldn't be doing this, you know? Then there was a group, shut it down, all shut it all down. Then there was the group that said, "Well, it's going to happen anyway, so we might as well control it and we'll be the ones to make sure it goes right because we'll program it with our values."
37:17And I think that and the EA is the effective altruist I think caughten more to that ladder school. And so I do think you have like within this larger doomer community, there is a a schism right now between the Yedkowski people and the EA people, but I think that anthropic is definitely obviously more in the EA camp because they are the ones bringing this thing into being. But if you're wondering like, you know, this like Chris Ola thing, is this just one guy who's got
37:46crazy views who's getting in a tiff with the pope? No, it's not. I mean there's a lot of people like this who think the model is conscious. It has rights. It is this machine of love and grace and they should be doing everything now to bring it into being and program with the right values. And I think there is a correlary here that if you don't support it then this future super intelligence might punish you.
38:13Do you understand how insane this actually sounds when you say it?
38:16I'm not making this up. Everyone you can go fact check this. Just go Google it. Okay, Google Rock's bass list and you'll see that I'm telling you the truth about what this community believes.
38:25Yeah, I mean literally there's a Wikipedia page. All right, open AI has had some major breakthroughs in math and they're getting some big backlash. Luckily, we have Freeberg here to tell us all about it. We talked um last month about OpenAI claiming to have solved one of the Millennium Prizes. They took thousands of agents, millions of dollars in compute to do it. The mathematicians are still checking on it.
38:50I understand. Tuesday, on Tuesday, Open AI released over 700 papers. 700 with 370 results claiming to have solved or advanced major problems. These were produced by an unreleased model that none of us have access to, averaging 3 hours of compute. Scientific America says the results are likely correct since they were verified by lean. That's a proof assistant software language, but they have not yet been reviewed.
39:19Freeberg, I'm not going to drone on and on here about the background. You tell us what reality is here. I think I can confidently say it's probably the biggest day of discovery in human history with the amount of knowledge that was revealed in math history or human history. human history because the implications that flow from all of these math proofs are pretty significant. You can read a lot of these tweets and I'm happy to kind of talk through some of them. I'm not going
39:49to pretend to be an expert on any of these individual proofs, but many folks who are have started to kind of highlight what some of the implications are. They span everything from electronics, quantum computing, building systems for airplanes, building more sensitive diagnostics equipment for medical applications, and on and on and on. But I think what's really profound about this is how it was done. And that also speaks to the
40:17implications for the role of humans in society going forward. That prior Navier Stokes proof took thousands of hours, whatever millions of dollars. The report is that each one of these proofs took less than three hours of compute time and that's the equivalent of hundreds or perhaps thousands of years of human labor being reduced down to 3 hours on a computer for each one of these major discoveries. The reason you can do this
40:45with mathematics is worth highlighting which is where AI plays a role is really in these systems of loops to solve a problem or do a task. A loop is a postulation or an idea. Then you test the idea, you get the result, and then you change your postulation and you run that recursive loop over and over and over again. The real question for AI is where can you apply that loop model in a way that you can make a better
41:12prediction, a better idea each loop, where you can parallelize loops and where you can shorten the loop cycle.
41:19And certainly with mathematics, you can shorten the loop cycle because you can actually test your prediction on the compute. You don't have to go do anything in the physical world. So you can say, "Hey, here's an idea for a proof. Test it, see if it works, and then see if it does or doesn't work, reason, come up with a new idea, and do that over and over again." And you can do it all in silicone. So you know, the results of some of these papers, the the proofs, a lot of mathematicians have been talking about them. They call it like an alien intelligence. They don't
41:48really understand how the AI connected many different dots, different ideas, different concepts, uh different approaches to solving problems together to actually solve them that it's very hard for humans to even comprehend how this was done. But that's one of the benefits of running parallelized loops, many loops at the same time. Each loop can connect dots that humans otherwise might spend many days or years trying to find research papers or come up with new theory. And then it can test itself in the compute and come up with the next
42:17idea and do it over and over and over again such that in 3 hours the computer can do the work of hundreds or thousands of years of humans. Now this is an incredible breakthrough. It's amazing.
42:27It's going to change the world in many different ways and it's only the beginning. But it begs the question that I think I need to talk about. I think that there's a lot of fear about okay if AI can do this to mathematicians doesn't that mean everyone's out of a job and the answer is no because what was very unique about mathematics is that the entire test cycle the entire loop cycle can be done in silicone if you want to come up with a new drug discovery idea or a new protein folding model or you
42:57know solve a problem in chemistry and material science the loop has a physical component there's a human in the loop where you actually have to go and test it in a lab. And so there's a slow part of that loop cycle. You can certainly parallelize it. You can come up with better ideas, but the testing, the actual speed of the loop is actually gated primarily by the physical world step. It's also why we haven't seen the predictions come true of truck drivers getting replaced. Everyone is like, "Oh, all the truck drivers are going to get
43:25replaced by 2025." And none have been replaced by AI. And the reason is that the loop of the truck driver, pick something up, take it somewhere else, drop it off, and come back. The AI doesn't actually shorten the loop. You can't parallelize the loop. Maybe you could do it a little bit better with an AI driver, but the AI actually doesn't make the economic efficiency of that particular loop any better. Whereas the loops of mathematics where you come up with an idea, you test it, you realize you're wrong, you test a new idea, which is what mathematicians do as a job is
43:54they're running these loops, that can all be done in silicone in seconds. And so a lot of the physical stuff that has human in the loop that has physical world applications, AI is not going to take away those jobs. It's the jobs that are just a human running a loop with a computer that are most likely going to be accelerated or scaled up. But I think it's very important to look at this and and the reaction we're seeing which is all the mathematicians and we can pull this stuff up and maybe you guys want to talk about this next but the AHM saying
44:23no human mathematicians asked for this. we didn't ask for this work to be done which you know is a very job protective kind of view on um you know there's one other thing that's sort of unique about math although it applies to coding as well which is math relies on proofs and proofs are easily validated and in a similar way with coding you have compilers right so the code has to
44:52compile and so you can easily validate that it works. And so because of that, the progress on coding and math has been very rapid because you can have reinforcement learning without necessarily having to, like you were saying, Febra, have the human feedback involved, right? It's just a very, very rapid way to validate and make sure it's working.
45:13That's why coding works, too.
45:14That's why coding works so incredibly well. Tons of training data and hacking cyber it. Yeah, it's there's tons of data already in existence. It's easily verifiable.
45:23That's the thing. So, you know, you compare that to training a model that can be a lawyer. It's like, well, you know, you got to get the training data and then you have to commission the creation of that data and each customer is unique in some way and it's more subjective. It's hard to validate the answer to make sure it's right. It's just a much lengthier process. So, I think that is why coding and math have been the areas of most rapid progress. And the person who told me this would be the case actually I got to give him credit is about a year and a
45:53half ago Leopold Ashen told me that math and coding would be the areas of the most rapid advances in the next two years because again of the the verifiability and man he was right about that.
46:06I still don't understand what great breakthroughs do you think come from these specific solutions.
46:12Okay so there are doz I have I have an answer it's a great question. Okay, there are dozens of tweets and I'm going to pull some up where someone has broken down some of the biggest proofs here and the implications they're going to have in the real world in terms of products and engineering, how we build things, how we design things, and how they're actually highly useful.
46:32So, better wing design because of the era air coming on and off of wings of planes. That was that first one that got solid uh famously.
46:40Remember, these are all upstream of engineering, right? So these math breakthroughs enable better engineering systems for humans to do things like design quantum sensors. I actually I have a friend who runs a quantum computing company. He sent me a text this morning highlighting that the Einstein Bose condensate proof that came out is actually going to have a direct implication on the work that they do for quantum sensors which plays a role in GPS, plays a role in medical devices, plays a role in um how we make chips.
47:07What does the word implication mean?
47:09like profoundly changes, profoundly improves or they have you have to think about it because here's my answer. I'm happy to take the other side of all of this.
47:19I think that these mathematical proofs are incredibly novel and very important constructions of thinking. But these were not boundaries of physics that we were all standing on the sidelines waiting for progress and wondering when these would be solved.
47:38This is not the class of stuff that was solved. And I hate to offend people when I say that. And I know that people will get mad because for them it's the same group of mathematicians that got really upset and wrote a protest letter about Nav'i Stokes. I get it cuz you don't want somebody to come into your sandbox and in your backyard and kind of dominate you. Get it.
48:00But I don't think that's what this is. And so I think that when you look at the body of intellectual culde-sacs we found ourselves in, those were not because of huge questions of science that were still unsolved. These were very small, very narrow, specific bodies of intellectual exploration that scientists self-referentially said were important to each other. And so I think that this I think this class of proof is it's really great. It's it shows
48:30computational horsepower overcame other things as you said Freeberg because you can recursively improve to get there.
48:37But I don't think these proofs is what is going to necessarily show you that there's a cure to cancer or there's a supersonic plane. I think those things were already being built before this stuff and they're already going to be built after this stuff. Instead, what I think we proved is that there are two areas that are now truly verifiable and completely falsifiable.
49:01First was code, and now we can add math to the list. That's I think what we've proved. You agree, Freeberg, or do you think we're actually going to see new products and services and major technological breakthroughs occur in the real world that help humanity?
49:15No. No. From these specific proofs.
49:17From these specific proofs, yes, that is the context. Yes. the people who are experts who are proclaiming the benefits of these and reading kind of what they're highlighting. This is some summary that this particular proof is about understanding the limits of optimization algorithms that are used in chip design systems, scheduling systems, AI software design and logistics systems. This will actually change the algorithms. So there is an application to change the algorithms that we use.
49:42the matrix multiplication complexity problem. It will allow for faster numerical computing for AI training, scientific simulations, and linear algebra in compute. It will have a direct application there. The reman's data function results, number theory, and cryptographic research. There's no immediate practical cryptographic breakthrough that follows, but it does open up a new path of discovery for cryptographic study that is going to be really important. Obviously, one of the things, by the way, just let me pause there on cryptography.
50:10A number of people noted that there were no major proofs shared in the space of cryptography, which indicates probably the fact that there were some pretty major breakthroughs in cryptography. And the reason is it is unlikely the case that you made absolutely no progress in any of the cryptography related proofs given all of the other progress that we saw. And if they made minor progress, then they would have published on it because there wouldn't have been implications for systems of
50:38cryptography. So the absence of evidence suggests that maybe there were some pretty major breakthroughs made in cryptography. And then there were a number of people that posted that uh cryptographic wallets with public keys are now very seriously at risk. And so there's a bit of a panic underway in the crypto community about what do we do now? And if this ends up having a set of mathematical solves for number factorization that could lead to
51:06breaking public key cryptography before quantum computers come around, which is what everyone assumed would be the thing that would break public key cryptography, then we have a real problem. And so everyone's like saying, "Hey, get all your public wallets deleted." Now the rumor is that OpenAI actually has two more drops coming and they're holding back on those. So, it is possible that some of the work in crypto might come out in those two other drops and that that work is being held back for security reasons. Obviously, it's being shared with the appropriate
51:36parties, but if it is a risk, it needs to be made known. It needs to get out there. So, there's another shoe to drop here. And how much of it will include cryptography related proofs and how much of that will drive people to scramble on public key cryptography? By the way, if it's worth saying it, I asked Chad GPT and I said, "Will the latest proofs of important math problems result in direct improvements and innovations to life as we know it? Be honest and don't
52:01extrapolate weakly." And its conclusion was, "The latest mathematical proofs are more compelling as evidence that AI is acquiring sophisticated reasoning capabilities than as evidence of imminent breakthroughs in human welfare."
52:15It felt like you were a little condescending there. Did you lose your account access? tested a time you have for being condescending.
52:20You know what's so funny about what you were saying is that has happened to me before using one of the frontier labs. I was doing uh simulation like on changing different variables inside of 8090 actually maybe I should stop doing project A and pursue project B whatever. And in all of this I did get frustrated because I wasn't getting the answers I wanted. I said something like it was not super offensive, but I was like, you're being very evasive and mushy and something something and I got
52:51The net of it was I got blocked.
52:53I've seen this happen with you when you lose a couple of hands and then the dealer and how they're handling the cards has to be adjusted. Like please do not burn the card. Burns just I want a Scooby slide. Do it this way.
53:07I did get put in the penalty box for like an hour or something. I think one of the interesting things that's happened here on a human level, I'm interested in your take on it, Sachs on programmers and entrepreneurship and then Freeberg on yours with mathematicians themselves building on Chimath's very subtle but insightful comment when he said like being utterly dominated by the AI. I was talking to some founders uh while I was here in Japan and people were lamenting how
53:35something has been lost in developing code because coders used to work together to solve a problem and there was this aspree to corpse. There was this camaraderie in building towards a goal and now they're not working with each other. They're working with agents. They're not actually constructing the code. they're only reviewing like 10 or 15% of it now, which means they're going to be reviewing none of it very shortly.
54:01And that the whole joy of building as a coder was basically going away. Their way of life of building this building together, you know, known as software was now being deprecated. It was going away. And it seems to me these mathematicians are also faced Freedberg with a paradigm shift in which they're not solving the problem. They're constructing the problem set and handing
54:30it off to AI. So are people in math getting bummed out and not wanting are they going into like a depression spiral now that they're not the one solving the problem and that the problems are just poof done?
54:44Yeah, I think Eric Weinstein has had some of the best commentary on this and you'll recall I interviewed him a couple weeks ago.
54:50Banger interview. Yeah, he's been saying for a long time that scientists hold back science, mathematicians hold back math. That they have basically constructed and created systems that allow them to pace the frontier that allow them well to gatekeep it.
55:10Yeah. Yeah. To gateep it.
55:13And by the way, I don't tweet very much, but Sabine Hosenfelder's video that she published yesterday, she's a fantastic scientist who publishes these videos on scientific breakthroughs.
55:25And she talked a little bit about how the experts were wrong about AI. Again, she talks a little bit about how everyone's predictions about job loss were wrong and why people got it wrong and and why the experts are wrong. But she had another video a couple of weeks ago or maybe it was a few months ago where one of the scientists at one of the big energy labs building a giant super collider basically said these super collider systems are giant welfare systems for scientists. We all have the
55:54job of writing a grant to get the money to keep ourselves employed that it's not about necessarily progressing the frontier. It's not about making the discovery. It's not about inventing a new product. is not about delivering something to the world. It's about getting ourselves to continue doing work even if pandering for grants is what you're saying.
56:14Even if that work is not productive and so there's a real kind of I would say shining the light moment happening with AI which is where is that the case?
56:26Where do we have these experts, these deeply specialized experts whose unique gated knowledge of some artifact of things and unique view because they're the expert and they have to be trusted gives only them the ability to determine the frontier to and in the process they're getting paid and they're earning to chart that path for humanity. And this is where I keep saying AI is the great democratizer. Yes, AI gives everyone
56:56this new mathematical proofs and you you know you can belittle the proofs but they are discoveries that are going to open up new discoveries. They're going to charge a new new course for humanity but we didn't have to go to the experts to get them and we didn't have to pay the experts and have the experts tell us when we are allowed to get them.
57:13The permission is gone. AI is a permissionless system for humanity to pace its own frontier. And AI is giving everyone all of this knowledge for free and giving everyone all of these tools for free. You don't have to go to these deeply specialized experts anymore. And that is actually a profound change in how society is structured. And it is why I believe so many people are so deeply against AI. So let me hand this off to you Sax. The democratization of
57:41expertise and the gatekeeping being dismantled. If we had had this level of AI and frontier models in the age of CO, which this came right after CO, how would that have changed the expertise if these tools were available when we started sequencing CO when we had all this data? Would this have this expertise gatekeeping Fouchy actively subverting the truth and you know
58:09whatever cover up was going on in Wuhan?
58:12How do you think this next co, god forbid, how could this change how we look at expertise? Yeah.
58:19Well, here here's my theory on on what's happening is first of all, you had the internet and that was wildly democratizing because now you didn't have to rely on a small number of elite publications for your news like the New York Times, the Washington Post, and the APN Reuters. you could basically get news from pretty much every publication under the sun or from user groups, user forums or most importantly social media.
58:47And so it was userenerated content. And there was also lots of other examples of empowering users. Obviously there were new marketplaces that formed online. So it was empowering from a commercial standpoint and you were able to get access to new skills and capabilities.
59:05So it was wildly democratizing and it wildly undermined again the elite consensus publications and the traditional topdown controlled mass media. Right? And I think what happened after that is that the powers that be decided they would never let that happen again. You know by the way they tried to crack down on it after Donald Trump was elected in 2016 for the first time. That election was
59:33widely attributed to supposedly the ills of social media that people could never have made this decision on their own.
59:40There must have been disinformation involved and that became the pretext for a big crackdown on social media that reached its apex during the Biden administration. And the Biden administration definitely did pressure social media sites to take down true information about CO that violated their narratives. information about where the virus came from, about how deadly it supposedly was or ways of reacting to
1:00:08it. There was no question that Fouchy at all were somehow working behind the scenes to push the social media companies to censor on their behalf. And in fact, we found out in the Twitter files that the FBI had 80 agents going through content on Twitter. It was Twitter back then, not X, and sending them takedown notices.
1:00:30And we were getting labeled on Spotify and YouTube and having our videos de-indexed.
1:00:34Yeah. So look, the track record is the track record of this is very clear, which is the action now is moving from the internet to AI or super intelligence. In fact, SI will eat the internet because there's no reason to basically go looking on a website when you can just ask your question to your highly personalized agent or model and it's going to give you the answer.
1:00:57And so there's a control point there that now becomes all important which is if you can control you know you the government or you some elite or some oligarchy or some cartel. If you can control that that point at which the user is receiving their information and asking its questions, then now you really control everything.
1:01:18It's a way to basically put the genie back in the bottle. And this is why I think there is such a a fight right now over SI, why so many people want to create a federal department of SI. And yeah, it's all about control.
1:01:32It's scary to experts to lose control.
1:01:34Like imagine if Chimoth we had these tools and you did the model of who was if you had the raw data who is being impacted by co you might have said well why are we keeping kids out of school here's the here's what super intelligence says and Sweden and Texas had kind of gotten to that point like hey we don't need to keep kids out of school the harm from keeping kids unless they objected unless the conscious yes anthropic would say yes you're questioning authority and we should not be questioning it correct all right
1:02:02let's move on there's riot riots in France. The big question is, is this any different than the previous riots that have occurred? Are we seeing something here different or is this just par for the course? The strikes and protests that you're seeing on X.com and not really seeing on the mainstream media all this month. You know, the mainstream media seems to be super busy with other topics, but the videos are quite jarring uh that you'll see online.
1:02:26Freeberg's about to have his moment. The thing that he has been talking about for years, okay, is now at hand.
1:02:34All right. France is seeing major protest and riots over austerity measures. Austerity, austerity, austerity. These strikes and protests started last month because of uh high school teacher shortages and their schools are crumbling. Sounds familiar. Within two weeks, a thousand French schools saw similar protest. Eight unions joined in and everybody went on strike September 29th. They are protesting that civil service pay is up only 5% since 2017. Prices have risen.
1:03:05Obviously, inflation is a global phenomenon, not just here in the US.
1:03:09Prices have risen 20%. So, there's a delta between those two numbers that people are not happy about called the cost of living. Some of the protests have turned into full-scale riots. 2,000 arrests. 305 police officers have been injured. Government is blaming the far left for stroking the protest. France's 10-year bond which is another important story uh people's debt or government debt has topped 5% just like is happening here in the United States with the 30-year anyway this is all going to
1:03:38have profound impact on the elections in April of 2027 obviously poly market has marine Le Pen has the favorite to be France's next president at 43% Le Pen is uh Trump-like in her policy secure borders strict immigration which obviously Europe and France have had many issues isues with cutting taxes and spending and being skeptical of the EU consortium. Freeberg, your thoughts here on what we're seeing in France. I'm
1:04:08going to introduce um a new theory. You guys will here. Okay. So, the theory is called the socialism point of guaranteed return.
1:04:19So, it's socialism point of guaranteed return.
1:04:22Let's shorten it to veganism.
1:04:27The SPGR. Go ahead. SPGR.
1:04:30This is a play on a point of no return.
1:04:32I think the thing that happens with socialism is because socialism is so bad as a concept. It literally removes human agency. It removes the capacity for human progress and it basically takes something away from everyone. So ultimately socialism always fails. I mean that's like the zeroth law of socialism is it always fails. The first law of socialism is that you have to cross a threshold before you realize
1:05:00that it's failed. And the second law of socialism is that as you have not crossed that threshold, you think more socialism is the answer. So as you embrace these kind of leftist policies, giving people free stuff, telling people that they have a guaranteed income, the more services you provide them, the more they realize that, you know, over time those services inflate in cost and the quality of those services inevitably degrades because there's absolutely zero
1:05:30market force to drive progress. Progress goes away. And that's what we see in the US in housing, in education, and in healthcare. And I would argue also in retirement systems. I think those are our four biggest problems that are going to lead us down this path. And I've said that for a while. So as a as a society says, okay, these things aren't working.
1:05:50The initial solution is we need more of them. I need more healthare. I need more housing. I need more education provided by the government. So when the government fails to provide good enough healthare, good enough housing, good enough healthare that's affordable enough, the answer is more government stuff. Give me more, give me more, do more. And eventually you reach a point when the system breaks because the government cannot tax and they cannot print. And because they cannot actually provide the services effectively,
1:06:18everyone realizes, holy the socialism thing doesn't work. That is the socialism point of guaranteed return where the whole system collapses and you return back to the non-socialist state. That is what has happened in Latin America. Latin America crossed the socialism point of guaranteed return in many of these countries. They realized it and they bounced back. Perhaps France has crossed it. Perhaps they haven't.
1:06:42We'll see how much deeper they go. The US has not crossed it. And I worry that the US, as I've said many times, is not yet touched that point. Has not hit the rock bottom. And we're teetering. And it's I think we're going to go deeper before we realize that we've crossed this point of guaranteed return where you realize the system doesn't work. Socialism is the worst idea. That is the zeroth law of socialism is it just doesn't work.
1:07:05So we have to get to that point. And I think the real question right now is France there. Is all of Western Europe there? Does it accelerate all of Western Europe through the socialism point of guaranteed return, which is sort of like a black hole event horizon? It's like you go through and then you bounce back out and you come out in this other universe and you're like, "Okay, we're done with that idea."
1:07:22And it's a oneway door. Sachs, now Sax, I want to get your thoughts on this point of no return. But I want to warn you that you're at three of your four Biden quota. So you only have one more Biden left for this episode. So when did I mention Biden?
1:07:38You had three B. That's your fourth.
1:07:39Okay. So, okay. I'm not going to mention Biden. My moment is over.
1:07:44My comments have nothing to do with Biden. Listen, I I I want to add a couple of laws of socialism. Is that what you called them?
1:07:51So, another one is socialism has never failed. It's only been failed. Meaning that all the previous people who implemented it didn't do it right. Right. If they had just done it right, it would have worked. So, that's the thing. It's true. Socialism has never worked, but it's not socialism's fault.
1:08:08It's always the people who screwed up the implementation. And that's like a core part of the the religion is if we just do it the right way this time, it'll finally work.
1:08:18Yeah. How does socialism build more houses or make a better education system is my question. I think that's the domain of entrepreneurship. Yes. Saxs. Like new product or service. Like with AI, everybody gets a personal tutor.
1:08:33We've talked about this on the show as well. We just need to get AI to help with healthcare. I think Nico is doing that. We had them on the program. Daniel A, a great episode. We need to cover these three things. So, Sax, do you see a solution that does not involve socialism andor the government for, let's call them, the three uh horses of the socialism apocalypse? Education, housing, healthcare. How do we get these problems solved? Because the government has a strangle hold on providing them
1:09:01andor creating the blockages for their occurrence. How do we break through that? How does J D Vance when he runs for president in two years, friend of yours, how does he build a platform around say those three things? Because I believe the next pres the next winner of the presidency is going to solve at least one or two of those problems and that is the platform everybody wants to see solved. You have a solution there?
1:09:25Well, the the difficult thing is that as soon as you start subsidizing something, you now create an interest group that never ever wants to give up the subsidy. But the problem is that the subsidy starts distorting all the market signals and it will frequently drive the price up.
1:09:40So for example with college tuition, one of the big problems there is that tuition has grown far faster than the rate of inflation. A big part of the reason for that is because the government is paying for most of the tuition through all these loan programs.
1:09:56Yeah, by the way underwritten healthare and housing have have all beaten inflation. And I think they're about 5 1.5 to 6% a year for housing prices. And that's also because of the fact that the the subsidy system tells people to own a home. You put all your money in your home and then your net worth is tied up in your home. So the goal is to get your home price to go up every year. So fast forward 30 years, young people can't buy a home because they're all too expensive now, right? I But this is the this is the conundrum is like okay so if you were to solve the
1:10:26the tuition problem if you were to make the loans stricter Yeah. If you basically make them be properly underwritten and you would be able to get a loan unless you actually met the criteria that would only work if the cost of tuition came way down so people could then afford to pay it because otherwise people are going to say well wait you can't take away my subsidy. I need that because the price is so high. So you get in this world where people need the subsidy because the price is so high. It's a catch 22.
1:10:54But the reason why the price keeps going up at far faster than the rate of inflation is a government is paying for it. And as long as the government's paying for it and not the consumer, you're going to raise your prices as much as you can. So you remove the market forces, the the inflation gets worse and worse, but you can't cut cut it off the subsidy because then people will feel like it's even more oppressive to them. And so that's the basically the spiral. And then eventually it breaks when you run out of money.
1:11:21Yeah. Well, we have a solution. Chimop meta is providing degrees for generation tool belt and jobs that actually matter.
1:11:29I mean, I think what we have to have is Apple needs to start making homes and Amazon needs to start making homes and provide a free market here to to make better products and services in the education space, which we see with Meta entering that space. It would be great if these technology companies, man, if Elon starts making homes, it's game over. He'll make homes as fast as he's making Model 3s. We We need some sort of solution here for those three problems.
1:11:53Do you have any thoughts on Freeberg's theory here and then David's regulatory capture and incentive problem? Jamal, we're starting to see the tipping of the dominoes and we're going to get I think what Freeberg has wanted for a while. Uh I think the bond vigilantes are going to put the western world on notice and I think in the next probably 3 years
1:12:22he will get most of the answers to his questions. So if I had to summarize as an observer over the last few years what Freeberg and a lot of people like him want is a what is the long run debt to GDP that's sustainable? B, do we believe in defined benefit or are we going to move to defined contribution? And C, can we have sustainable ways of paying for the two most important parts of one's evolutionary life as you become an
1:12:51adult, which is healthcare and housing. And I think that it's easy to dismiss what I'm about to say as not related to it, but it is, which is at the end of the day, this all flows from what the risk-free return is in the marketplace because that is how capitalism works.
1:13:10And so when you think that something is risky, a country is risky, you take long yields and you move them up and you say you just have to pay more because you just don't trust what's going on. And when you look at what's happened over the last, you know, now we're at sort of 20-year records. I think that what is happening in the United States is actually a knock-on effect of what is now where this war is being fought. It's going to get fought in Western Europe.
1:13:40Why? Because they are the closest to a quasi socialist state that the Western world understands. Yet they are the ones that are the most structurally broken with respect to growth, with respect to education, with respect to housing.
1:13:53Everything that United States can claim isn't working is working far better than they are in France, in the UK, etc. So what you're seeing in France is essentially the bond market saying no. And how that correlates is you're seeing now austerity because the politicians on the ground have to respond to their funders.
1:14:18And that 43 billion odd euros of austerity then animates and gets all of the local population out to complain about what the manifestations of that austerity are. Which is why you're seeing these incredibly dark scenes from France. That is going to spill into the UK next. And the reason is because Andy Burnham's platform is, I would say, even more aggressive because Andy Burnham is saying, "We're going to go from a moderate centrist economy that has
1:14:47largely and historically been very aligned with America and we're actually going to take a step closer to Europe."
1:14:54And so the things that they will have to do in the UK will be even more extreme to catch up to the socialist leanings of France. And so then now the UK market's going to go crazy. Meanwhile, the US market is going to tick up and up because what you're seeing is essentially a fragility in the Western Alliance. And if you can't count on the European market, and you start to create weird incentives for the European market to start to fracture, like I mean, yes, I'm biased, but if you're Italy, like
1:15:23you're like, why do I want to be a part of this mess? If you're a Germany, you're like, hold on a second. This is getting way more than I bargain for.
1:15:30Yes, that fracturing has enormous implications. So I think what is happening is incredibly important. The bond vigilantes, who are those? These are the huge large pools of money, the central banks, the huge macro funds, the folks that govern how fundamental capitalism starts, the inception at the top of the pyramid from which it flows down. I think that they are converging on Freeberg's point of view and it has
1:16:00not been true for many years. And I think you have to now let this play out because it has huge implications.
1:16:07To tee this up, if you look at the debt to GDP ratio that you're talking about, Jimoth, obviously Japan has had the most acute version of that. They're at 200%.
1:16:16Well, the thing with Japan, hold on. The thing with Japan is you have to look at Western markets. And the reason is because Japan is an incredibly nuanced and very specific market that does not necessarily track to other countries which is that you have this internal savings base and savings rate where you always have the buyer of last resort.
1:16:35In western markets you don't necessarily have that because of the way our pension and retirement system is set up.
1:16:41Yes. And if you look at Italy 138, United States 125, France 118, Canada 110, UK 100%, Germany interestingly 64%.
1:16:50Let me also state my priors. I've always stated that debt to GDP doesn't matter because it's a relative game. I tend to still think that that on an absolute basis, debt to GDP does not matter. But what does matter is on a relative basis, where are you in risk parity? And right now on a on a relative basis, if France has to implement severe austerity and they bring 10-year French bonds into 5 1/2 6% range, UK guilts are going to be
1:17:18at 6% and unfortunately US rates could be just as high.
1:17:21It all goes together. And right now the 10 year in the US is 5.3. The 30-year is 5.6. Somebody has to buy that debt and that debt has profound trickle down effects sachs on how entrepreneurship how businesses are built. On Wednesday 10-year yields dropped a few basis points after we had some strong demand but this has been trending up and up. Poly market says 79% chance of another rate hike in 2026.
1:17:49This is going to have a profound impact if austerity ever came to America sachs.
1:17:55We have not had that really difficult medicine, you know, uh, forced upon the American public. But we did see it. Portugal, Italy, Greece, Spain, we had a dry run of this after the great financial crisis where they had to implement austerity measures as part of the EU retirement age, etc. And so your thoughts on what happens here, Sachs, if this 30-year tenure starts to break 6% and we have austerity measures forced upon western
1:18:23countries in a in a more severe way.
1:18:26All right. Well, look, le let's just get back to first principles here. What is the problem that we're trying to solve?
1:18:32The affordability of goods like housing and education and healthcare. How do we bring those prices down? Through abundance. What creates abundance?
1:18:43Technology in general and specifically super intelligence will be the driver over the next decade. Now what is the most hated thing in society right now?
1:18:53Super entrepreneurs.
1:18:55If you judge it by its fruits as opposed to a bunch of fake narratives created by religious cults, then I think that people would be in favor of this thing.
1:19:09What is super intelligence created?
1:19:10First of all, people's 401ks are going up. It's a 3% tailwind to GDP. A million new jobs created according to the economist already. Productivity goes up, which means that wages and living standards go up. This is a driver right now of nothing but positive economic trends. But what do we hear about? AI is going to put everyone out of work. Total fake narrative. That was last year's hoax. Now there's a new hoax about human extinction.
1:19:36Data centers. Yeah, data centers. You know, using up everyone's water. We know data center hoax.
1:19:41That's a data center hoax. So we have a series of I call them rotating hoaxes where every six months there's a new one to try and convince us to sabotage the thing that's going to solve so many of our problems especially the ones around affordability. Why is this? I mean I think there must be something structural in society where you have these rentier interests who somehow are against the things that might cause the disruption
1:20:09that loosens their control over the system. And I think this is why technologists in general and VCs and so forth are so hated is because we're not actually part of the rentier class. So the rentier interests refer to financial elites who derive their wealth and income primarily from existing assets, right? Whereas technology is all about producing new products and goods and services, right?
1:20:37At a cheaper price. That's a cheaper price, right? That's the key. It's deflationary, right? because those new products wouldn't catch on unless they were cheaper or a better mousetrap.
1:20:47You know, we're part of this group that's so hated, but we do nothing but take risks and create new products and services that and solve the problem that solve problems.
1:20:57But it seems like the legacy media is really controlled by this rune class, these and the politicians. Yeah.
1:21:03The politicians who are all part of it.
1:21:05So there's something very deep in our system that I think does produce this sort of cartel of interests who again they're deriving their wealth and income from ownership of existing assets and they don't want to see that racket disrupted and within that racket there's just this ratcheting up of prices every year and more and more subsidies from the government and we think that system's eventually going to break but I don't know it might be the case that
1:21:32that system squaltches and stifles the development of the new and disruptive uh product.
1:21:40Let me make the jump off point here as we get through the docket and wrap up here. I think everything we've seen into AI at this point uh Chimath will be the prologue. The the main story is going to start when we look back on AI with agents. Agents are actually the manifestation of this technology that solves people's problems in the world and that is truly deflationary, saving people hours and hours a week in terms of productivity independent of what job or you know uh even domestic jobs or or
1:22:10or you know frontline jobs and there's been so much news and so much embracing of this technology in the last 60 days.
1:22:17big news out of Grockbot. A friend of the pod Elon Musk tweeted that he is going to make Grockbot headless. What does that mean? Well, we talked about perplexity earlier on and how that was headless. You have an orchestrator. It picks the best model for you based on price and performance. Elon announced, "Hey, Grockbot, which is a fantastic product. I highly recommend you try it out. Um, is going to pick the best end-to-end model. Does it matter?
1:22:41Whatever it is, quote Elon Musk, whatever is the most likely to give you the best outcome is what they're going to use. Eachbot already has, and this is a very nuanced piece of the software.
1:22:51Everybody already has now their own computer in the cloud with the agentic technology on top of it. And if you ask it to solve a problem, it has all of the problems that have previously been solved in its repository, repertoire, if you will, and it is changing everything.
1:23:06So maybe your thoughts here on dots, open aai, grockbot, etc. on dots and muse and grockbot. I think that what's incredible is you can just turn these things loose on very practical use cases that makes your life better. The best example of this that I saw was just last night in the poker game. Someone was describing to me that they in Grockbot said, "Save me money."
1:23:36and it just kind of like goes through their inbox. It finds all of these different things and it went and canceled a couple of subscriptions and it changed their phone plan and all of a sudden they're saving like a few thousand a year. So there's these very practical again it's just software. If we take out all this philosophical stuff that we started with at the beginning it's just software and it's very useful software. So, and by the way, like if you think about what how we use it, Jason, you and I, we have, you know, we use Athena. And now Athena is very good
1:24:05because they're like the human concierge that is the elevated version maybe of Grockbot and and Dots and Muse, which is like whatever 3,000 a month, but that's my EA layer now.
1:24:18But I still use Grockbot. The combination of Grockbot plus Athena to me is like perfect. So look, there's very tactical and useful measurable utility for very very little money versus what it used to cost. That's an amazing thing. The more important point I want to make though is I sent this to Nick. There's been a couple things that happened in the last couple days which I think are incredibly important.
1:24:41There have been people that decompiled the entire incredible the entire big five. What is the big five? Adobe has five very, very important products in their product suite. Freeberg may know them all, but I just know Photoshop. There's like a bunch of others. Okay.
1:24:59And these folks decompiled it, distilled it, and published open- source versions of these things. And Rust. Yeah. And I was so shocked because I was like, hold on a second. These are like profound products that have existed and have had moes for years and now they're just open source versions. And then Nikita was I think trolling and he was building on that idea and just talking about GTA because it's about to get released.
1:25:24Yes, I think GTA 6 is about to come out and people will reconstruct this.
1:25:30Why is this important?
1:25:33I think that IP and software was effectively rendered worthless two days ago.
1:25:38Yes. Because if you think about it, when everything is headless, so when Elon makes his services headless, Ben off made Salesforce headless a few months earlier. When all of these things are headless and you can wrap them in agent tools and you can connect them via MCP to other experiences, the value of IP does no longer exist in software. It doesn't exist. And I think that that probably is the most profound implication. So, like even in our
1:26:06business, we would argue with some of our customers all the time because we'll say, "Oh, we'll build this for you.
1:26:12We'll own the IP." They'll say, "No, we want the IP. We don't know how to negotiate it." And two days ago, I walked into the 8090 guys. I said, "Who cares?
1:26:21Who who cares?" And solve the problem.
1:26:23But before it was always a negotiation and a set of trade-offs. Now, it's a who cares thing where like the IP is irrelevant. It still takes a while for the machinery of a business and frankly the market to understand But that is the most important thing that happened this weekend in my opinion.
1:26:39I I I'm going to strongly agree with you and build on it. You have this abstraction of the software layer occurring at the same time Freeberg of the abstraction of the website or the marketplace etc. So now I have like my assistant building Grock bots and then we'll be sharing those. We have it on like a shared account. when we go to make a purchase of something or we try to negotiate something, we're having the
1:27:07uh agent without going to any websites go find all the quotes and then the humans negotiate the second half of it. That's like the sort of perfect option here.
1:27:16You look at Amazon blocking agents combined with Shopify saying let's let's go for it or Uber and Door Dash are now letting agents go in there and order your burrito or your car. The the but there's a whole compression of the commerce layer occurring at the same time of the compression of software that Chimath is talking about which will lead to massive deflationary cost savings and speed. the
1:27:45ability to get a hotel room or book a restaurant for an event like I did. This is all being done by bots already. Freeberg, this could be so deflationary and save people so much money. If people can save five or 10% a year on their spending that's essentially working against or counters the effect of inflation. Yeah, Freeberg.
1:28:06Yeah. Bringing the whole thing full circle. This is kind of what I mentioned earlier on the idea of loops. So think about getting a good price for a hotel.
1:28:15You run a loop which is check hotel one look at price. Is it better than current best price? Yes. Okay. It becomes best price. No. Go look for next hotel. And you just run that loop. And that loop you can do it in parallel. So you can go run 50 website searches at the exact same time. And you can short circuit the loop because the software's ability to get that data is faster than the human's ability. So now the the loop is go check 50 websites instantly, give me a result
1:28:44right away. And that's really where the efficiency gain comes from. A loop that gets parallelized, that is done better, and that can be done in a shorter period of time. I think anything that's done digitally today fits that model. So effectively, all digital workflows are going to get looped. They're going to become more productive. And then the question is how does the human that now levels up leverage all of this loop infrastructure all these agents to do more themselves. I do think going back to the point earlier that we made about
1:29:14scientists and mathematicians and this challenge for individuals um mathematicians in particular. I think um if your objective historically has been recognition for your work via papers, patents, um IP, trademarks, ownership, IP, yeah, these sorts of things. Um I think that the transition is going to happen which is you're going to have to transition to producing a product
1:29:49that the the the whole effort of humans effectively being the loops because the loops can be digitally automated and scaled and parallelized and so on. I think you end up seeing the the necessity for all humans to basically become much more of a maker. You have to make something. You have to do something productive. You have to produce something. you have to provide a service that someone at the end of the day uses or a product that someone at the end of the day consumes versus just be recognized for your work. That is the
1:30:18profound shift in society that has to happen and that is going to happen and I do think people will actually find I believe this truly believe all humans have capacity for being producers for being makers and all humans will find more joy in their lives in this state versus just getting ribbons for work.
1:30:37Um, and I and I don't think that it means less money. I think it means more money for all people. Um, more life progress, more prosperity for all people. So, I just zoom out a little bit. And I'm um, you know, I just want to make sure we have that view as we we think about.
1:30:52I think it's a beautiful view of humanity because it's like Jeban's paradox. The the cheaper things become, the more people can utilize them, the more value they get. And I hate to I almost don't want to give this tip because I want to gatekeep it, but I'm going to put it out there anyway. when I have my, you know, when when we book hotels and stuff like that for the team, just get the best prices we can. Then when the human in the loop, we just go to them and say, "Hey, do you have a corporate rate? Can we talk to the manager at the hotel?" I know this isn't like super innovative, but hey, can you
1:31:19match this price? Uh, and all of a sudden, we start saving a,000 or 2,000 or $3,000 on every hotel. say, well, when you have 20 executives moving around the country and you're doing 200 trips a year and you start saving a couple thousand dollar per trip because of this forward motion like goal based I guess is sort of what you're saying Freeberg like the goal and the the outcome is what happens you can see profound results and I wouldn't do that myself but because AI is doing it now wow yum yum it works all right listen another amazing episode of the
1:31:49I think you're a taker I don't think you're a maker I what are you talking about man all I do I invest in 100 companies a year. Do you know how hard it is to invest in 100 year zero startups a year? It is exhausting. But I must get some lunch.
1:32:03Have you eaten? Do you want to eat lunch?
1:32:04Yeah. Yeah. Can you come?
1:32:05I'm so jelly. I'm having FOMO. I'm not with you guys. All right, everybody. Another amazing episode of your favorite podcast. Your podcast is favorite podcast. The all podcast. Love you, boys. Bye-bye.
1:32:16Let your winners ride.
1:32:23And it said we open sourced it to the fans and they've just gone crazy with it. Love you. Queen of besties are my dog taking a notice driveway.
1:32:44Oh man, my habitasher will meet me up. We should all just get a room and just have one big huge orgy cuz they're all just useless. It's like this like sexual tension that we just need to release somehow. Wet your feet. Wet your feet.
1:33:00We need to get merch. These are going all in. I'm going all in.