0:00You've probably already heard by now, but OpenAI announced 20 new updates on Dev Day. And it's going to change the way we use codecs, ChatGpt, and AI in general forever. And I'm going to be honest with you, they announced a lot.
0:14They announced a new agent platform called DOT that you can call for hours and it can do things for you and it's built directly into the ChatgPT desktop app, iOS app, and web app. OpenAI also released a brand new model that's nearly as good as Astra for five times less money. They also released a new fast mode which makes code generation eight times faster and they release so much more. And in this video I'm going to go through all 20 updates and why each one
0:42matters. Okay, the first update to the Chat GBT app that you need to know about is their new agent platform dots. So, if you open up the Chat GPT app on your computer, it's going to look a little bit different. You'll notice a different model down here, and you'll notice a completely changed side panel right here with a ton of new features. The first one I want to talk about is right here.
1:09This is their new agent platform called Dots. And so the best way to think of a DOT is a named personal AI agent that runs on its own virtual computer that's connected to all the tools you use. You can call Dot, you can Slack message Dot, and you can text dot as well. As you can see here, I just got off an hourong call with my Dot, which I named Bluey. So, if you're on the Chat GPD desktop app and
1:37you have yet to set up DOT, just hover over this home icon. And what you're going to do is you're going to select create your dot or it should just say your dot right here. And when you select this right here, you will be able to set it up. And when you set it up, it will ask you to connect your email. And that brings me to the second update to the Chat GBT app that you need to know about, which is Dot can fully control your email and calendar. Here I am talking to Bluey. Hey, what did Emily
2:07just say? Like what printer did we get?
2:08She met sent me an email and then I want to know like five things that we could create with this 3D printer that you could actually generate. So come up with some prompts for that. Bluey can go in check the email and you can see here I'll check Emily's email for the printer model. Then give you five ideas of prompts for printable designs I can generate. And here we have Blueie thinking. And we can kind of see what it's doing right here. And you can pausey by pressing pause. And every time it thinks it has this little like light bulb. So it's done working. And I switched to a new chat because I wanted to show you that if you hover over this
2:38home icon to open up the side panel, you can see that Bluey has one message. So you have this little notification from Blueie. I can click on it. And here it's done. So Emily said this. You ordered a bamboo lab blah blah blah blah blah. Oh, and here we can see that Emily says you ordered a Bamboo Lab H2S AMS combo. And so it's a filament 3D printer and we ordered some other stuff.
3:01And here it came up with with five prompts. And I'm going to say, okay, I like this. Please put this in a at pages. This is an update. Little sneak peek. We'll get to this later. Make it public and send it to her on email.
3:19Okay, so it's done. And it told us what it did here. It said it created five 3D printing projects for the Bamboo Lab H2S. So, we can actually click on this and this is a document that it created in the new pages feature inside chat GBT. We'll get to this later. And then it sent the email to Emily because it's connected to all of my plugins that I've already set up. And the first one that's really useful is Gmail. And so, it can use all the plugins that you could use
3:49with Codeex. And it just sent the email over to her. And connecting email and calendar is incredibly useful when using Dot. the new agent platform. But the third thing that you need to know about the new chat GPT app is you can actually call your dot directly. And so here we are on the chat GPT iOS app. If you click this button up here, go to the menu, you can see your dot right here. I can click on this and then I can
4:14immediately call my dot right now.
4:23Hey Riley. Hey, good to hear from you.
4:26Hey, what's going on? That Emily email I sent, did that go through? Can you check my email and and just what was the last email I sent to Emily?
4:32Let me check your sent mail. Hang on.
4:36Yeah, found it. You sent it today at 3:22 p.m. Eastern and it's in your sent folder. It's the one with the five Bamboo H2S project ideas.
4:47That's amazing. Can you actually send a message to John in Slack sending that same document?
4:53Yeah, on it. Let me send that to John now. Slack John is John Cam and the page is team viewable. So I'll include the prompts and the Slack message as well as the page link.
5:04Cool. Send it link and first three prompts are in his DM. Sending the last two and print checks now.
5:12Amazing. All right, I'll check Slack.
5:14Great. It's John link plus all five promps and checks in the DM.
5:21Look at that. So, because I've connected my Slack plugin into the Chat GPT app, my Dot can fully control my Slack. You can send people like John on my team a message, which is really cool. But let me show you something even cooler. Dot can edit those GPT pages, which we'll talk about a little bit later, while just by you talking to your Dot. So, I'm going to unmute it and ask it to make some changes. Hey Blueey, what I need you to do, you know how we have
5:51everything listed out on that document we made? I want a table above minimalist desk valet, which just lists out the different prompts.
5:59Got it. I'll add that table above the first section, desk valet. And the full prompts are still below.
6:04No, thank you very much. Add like one little sentence beneath that, which kind of gets people excited to read the next section. And then for all of the copyable prompts, change that to like prompt formatting instead of plain text. on it. I'll tweak the table wording and formatting and and the prompt formatting should be for like the copyable prompts down below.
6:27So, it made those changes.
6:33All set. I added a oneline teaser under the table and converted all five copyable prompts into prompt blocks so they're easier to grab. The page link is updated in chat.
6:43Okay, you see what it did? It added this sentence. Then it changed this to prompt formatting, which is something we'll get to later. But these are really easy to just copy and run these prompts immediately. And so I can edit this document with Bluey, which is my dot agent, which is a brand new feature inside the chat GBT app. So calling dot is really useful. But the fourth thing that you can now do inside the chat GBT app is you can add your dot to Slack. So
7:10once you've set up your dot and it'll look something like this. If you click on your dot up here, you can very easily add Slack. But once you've added it to Slack, you'll actually see this right here. So I can actually click directly on this and say open in Slack. And then we're just going to open this up. And here you can see that I can message Bluey my dot directly inside Slack. And so it's under agents and apps. I can very easily click on this and say, "Hey,
7:39can you give me the the latest on my Convex video?" And this is basically the same as me sending it inside the chat GBT desktop app or web app or iOS app except it's through Slack. And here you can see that there is one reply and it is unread. So I'm going to zoom out for a sec and I can click on this and now it said I'll check the latest Convex messages and approval status. So it's still working. And there you go. It sent
8:07me a response based on my email and other Slack. And it also gave full links for everything. Like I can click on the video and this took me directly to the script where I sent my video on Slack. So it has full context over Slack, email, and everything. And I can message it directly in Slack DMs. But that's not all. I can actually go to a channel, right? This is the Riley Emily channel.
8:31I can click on all the members and I can very easily just type in Bluey and there we go. I can add Blueie to this channel.
8:40Now both Emily and I and the rest of my team can message Bluey. So I can go at Bluey, please give Emily and I next steps on most important things we need to do. And there you go. We can see the two replies. We can go ahead and open this up. and it gave us a little summary of everything that we need to do. So, it has all of the context. I can message it directly inside Slack. So, the fifth
9:08update to the chat GBT app that you need to know is you are going to be able to message dot soon. So, this isn't actually available yet, but you will be able to send an iMessage to your dot.
9:21That means you'll be able to take the agent that has access to all of your plugins that has access to its own little computer. You'll be able to put it in your Slack. You'll be able to call it directly in the chat GBT app and you will also be able to add it to your iMessage. And then the sixth update and the final dot update to the chat GBT app that you need to understand is that Dot has a computer and browser. Let's take a look. So remember I told you that you could easily open up that side menu by
9:51clicking on Bluey. You can also do it by pressing this button right here and this opens up the details. Now here if you click on Blue's computer I can click on this and this isn't a this is a real computer. Look I can click on draw and we can just use this little virtual computer. This is a real computer that runs in the cloud that I can use and Bluey can also use as well. And so this is really useful for things like filling out forms, checking to see if websites that you're building work, or doing
10:20anything that involves a computer, which again is most things. Because remember what OpenAI is trying to do here is they're trying to create a little virtual employee, a little virtual assistant with a name, right? It is a named personal agent and it can basically do anything that like a human virtual assistant would be able to do and that's why it needs a computer. So that is the basics of dot and that brings us through the first six updates that they made at devday. Now we're
10:49going to move to the seventh update to chat GBT that you need to know about which is their new model 6.1 soul. As I said earlier inside the chat GBT app whether you're on your phone, the desktop or the web, you will see a new model GBT 6.1 Soul. My initial use of this new model is that it's pretty good, right? It is a solid model. It feels like a frontier model and it is significantly cheaper than Astra. So if
11:18we look at the input tokens and output token cost of GBT6 Astra, which is the model that went crazy viral, everyone was super hyped about it. Really smart model. And we can see here that it is $10 per million tokens in and $50 per million tokens out for a combined 60. When you do the same thing for 6.1 soul, it is $12 for $2 in, $10 out. So, it is five times cheaper to use this model.
11:48And OpenAI kind of describes this model.
11:50It is lower cost aimed at coding and computer use. And it is a practical workhorse and I that's what it feels like to me so far. But until then, let's just move on to the eighth thing. And the eighth update to the chat GBT app from an announcement at devday is their new ultraast mode. And so this new ultraast mode is eight times faster in terms of output tokens or it can generate code or whatever the output is
12:19inside codeex. It can do it around eight times faster inside codeex. This is an insane leap in speed. However, I think this is going to be mostly used by businesses because this is only available on the latest plan that OpenAI has announced, which is the $500 per month plan. So, this is Pro500. And so, this new $500 per month plan is the only plan right now that gives you access to
12:49ultraast inside the chat GBT app or if you're using codeex. And if you have the $500 per month plan and you come down to right here, you can see that you have fast mode which actually uses more usage and it's 1.5 times faster. You'll see another mode that you can use which is like I think it has three of these little lightning bolts that shows that you are using ultraast. Using ultraast uses six times the amount of usage as if
13:17you use it on regular. So, if you're using Astra on not fast mode, just regular mode, it'll be six times more usage to use it with ultra fast, but it is about eight times as fast. If you try and create things in Blender or create video games or things that are very visual, even like having it use Excel, the speed at which it moves is honestly breathtaking. How quickly it can do these really intelligent tasks almost,
13:45it feels in real time. and I've seen a lot of really cool demos. I'm just not in the mood to spend $500 yet per month on an AI plan. So, the 10th update to the chat GBT app that you need to know about and this one is big and the most slept on and this is space. So, GPT space. They announced a place where you and your agents can create and work on stuff and you can create pages, presentations, and sites. Let me show
14:14you. So, you actually already got a glimpse of this when I was using Bluey and we were creating documents and we can very easily go up to space and we can click on pages. This is like a full notion style notetaking app, right? You can create these pages. We can uh type new and we can say what can the new GPT pages do? And so here we can very easily go down to this chat. Every time that
14:42you create a new page, you'll see this pop up here at the bottom right. We can very easily message an agent. Hey, I'm writing this uh what can the new GBT pages do? I want you to please like write out what it can do, but show me show me the different things that it can do like code blocks and call outs and all those things. Please write it on the page right here. Lead with like a series of four mermaid diagrams to show what pages are and what they can do. Okay, look at this. So it's still going but we can see that it added these mermaid
15:11diagrams directly in the chat or directly in the document. So this is very similar to notion. You can create these blocks. And here you can write text. You can also do headings. You can do strikethroughs. You can do these callouts. You can do lists and checklists. Here you can have like text that you can copy. You can very easily create tables and a lot of things. And this is actually a prompt formatting.
15:37And so let me show you how you can do it. So you can just type and I could type in prompt. And so you can type in this prompt formatting. And so here are the examples like please make a diagram. And so if you actually click on these, it'll automatically enter this prompt.
15:53So that's what prompt formatting is. But this is a really cool way to create documents. And here are like some interactive charts that you can see right here. And you can just ask AI to create these charts. And if you want to create these like visualizations, you can come up here and press visualize and then you can just describe a visualization like pie chart of the most used uh features in pages. Oh, and I believe it's done. Look at this. We can
16:21accept the change here. And this is what it created. We have this interactive pie chart directly in there our pages right here. Look at how insane this is. And we have a full document editor directly inside chatgbt. Now we can open up the side menu right here and we can actually see the subpages. So I could very easily add a subpage and we could say sub page here for research. And then I could very
16:50easily come up to bluey. I'm just going to say hey there's a new document. It's called I mention it sub page. Please, can you compare um GPT space to notion and use tables and graphics? So, I can just give this task to Bluey and look, we see Bluey's work right here. You can see exactly what it created. We are in the subpage. So, if we click up here and
17:19show pages, the first page that we created directly in codeex, I believe, is right here. But we can switch to just this subpage which is what Bluey created. So it can add tables, can add these charts. And there you go. It compared it with notion. And space can be kind of thought as like Google drive. It's like GPT space. And here we can see that what we just created was pages.
17:45Obviously in previous videos we talked about sites. That's also in space. We have images. So here are all of the images that we've created inside codeex.
17:54And then we also have Google Drive right here. And we can fully control and see Google Drive inside GBT space. And when you're done with a document, it's very easy to click share. And then you can actually share it with anyone on your team. You can copy the link and send it to anyone. And you can even have your AI send it to anyone. I can say, "Hey, send this to Emily right now." And I can send that link. And boom, that will send it off to Emily via email. Okay. So, the
18:22next 10 updates are not going to be as demo focused, so they'll go a little bit faster. So, the 11th update to the chat GBT app that you need to know about is ChatGBT in Slack. Now, we've already talked about adding a dot to Slack. You can also add ChatGBT directly inside Slack. Let me show you how this works in your Chat GBT web app. I do this in the web app. I can come back down here and click on this. and we're actually going to go to workspace settings. And down
18:52here, we're going to find agents. We're going to click on agents. When you come up here to GPT agents, you can create a new agent, right? You can add a Slack agent. I've already added this. And this is a chat GPT agent. And once you add this inside Slack, you will see this chat GPT. I can message chat GPT. I can give it plugins. I can give it access to anything. And you can actually control
19:21the model. With the dot, you can't control which model dot uses. But with this, you can. So I can actually click on this right here. And you can see here you have much more control over this agent. You can actually make it just selected channels only. You can show this is six Astro. We can change it to 6.1 soul. That'll allow us to save some tokens. And just like dot, I can go into any of these channels. Let's go into our
19:49packaging channel. And I can very easily add chat GPT to this channel right here.
19:57And we can very easily just talk to chat GPT, give it plugins and skills, and it's directly inside our Slack. The 12th update to the Chat GPT app that you need to know is they have a new meetings plugin. And so this meeting plugin is actually not out yet, but it's going to be a AI notetaker for meetings that's built into chat GPT. And I believe this will be integrated into GPT space and it will have a dedicated meetings tab.
20:25Don't quote me on this, but I'm pretty sure that's where it's going. And so if a meeting starts and you have your chat GBT app open, it'll automatically start recording and then record it directly in chat GBT space and you'll be able to ask questions about it and obviously take actions automatically. You could set up a routine to review all of your meeting notes and automatically do tasks or remind you to do all the tasks mentioned in the meeting. Okay, so the next update in my opinion is one of the most slept
20:52on and it is insanely cool which is plug-in extensions which can which can be thought of as apps inside the chat GPT app which is a true agentnative app.
21:04Okay, so yes, there was already plugins right you could add plugins and you could add the Figma plugin and if you come up here you can see all of the plugins that we've created but it actually goes deeper than that. Now, these plug-in extensions can be think of as chat GPT apps. Let me show you an example. I have an app. It's called Magic Path, and I added it as a plugin.
21:28But if there is a plug-in extension, if you click on these three dots, you'll actually see it right here. The two options are Figma and Magic Path. The rest of these are built into ChatGpt.
21:38But if we click on magic path, which is an app here, this app is built directly into chat GPT. And so this app right here can actually communicate with chat GBT. So let me show you what I mean. So I want to design a cool landing page that looks like agentnative.inc except a database of all the coolest tools. Now, did you see what just
22:08happened there? I pressed enter in magic path which is created by a guy, someone else, right? A company built this app and when I press enter, it actually enters it into the chat GBT app. So, I it is using my tokens here in the actual app. And so, here it's actually using the browser to see what agent native's website looks like. And look at this. It created this in the app which is magic
22:37path and you can do the same with Figma. This is an app that's basically built into chat GPT and they're an extension for the plugins that you could already create on chat GPT. And so if you look at this post from Petro Kirano, he is the CEO of Magic Path. And look at this. He said, "Stop what you're doing and build plug-in extensions for ChatGpt.
22:59We've grown over 2,000% since the announcement. If you are a product builder, this is a huge opportunity to get your product in the hands of more people if you make them fully agent native or built into the chat GBT desktop app. And so this brings me to the 14th update that they announced, which is signin with chat GBT. And this is very similar to the previous one. You can very easily now add signin with chat GBT to any app that you build. and more
23:27apps that you use in the future, you're going to be able to log in with your chat GBT account and you can actually use your credits or API credits that you are given inside the chat GBT app in the app that you're signing up for. So, this example shows Devon. Devon is the app that you're signing into through ChatGBT. And now you can use your Chat GBT credits. Let's say you're on the pro plan for $200 a month. you can use your credits from that account in the app that you're signing up for, which is
23:57Devon. And they're making it a lot easier for developers to build apps that allow you to do this. So, if you want to build like a vibe coding platform, for example, you could allow people to sign in with their chat GBT account, and you don't actually have to build the agent, you could just let people use their chat GBT credits inside your app. This is going to be very, very interesting for app builders, and I'll be talking about this uh in great detail going forward.
24:21So, the next four updates have to do with Codeex, and we're going to go through them together. So, first thing that they announced is that the Codex CLI got huge improvements. Not only can you more easily use your voice inside the CLI, they have a new agents view and it's much better for prompt editing.
24:39Now, this one is the biggest. They made improvements to Codeex Cloud and they announced Codeex Cloud, meaning you don't need to keep your computer running when you are using Codeex. And so normally when I do almost any task but especially codeex tasks I use codec. So if we create a new chat you can either use chat GBT which includes chat and work or you can use codeex. And the reason why people have dedicated Mac minis to do all of their coding tasks is because if you want to do coding work
25:09you need a computer to do all of your work on. So, normally you're doing it locally or at least I do it locally and I will use my computer and I have two apps that I'm building right now. One is the agent native landing page and the app within it and then I have another app that I'm releasing probably in a few weeks that will be open sourced. And when I work on these, I work on them locally, meaning they run on my Mac. I can test them immediately on my Mac. And when I want to work on this app from my
25:37phone, I can use the remote feature which basically allows me to control codecs from my phone. However, they're releasing a new feature that is called cloud. And they're making it significantly better and easier to use.
25:51If you go to your iOS app, you will see this little cloud icon right here. And this allows you to basically set up a an environment or basically a computer with a very specific setup. So maybe you'll sign into your clerk, your convex, your versel, GitHub, everything the first time and then you can basically reuse that environment for all tasks. So it makes doing coding tasks in the cloud significantly easier. So you can go off, go on vacation, bring your phone, and
26:20you can do a lot more coding tasks directly from your phone. OpenAI, what they're really trying to do with this is just make it incredibly easy to get the power of codec, but not have to have a computer running. you have a dedicated codeex cloud that you can rely on for most coding tasks. And so that will make it easier for us to use codeex in the cloud. The next thing that they announced is code review inside codeex.
26:42And so if we go over here into the new side panel that they've created and we go down to code review, I can see the different PRs that I've made while building my app. Now you may not see the code review tab right here. If not, you're going to have to click these three dots and you have to pin code review to the side panel. I've done that. And so here is a PR that we've created. And so this is just a change to the app that I wanted to make for my
27:10internal tool. And so when I asked Codex to make some changes, this is the PR that it created. And I can very easily click review with Codeex and Codeex will immediately start reviewing, which is really cool. And so this is just really good for app building. And they've also released codec security dashboard. Now, I don't know if this has publicly been released yet, but they're going to make it a lot easier to check for security vulnerabilities if you're building apps.
27:36So, if you're just a vibe coder, you now have code review and this security dashboard built into codeex that you can use as a way to make sure that your app is secure and without bugs and make sure that people are safe using your applications. Okay, so 19th thing that they released is a decisions API which is a Jev competitor. And so the way the decisions API works, it's not like a traditional LLM. Like if I were to type something into codeex here, I would type
28:05in input tokens and I would press enter and codeex would output tokens. That's not how the decisions API works. There's a certain amount of tokens that come in the input right here. Like you would say new incoming customer email. The decisions API is meant to make really fast intelligent decisions and it's only trained to select from possible options.
28:28So it would just select whether it should be sent to sales or billing or technical support. And so it makes it really good for classifying a bunch of things that happen within your company.
28:38And you can do this and have it analyze every single email and categorize them and decide how urgent they are. It's very good at making fast decisions based on a certain input, but there is no output token. When this API is released, I'll make a full video on this probably.
28:55So, make sure to subscribe for that. And now we have the final update of the day, and it's going to come in a pair, which is cloud computer use and agents API.
29:05So, OpenAI, one of their main goals for throughout this event is they're trying to make it really easy for anybody to build an app that uses the Codeex agent, right? They've done a lot of work to make the Codeex agent really good. Their models work really well with Codeex. They have really good computer use with their agent. Now, they want you to be able to create apps with the agents API.
29:27And so, the agents API is OpenAI's developer service for running their agent inside your own product. So you can build agentic apps and before if you wanted to do this you would need a ton of different API keys. Now all you need is a platform project and an API key. So the same you if you guys have been watching my videos you know that with an open AI API key you can make an AI wrapper right a chat GPT wrapper. Well now you can make a codeex wrapper right agentic apps. And not only can you
29:55create an agent, that agent can actually use computer use, right? You can build codeexpowered agents into your own apps using the agents API and then it lets you use the computer in an open AAI hosted browser. So the same way that your dot has access to this computer right here, it makes it really easy to create an app where you whatever you build will have access to this similar browser, which I think is awesome. And
30:23I'm have a lot of fun projects coming up very soon where I'm going to use this API, but this is going to be a longer video obviously. And so I'll put a link in the description to the agents API. I recommend reading this. It's pretty interesting to learn about if you want to truly build an agentic app or in my case, I want to build a little hardware device that acts as an agent, which I think is just going to be the coolest video and project. I I'm super excited for that and that'll be coming in the next few weeks. But I highly recommend
30:52checking out the agents API because you can build insane things with just an API key. You give it to Codeex and it will cook and build you something insane. All right, guys. Well, there you have it.
31:02This is what we covered today. You can pause the video to see everything we talked about. We talked about all the updates to DOT. We talked about the new models, ultraast mode, the new $500 per month plan. We talked about space, super underrated. We talked about all the places you can use chat GBT, the new types of apps that you can make which are plug plug-in extensions and use and we also talked about the codec cli codeex cloud code review codec security
31:29dashboard and we talked about the decisions API and how you can create your own agents. I hope you guys got a lot of value out of this video and I will see you here for the next one.
