SPEAKER_00: let's cover what they really launched this week and then we'll do a demo with some of their latest

SPEAKER_01: stuff they launched a desktop app iron ironically a mac app before windows app given all their

SPEAKER_02: investment a minute ago you were showing me the charger it can take a screenshot actually right in here you take this and you see this it can take a the screenshot or you can take a photo

SPEAKER_04: file yeah yep so i said can you explain what you think is going on here let's see what it says

SPEAKER_06: the image appears to show a video call between two individuals person in the top frame is holding up a device possibly explaining or demonstrating to the person he looks somewhat confused or concerned

SPEAKER_11: that's typically how i look to be a virtual minute tech discussion perhaps a product demonstration

SPEAKER_10: yeah i mean it knows what's what's up yeah so that is yeah kind of bonkers this week in startups is

SPEAKER_13: brought to you by linkedin jobs a business is only as strong as its people and every hire matters go to linkedin.com twist to post your first job for free terms and conditions apply eight sleep good sleep is the ultimate game changer the newest generation of the pod the pod for ultra has arrived head to eight sleep.com twist and use code twist to get 350 off the pod for ultra and hidden layer generative ai is revolutionizing industries hidden layers ai detection and response solution secures your generative ai and llms from malicious attack helping you generate more by enabling seamless

SPEAKER_19: and secure generative ai visit hiddenlayer.com twist to learn more all right everybody welcome back

SPEAKER_21: to this week in startups sandeep madra sunny my guy is here with me and we're going to do ai demos it's been a huge week you're going to want to get a notepad out or your chat gpt assistant and you want to take notes because we have a ton of demos to show you today welcome back to the program sandeep madra

SPEAKER_23: from grok formerly definitive intelligence which was purchased by brock which you can access at console.grok.com if you want to be one of the 250 billion developers who are working on it now

SPEAKER_21: it's 150 250 some great number 175 000. it's a lot of devs okay let's get right to it we know open ai did their big reveal on monday after sam waltman was on all in and didn't tell us uh and he had all

SPEAKER_23: this stuff launch actually true story he was i think um he told freeberg that they had some stuff to demo but then that they pushed it back so that was our mistake we should have rescheduled him so that

SPEAKER_29: we actually had the demos but we'll give you the demos right now yeah did you see the discussion

SPEAKER_31: with him on all in i did i thought yeah what do you think i thought it was really really good

SPEAKER_33: okay i think he got trashed in the comments and online yeah i was kind of wondering saying anything what do you think of that feedback people were upset that he didn't say enough i think like the people

SPEAKER_35: that watch all in are always expecting you know something big and you know he said three or four important things here's what i'll kind of say he said the next versions of chat gpt may not be

SPEAKER_37: numbered or gpt may not be numbered right that's big that's big he talked about the story of what

SPEAKER_38: happened right and gave information he had never given before that was one breaking news story the

SPEAKER_33: second breaking news story was that all of these projects like the chips and the phone were part of open ai well that's where i was gonna never told that to anybody and he was like yeah well i mean nobody

SPEAKER_23: asked me and i was like well okay well i just asked yeah and i thought the third thing that was breaking news was what do you think it was was there anything else you thought was kind of breaking the story of

SPEAKER_45: how he got fired yeah like he was at the f1 yes and he got the call and then he sat around for a bit then he became okay with it and he was flying back like yeah just that whole story was pretty good

SPEAKER_49: what else are people looking for well and then also the stuff he talked about with uh inference

SPEAKER_21: and training data versus and copyright i thought was really revealing the fact that he wasn't going to touch music and that he respected people's copyright he'd never talked about it in that kind of detail so that's like four or five pieces right there yeah i think people might be mistaken his general

SPEAKER_23: and i guess i've heard two different versions of this like cynical people are like he's not being humble he's being aloof or evasive and holding his cards close to the chest and you know maybe i guess the most cynical interpretation was he you know he's being uh sly or something and then on the other side

SPEAKER_33: people are like he's being humble and he you know doesn't have all the answers and he's trying to

SPEAKER_23: explain that and then some people are like it's both he's always being fake humble like he actually knows what he's doing and you know all this humility is like he's a james bond villain and i yeah i was like i don't think he's a james bond villain i do think he's figuring it out i've known him for a long time and yeah i do think he's actually pretty calculated but another word for calculate is thoughtful or

SPEAKER_45: strategic so anyway i don't like you guys he could have kept it you know and the reality was you know some of the videos we're going to pull up today because all that functionality is not fully released

SPEAKER_60: to the public they were recorded on the friday ah so the day before day after we tape we tape

SPEAKER_35: after you guys tape because in some of them people are asking hey what day is it and it's like oh it's may 10th right so got it um i think that was the issue is that they were still working on it again

SPEAKER_23: working on it yeah yeah okay let's get right into it then great job uh breaking down the all-in episode great job for freeberg for getting him on the pod i don't have any problems with it so let's

SPEAKER_29: get started so many uh different ways to start here and i'm curious where you're going to go first

SPEAKER_00: let's cover what they really launched this week and then we'll do a demo with some of their latest

SPEAKER_06: stuff right so here we are on the open eye youtube channel and if you're not watching go to our youtube channel this week in startups on youtube and i'm going to pull up the ones that are kind of

SPEAKER_35: novel because you know there's a bunch here and some of them we've seen before like you know there's a demo here where someone makes it count this gentleman makes it count then he makes it count slower and faster which is actually very hard to do technically but you know it's not that interesting

SPEAKER_37: a dad joke you've probably done this a hundred times well i thought the going faster and slower

SPEAKER_67: on the counting where he tells it hey can you count faster and it counts too fast so somewhere in between

SPEAKER_21: that actually is something that i think it does need to understand so it doesn't feel like and i talked about that on all in with sam altman was right now when you're talking to it it feels like cb radio where i'm like can you talk slower over and then the other person can talk but if you try to talk

SPEAKER_71: at the same time i do think they're teaching it to be interrupted can you count from one to ten for me

SPEAKER_73: please of course one two three hey actually that's um that's a little slow could you count faster sure thing one two three four five six seven eight nine ten okay that was a little bit too fast can you

SPEAKER_78: like count somewhere in between those two got it one two three and now even slower please okay one

SPEAKER_81: two okay we get it we get it i think it's important you know that the interface for voice

SPEAKER_21: works because when you use siri we all know when you use siri it's like you're giving it one command

SPEAKER_23: and you're waiting 30 seconds 60 seconds for that to get deployed and come back to you it just kills

SPEAKER_44: the whole experience totally does so yeah i think the ability for it to understand and adjust itself

SPEAKER_35: which we hadn't seen before is is a really big new feature one of my favorite ones which i hope a lot of people start using was math problems with gpt4 i'm just going to start it and this is sal khan yeah khan academy yeah so i'm going to just start with this one open ai invited myself and my son

SPEAKER_89: imran here uh to try out some of their new technology and so we're curious about how good it might be at

SPEAKER_92: tutoring someone in math on khan academy so let's get it started it's loading up so it's loading the ios

SPEAKER_89: app correct on an ipad yep actually in in this form hello there i'm here with my son and i'd love you

SPEAKER_103: to tutor him on this math problem but don't give him the answer you can ask questions and nudge him in the right direction but i really want to make sure he understands it himself and he's here in the

SPEAKER_105: room so you can talk to him directly of course i'd be happy to help let's look at the problem together can you first identify which sides of the triangle are the opposite adjacent and hypotenuse

SPEAKER_45: relative to angle alpha all right so we get the idea here and so i think again this is really

SPEAKER_35: important because they've done two things they've made it such that it can look at your you know

SPEAKER_33: device screen right so the app just to make this crystal clear for people the chat gpt app is open

SPEAKER_112: it's taking up about a third of the screen the other two of those of the screen is like a drawing program where they've drawn uh i think it was on khan academy it was just a website yeah it's just a

SPEAKER_21: website so he's on the webpage but it's seeing what you're seeing on that webpage so it's asking to read your screen which is something that's allowed in ios or on your desktop now so it's watching what you're doing therefore it's kind of the guide on your side and it's there and it's being able to

SPEAKER_35: watch the screen and then help you which you know for me sal khan has a very famous ted talk where he talks about you know two sigma and basically what that talk is about says if you give any student at any level a tutor they improve two standard deviations two sigmas and so imagine this now available for free for anyone on the planet to use pretty awesome now we just have to get them off tick tock or uh

SPEAKER_23: fortnite yeah and uh everybody on the planet's going to be you know yeah two years ahead in math

SPEAKER_121: hey founders hey startups when you're hiring for your small business you want to find quality professionals who are right for the role but i understand it can be tough to find the time and resources to find that perfect hire that's why you want to check out you guessed it linkedin jobs linkedin jobs gives you the tools to find the right professionals for your team faster and for free and linkedin isn't just some simple job board it helps you hire professionals that you cannot find anywhere else there's over a billion members on linkedin now and they're in more than 200 countries and i know many of you are leveraging different time zones to get work done different geos to find talent and linkedin is the best place to get eyeballs on your job posting you know that even those who aren't actively searching for a job will see your ad why because linkedin knows who might want your job you got a lot of ai machine learning going on over there so even if they're not actively searching they're going to see your role and you know what those are some of the best candidates and did you know that 70 of linkedin users don't visit the other leading job sites if you're not looking on linkedin you're looking in the wrong place and the best part is when you use linkedin jobs 86 of small businesses get a qualified candidate in 24 hours so hire professionals like a professional on linkedin linkedin jobs helps you get the right people faster and guess what the first one's on your boy jay cow post your first job for free linkedin.com twist that's right

SPEAKER_33: linkedin.com twist to post your job for free terms and conditions do apply and so that is the truth as

SPEAKER_23: we move on and now what is your excuse for not wanting to get smarter becomes the question because not only is all the reference material on the internet not only are there videos now there's a coach

SPEAKER_33: that can walk you through those reference materials and do what's called adaptive learning adaptive learning has been something they've wanted to create on computers for a long time and it's just been too

SPEAKER_23: hard because you had to manually hard code it here a language model is doing the adaptive learn correct

SPEAKER_35: that is exactly it and doing it at your own pace it's not a person you don't have to worry about their time and their tutoring you know cost is just the smartest most powerful tutor in the world that

SPEAKER_21: can be customized to your learning level and so while we worry as a species about ai taking all of our jobs and all this kind of stuff ai is also going to make us smarter every single person who wants to learn how to play chess or do math or maybe cooking or play guitar this thing's going to be able to watch you play guitar on your camera and tell you hey you know what when you're doing that c chord there's two different ways to do it here's some visualizations of that and just you know maybe press a little bit more gentle on your fingers so they don't hurt and like this is stuff that a teacher would do and now anybody billions of people on the planet are going to have a custom tutor this is a

SPEAKER_130: plus yeah for me one more just along those i want to show what would you rate this one did you

SPEAKER_01: rate you want to write this one don't write it yet okay we'll rate the whole thing as a thing because otherwise we're going to end up a lot of ratings here i like a lot of ratings okay okay

SPEAKER_04: i don't vote so here which is kind of going to your point um hey how's it going you can see here he

SPEAKER_137: has a video open how about you i see you're rocking an open ai hoodie nice choice what's up with that

Jason Calacanis: ceiling about are you in a cool industry style office or something well can you take a guess

SPEAKER_142: of what i might be doing based on what i'm showing you here hmm from what i can see it looks like

SPEAKER_145: you're in some kind of recording or production setup with those lights tripods and possibly a mic it seems

SPEAKER_04: yeah so again we get the idea here the presenter has the iphone app running the latest version of

SPEAKER_35: chat gpt and it now has a mode where you can start a video a live video stream to it so it's not a picture anymore because we got used to that so he just basically opened a camera and he initially had the camera pointed at himself and it described him and what he was wearing and it got a little bit of the ceiling so i guess that he was an industrial office and then he flipped the camera around and he had like a recording setup and it said oh yeah it looks like you're recording there's a lights and

SPEAKER_33: some cameras there so what is there a mode this is called is it called camera on mode is there a mode for this environment mode where do they call it i haven't seen this released in the app yet it's not

SPEAKER_45: in the app yet i looked for it yeah exactly so my guess is like you know today you're you have the

SPEAKER_35: ability to give it a picture or turn you know audio or other things they're going to add them like a

SPEAKER_124: sort of like a record button and it's going to open up and it's going to create that recording got it so

SPEAKER_33: i wonder if it can turn on both cameras because i'll just call this environmental awareness mode environment awareness mode eam em so when you're in em mode environmental awareness mode it knows what's going on around you so why would this be important well if you had it in a your phone in a cradle let's say you know like i have a qui charger on my desk here yeah um i'll actually show it to you so i have a charger you know like this from anchor so this is my anchor charger and my phone's on it right so if i had this and it was looking at me then i could uh if i was holding my guitar it'd be like oh are you looking to do guitar lessons and we would be skipping the step of me opening you know the app and saying

SPEAKER_23: hey i want to do guitar lessons because it would be aware of what's going on around me which i think is

SPEAKER_33: super powerful if there was this environmental awareness mode okay environmental awareness so it's kind

SPEAKER_37: of setting the context for you saying here's what's going on around if you were in the kitchen it would

SPEAKER_159: see that you're in front of the stove on your ipad in an ipad stand and it would see if it was tilted

SPEAKER_21: down all of the ingredients and it would see chicken and say oh you're cooking chicken do you need some help oh i see there's you know bread crumbs and i see mozzarella and i see some tomato sauce are you

SPEAKER_33: making chicken parm like this is kind of like whoa just like a human might walk into your kitchen you know you might walk in and your spouse is cooking oh you're making chicken parm that's kind of mind blowing when you think about it just to understand the context of where you are what's going on oh

SPEAKER_151: you're in an airport are you looking for instructions of where to eat oh i see you're in tokyo oh you're in shibuya district oh i see you're in you know ginza are you looking for a sushi place i mean this is crazy when you think about it being aware of the environment around you and just how much friction

SPEAKER_33: that takes out of the world and plus sound it can also listen to sound right it can now yeah it's

SPEAKER_35: going to have that full ability to listen all the time and provide that context to you yeah chat gpt can

SPEAKER_06: now see hear and speak we're beginning to roll out new voice images capabilities in chat to be there for new more intuitive type of interface by allowing you to have a voice conversation or show chat gpt what you're talking about voice and image give you more ways they don't have a name for this they should

SPEAKER_04: it's actually an interesting thing because people are saying hey maybe they should name it because they have all these kind of new functionality two more things i want to show this wasn't part of the release but we never got to demo this so i want to pull this up so one of the things that they've added if you go on your settings in chat gpt now yeah jason you're going to really like this

SPEAKER_01: if you turn on memory yes i have memory turned on yeah do you have it where it's starting to remember

SPEAKER_04: different things yes remember that i like this not custom instruction not i like things in a table we

SPEAKER_35: did that another time yeah but hey i've got a puppy and the puppy's name and you remember you know all these kind of little things okay that's another really interesting feature that they launched and

SPEAKER_33: you can ask it what do you remember about me correct and it will tell you what it remembers about

SPEAKER_156: you which is super cool so the last thing we're going to show from them and then we'll give them a

SPEAKER_01: grade on all these things is they launched a mac app desktop a desktop app iron ironically a mac app

SPEAKER_02: before windows that given all their investment yeah a minute ago you were showing me the charger it can take a screenshot actually right in here you take this and you see this it can take a the screenshot

SPEAKER_04: or you can take a photo file yeah yep so i said can you explain what you think is going on here

SPEAKER_06: let's see what it says the image appears to show a video call between two individuals person in the top frame is holding up a device possibly explaining or demonstrating to the person he looks somewhat confused or concerned that's typically how i look the background suggesting room musical instruments some posters correct the person on the bottom is listening attentively possibly involved in the discussion about the device he's wearing glasses and has headphones on earphones on with blurred background indicating a focus on his face it could be a virtual minute of tech discussion perhaps a product demonstration yeah i mean it knows what's what's up

SPEAKER_10: yeah so that is yeah kind of bonkers now is it continuously monitoring what's on your screen

SPEAKER_37: and it does not have a mode i could not figure out a mode basically all i could see here is um you

SPEAKER_35: know pretty much this is like a chat gpt mac app it has the same mode of like you can go in with your phone app or it can be constantly going back and forth with you but it does not have a mode for

SPEAKER_179: continuously monitoring your desktop continuously monitoring yeah yeah because that would be very

SPEAKER_21: interesting that if you and i recorded this whole episode and instead of just giving us a transcript and a summary it added the screenshots it annotated the screenshots and all of that you know and now

SPEAKER_184: you start thinking three months away they're gonna have that now that they have this they're gonna have

SPEAKER_153: that you've heard me talk about how great my sleep is sleep is a superpower and my superpower is eight sleep they've got the amazing pod that you add to your existing mattress it will cool you down or warm you up depending on which side of the bed you're on i like it nice and cool i sleep deeper i am a sleep king and you might be a sleep king or queen too and you can be one if you get the pod4 ultra that's right pod4 ultra is out and it is definitively the greatest tool for helping your sleep pod4 ultra can cool down each side of the bed to 20 degrees fahrenheit below room temperature it's a better cool than the air conditioner so i can put the air conditioner on a reasonable temperature and then keep my pod ultra even a little bit cooler than that and they also introduced an adjustable base that fits between you and your mattress and your bed frame so you know when you want to read and your partner wants to sleep well now reading and sleeping positions are right there to help you unwind after a hectic day even elevate just a few degrees automatically to help with your snoring if that's one of your challenges not only that it has sensors that will track your sleep time all the phases of sleep your hrv and your heart rate so it's basically a wearable that you don't need to wear i think i get like an extra hour of deep sleep every night because of it i'm coming into the game with good energy so here's what i want you to do get the sleep you deserve at eightsleep.com twist and use the code twist to get 350 bucks off of the pod4 ultra currently shipping to the u.s canada uk europe and australia i love this product so much i designed it to

SPEAKER_21: invest in the company well now imagine we're on a call and it's researching it or let's say we're taping an episode this week started said hey you know what give me all the links for the show notes and uh write a blog post about it and post it to my linkedin and put it in my drafts folder it could make like a whole blog post an email newsletter and you can say and tell us what we got wrong or give us suggestions for future topics for the podcast i mean this could be really powerful it could be like a virtual um podcast producer watching you work or if let's say i did five meetings with startups today and i had two meetings with the investment team like i said just give me a summary of the day

SPEAKER_04: and what i got accomplished and it was just sitting there and it was doing that and then you're like and you're like oh you know what remember during that meeting so and so was saying this yes yeah

SPEAKER_21: what was it again exactly you could be like hey is there anything i forgot to put on my to-do list yes and it would just go back and be like yeah you know you did mention the to-do list seven times last week or this week here are the seven items and here's the video clip of it i already put them on your to-do list so like just listen to my entire day with to-do lists or just be listening and you and i are just sitting there working and i'm like you know what remind me next week to do this and those

SPEAKER_33: kind of things exist in task management software there's a to-do list but a persistent assistant

SPEAKER_85: listening to you is a whole different level of power um that you could have and i've actually

SPEAKER_33: um i'll just mention it here on this podcast so i invested in a company called athena you can go check out athenawow.com and what it is is it's assistants like real assistants but they're based in the philippines and they're about three thousand dollars a month it has changed my life and so i will have this real world assistant which cost me only thirty six thousand dollars a year i'll sometimes have her on zoom with me with my desktop up showing her what i'm working on and she's learning what i'm doing and then there's this learning real life person there's a real life person okay so we are in the process of documenting and learning everything and i think there's going to be this merger between like

SPEAKER_21: my ea in manila who works with me for you know eight nine ten hours a day and this and if you go to athenawow.com uh they'll let you jump there's a wait list to get on this thing if you talk to any ceo in silicon valley they're using this because it's hard to get a personal assistant and they're they basically skim the cream of the top 0.1 percent of knowledge workers in manila and it's by the same founder who did thumbtack and so you'll get like uh fifteen hundred dollars off if you go to athena wow just and there it is boom i was the first investor in thumbtack and i'm the first investor in athena so go to athena wow and you'll see uh yeah and uh it just will make you so so efficient and then you add this to the mix that my assistant plus this virtual assistant would be sitting there you know collaborating on stuff and that and that's what i'm really trying

SPEAKER_206: to do is i think that feature yeah is so killer right because think about you know zoom has this

SPEAKER_35: feature now right where you can come in and you can do all that but you know what's with me is not zoom all the time but chat gpt or you know take your pick of whichever one you want to use so to be able to recap the day how how powerful would that be insane yeah especially because then i was sure

SPEAKER_33: my athena assistant and then she would nikki would be like oh okay i watched your day i watched the recap of your day and i guess i just give she'd be like give me a 10 minute recap of jason's day and

SPEAKER_02: wow yeah okay let's keep going awesome okay well let's give them a score because we're done i'm gonna

SPEAKER_21: i'm gonna um you told me not to but i'm gonna do this anyway i think the persistent app watching what you're doing is a plus plus plus the fact that it exists and it works and it's doing this right now is the game changer of all game changers and i know a lot of people were thinking about like monitoring desktop and doing stuff but this thing's out now so this is like one of the best things i've seen in ai to date because it's closing the gap between like a toy that gives you you know hallucinations and like some you know basic web research to now watching your behavior um i think the ability to talk to it better i give that a b like the speed uh which is doing it but the the contextual awareness of your environment and watching us work that's an a plus feature for me

SPEAKER_37: yeah i'm i'm in the a category as well for some room like we don't have all those features yet but like we're close now yeah i mean this was a great release yeah yeah is it any better

SPEAKER_21: like is the model any better or is this just new features on the existing model no no the model is

SPEAKER_04: faster which is important right obviously we spend our time thinking about that so they've made it

SPEAKER_35: they've made it a lot faster which is good it's low latency but the important thing about the model is it's truly and they call it omni it's truly multimodal so a lot of times you see some people

SPEAKER_37: doing voice and images and obviously llm type stuff and what that's typically been is what's called kernel

SPEAKER_211: fusion kernel fusing but here they trained a model from scratch with all three of those things so it's

SPEAKER_206: not three different models that they kind of fuse together ah it's a model that was trained on text

SPEAKER_184: on video and on audio so that is you know some underlying underlying technology uh that i think you

SPEAKER_21: don't see in the interface explicitly but if it is listening and watching you you know that's what the o is for the o is for omni so exactly and the omni means audio visual text all in real time at the same

SPEAKER_48: time time and it knows how to move between those which is kind of incredible yeah and so with the mac os app

SPEAKER_184: yeah you just can open it up and boom yeah and also on the desktop app you now have the voice

SPEAKER_23: conversations it's only for plus subscribers which i'm one but i don't see it here so i think i have to get it turned on or something twice as fast for 50 less cost for businesses i think just talking about a big picture the costs are going to continue to plummet on this thing and they said they want

SPEAKER_21: it to be free for all users and he wants to give everybody access to this so is it now free for chat gpt4 on the website like if you're not logged in i noticed that everybody

SPEAKER_33: is now starting to let people use these services when you're not logged in did you notice that that you can start playing with these so it used to be you had to be logged in so i just launched a private

SPEAKER_233: window and if i type in chat gpt i can ask it a question hello what can you do yeah and in which

SPEAKER_48: model yeah that's chat gpt 3.5 and then i think you can change it to 4.0 you have to for four you have to log in and create an account oh you do okay but the point is it does seem like there's a path

SPEAKER_151: here but i think for chat gpt4 not omni i don't think you have to pay now so it seems like they're

SPEAKER_33: going to it's almost as if whatever the last version of microsoft office was would be free free the new version is paid so that's kind of an interesting model it goes back to their nonprofit

SPEAKER_21: roots i think what's going to happen is when we talked to sam altman on the all in podcast last episode i asked him about ubi and his experiments there and he said he wanted to give a certain amount of compute ai or ai resources to people that seems really interesting i think open ai maybe part of their mandate is going to be to make all this stuff free so while they have a paid version whatever the most recent is is paid so you get a little bit of edge so maybe like this year's version you have to pay for but last year's version everybody gets for free and last year's version shouldn't cost them that much to service because inference and everything's getting cheaper and they'll have optimized the model so it's expensive to serve up chat gpt 4.0 i would expect right so omni is going to be expensive yeah and 3.5 is cheap right what would you say the difference in

SPEAKER_44: cost is in a multiple for them well in this case 4.0 was a very specific it's actually cheaper it's

SPEAKER_240: it's half the price listen we all know generative ai is revolutionizing every industry in fact we talk

SPEAKER_121: about it here on this podcast every week and companies that are slow to leverage this technology well they're going to risk falling behind their competition but new innovations also bring new threats how do you safely accelerate your company's gen ai adoption while also managing the risk well let me tell you about hidden layers ai detection and response platform it's a security solution specifically designed for generative ai and large language models lolms you know that it provides your security team with visibility and tools necessary to detect and prevent threats like leaking of confidential information we've seen that a couple times as well as malicious prompt injection that's a serious threat and model theft right people are starting to steal that's just the truth of it folks people will steal your innovations that's going to enable your company to harness the power of ai and to do that securely and confidently it's trusted by leaders in finance tech healthcare and even the u.s department of defense the dod hidden layer helps you generate more by enabling seamless and secure generative ai so here's your cta the old call to action with hidden layer go from pause to possibilities and step into the future of secure ai innovation learn how to protect your generative ai today by visiting hiddenlayer.com twist that's hiddenlayer.com

SPEAKER_35: slash twist there's a couple of interesting intersecting forces here let's just talk about them people have been saying and i'm not in agreement that models will keep getting bigger okay i feel like the folks that have been saying that are trying to do it as a moat because the models get bigger becomes harder and harder for anybody else to enter that but as the models get bigger they become way more expensive to run so it's also it's also like a perverse incentive as in oh let's make one that's twice as big as gpt4 well then it's going to be twice as expensive to run right so yeah i think what we're seeing now is tech usually gets more efficient not bigger and more expensive okay and so we may see a bit of a shifting landscape here where future models are actually cheaper to run than older models

SPEAKER_37: right older models become worthless so that's what it really is it's not worth okay that's bizarre hold

SPEAKER_244: on let me i have to really grok yeah what you're saying with the cube with a q grok with a q

SPEAKER_151: if you make a new model they're becoming so much more efficient that the new one has better gas mileage than the last one but not just better gas mileage like 100 miles per gallon instead of 10. therefore if i gave you a new car and it was 100 miles per gallon and your previous one was 10 miles per gallon you would stop driving the one that was 10 miles per gallon because you'd make up the cost so quickly

SPEAKER_27: yeah so in other words all these previous models are going to get thrown in the garbage they are

SPEAKER_37: depreciating super fast like i can tell you from our experience at brock the day llama 3 came out 48 hours later we deprecated llama 2 we just took it off the site everyone moved over and we can see the

SPEAKER_21: prices right here producer court will pull them up yeah the pricing is plummeting what is the pricing you know trend line here when when you when we talk about this sunny talk about gpt4 oh is 50

SPEAKER_37: cheaper than gpt4 where gpt4 was 10 per million tokens input and 34 million tokens output it's now gone if you scroll back up a little bit it's gone to five dollars and fifteen dollars but just to let you know open source is still cheaper open source is 60 cents per million tokens input and 80 cents per million

SPEAKER_117: tokens output okay so that's a fraction of that yes and the open source ones hosted are that price right

SPEAKER_156: yes look at where the original gpt4 was 120 dollars and 60 dollars okay so 120 dropped to what 120 dropped to 15 over what time period approximately did that happen so gpt4 came out

David Friedberg: last march okay so in a year yeah year and a month so you think that these things will get 90

SPEAKER_21: cheaper year over year i believe so so that means over two years it'll be one percent so every two years they will be a hundred times cheaper but we're going to use them a hundred times more now think

SPEAKER_35: about all the stuff we did today and if it's running all the time it's not viable to pay that much if it's listening to everything you're doing because we're entering a world where before it was you know sort of limited interaction you're typing some text you're doing it now we're talking about a world

Chamath Palihapitiya: worth recording you all day long so what you'd have to do is say you know what record every word i say

SPEAKER_118: because that's just going to be 10 hours of audio and maybe i only talk for two hours of the day so

SPEAKER_21: it's two hours of audio but take a screenshot of my desktop every second means 60 seconds uh let's say 600 minutes 3600 screenshots or something like that processing 3600 screenshots that doesn't seem that

SPEAKER_33: expensive yeah it adds up it adds up now and especially if you were going to record video

SPEAKER_85: you would need at least i don't know how many frames per second but typically 30 frames per second maybe less maybe you could do it in 10 skip around you know film is 24 frames per second so yeah you

SPEAKER_212: probably do it uh zoom obviously does less maybe like 10 or 12 would work so interesting what's going

SPEAKER_35: to happen is we're going to be processing a lot more data with these um you know with these technologies

SPEAKER_23: which is good they should have like uh they should have you know they have this um portfolio company that i'm really enamored with it's called recall and let me show it to you here and i'll get your

SPEAKER_266: view on this this company and actually i'll get you to give a letter grade hold on let me just share

SPEAKER_23: my screen oh a jcal demo a little jcal demo here of this company recall um because i know that you like

SPEAKER_29: this category this is called recall so here i am on a youtube video right um and let me just go to the open ai page here okay here i am on open ai and uh here's that one we just played right but i will

SPEAKER_21: click on recall here you see it's doing its work and it's recalling this page it's analyzing parsing the data of this youtube video and then it gives me a summary of the youtube video and then i can save this and then when i save it it saves it to my knowledge graph and then it automatically is building a knowledge graph for me of all this stuff and yeah um then i can click on knowledge graph and i can see the all in podcast you can see open ai say hello to chat gpt4 and i can start to move around and see what are all these here's universal basic income right which is the ai we're just talking about universal basic income here's the ubi page and this came to it because we were just on i have the all in podcast on here from youtube and these are the themes that when i come to my knowledge graph you can see here are the themes all in conversation with sam and here's what came up

SPEAKER_112: here's google masayoshi-san i mentioned stripe i mentioned peter teal uh sam altman wow and that's berkshire hathaway y combinator really from my introduction here's ubi and then you see ubi can

SPEAKER_21: go out and here's chat gpt and here's open ai and i've only put a couple things in here but as i add stuff here like if i were to do a search for uh ubi experiments and find a video about a ubi

SPEAKER_23: experiment right south korea's ubi experiment here then i add that to my recall and this is a company we've invested in we incubated so now it's discovering the connections it's summarizing the

SPEAKER_21: main ideas boom it's going to put it into i've saved it into my um knowledge graph now when we go back

SPEAKER_33: to recall it now has that one here do they do it via the youtube transcripts or like i don't know but here we go now if i find ubi here's open ai and when i find that ubi one eventually there's dolly overton window and at some point ubi there's ubi it's going to have for ubi you know the two or three places we talked about it and i can expand the card thing here right and uh see more things related to it you get the idea yeah so what i asked them to do was to monitor every single web page that i visit in recall and they said that's too expensive and i said well how expensive they said it would be

SPEAKER_268: like hundreds of dollars a year and i'm like charge me a thousand yeah i would pay for that give i mean

SPEAKER_29: come on what are we talking about here if you're a business executive let's you know you know where

SPEAKER_11: i would pay for that jacob get recall.ai you would pay ten thousand a year a thousand a month you pay

SPEAKER_45: a thousand how many times i've been to a tweet and i forgot to like it or do and i can never find it

SPEAKER_286: again and it's like i really need it for something oh my god rate that uh startup that we just

SPEAKER_06: invested in what do you rate that get recall i'm gonna give them a b perfect yeah i give it a b right

SPEAKER_81: now and if they had the feature where they did everything i would give it an a yeah you know

SPEAKER_262: chat gpt will have some of these features but i do believe as we look at this space that dedicated

SPEAKER_21: products that are gonna you know that have features and interfaces for a particular vertical bookmarking and knowledge graph writing a screenplay and doing storyboards doing math like it's just gonna enhance those things so you'll have chat gpt underneath con academy but you're still gonna want to go to the con academy website i think and have like a full experience there i think

SPEAKER_45: those things are still gonna exist exactly what's not clear to me just yet because there's so much

SPEAKER_35: happening right now is and you know what's really kind of got me thinking a lot is you know we're gonna get into the next set of the demos but what we just finished with with is if i have that mac app and it has now access to everything and then i do something on my phone it has access to a bunch of things and then the flip side you know one of the things google did today or yesterday right when google io was on they talked about um the generative experience being part of their court search

SPEAKER_01: engine so everything you're doing from them and as part of the search gmail youtube they're gonna

SPEAKER_23: have their own knowledge graph wrong oh and in chrome okay wow so here it is the your everything you do is going to be surveilled and inside of google or open ai pretty scary and insane if that got hacked

SPEAKER_151: but i guess the benefit is the language model and everything about you at some point the fbi could

SPEAKER_33: come or a quarter or to come and say hey tell me everything you know about sandeep and it'd be like yeah we know sandeep likes these websites and really likes this actor and watches these tv shows listens to this music i mean it's kind of crazy when you think about it yeah they could probably

SPEAKER_211: end of privacy from your they could get that from your search history but if you go and if your search

SPEAKER_00: history is on for google it wasn't even on and they were still doing it for some people they got in

SPEAKER_296: trouble for that recently they got in trouble for but already what's that incognito mode not the big

SPEAKER_117: joke inside of google was incognito mode was not incognito but chrome has um helped me write

SPEAKER_206: built in now oh wow you can create custom images you can organize your tabs in a smart way so they're

SPEAKER_300: already starting to add the high level ai features amazing so help me write is like grammarly inside of

SPEAKER_184: chrome that's interesting yeah so yeah i i do think like i wonder um i love grammarly but i think like

SPEAKER_23: 60 70 percent of grammarly will be built into other products so grammarly is going to have to keep figuring out what unique features they can add for writers that aren't going to be in like sort of

SPEAKER_01: native products yes exactly so you know it's an entire journey that's happening very quickly i do think

SPEAKER_23: like you will be able to build apps that are 10 20 30 40 better than whatever is in these just like

SPEAKER_29: chat gpt keeps making things that are 20 30 better than what's in another person's model so you just have to keep adding features and listening to your customers okay all right talk to me about google

SPEAKER_37: so google google at google.io a lot of things talked about there um from developer stuff which

SPEAKER_35: is at the at the core of what they announced on the developer things which we won't bring up right here you know they've expanded the context of gemini to 2 million they launched a new ai chip as well which is awesome and they're continuing to make more services available within vertex but from a consumer standpoint we're just going to talk about a few of the things that they've put out and the best

SPEAKER_04: way to kind of get access to these back at labs.google okay so if you once again google making it

SPEAKER_309: impossible to navigate to find stuff i mean this is something i mean what bar.google gemini.google now

SPEAKER_311: it's labs.google.com okay yeah so here you can see google right yeah labs.google is not even.com now

SPEAKER_35: right so i think we and so uh what we're going to do here is we're just going to start going into a few of the things that they launched i know you like this one jake out notebook lm so what they did in notebook lm is it can take up to 1.5 million tokens and contacts now so if you have a bunch of

SPEAKER_37: content here you can put it in here and it can then basically create a summary for you on that

SPEAKER_23: content right i did this i had uh steven uh johnson on this we can start up you and look it up and um

SPEAKER_21: i showed myself taking the screenplay yeah for founder the founder and the book grinded out the pdf of the book grinded out about ray crock and a bunch of other ray crock business case studies i found from like harvard and other places like pdfs i found and i put those all in there and when we did an episode i asked it give me key moments in the history of mcdonald's and what lessons they learned and it really started to act as a research assistant the job of a research assistant who would compile all that read that and then sit in a room with the writers it kind of acted like that and you know that's like a you know basic research position in the world the 50 60 70 000 a year is what researchers get paid you know i've employed them for many years in publications and journalism starting pay by you know maybe 40 50k you know if you're an expert researcher you can get up to 60 70 80k in the world after 10 years and those exist in all number of modalities like a magazine a newspaper a consulting firm a law firm whatever just a general researcher seems like that function is going away in the world anybody who needs a researcher can use notebook lm gemini chat gpt the researcher mode so that means we all get to do other things right and i can tell you my producers have been using chat gpt since it came out at my insistent to summarize things and the summaries that they do versus what chat gpt can do essentially the same so then what it comes down to is them understanding my personal taste or the

SPEAKER_23: the gestalt of the show fancy word for the the vibes of the show the vibes and then kind of cross

SPEAKER_21: referencing them right and so eventually we'll put into one of these llms all 2000 episodes and say what would jcal find interesting about this startup or this person and it will go out find the 20 interviews

SPEAKER_29: this person has done and then you know surface the things that they think i might be interested in it's

SPEAKER_35: really going to be very interesting yeah yeah so now it's all of that just with 1.5 million tokens of input context you can imagine jacal that should cover almost all the things you've ever published

SPEAKER_112: everything i've ever published wow to that you think 4 000 hours of podcasts would fit in that maybe no let's leave the podcast out oh okay everything i've ever written blog posts etc maybe all the

SPEAKER_325: transcripts right yeah yeah i mean a book is basically six to ten hours right yeah um so if you

SPEAKER_29: think about it like every podcast maybe every five podcasts is a book in terms of the transcript so there

SPEAKER_35: you go 60 000 words whatever amazing wild we're gonna keep going through their stuff so the next thing they did is they've made a generative search experience i don't know if you use this but like this is sort of my go-to these days more so which is the gen search experience and so they've made this uh generally available and so when you do something uh and we're going to just show this example here so again i'm in the google labs showing off ai overview on more searches overviews and search okay and this

SPEAKER_300: doesn't work you have to use your gmail address for this to work once again yes

SPEAKER_04: yes and you have to use google chrome god damn it how can i get better improv or how can i keep bananas fresh longer what you're going to see is and see they've got it the ai overview right here now this is interesting now jcal right because they're calling it a review yeah it's perplexity yeah i mean perplexity yeah well you know i think they're they're innovating too so don't don't don't count them out but this experience is zippy so yeah do it one more time i want to see

SPEAKER_81: where should i go on vacation with my 10 year old in january that's warm and fun i mean i got really

SPEAKER_346: detailed here let's see yeah that that was that was too much for it okay tell me about turks and

SPEAKER_29: caicos there we go there you go perfect yeah and then if you show more it's kind of instant i wonder

SPEAKER_27: if it's pre-cached i don't know yeah what's interesting is this one is different than the

SPEAKER_04: banana one this one's called ai overview it's different color that one was blue that was a little bit different interesting so they maybe have just cashed up all the most popular ones right yeah see

SPEAKER_353: how this one is red oh yeah look at that huh yeah i mean this one was in this one was instantaneous

SPEAKER_354: they make everything so hard oh god it's just yeah oh see this one this one went into generating interest ai overviews in search okay i gotta sign in i gotta use my gmail account i talked to sundar

SPEAKER_357: about this actually i said okay you just do you see jake like like so much stuff has gone below the fold like previous google was so much harder to use yeah i mean this is the end of seo uh so if you

SPEAKER_33: wanted to get traffic from google the reason google didn't do a lot about this uh or one of the reasons

SPEAKER_21: um they didn't do this was because they were in a very fragile balance between indexing people's content leveraging it to make money intercepting search traffic google becoming the starting point and then sending traffic to people now they're going to train on your data give the answer and not send anybody to your website and this is going to result in people saying i want to get paid for my content if you're just going to use it to rehash this stuff yeah i'm saying because here when it's doing it

David Friedberg: um let me show you mine i just used one of theirs or actually yeah so if you show more here one of the

SPEAKER_21: interesting things is they i think they'll put uh scroll down let's see if they put uh links so see what they did here they made an overview but because they're in a very fragile relationship with publishers

SPEAKER_33: they gave a carousel at the bottom of their sources they didn't quote them but click the first one and you know on that list and i bet you of the six they did here you know this ai article from forbes was probably where they got the information from so i wonder if they're just giving you the top six google

SPEAKER_159: results or the top six google results that created that summary wow what do you think i don't know

SPEAKER_35: that wouldn't be useful i mean i i think what they have to do if they want to be competitive here with folks like perplexity they have to look through a few of the results summarize it and then spit

SPEAKER_33: that out but that's what i think that's what they're doing i think that's what they just did so if you typed in here what are the top science fiction films of 2023 and it if it does summarize

SPEAKER_159: this you know that it doesn't know that without having indexed a page right that's not the type of

SPEAKER_369: result that they're going to know interesting here see this yeah well that's because yeah you got the

SPEAKER_151: it asked you to generate it because they already have what to watch like they have their own

SPEAKER_325: yeah thing here but here look it did ib it it gives you some of them and then it gives you

SPEAKER_151: immediately im dba and then it says according to rotten tomatoes and look there's a down carrot there if you click it it gives you the link so they're doing sources and they're making the sources a little

SPEAKER_21: robust you notice that yeah why are they doing that this is the fragile relationship that happens when you steal people's content without their permission google has stolen this content and made these summaries without the permission of those sources so what they're hoping is and i'm using the word stole to be a little provocative here but you could say they've leveraged they've utilized without permission we know that they don't have permission to utilize these okay they utilize these without permission to create summaries in order to not get sued they're hoping slash film and imdb are good with

SPEAKER_335: that high profile link yeah see what i'm saying what the ultimate test will be is how many people

SPEAKER_35: continue to click these links and yes how imdb looks at it says oh you know they're still sending 80 or 90 percent of the traffic they were before fine but if that goes way down there's going to be chaos

SPEAKER_23: i'm investing in a startup that is creating a clearing house for the rights for content holders

SPEAKER_202: in ai mart so like someone does this for yeah exactly someone's gonna say someone does it for

SPEAKER_21: music right yeah and people do it for movie clips uh people do it for social clips like you know those viral clips where you see when somebody posts some breaking news story on x.com formerly known as twitter and then all of a sudden all the reporters reply back hey it's abc news hey it's nbc news hey

SPEAKER_151: it's cnn can we use have permission to use your clip there's a company i think it's called story full and

SPEAKER_21: what story full does is they look for those moments they tell the person we will monetize your clip they'll put the clip on a marketplace and tell everybody you can license this for this amount of

SPEAKER_29: money to play on the local news or your website and like i don't know if you know that so if i take a

SPEAKER_35: picture of like a car on the fire or something on the highway and it's i get the video i can monetize

SPEAKER_33: that wow of course you can and so here is story full this company makes a lot of money and the only reason you would know about story full is because you would have shared one of these but story story full sources verify and license breaking news and viral video content in real time and so if you are

SPEAKER_21: you know a news program you know with editors a new york times a cnn you know that you have to get permission for these social videos and so they have relationships and they pay you can see here they have 300 plus broadcast clients etc and so when these crazy you know like that whale humpback well coming

SPEAKER_01: out of the ocean all those citizen journalists did that submitted it to them to say story full has

SPEAKER_21: people out there watching and then uh you can submit the video they'll get yeah they see your things trending they'll get in touch with you got it or you can just go there and submit it and make money from your video so you have to have a submit thing so that's story full that's crazy yeah so you know if you or i as non-commercial entities retweet something yeah you're not going to get in trouble for that a retweet is not taking it and then commercially using it yeah and so nobody's really

SPEAKER_23: going to sue you for that and if you put it on a social media platform that has retweeting that's considered like safe harbor no big deal but if i take it and i put it on cnn or i put i download the

SPEAKER_21: video and then put it on my re-upload it to my account yeah and i monetize it then you're in trouble and that's what story full does is they've created a way to be a clearing house for all of this so those 300 broadcast channels go onto story full and they say you know what we need something for the 11 o'clock news just grab hey you're never going to believe what happened when this couple went to

SPEAKER_391: sea world oh my god they got splashed with a bunch of water how crazy is that susan you know that kind

SPEAKER_392: of kooky yeah you know you should do a whole episode in that voice oh god yeah i can only keep

SPEAKER_395: that voice up for like 90 seconds before it actually hurts because it's so high energy oh

SPEAKER_151: whoa it's crazy this is the innovators dilemma when you're open ai or an open source model you can

SPEAKER_33: do whatever the hell you want you got nothing to lose when you're google and you already have these relationships and you have deals they're they're just really scared of getting sued or having a class action lawsuit and they know better because they've got 20 years of lawsuits and legal actions and you know the people at google indexing stuff have had the people at the new york times come and say here's what you can take here's what you can't take and then you know these this is what happens after multiple decades opening eyes like yolo bring on the lawsuits we're brand new they they don't have

SPEAKER_151: the induction the institutional knowledge relationships and or scar tissue well i was going to say scars are the

SPEAKER_21: biggest ones right where yeah they make you gunshot right yeah the one thing sam said is hey we're not touching music right now and he was like yeah i just believe in artists i wouldn't do it in the style of i wouldn't say do it in the style of dire straits or rolling stones because they know they're

SPEAKER_04: gonna get sued everyone understands the history of um napster and you know bingo you know music industry

SPEAKER_21: understands the value of their content and their rights and they are predicated on protecting those rights yes the news industry and content sites they don't bother photographers sometimes they bother

David Friedberg: sometimes they don't video if it's disney yes they do right well you know why if you think about content

SPEAKER_02: as these like concentric circles or pyramid or whatever there's not that many big artists so it's

SPEAKER_184: easy to protect them yes there's a small number of artists on the fat tail of the long tail yeah

SPEAKER_23: whereas forbes articles they produce 10 000 a day of the schlock articles on fortune forbes all these places yeah you know whatever you know there's a 10 000 sub stacks get published today that kind of stuff those people are not fighting to protect their rights but yeah every single rolling stone song is

SPEAKER_33: violently protected every single star wars and marvel character is violently protected and he said i said you know i noticed you can't um do darth rader but i did know you could do the concept of a sith lord and he's like yeah that kind of makes sense doesn't it like one's a concept a jedi one's a i specific

SPEAKER_151: character and so you know they're i guess their red teams are doing all that but anyway i think

SPEAKER_411: yeah i get it you know kind of i i think google they're all concepts within star wars yeah but the

SPEAKER_200: concept of a hero or a villain is not the concept of a laser sword probably existed before star wars or

SPEAKER_413: a sword certainly did or a sword that's got superpowers excalibur has superpowers yeah of course like a powerful sword or a sword made of fire has existed before star wars right what's the tail on

SPEAKER_117: content predict uh content protection 50 years i think it's 75 after the life of yeah laying uh let's

SPEAKER_212: ask what is the length of protecting characters in the united states whatever copyright there you go

SPEAKER_21: what is the life of the author plus 70 years yeah that's what i said left the author plus 75 years 70. so the reason that keeps growing is because of um mickey mouse so they kept they called it the mickey mouse rule right so for works published before 1978 the term is 95 years from publication right so they kind of grandfathered everything in yeah so whenever you published it 95 years and the sorcerer mickey uh will not enter the for example 1940s film fantasia version of mickey mouse known as sorcerer mickey will not enter the public domain into 2036 the cartoon style shorts will not enter until 2100

SPEAKER_23: so steamboat willy in black and white is now uh so see that the state i know more about this than i should the steamboat willy version of black and white features a more simplistic style that was the

SPEAKER_33: one that just became public domain on january 1st 2024 in 1928 so this is why they keep updating the style of the characters they keep updating the style so that they reset it that's why you see

SPEAKER_21: new versions of thor or slightly modified versions of iron man if they keep changing it they can keep protecting it and then you might be using some old one that doesn't look like the old one right clever

SPEAKER_132: right yeah jake i think we have to part two this there's definitely part two this thank you everybody

SPEAKER_21: for tuning into this week in startups part one please this is part one we got a lot more to do console.grok.com with a q sign up as a developer let's get sunny's uh equity position and my equity position in grok to the moon you can follow sunny x.com sundip i'm x.com jason joining us as co-host of this week in startup shortly alex wilhelm formerly of tech crunch x.com alex i cannot wait to get a new co-host in here sunny will still be doing ai by the way be the co-host for the other couple episodes every week we'll see you and by the way mark souster of up front ventures has been doing four episodes for me so like johnny carson or jimmy kimmel i have some people sit in and do hosting for me uh mark souster thank you to my pal mark souster he's doing four episodes i think two of them are up already they're amazing go check them out and you'll see them in the feed so if you don't see me on an episode don't worry not going anywhere but with four episodes a week 200 a year plus all in that's 250 episodes a year i'm going down to like 150 and then 100 will be done by uh people in my network

SPEAKER_37: can i say something and jacal's team makes it quite easy you gotta do your work you show up with

SPEAKER_35: your microphone and your computer and that's it so everyone that's wanting to do pods that has to go through the entire uh arc of the content then you have to record it then you have to edit it then you have to publish it marketing you've got a machine yeah yeah i'm trying to make this week in startups

SPEAKER_33: twist into a platform so i think i'm going to start referring to it just as twist and then it'll be like twist with mark souster twist ai whatever just you have this weekend startups and you know if it goes to seven days a week because it was at six days a week at one point if it goes to seven days a week again that would be okay with me i just can't do seven days a week and all in because that'd be eight and then i have no life and then you know you look at these people who do a daily talk show at night they lose their minds yeah they eventually james corden you know charlie rose howard stern anybody who does this every day the burnout is too much yep see you all next time bye bye