HomeVideos

The State of AI: Models, Moats, and the Consumer Renaissance

Now Playing

The State of AI: Models, Moats, and the Consumer Renaissance

Transcript

1124 segments

0:00

to help me break down all things uh

0:02

around this incredible abundance. I'm

0:04

gonna bring up Anisha Charia.

0:07

>> Hi.

0:08

>> Awesome. Awesome. Awesome. Hey, Anish.

0:10

Uh Anish and I were at the at GP offsite

0:13

uh earlier this week and and he shared

0:15

with me that he's already running

0:17

Grockbot uh and has purchased a bunch of

0:19

jeans for him. So, Anish, do you want to

0:21

do you want to drop what you purchased?

0:23

>> True story. True story. Yes. So, I'm

0:25

going to reveal an important secret um

0:27

protected IP, which is that I mostly

0:29

wear frame jeans. Frame is a great

0:31

brand. Um,

0:32

>> and Grock Bots is an awesome product.

0:34

Actually, I'd say the kind of defining

0:35

characteristic of Grockbots is sort of

0:37

resourcefulness. You know, I went to bed

0:40

a few nights ago and said, "Hey, uh, buy

0:42

me a pair of jeans that are inspired by

0:43

these." I took a photo of my current

0:45

jeans. Um, I said, "Don't spend more

0:47

than $500 and get it done." I woke up in

0:49

the morning and it had researched, found

0:51

a pair, same fit, different wash, used

0:54

my credit card, purchased them and

0:56

they're on the way. So, I think that is

0:57

going to be something that we see more

0:59

and more of. We already have the

1:00

capabilities and now a lot of the kind

1:01

of unlock will come from resourcefulness

1:04

um and also the kind of product

1:06

architecture delivered in a way that

1:07

most consumers um can understand.

1:10

>> Awesome. Awesome. Awesome. Yeah, I told

1:12

my team that I'm going to set my bot to

1:14

finally take care of the pile of things

1:17

I've been promising my husband that I'm

1:18

going to sell [laughter] for the last

1:20

two years. That is the project for for

1:22

this weekend. Uh so Anish, we asked the

1:26

question earlier, which one of today's

1:27

AI leaders will be the clear winner in

1:29

three years from now? What's what's your

1:30

take?

1:31

>> I'm a many winners guy and I see I'm in

1:33

a you I'm in good company with many of

1:34

you. I mean, if you look at what's

1:36

happened in the last two weeks, um, you

1:38

know, XAI went from not even being a

1:41

real contender on the model side to

1:42

being, you know, one of three. So, we

1:45

extraordinarily went from a two- horse

1:46

race to a three-h horsese race. And, you

1:48

know, even more broadly over the course

1:50

of the year, we went from anthropic

1:52

feeling like they were so dominant, they

1:53

could do no wrong to OpenAI who's just

1:56

had an excellent three months. You know,

1:57

the new models are exceptional. The new

2:00

codeex harness and chatgpt desktop app

2:02

is very well done and we're seeing the

2:04

sort of specialization in different

2:06

directions of these labs. They're both

2:07

growing like crazy, you know, despite

2:09

each other's continued successes. Um,

2:11

XAI and as openweight does well. Um, so

2:14

I'm definitely in the many winners camp.

2:16

>> Yeah, it's interesting to see the

2:17

sentiment also on X, which is not always

2:19

a perfect, you know, uh, weather vein

2:21

for the future, but but oftentimes a

2:23

early indicator of at least where

2:25

developer sentiment is. And there's been

2:26

a lot of push back from Claude it seems

2:28

like recently on people uh in terms of

2:31

token usage etc. And so you know

2:34

developers tend to be fair weather fans

2:35

on these things they will go where the

2:37

latest and greatest and very best model

2:39

isn't and particularly the last six to

2:41

eight weeks I think we're going to see

2:42

some very interesting um traction in

2:45

terms of the flow of activity but

2:46

obviously anthropics going public uh

2:48

later this year um and also you know

2:51

there's a lot of lot of keen interest on

2:52

this. So with that uh that actually

2:54

brings us straight into the topic of

2:56

discussion today. So where where and

2:58

what is next in the next frontier of

3:00

intelligence.

3:02

>> Amazing. Thank you Jen. So let me tee

3:03

this up for everybody. Um and please hop

3:05

in if you've got questions. So let's

3:07

first cover the kind of macro and what's

3:08

happening um at a market level. Then

3:10

we're going to hop into the application

3:12

layer broadly and sort of talk through

3:14

why applications are the productization

3:16

of the intelligence primitive. And then

3:18

finally let's talk about consumer. you

3:19

know, with the launch of Grockbots and a

3:20

few other products, it's actually been a

3:22

very fun um couple of weeks in consumer.

3:25

Okay. Uh hopefully our our dear friend

3:27

Leopold doesn't mind me poking a little

3:29

fun at him here with situational

3:30

awareness, please. Next. Um all right.

3:34

Look, I think that the kind of case for

3:36

this being a bubble um is over sort of

3:38

discussed or at least fully discussed. I

3:40

think actually the out of distribution

3:42

topic that's less discussed is what if

3:44

we're insufficiently optimistic? And if

3:46

you look at some of the underlying

3:48

indicators, what they point to is

3:50

essentially infinite demand and highly

3:52

constrained supply. You know, things

3:54

like B200, which is a non sort of

3:56

cutting edge GPU prices going up on a

3:59

per hour basis. That is very uh strange.

4:02

Normally, we see these things be highly

4:04

deflationary and it sort of points to

4:06

very constricted supply and essentially

4:08

infinite demand. So we're thinking and

4:11

talking a lot about what's the kind of

4:12

informed case for optimism here given

4:14

some of these second order indicators.

4:16

The SAS bubble was a very or the SAS

4:18

sort of uh you know whipssaw was an an

4:21

interesting peak into market psychology.

4:24

You know back in February when we saw

4:26

this you know 30 to 40% draw down on a

4:28

bunch of SAS names. We said that the

4:30

market has oversold software. Lo and

4:32

behold here we are many of those names

4:33

are back up 40%. So I'm not quite sure

4:35

what we collectively accomplished, but

4:37

I'll tell you what we said then, which

4:39

is still true today, which is for the

4:41

enterprise, software spend is 8 to 12%.

4:44

It's just not a huge proportion of

4:46

spend. So the upside to vibe code your

4:48

own payroll or CRM is not particularly

4:50

high. The downside is essentially

4:52

unlimited. You know, obviously there's

4:54

all kinds of sort of compliance um

4:56

implications of not getting things like

4:57

payroll right. So most enterprise

4:59

software today demands a level of

5:01

precision that just isn't afforded by

5:04

coding agents. Um the the one thing that

5:06

has happened though is the sort of tide

5:08

has receded. So for a lot of SAS

5:10

companies had a ton of SBC and you know

5:13

things that distorted their economic

5:15

performance. I think that's very much um

5:17

visible now and they're going to have to

5:19

sort of accelerate or die. So, so less

5:21

bleak for the SAS uh sort of market than

5:24

perhaps we all collectively thought for

5:26

a few months there. But still some sort

5:27

of existential questions to address. You

5:30

know, there's been a huge sort of

5:31

discussion of moes. Are there any moes?

5:33

There's no more moes. And it's it's very

5:34

funny because if you actually study u

5:36

moes, which I think are most famously

5:38

codified in the book seven powers that's

5:40

one of my favorites. The vast majority

5:42

of moes actually are not affected by

5:45

abundant lowcost intelligence. You know,

5:47

when you think about network effects,

5:49

scale effects, which shows up in

5:50

distribution, brand effects, which we

5:52

tend to discount in Silicon Valley,

5:54

these things are as good as they've ever

5:55

been. You know, no amount of coding

5:57

agents is going to make Nike not Nike.

5:59

And Instagram, um, the power of

6:01

Instagram was never the complexity of

6:02

building the Instagram app. Of course,

6:04

it was the kind of network behind it.

6:06

So, you actually think the majority of

6:07

modes are as good as they've ever been

6:09

and and of course are still crit

6:10

critical to building compounding value.

6:12

There are a couple of modes that are

6:13

exposed. For me, the integration mode is

6:15

the most obvious one. You know, SAP is

6:17

is so famously complex to integrate into

6:20

and out of that it's a sort of

6:22

existential risk to even migrate from

6:24

one version of SAP to the next. Coding

6:26

agents makes this dramatically better. I

6:28

think there's a bit of an existential

6:29

question actually for SIS and gsis as to

6:32

what will their value be when they've

6:34

historically been this sort of point of

6:35

integration. So, I do think this moat is

6:37

a little bit at risk, but for the other

6:39

traditional modes, they persist and

6:40

they're as important as they've ever

6:41

been. Yeah, I think this is a really

6:43

important concept. You know, as you

6:44

start to think about what are the job

6:46

functions in the enterprise that are

6:48

alpha creating, it's typically product,

6:50

sales, engineering, research, and

6:53

conversely, what are the job functions

6:55

in the enterprise that are sort of maybe

6:57

administrative is is uh too uh too

6:59

bleak, but they are supporting other

7:01

functions, legal, um HR, finance, etc.

7:06

We really think that the kind of

7:07

rational architecture and the one that

7:08

is emerging is that for jobs that um

7:11

have unlimited upside like sales or

7:13

product you always want to use frontier

7:15

tokens. And the reason for that is you

7:17

just don't know what the value of the

7:19

new product feature or closing a

7:20

customer account is. It's effectively

7:22

unbounded and therefore it's

7:24

economically rational to pay almost any

7:26

price for a model that's even one IQ

7:28

point smarter. You know, your Fable 5 or

7:30

your Gro uh or your um GPT56.

7:34

Conversely, when you talk about

7:35

something like finance, you know, the

7:37

best way to close the books is

7:39

accurately. You can't close it, you

7:40

know, 10x better than accurately. So, as

7:43

a result, you kind of have this bounded

7:44

upside problem where it makes sense to

7:46

use openw weight models with

7:48

reinforcement learning for the kind of

7:49

paroefficient um cost curve. Maybe

7:52

before we we go off this one because

7:53

this is a big debate and and again when

7:55

Kimmy dropped a few weeks ago there was

7:56

a lot of consternation uh about this

7:59

this topic just given the relative cost

8:01

which was the focus of of the topic of

8:03

discussion. But you know um our our

8:05

founder Jesse Zang from Decagon dropped

8:07

this great post around the fact that in

8:09

some respects and and for a lot of

8:11

companies like Decagadon open source is

8:14

actually the only option. It's not just

8:16

cost. It's it's that they can actually

8:17

localize it, train, fine-tune it. And so

8:20

maybe unpack a little bit of that

8:22

configuration. Talk through the the

8:23

nuances there and why folks shouldn't be

8:25

concerned even though that is the case

8:27

for startups that there's a lot in the

8:30

way of abundance around this topic.

8:32

>> Yeah, I mean one of the big topics that

8:34

we're seeing or one of the big trends is

8:35

that there are just one there are sort

8:36

of comparative advantages of different

8:38

models. So and the models often have

8:41

sort of areas of focus that are almost

8:42

at um tension with each other. So you

8:45

see a certain set of models that have a

8:46

high degree of neuroticism. Like there

8:49

sort of autistic models. GLM52 and GLM53

8:53

are great examples of this where they're

8:54

very literal and they'll only do exactly

8:56

what you told them to do and nothing

8:57

more. Then we're seeing models like a K3

9:00

um that are just much more sort of open

9:03

and they're very presumptuous and

9:05

they're creative and there are roles for

9:07

both types of models in the organization

9:08

and and often the sort of shapes of

9:10

those minds if you will are at odds with

9:12

each other. So that is like one reason

9:14

you actually want to have multiple

9:15

models. The reinforcement learning is a

9:17

really important point. Um you know if

9:19

you actually have a problem that you can

9:21

specialize the model around with your

9:24

reasoning traces, you can start to

9:25

create this compounding advantage in

9:27

your domain for your customer base where

9:29

you're able to kind of shape the

9:31

intelligence to be better than any

9:33

general intelligence for your problem. I

9:35

know Harvey's had some great results

9:37

with this as well. Now the trade-off of

9:39

that kind of reinforcement learning is

9:40

you lose generality. So if you have the

9:42

best sort of model that's fine-tuned for

9:44

solving legal problems, it may not be

9:46

great at solving sort of theoretical

9:48

math problems and that's okay for

9:50

Harvey's uses or in the case of decagon

9:53

customer support. So this sort of openw

9:55

weight specialization property is

9:57

something that's very unique and one of

9:58

the reasons our startups are selecting

10:00

them. This is also a big topic. We've

10:02

learned so much since January. We should

10:04

really do this monthly gener. Yeah. I

10:05

mean honestly we there's just so much

10:07

changing. So in January February there

10:09

was a lot of discussion and it's it's

10:11

very idiosyncratic and interesting. You

10:12

know anthropic quad released what is

10:15

called a legal plugin. You know plugins

10:17

are just collections of skill files. You

10:19

can think of it as a zip of skill files.

10:21

Skill files are just prompts. They're

10:22

just long prompts. And there was this

10:24

huge panic and all of a sudden Thompson

10:26

Reuters and a bunch of other sort of uh

10:28

you know big legal names traded down

10:30

dramatically. But those were really just

10:32

prompts. And there's a lot of discussion

10:33

about if labs were going to integrate

10:36

vertically integrate up into the

10:37

application layer. Instead, we've seen

10:39

the very opposite, which is yes, they

10:41

are vertically integrating, but they're

10:42

vertically integrating down into

10:43

inference and compute. It's actually

10:45

logical now um in hindsight because the

10:48

workloads for inference are very

10:50

homogeneous. So, you can build enormous

10:52

scale in one part of the value chain.

10:54

Whereas when you think about the

10:56

application layer, you know, you've got

10:58

so many idiosyncrasies and unique needs

11:00

in terms of pricing, packaging, um, sort

11:03

of productization, how the market wants

11:05

to buy. So, it's actually a much more

11:07

challenging and opex heavy proposition

11:10

to move into the application layer

11:12

versus moving down into the inference

11:14

layer. And this is the point I alluded

11:16

to earlier, which is sort of this

11:17

discussion of model commoditization. And

11:19

you know if you use the models every day

11:21

which I do I sort of hold myself to a

11:22

standard of making something either

11:24

small or big with every model that comes

11:26

out you you start to appreciate the fact

11:28

that these things are are not

11:29

commodities that they have comparative

11:32

advantage at a domain level. So a great

11:34

example is open AI with their new um GPT

11:37

models are just so so good at knowledge

11:39

work. The harness is also very well set

11:42

up for knowledge work. You know if

11:43

you've used the chat GPT desktop app you

11:45

know what I mean. If you haven't please

11:46

install it. It's very very cool and

11:48

interesting and it's the perfect sort of

11:50

when I say harness I kind of mean kind

11:52

of product container like a browser. Um

11:54

it's the perfect product container to do

11:57

spreadsheets and slide presentations and

11:59

written documents and all of that type

12:01

of work. If you look at cloud code which

12:03

many of you I'm sure have used it's just

12:05

so oriented towards software engineering

12:07

you know it's in a terminal UI.

12:09

Everything from the small design

12:10

decisions to the areas in which it

12:12

specializes like code planning and code

12:15

testing is oriented towards the software

12:17

engineer and there are many trade-offs

12:19

both products are making for that sort

12:21

of respective specialization. So one

12:23

you've kind of got this domain level

12:25

specialization that's already occurring

12:27

and then two as I mentioned earlier

12:29

you've got this sort of I think of it as

12:30

the big five sort of personality traits

12:32

if if folks have studied that you know

12:34

you can't be both highly open and highly

12:37

neurotic. Um, and you know, sometimes

12:39

when you have an intelligence you're

12:41

applying to an accounting problem, you

12:42

want neuroticism. When you're applying

12:44

it to a design problem, you want

12:45

openness. So you actually have a need

12:47

for both types of minds in the

12:49

organization, which is why you would

12:50

select something like a GLM53 versus a

12:53

Kimmy K3. So definitely not commodities

12:55

in our view. This is an important point.

12:58

You know, there are many product

12:59

categories in which model aggregation

13:01

delivers a greater than sum of parts

13:03

outcome. And you know, a good metaphor

13:05

for this is Expedia. You know, it's so

13:07

much more useful to use Expedia than it

13:08

is to go to United, then to go to Delta,

13:10

then to go to Southwest. You just want a

13:13

single place where you can benefit from

13:14

seeing every airline's inventory.

13:17

Similarly, you know, in coding, we're

13:19

actually seeing this with cursor a ton

13:21

where you want to do a very frontier

13:23

model for planning, for example, but

13:25

then you can use a lesser model for

13:27

execution and you really need to have

13:28

one product harness or sort of product

13:30

architecture that lets you use multiple

13:32

models. Creative Tools is another great

13:34

example where you've got, you know,

13:36

models that specialize in different

13:37

modalities. So you've got something like

13:39

an 11 Labs which of course is incredible

13:41

at voice music as well and then you've

13:43

got something like Black Forest which is

13:45

doing such an excellent job in kind of

13:47

video and and creative direction and the

13:49

correct product is to bring all of these

13:51

together into one shell. And then

13:53

finally research and decisions. We see

13:55

this all the time where you know the

13:56

models are trained with sort of non-over

13:58

overlapping data sets often. So you're

14:00

able to just get more information by

14:02

running the same query through many

14:04

models adversarially and then having a

14:06

separate model sort of help you

14:07

converge. This is a place where the

14:09

application layer really shines because

14:11

labs of course are both incentivized and

14:13

structurally only able to provide their

14:15

own in-house models. You as an

14:16

application sort of aggregator can

14:18

provide the best of breed. Okay, let's

14:20

jump into the apps layer. Now the key

14:22

point about the application layer is

14:24

that you know intelligence is a

14:26

primitive just like buying cloud is a

14:28

primitive and what does Salesforce do?

14:30

It sort of takes the you know AWS cloud

14:33

primitive and turns it into CRM software

14:36

that delivers an economic outcome for

14:38

all of their customer segments. The same

14:40

thing is true of the AI application

14:42

layer. You know it's great to have the

14:44

raw intelligence primitive but you

14:46

really need Harvey to turn that into an

14:47

economic outcome for the legal industry.

14:50

Similar for somebody like credit unions

14:52

is a really interesting market segment

14:54

where they're so idiosyncratic in how

14:55

they want to buy products, how they want

14:57

the product sort of productized and and

14:59

the shape of the ambition for their

15:01

market. You know, most credit unions

15:03

don't want to uh decrease their

15:04

headcount by half. They want to double

15:06

it, right? And they want to double it

15:07

while having a an economically

15:10

performant business. So, it's just a

15:12

very um specific way that they see the

15:14

intelligence primitive playing out in

15:16

their market segment. and the

15:17

application layer's opportunity is to be

15:19

the one that kind of delivers that. This

15:21

is a bit of an advanced concept, but I

15:22

think an important one. If you look at

15:24

the kind of way that the evolution of AI

15:26

use um has gone, it's gone from

15:28

prompting models to putting models in

15:30

loops. You know, the the term agent is

15:32

overused, but agent is just a model in a

15:34

loop with sort of tools and memory and a

15:35

few other things. A great example of

15:37

this is coding. You know, we've all seen

15:39

this from um software companies, which

15:41

is a bug gets reported, it gets

15:43

reproduced, a fix gets generated, it

15:45

gets verified. If it's a low-risk fix,

15:48

it gets integrated and shipped and maybe

15:49

the customer gets an email saying your

15:51

bug was fixed. If it's a high-risisk

15:53

change, perhaps a human reviews it. But

15:55

that way, every bug that actually gets

15:56

reported to the enterprise now gets

15:58

autonomously fixed through this coding

16:00

loop. As you start to take that idea and

16:02

apply it to other parts of the business,

16:04

things like price optimization, things

16:06

like procurement, these are very natural

16:09

sort of business loops that occur that

16:10

can be fully automated by these models.

16:13

And then perhaps the most ambitious type

16:15

of loop is the business loop, which is

16:17

hey, you make a change that's very

16:19

crosscutting to the business and the

16:20

model comes back and says, hey, I think

16:22

we need to open a branch in Tijana. Now

16:24

the model can't do that autonomously but

16:26

it can make a change at the sort of

16:27

surface level of the entire business

16:29

which is extraordinary. This is how

16:31

enterprise automation is going to occur

16:33

through AI and I think for me coding has

16:36

just been over and over again an

16:37

illustration legal is another great area

16:39

of industries not markets. This is

16:41

something that Mark says and he's so

16:43

right which is if you look at

16:44

intelligence as a primitive let's think

16:46

now about coding intelligence as a

16:47

primitive. All of these products are

16:49

working in their sort of respective

16:50

areas of the stack. You know, Quad Code

16:52

does such an excellent job of kind of

16:55

exposing the raw hardware, so to say, to

16:57

the developer all the way up to replet,

16:59

which is a great abstraction layer for

17:01

the average small business owner that's

17:02

unfamiliar with code. These are

17:04

variations of sort of pricing,

17:05

producting, pack, productization,

17:07

packaging for the coding primitive and

17:10

intelligence and all of them are working

17:12

as a result. So, I think a big mental

17:14

model shift for us is ensuring that

17:16

we're assessing these as industries, not

17:18

necessarily simple markets. Okay. and

17:21

consumer consumers had a really cool

17:22

couple of weeks. You know, we've been

17:24

saying for, you know, for three years

17:25

that this is going to be consumer's

17:26

quarter, but I I think that this might

17:28

be consumer's quarter. Let's go into it.

17:30

The things that have actually held back

17:32

consumer um so far have been a couple of

17:34

things. You know, the first is consumers

17:36

don't love paying for software. We've

17:38

learned this lesson um over and over

17:39

again. And unfortunately, unlike the

17:42

sort of magic of software in the past,

17:43

um AI software has marginal costs of

17:46

distribution and engagement. And the

17:47

marginal cost can sometimes be very

17:49

high. you know, I built a an app I use

17:51

to help me browse my X timeline and it

17:53

costs $250 to onboard a new user. So, if

17:56

I'm a startup founder looking at that,

17:57

looking at a kind of $250, even with a

18:00

$0 TC onboarding cost, it's very hard to

18:02

make a mass market free product work.

18:04

That is changing now because of openw

18:06

weightight models, dramatically cheaper

18:07

and more performant. You know, the

18:09

second is we've never had an AI native

18:11

distribution channel. There's no app

18:12

store for AI. So, this actual product

18:15

cycle for consumer looks more like web

18:17

2.0 know where you have to kind of build

18:19

the channel alongside the product and

18:21

less like mobile where you actually have

18:22

the central point of distribution for

18:24

the entire ecosystem. Then the final

18:26

point I think is an important one. You

18:28

know command line is we're sort of in

18:29

the the DOS era of AI and for this

18:32

technology and its capabilities to sort

18:34

of fully be embraced by consumers. We're

18:36

going to need the windows so to say. So

18:38

I think there's just a ton of work to be

18:39

done around product and design craft to

18:41

ensure that consumers know how to

18:43

consume um all this magical new

18:45

capabilities.

18:46

two things are working. Um, so coding

18:48

agents is are extraordinary. I know have

18:51

been discussed. I think it's it's

18:52

interesting to think about how they work

18:53

for consumers. You know, if you think of

18:55

this concept of the digitally native

18:57

entrepreneur, if you're not a

18:59

programmer, the way that's historically

19:01

shown up is you're a YouTube creator.

19:02

And there's a whole moral panic that we

19:04

had, you know, 10 years ago about the

19:06

kids want to be YouTube creators, not

19:07

astronauts. But I would interpret that

19:09

instead as the kids actually who grew up

19:11

on the internet want to build businesses

19:13

on the internet and the only way to do

19:14

it again is being a creator. Now with

19:16

coding agents you can build a software

19:18

product that generates $100,000 of

19:20

revenue a year, a million dollars of

19:21

revenue a year. Now these are not

19:23

venturebackable businesses but it's a

19:25

sort of mom and pop SAS opportunity

19:27

which is emerging and I think very very

19:29

cool for the country. personal agents.

19:31

We had this collective moment of

19:33

excitement around openclaw um in January

19:36

and it was an extraordinary sort of

19:38

composition of primitives but it never

19:40

really crossed over into consumer. You

19:41

know it was sort of a developer oriented

19:43

thing more of the homebrew computing

19:46

club kind of energy. Um we're starting

19:47

to see with the emergence of Grockbot

19:49

and chat GBT work personal agents being

19:52

turned into software that consumers can

19:54

use. Anisha actually um do you mind just

19:56

pausing on this before we go to the town

19:57

demo because you know you you were a

19:59

founder um building in the last era of

20:02

the the consumer app experience and when

20:05

I even think about I was like gosh how

20:06

do you even define consumer today

20:08

because you know the plumber that

20:10

utilizes now Grockbot to completely turn

20:13

around their business end to end like is

20:15

that consumer or is that enterprise

20:17

because like it's very like it's almost

20:19

like a like PLG

20:22

>> movement but but it's coming from as a

20:24

consumer consumer that then cross over

20:25

into enterprise and and particularly

20:27

like the last era of consumer

20:29

application is more towards

20:30

entertainment as a way to to monetize

20:32

and so maybe unpack some of that and and

20:34

particularly where you've been spending

20:35

time as a part of that.

20:37

>> I mean our simple rule is if you cannot

20:39

justify acquiring the customer through

20:41

sales which usually means a 15k ACV you

20:44

have to acquire them through marketing

20:46

we think of them as a consumer which is

20:48

most small business owners. So I think

20:50

that the plumber is definitely the

20:51

consumer in our sort of investing mind.

20:54

Entertainment is huge and there's going

20:55

to be a bunch of AI native entertainment

20:57

companies. You know I would argue

20:58

character was kind of an entertainment

21:00

company. There's been a huge trend

21:02

around short form drama mostly in Asia

21:04

and that's starting to come over here.

21:05

Many of those are generative or sort of

21:07

generative assisted. So I look I think

21:10

entertainment is going to be massive.

21:11

Most people want to spend time not save

21:13

time and consumer is not that interested

21:14

in productivity. So that's definitely

21:16

going to happen. Um and probably worth a

21:19

separate deep dive. Okay. And I think

21:21

town for folks who have used it, it's

21:22

it's just such a magical experience. And

21:24

you know this is like the the number one

21:26

sort of um piece of advice I give to

21:28

everybody, friends, family, uh folks in

21:30

the industry is like please just use the

21:32

products because it's so easy to build

21:34

intuition when you see how they change

21:36

day-to-day. And town is an investment um

21:38

our partner Alex Rampel made. It's

21:40

really extraordinary uh productivity

21:42

product and you sort of see how the

21:44

compounding um improvement of the

21:46

product through memory advantages it

21:49

over time. So the first day you use a

21:51

product it doesn't know you that well.

21:52

It's sort of like an employee a new hire

21:55

who's just getting up to speed. By day

21:57

30 it's able to make excellent

21:59

assumptions on your behalf because it

22:00

just has soaked in 30 days of sort of

22:03

context, memory and skills. And this is

22:05

a pattern that we're seeing more and

22:06

more. The sort of compounding value

22:08

being delivered to the end customer

22:10

showing up as retention in the business

22:12

and sort of showing up as pricing power

22:13

on a per customer basis.

22:16

>> Yeah, this is a great one because uh

22:17

folks can utilize town for their

22:19

personal use case. Uh and it's a free,

22:21

you know, trial. They give you I think

22:23

something like 40 uh credits to start or

22:26

something around there. Um and so you

22:29

can kind of see it once you plug into

22:30

your personal email how productive it

22:32

actually is. Um, on the professional

22:34

front, I'm always inbox zero. On the

22:36

personal front,

22:37

>> my inbox is like 20,000. Uh, David

22:40

George is is probably cringing on the

22:41

inside here just because it's

22:43

unacceptable. However, uh, you know,

22:45

personal life things are common. So, if

22:46

you email me in my personal, I will

22:48

never respond to you. However, I plug

22:50

into it and like I don't even check

22:51

anymore. If there's something important,

22:52

town will surface it to me. And also, it

22:54

does all the scrubbing of like

22:56

subscriptions and all the things that it

22:57

can optimize and it's starting to now

22:59

self-improve upon itself. So like it'll

23:02

send you emails where it says like hey

23:03

this routine is costing this much like

23:05

here's how you could actually save your

23:07

credit swe. So it's sort of this this

23:09

unlock into what starts on the

23:11

productivity side and to your point

23:12

maybe people won't pay for that

23:14

personally but once it starts to get

23:16

locked in and then expand in terms of

23:17

the remit you're like okay I'll pay the

23:19

whatever x bucks you know just because

23:21

it helps to manage my life and I can put

23:23

it on autopilot.

23:25

Yeah, it's such a great point, Shannon.

23:27

Like my mental model for this is just an

23:29

experienced employee, a tenure employee

23:31

versus a new hire. You know, the new

23:32

hireer may be brilliant and may even

23:34

cost less than tenure employee, but we

23:36

all know the value of a tenure employee.

23:37

They're just able to make great

23:38

assumptions on behalf of the

23:40

organization and you. And you know, may

23:42

this is a little philosophical, but I

23:44

think this is where it all goes. Just as

23:45

we talked about kind of coding loops and

23:47

business loops for the enterprise, we

23:49

think there's a set of loops that are

23:50

informally defined that really um sort

23:53

of lay out a consumer's life. think of

23:56

um family, friendships, money, health.

23:59

These are all areas where you have sort

24:02

of changing information, decisions,

24:04

agency, execution, and then the loop

24:07

continues. So, we're starting to see

24:09

some of these sort of loops emerge

24:10

around self-improvement, kind of health

24:13

and finance are the two areas that

24:14

OpenAI is focused on. We've seen a bunch

24:16

of startups working on shopping, but we

24:18

think that like the kind of way that

24:19

this ends up playing out is a dramatic

24:22

quality of life improvement for the

24:23

consumer and um and that really follows

24:25

the shape of past product cycles where

24:28

80% of the surplus is delivered to the

24:30

mass market.

24:31

>> Do you think each that all of these uh

24:33

sorry maybe just going back to the to

24:35

the last slide there's a question here.

24:36

you know, when you think about these

24:37

personal agent examples, whether it be

24:38

town or ethos, etc., all point to, you

24:42

know, kind of one assistant having

24:44

context, but it seems like there's many

24:45

different options. Do you think it'll

24:47

end up being, you know, sort of one

24:49

dominant platform for this personal

24:51

aspect of your life as as time

24:53

management? Um, or will it be like an

24:55

operating system where you have many

24:56

kind of talking to each other and kind

24:58

of configuring on the back end?

25:00

>> I the comparative vantage point kind of

25:02

comes to mind. you know, I think the the

25:03

characteristics you want from your CFA

25:05

are different from the one that you want

25:07

from your sort of party planner. Um, and

25:10

that just the surface area is so broad

25:12

that I think that yes, there's

25:13

overlapping bits of context. And I think

25:14

Grock Bots has done a nice job of kind

25:16

of illustrating this in product or you

25:19

have many bots that are pointed in

25:21

slightly different directions that all

25:22

coordinate to deliver a globally optimum

25:24

uh optimal outcome.

25:26

>> There's a few questions. I'm going to go

25:27

back to topics you've covered earlier.

25:28

So if the application layer captures

25:31

economic outcomes, how do you think

25:34

about the competition from the model

25:36

companies um and what will they allow

25:39

value accretion to happen downstream and

25:40

and you know are companies at the app

25:43

layer able to compete with the frontier

25:45

labs going after that particular market?

25:48

>> I mean I I think so again I think that

25:50

we're we're underestimating the kind of

25:51

complexity of product pricing packaging

25:54

and how the end customer wants to buy.

25:56

you know, the way that um you know, a

25:58

teenager wants to consume the

25:59

intelligence primitive is different than

26:01

the way an marketing executive at credit

26:03

union wants to actually consume it. Um

26:05

and it's very heterogeneous. So to me,

26:07

it just makes less sense for um the labs

26:10

to move up to the apps layer than to

26:12

move down to inference. So, you know,

26:15

and that kind of permission point's an

26:16

interesting one. I think if we lived in

26:18

a world of 2023 when it was one model to

26:20

rule them all, it wouldn't even matter

26:22

if you had permission because the labs

26:23

would just take 100% of your gross

26:25

margin over time. But now because you've

26:27

got many options at all points in the

26:29

paro frontier, you know, the labs have a

26:31

harder time actually doing things like

26:33

that.

26:34

>> Awesome. There was a question just on

26:35

traction. So, do you fund anything where

26:37

there's um there there's no revenue at

26:40

this point just given how quickly people

26:42

have been making progress or is it

26:44

extremely difficult? um we try not to I

26:47

I certainly have spent less time um on

26:49

that strategy. Look, I I think that the

26:51

basket is majority investments that are

26:53

showing some signs of working. Certainly

26:55

from a product velocity perspective,

26:56

that used to be something we measure

26:58

pretty carefully. Like it's

26:59

disqualifying to not be showing a live

27:01

product in a pitch at any stage these

27:03

days because it's so trivial to build

27:04

stuff. So almost everything we we're

27:07

seeing are showing signs of you know

27:09

sort of some sort of breakout. I mean my

27:11

model is somewhat simplistic where I

27:13

just sort of look at once you have stats

27:15

sig sales and product if we extrapolate

27:17

from there um do we kind of like the

27:20

price that we have to pay to be a part

27:21

of it and the risks that we're taking

27:23

implicitly and that's I'd say the

27:25

majority of the work that we do look for

27:26

very talented experienced folks we do

27:29

kind of take a small call option which

27:31

looks like a pre- everything round um

27:33

but that's not the majority of what we

27:34

do.

27:35

>> Yeah. Yeah. Well, when you think about

27:37

the the um kind of competitive landscape

27:40

on this uh consumer has been unloved for

27:43

so long um are you seeing now this

27:46

reversion just given it's clear that

27:48

apps is sort of this next layer of value

27:50

creation like the model sort of layer

27:51

has been somewhat set and I say that

27:53

with a huge aster because there might be

27:55

new algorithmic breakthroughs you know

27:57

kind of kind of folks coming out from

27:58

left field as as we have in the

27:59

portfolio as well um but do you feel

28:01

like the shift from the competitive

28:03

dynamic shifting more towards

28:04

application

28:05

>> 100% I It's sort of a renaissance for

28:07

being a consumer builder because you've

28:09

got this extraordinary primitive that

28:11

you can work with. By the way, we now

28:13

have a primitive that can kind of

28:15

operate in the, you know, emotional

28:17

interpersonal domain. You know, you can

28:19

like have a conversation with claude or

28:21

openai or K3 and and feel feelings. And

28:23

we've had 40 years of technology that

28:25

really boosted our intellect and

28:26

productivity, but nothing that kind of

28:28

spoke to our humanity. So, it's a whole

28:30

different technology surface. It's very

28:32

wide. I think there are a set of

28:34

products that labs are just culturally

28:36

not set up and big tech not set up to go

28:38

after. You think about launching, you

28:40

know, a companion product at Google that

28:42

may disagree with you that may um have

28:44

sexual innuendo in it. Like these are

28:46

things that there's a thousand

28:47

committees at Google um are designed to

28:50

prevent. So startups have areas where

28:52

they're kind of uniquely capable and

28:53

then look finally the consumer sort of

28:55

excited to download new software,

28:57

excited to pay for it. It's like

28:58

Christmas 2009 with the iPhone. People

29:00

want to try try new apps, but unlike the

29:02

99 cents days, they're willing to pay

29:04

200 a month. So, it's sort of a

29:06

renaissance for consumer builders and

29:07

and yeah, I think that things have

29:09

changed.

29:09

>> Trying to come up with a joke that the

29:11

autist in San Francisco are keenly

29:13

keenly waiting for this moment for a

29:15

very a very long time. Uh

29:18

there's a there's a good um a question

29:20

from Michelle here. You know, how should

29:21

we think about the new economics of AI

29:23

apps companies because there's a great

29:25

there's a debate around unit economics

29:27

of of um apps companies, right? like for

29:29

example, they may may have lower gross

29:30

margins. They're just getting more

29:31

pressure just because they don't have as

29:33

much compute access. Um capital is such

29:35

a moat in this environment. Um it's it's

29:37

hard to be competitive. So how do you

29:39

think about the economics of of

29:40

underwriting returns in in um in

29:42

companies today?

29:44

>> I mean David wrote a great post on this.

29:46

I think that the kind of the margin

29:47

topic is a lot more nuanced than it once

29:49

was. I think it's actually rational in

29:51

many cases to trade away margin to have

29:53

wider product surface. I think the very

29:55

positive part of what's happening in

29:57

this product cycle is the willingness to

29:58

pay is extraordinary. And that's why the

30:00

exercise that we often do with founders

30:02

is like on the consumer side, for

30:03

example, is if $20 was the historic

30:06

ceiling, what's the $200 a month skew of

30:08

your product? And in fact, what's the

30:10

$2,000 a month skew? Like what's the

30:12

Birkin bag of software? I think we're

30:13

going to have this luxury software.

30:15

We're already seeing willingness to pay

30:16

for it. So the margin topic is more

30:19

nuanced, but the willingness to pay and

30:20

buy is higher than ever. So, you know,

30:22

it's a little bit of fog of war, but

30:24

we're we're thinking about all those

30:25

topics.

30:26

>> Anish dropping Birkin bag framed jeans.

30:29

Like, I had no idea you were such a

30:30

fashion. This is like your your butt is

30:32

helping you get up to to seat here, my

30:34

friend. Uh for a guy secret [laughter]

30:38

is a good steward of capital. Okay,

30:40

that's all that I am.

30:41

>> For for a guy I only see in quarter zip

30:43

ups. I'm just saying. Uh

30:46

>> um Okay, maybe one question for you on

30:48

just on the on the founders because I I

30:49

don't know if you remember this

30:50

conversation. This is probably 5 years

30:52

ago or so. Um where most of the founders

30:55

you saw saw more uh diversity in their

30:59

background in part because the software

31:02

and technology was way more

31:03

sophisticated. So you had a lot of

31:04

program managers spinning out of Google

31:06

for example and starting a company etc.

31:08

What are the type of founders you see

31:09

building an apps today? Are they do they

31:11

tend to lean you know more technical

31:13

more researcher derivatives? Are they

31:16

product managers? like what what kind of

31:17

archetype are you seeing at least the

31:20

early innings of apps come out from the

31:22

woodwork on?

31:23

>> Yeah. Yeah. Less MBAs, more researchers.

31:26

Um and they both have their kind of

31:27

strengths and weaknesses. I think the

31:29

business sophistication of the founders

31:31

are seeing today is lower, but the kind

31:33

of technical sophistication is

31:34

dramatically higher and the technical

31:36

sophistication is kind of upstream of

31:38

all the good things that happened. You

31:40

know, business sophistication can be

31:41

kind of taught and observed, but

31:43

technical sophistication typically not.

31:45

So, we're definitely seeing a much more

31:46

technical kind of earlier career

31:48

founder, but the things they're doing

31:50

are extraordinary because they don't

31:52

have any sort of preconceived notions

31:54

about what's possible. And so much of

31:56

what holds back senior founders that

31:57

don't quite get to the other side of

31:58

this product cycle is, you know, they're

32:00

not close enough to the technology and

32:02

they've got an idea that's rooted in the

32:04

past of what the ceiling is. And I think

32:06

the best thing about these young

32:07

founders is they assume everything is

32:08

possible. You know, we are at an offsite

32:10

where Ben was saying that the the

32:12

biggest risk in the past with the ideas

32:13

were too big and now the biggest risk is

32:15

that the ideas are too small. But I

32:17

think that's sort of illustrative of the

32:18

different founder archetypes.

32:20

>> Yep. Yep. And maybe on that similar

32:22

thread, it used to be that that if you

32:24

gave a founder too much money, it would

32:26

wreck the company because the founder

32:28

almost always has way too many ideas and

32:31

is a visionary and doesn't have the

32:33

talent to actually commensurately

32:36

land with all those ideas. Um and we're

32:39

seeing a whole new paradigm on that.

32:40

Maybe unpack that idea a little bit more

32:42

just uh because it was such a huge theme

32:43

of the offsite.

32:44

>> Yeah, I mean for sure this was a

32:46

historic wisdom. You know, why didn't we

32:47

give every seed company 20 or 50 or

32:49

hundred million dollars? You know, it

32:50

wasn't just the kind of riskreward, but

32:52

rather typically the constraining factor

32:54

was they just didn't have enough

32:55

talented people to work across $20

32:58

million of product surface at the same

32:59

time. They really had to focus on one

33:01

idea at a time and the capital was a

33:03

great way to enforce that focus. What

33:05

we're now seeing is you could make

33:07

different sort of product and model

33:09

trade-offs through more or less capital.

33:11

And there is a case for a company that

33:13

raises a hund00 million, uses it

33:15

productively and in a focused way and is

33:17

able to deliver a different value

33:19

proposition um than the very same team

33:21

would be able to do with 20. So I think

33:23

that that again like the sort of just as

33:24

we talked about sort of fog of war

33:27

around margins, I think this question of

33:29

what is the optimal seated around size

33:30

and how much capital can you put to work

33:32

effectively is a much more nuanced

33:34

topic. I mean, it's sort of this

33:35

embarrassment of riches, but I'd rather

33:37

have this problem than the problem we

33:39

had five years ago, which is, hey, my

33:41

fintech company is indirectly

33:43

subsidizing their customers through weak

33:44

underwriting, and we don't know the path

33:46

home.

33:46

>> Yeah. Yep. Yeah. The Chris Chris Dixon

33:49

model, which is you always want the

33:50

problem of supply, not of demand. Right.

33:52

Right now, we have to fix the supply

33:54

part, right? Uh but the demand is like

33:56

uh so so abundantly there that that uh

33:58

undoubtedly that will um the supply part

34:01

will will get fixed. Um maybe I'll close

34:03

on this one last uh question for Mosfa.

34:05

So um double clicking on theme sector

34:08

adoption of AI. So unlike large

34:09

enterprise the friction of adoption is

34:11

much less because they require less

34:13

change management. I agree with many of

34:15

that but uh not not all uh small small

34:20

uh medium businesses sometimes have uh

34:22

more habit change that you got to work

34:23

through. But the question is how do you

34:24

see the gotom market playbook for

34:26

startups targetingmemes and has that

34:29

changed in the age of AI? I mean a lot

34:32

of it for existing thememes I think it's

34:33

the same channels with which you

34:35

historically reach them. I actually

34:36

think that one of the interesting things

34:38

about marketing in the age of AI is that

34:40

all of the sort of existing networks

34:42

have been so trained on the methodology

34:44

of building new networks that they're

34:46

very careful to ensure no one does it on

34:48

their network. So Instagram, Tik Tok X,

34:52

it's very hard to build a new sort of

34:53

distribution channel off the backs of an

34:55

existing one. So what founders have to

34:57

do is actually build a product that has

34:58

the original network effect which is

35:00

word of mouth. So we're definitely

35:01

seeing more of a focus on word of mouth.

35:03

Yes, the kind of old channels for

35:04

reaching are still there. Actually think

35:06

the most interesting segment of the

35:08

market though is sort of new business

35:10

formation which is by the way at an

35:11

all-time high. I think it's the highest

35:12

it's been outside of a peak sort of

35:14

moment during COVID. These are people

35:16

who would have never otherwise been.

35:19

It's not the sort of 55year-old plumber.

35:21

It's a 25year-old who previously would

35:23

have been a YouTube creator and now is

35:24

building SAS for their, you know,

35:26

neighborhood or their city or their high

35:28

school or whatever else it is.

35:30

>> Yep. Yep. Awesome.

35:32

Well, thank you so much for listen. It's

35:33

always great to have you on. Uh now, I

35:35

know you're a fashionista and we're

35:36

going to be clipping that endlessly uh

35:37

on the socials. Um but uh but thank you

35:40

for that. And if folks have any

35:41

questions, you know where to find Anish.

35:43

Um and uh we'll follow up here for some

35:45

of the questions we weren't able to get

35:46

to as well.

Interactive Summary

The video features a discussion about the current state and future of the AI industry, focusing on the 'intelligence primitive,' the shift from model-centric to application-centric development, and the burgeoning consumer AI market. Experts share insights on the competitive landscape of AI models, the importance of resourcefulness in product development, and why they believe we are entering a 'renaissance' for consumer AI builders.

Suggested questions

4 ready-made prompts