HomeVideos

Bill Gurley, Gavin Baker & Antonio Gracias on the AI Bubble and Why Startups Go to Zero

Now Playing

Bill Gurley, Gavin Baker & Antonio Gracias on the AI Bubble and Why Startups Go to Zero

Transcript

1102 segments

0:09

my name is Bill Gurley I've been a

0:10

venture capitalist for 25 years at

0:12

Benchmark Capital before that I was a

0:14

saleside analyst for four years um I've

0:18

someone referred to me recently as an

0:20

elder Statesman of the VC industry which

0:22

I didn't particularly like but um

0:25

Perhaps Perhaps that label will stick um

0:29

I'm going to ask these two gentlemen to

0:31

introduce each other um and while

0:33

they're doing it um I'd love for them to

0:35

talk a little bit about the unique

0:37

relationship that they have with each

0:39

other it's not super common for two

0:41

different fund managers to spend as much

0:44

time together as they do and perhaps

0:46

they can explain part of that as we go

0:48

do want to go first Kev uh sure yeah uh

0:51

thank you Bill and I'm just going to say

0:53

you're a Statesman of venture capital

0:55

thank um you leave the senior off I

0:57

appreciate that yes um

1:00

no I I I would say a few things um

1:02

Antonio and I met nearly 10 years ago or

1:04

maybe 10 years ago um and we kind of

1:08

instantly became very close friends um

1:10

and to this day Antonio is is one of my

1:12

closest personal friends uh but beyond

1:15

that um has a crossover firm

1:20

um you know it is very important to

1:23

think about your partners um who are the

1:26

VCS going to be um that are um you know

1:30

on the boards of the companies you're

1:31

invested in and something that I have um

1:35

that I've realized is I feel safer when

1:38

Antonio's firm

1:40

Valor is invested and on the board and

1:44

the reason for that um is that they are

1:47

what they have built is a very unique

1:50

product so above and beyond being great

1:52

friends but I think of them as an

1:53

insurance policy if something goes wrong

1:55

and Adventure things do go wrong a lot

1:59

lot um and the reason that they are an

2:03

insurance policy is because Antonio's

2:06

firm is very unique a lot of growth

2:08

Equity firms talk about the value uh

2:10

that they can add uh to portfolio

2:12

companies and that basically boils down

2:14

to giving

2:16

advice hiring people and then maybe you

2:19

know helping you hire people and then

2:21

maybe hey here's like a sales plan

2:24

Antonio describes Valor has we are the

2:26

garbage man of business we do the very

2:29

we Sol the very hard problems that no

2:31

one else wants to solve or can solve um

2:34

and I've seen him say to a company like

2:35

hey what are your three hardest problems

2:37

I will solve them um and it's very very

2:41

real

2:42

um you know real operational Works

2:45

supply chain expertise sending a team to

2:48

China to stand up a supply chain uh but

2:51

what convinced me it was real uh was in

2:53

the summer of

2:54

2018 um I wanted uh to see

2:58

Antonio and and um at the time he was

3:02

working every night all night at the

3:05

model 3 factory um with Elon and so

3:08

Antonio said hey I'm super excited to

3:11

hang out but we can meet it uh you know

3:13

I could really only meet at 2 or 300

3:15

a.m. that's when my shift ends um you

3:18

know so go to the model 3 factory

3:19

there's Antonio hard hat glasses um and

3:22

I later learned that at Tesla they call

3:25

Antonio's partner the wolf when when

3:28

there's a if you SE pul fiction yes I

3:32

thought you'd get it bill um the wolf

3:34

comes in and helps and then they called

3:36

Antonio gendal because if the wolf can

3:41

solve it gendal comes and if you've seen

3:43

white hair it's white hair exactly um if

3:45

you've seen yeah I don't know you might

3:47

be Gandalf the gy

3:49

man and if you've seen uh you know the

3:52

two towers Gandalf comes at the turn of

3:54

the tide and they solve really really

3:56

hard things um and I would also submit

3:59

that probably prob Antonio and Elon are

4:01

the only two people um who have their

4:03

own plane who would pull all nighters

4:06

many nights in a row running a factory

4:09

line and Antonio I feel very comfortable

4:11

saying is the only person running a

4:13

growth Equity Firm who can run a factory

4:16

line and improve it um so supposed to

4:20

introduce yourself you just talked about

4:22

I thought I was supposed to introduce

4:24

that was great I'm gav okay now you're

4:26

gav yes so wow I'm uh B speeches Thank

4:29

You Gavin um I will say that uh it's

4:32

great to be friends with Gavin because

4:34

he's a deep intellectual and I'm a

4:36

second shift plant manager so we'd

4:38

really make great Partners um very funny

4:40

no and and the reality is that uh when I

4:43

was at when I was the on the board of

4:44

Tesla the director we had lots of

4:46

investors and part of my job was to help

4:48

talk to them um and I talked to many of

4:51

them Gavin was exceptionally thoughtful

4:53

he ran the number one growth fund in the

4:57

country uh he beat 2 200 peers sort of

5:00

year after year after year and at

5:02

Fidelity he was our primary contact so

5:05

why was he at the factory in 2018 at 3

5:08

in the morning it's because you know

5:09

your friends when things are going

5:11

really badly and uh things are going

5:13

really badly when it's existential and

5:14

you're running out of money and you

5:16

can't ramp your factory and you know who

5:17

shows up one of your investors that felt

5:21

great and so when I think about Gavin

5:22

why I do deals with Gavin it's because

5:24

when things are really dark um he's a

5:27

great adviser he's a great friend and

5:29

he's want to show up and bring you some

5:30

in an Out burger at 3:00 in the morning

5:32

which is like more than most people ever

5:33

do for you so it's been a wonderful

5:36

friendship and relationship but it won

5:37

that's earned through through respect of

5:39

our commercial relationship U and now I

5:42

get to spend time with him because he's

5:43

deep on semiconductors deepal

5:45

intelligence deep on the things I really

5:47

care about which are deep Tech we have a

5:48

shared passion and that shared int

5:50

intellectual passion has led us to lot

5:52

of deals together and to work together

5:54

and I think we have a good partnership

5:55

because I am a second shift plant

5:57

manager and he's a deep intellectual so

5:59

it works well together yeah thank you

6:02

Gavin I I'm not going to take the

6:04

compliment um yes but yes thank you yes

6:08

grateful so so what I was hoping to do

6:10

um I wanted to hit on public stocks

6:13

briefly um that's Gavin area of

6:16

expertise um and then talk about

6:19

privates talk about AI although that it

6:22

might jump in before yeah we get to to

6:25

that point and then if we have time left

6:27

we'll hit on some other more specific

6:29

things so Gavin the the my first

6:32

question for you is last year I guess we

6:35

had this weird anomaly event or it felt

6:37

like an anomaly where which people now

6:40

have branded the Magnificent 7 and you

6:44

know I even I talked to LP's you know at

6:46

Benchmark who like I say how's it going

6:49

and this was like the number one thing

6:50

they brought up because you know if you

6:52

were if you're exposed fine it was what

6:54

100% 90% or something with those seven

6:57

and if you weren't you know and but but

6:59

I think there's another question I have

7:01

so one you know what do you think

7:03

happened there was it an anomaly will it

7:05

continue and personally as a as a

7:09

venture capitalist in early stage when

7:11

we'd always counted on the the big

7:13

companies to get stodgy and slow and for

7:16

their growth rates to slowly fade and

7:18

then you know we'd laugh about them and

7:20

take share if if that's not happening

7:23

that could be an alarm Bell yeah um so I

7:28

think so first of all 2023 was not that

7:31

different from 2021 as a year there was

7:33

an equally narrow maybe even narrower

7:36

Market in 2021 because it wasn't quite

7:38

the Magnificent Seven maybe it was like

7:39

the Magnificent five or six

7:42

um but the reason that this is happening

7:45

is um a few things so first you know I

7:49

think everybody in this room understands

7:51

there are increasing returns to scale

7:53

and Technology particularly online this

7:55

relates to network effects customer lock

7:58

in effectively zero marginal cost of

8:01

distribution um it's why it's almost you

8:03

know impossible to gain share against a

8:05

number one player in a digital Market

8:09

um AI turbocharges all of that because I

8:14

think the most important thing to um

8:16

know about AI is what I used to call the

8:18

iron law of AI um but then open AI

8:21

started calling it scaling laws and

8:24

obviously open AI has um more of a more

8:28

voice and credibility um than me on this

8:30

topic so I'm going to call them scaling

8:31

laws it just means very simply if you

8:34

want to double the performance of an

8:35

algorithm and we measure the performance

8:38

of an algorithm has variance from zero

8:40

errors you know so when Tesla autopilot

8:42

goes from 99.5% accurate to

8:46

99.75 um you've doubled its quality and

8:48

that's important because human beings

8:50

operate at you know 59s like I could do

8:53

this and talk and that's actually pretty

8:55

hard for a a robot to do um and

9:01

um so what scaling laws say is if you

9:04

want to double the performance of an

9:05

algorithm you need to train it on 10x

9:08

more compute and data so the reason this

9:11

turbocharges these increasing returns to

9:13

scale is the largest companies have the

9:16

most compute they have the most data um

9:20

and this is why I think to um you know

9:23

to to quote your partner uh Eric vishria

9:25

who I'm a great great admirer of along

9:27

with you bill um

9:29

you know he he said it was a game of

9:31

Kings it is a game of Emperors um Ai and

9:35

if you are you know all these Frontier

9:38

Model companies have been funded and if

9:40

you're a frontier model company and you

9:42

are not getting a lot of what is called

9:44

rhf and you could think of AIS as just

9:47

you know they're like little human

9:48

beings that need to be grown um and

9:51

human beings need to be socialized and

9:53

so do

9:54

AIS um if you're not getting a lot of

9:57

rhf you're worthless

9:59

so all these billions of dollars have

10:01

gone into these companies and they're

10:03

almost all going to be zeros if you're a

10:06

frontier model company and you don't

10:07

have a lot of distribution to get rhf

10:09

you're going to go to zero because you

10:11

cannot compete with Google with xai with

10:14

its partnership with Twitter um with

10:17

Microsoft and open AI um why don't you

10:20

with people what rhf is uh re

10:22

reinforcement learning from Human

10:24

feedback it just literally means the I

10:26

mean what technically happens is the AI

10:29

um you know gets asked a question human

10:31

beings look at its answers and then they

10:33

they help it give better answers but you

10:35

need a lot of human beings asking

10:37

questions to do that right why do you

10:39

think just quickly the the tech

10:43

companies prior you know IBM HP deck uh

10:46

whoever son like why didn't they

10:48

recognize increasing like is it just

10:51

awareness of increasing returns it's

10:53

happening well a I think it is if you go

10:56

back to IBM it was more of a hardware

10:58

company and they're not increasing

10:59

returns to scale

11:01

Hardware um but you know the funny thing

11:03

something I often think about is maybe

11:05

one reason Tech multiples have expanded

11:07

is IBM's IBM's Mainframe business has

11:10

been shockingly stable for the last 25

11:13

years and that was the only real

11:15

software part of the business that they

11:17

had yeah yeah um as you look forward to

11:21

the the year ahead what what trends do

11:24

you think are most important to the

11:25

public markets and and what what's on

11:27

your your Worry List you look look the

11:30

Worry List is very simple um the history

11:33

you know of inflation is that when you

11:35

have um and after this I really want to

11:37

listen and not speak um the history of

11:39

the history of inflation is when

11:41

whenever you have a big episode there's

11:42

almost always a second wave there are

11:44

structural reasons that this happens um

11:47

one of them that there are all these

11:48

contractual price increases that are

11:50

based on last year's inflation that are

11:53

going into effect right now um so second

11:57

wave of inflation um is a big risk the

11:59

other big risk is for the first time in

12:01

my career geopolitical risks are um

12:05

positively correlated what I mean by

12:07

that is if there is a shooting war

12:10

between the United States and Iran over

12:13

you know what what happened two days ago

12:15

our future events the odds that North

12:18

Korea does something with South Korea

12:21

and China does something with Taiwan go

12:23

up exponentially because the US tied

12:26

down in Europe have to keep Europe safe

12:28

and you know Russia is scary we're

12:31

pretty committed in the Middle East and

12:34

we now have three carrier groups around

12:36

Taiwan makes sense um so that's those

12:38

are big risks yeah um and then you know

12:42

from the variable side I I do think the

12:43

most important thing is mag 7 or lag s

12:47

does Facebook inter search they should

12:50

does Apple inter inter search what does

12:52

on device a AI due to all of this I

12:56

think it's going to really scramble the

12:57

competitive Dynamics between the mag 7

13:00

and I think those two decisions along

13:03

with how much cost Google

13:05

Cuts so much of public Equity

13:08

performance are going to flow from those

13:10

three things are you personally on the

13:13

is Google more threatened Bay AI or or

13:16

more helped no it is obviously more

13:18

threatened yeah massively more

13:19

threatened of the S I use but it's also

13:22

it's more threatened but this been a

13:24

very mismanaged company for a long time

13:26

and we saw what Facebook did when their

13:28

back was the wall now back is against

13:30

the wall we'll see what they do and they

13:32

have every right to win but I use a

13:35

search based app called perplexity now

13:38

at least as much as Google yeah to your

13:40

point though about um big companies

13:41

being slow I mean they bought deep bind

13:43

in 2010 we were investors when they

13:45

invest Deep Mind squandered their lead

13:47

they had you know seven eight year lead

13:49

over everybody else and just blew it so

13:51

I'm no AI expert but I think the uh the

13:55

the experts I read would would argue

13:57

that had Google patented the attention

14:01

window that's in the the paper the great

14:03

deine paper these other companies

14:06

wouldn't exist maybe like you can't have

14:08

open AI without the attention window fa

14:11

attention is all you need attention is

14:13

all you need yeah yeah um they they they

14:15

had a they also had a um philosophy this

14:17

padle board game yeah of trying to

14:20

protect Trade Secrets by you know they

14:21

published that paper but they weren't

14:22

publishing a lot in that time and I

14:23

don't think they knew what they had at

14:25

the time that's the issue just the human

14:26

brain attention is all you need can't

14:28

pay attention you can't you can't win

14:30

yeah yeah yeah um all right let's shift

14:32

to the private Market

14:34

um you know there's the private markets

14:38

are always in flux and I think the thing

14:40

people want to talk about most is what's

14:43

in flux and there are there are changes

14:46

that come about systematically and there

14:49

are changes that come about

14:51

cyclically well Bill why don't I invite

14:54

you to speak first on this topic since

14:56

Antonio and I just spoke and then

14:57

Antonio will speak speak and I will say

15:00

nothing cuz I'm I'm on stage with two

15:02

experts fair enough so

15:05

on I think on the systematic side since

15:08

I entered Venture it's always gotten

15:10

more competitive in fact I was earlier

15:13

today listening to Osan he talk to Doug

15:16

Leone and he he he said it went from

15:18

being like this bespoke craft business

15:20

to a Main Street retail business like

15:23

it's just way more competitive there's

15:25

more money there's more players you can

15:27

get a check from anyone

15:29

and I and I don't see that changing if

15:31

anything this AI thing just proves the

15:34

point um cyclically I think we're in a

15:37

very unique position I think it's

15:40

different than 99 and' 09 um I think the

15:43

key difference is these companies raised

15:46

so much money in the um in the 2020 to

15:51

2022 phase that many of them were

15:55

sitting on three years of Cash When the

15:57

correction happened

15:59

um many of them did layoffs pretty

16:01

quickly which is kind of interesting

16:02

because there's systematic learning from

16:04

the past um and so some of these things

16:07

are just coming to Bear right now so

16:10

it's just is this very delayed response

16:13

the other problem is in 2020 to

16:17

2022 every single data point you would

16:21

get as a founder and a venture

16:23

capitalist board member from Wall Street

16:25

said growth at all cost doesn't matter

16:29

what Ju Just grow as fast as you can the

16:32

only thing I would just say is I know

16:34

for sure that Anon and I many times in

16:37

2021 cut Bur said cut burn no I'm

16:40

talking about the markets r large are

16:42

are are are are suggesting that this is

16:44

the best behavior and if you're in a

16:47

head-to-head competition with another

16:49

company where Money Matters yeah you

16:53

could choose to be pragmatic and lose

16:56

and so you have this game I use always

16:58

call it the game on the field problem

17:00

like um when you move this dramatically

17:04

to this new world order and the New

17:06

World Order not only wants profitability

17:09

but you have massive multiple

17:11

compression it's just very difficult for

17:14

these companies like the cultural shift

17:17

you need to go from burning a lot to

17:19

burning nothing and then just to stay

17:22

motivated when you used to think all

17:26

companies trade at 20 or 30 times

17:28

Revenue

17:29

and now you look at the pieces you have

17:31

and and somebody's coming in and telling

17:33

you oh that's probably worth two three

17:35

times Revenue like it's catastrophic

17:38

like the and and and that's another

17:40

delay Factor like it just takes the

17:43

founder two or three years to get in

17:45

touch with that reality like to finally

17:48

believe it in their brain and anyway I

17:51

it makes these correction Cycles so

17:54

difficult I wish the Venture industry

17:56

wasn't cyclical I had this lunch once

17:58

with how our marxy said explain the

18:00

business to me and I spent 20 30 minutes

18:03

a bunch of graphs and stuff he go o that

18:05

business is horrible I'm like I'm like

18:08

why and he goes well I can play every

18:10

cycle like I I have a strategy for all

18:12

Cycles he goes this thing's always going

18:15

to Boom bust yeah and and I find that

18:18

people take risk on very slowly like the

18:22

The Boiled frog component and risk off

18:25

is immediate mhm yeah so I think of more

18:28

as a Sawtooth than a sineway great I I

18:31

love that analogy and just maybe I'll be

18:34

a little moderator for this part of the

18:35

panel Antonio how do you think about the

18:38

state of the Venture cycle and then more

18:40

importantly how do you think um about

18:43

building competitive Advantage for your

18:46

firm yes so I was going to answer this

18:48

question um a little bit like Bill but

18:50

structurally what's happening with our

18:51

firm is uh and I'm going to blame you

18:53

Gavin so that the the the crossover the

18:56

mutual funds and the crossover hedge

18:57

funds uh destroyed the pricing in the

18:59

Venture market and here's why so there's

19:01

a bunch of hedge fund people right I'm G

19:02

to I'm be very controversial um if

19:04

you're a hedge fund manager running

19:06

across over hedge fund or a mut fund

19:07

manager you can put a private uh company

19:10

in your portfolio and it marks maybe

19:12

once a quarter maybe once a year and no

19:14

matter what happens even if its returns

19:15

are not ACC creative to your portfolio R

19:17

return your sharpen stino ratio improve

19:19

and therefore you get paid more money

19:20

this is a joke please stop allowing them

19:23

to do this yes it's literally destroying

19:25

the pricing in the private markets and

19:27

it's creating the rationality Bill's

19:29

talking about however if you have a

19:31

hedge fund that is putting you know I'll

19:32

call it the spray and prey method of let

19:34

me be in every deal cuz I've got uh I

19:36

hired a fancy consulting firm I'll never

19:37

forget the conversation with somebody

19:39

with a client when they were you know I

19:41

have just give order of magnitude I have

19:42

about 100 people working in private

19:43

markets a third in in in infrastructure

19:46

a third in operations and a third

19:47

Investments right so I can I today

19:50

sitting here today we have four teams

19:51

deployed in the field maybe five I've

19:52

got one at neural link during quality

19:54

I've got one at K Health I've got people

19:55

over all over the globe basically

19:56

working on our companies to drive value

19:58

and help your company succeed we want to

19:59

King make with our

20:01

operations um the reality is I'm sitting

20:03

in a meeting and uh the clients asking

20:06

questions to two different managers I

20:07

won't name the manager and manager says

20:09

listen I can Outsource um you know my

20:11

due diligence and operations to these

20:13

fancy Consultants that I'd pay like $400

20:15

million a year to I said well listen man

20:17

I I get it I guess we're just not that

20:18

smart I guess actually work at Mackenzie

20:19

or Bane because I can't figure out how

20:21

to Outsource them where I would have um

20:23

I it's hard this is hard work and it's

20:26

not Outsource you have to do it yourself

20:28

cand or people won't go do it and the

20:31

reality is that it doesn't work it just

20:33

doesn't work the reason you're seeing

20:34

these giant booms and bus I have news

20:36

for you is because it actually doesn't

20:38

work so please stop doing it Gavin

20:40

doesn't do it he under writes for

20:41

principles but if you look at a hedge

20:43

fund ask the question these guys

20:44

actually doing the work underwriting

20:46

this investment understanding the cash

20:47

flow it works for somebody if you can if

20:49

you can get 2 and 20 on a00 million and

20:53

you don't go on the board right they all

20:54

have fancy they all have fancy houses

20:55

down here in Florida for sure do no work

20:58

don't show up don't do anything I guess

20:59

I'm the idiot exactly exactly I mean I

21:02

was uh so that's point one point one is

21:04

that structurally the business has

21:05

changed what no matter we like it or not

21:07

returns are coming down so we have to

21:08

find a way to add more value that's

21:09

that's the answer um and I but I will

21:11

say this it's also the most interesting

21:13

time in my career so I've been doing

21:15

this for 25ish years and maybe 30

21:18

actually 25 30 years um I actually

21:20

bought my first stock Apple computer at

21:22

the age of 13 so I've been looking at

21:23

technology for a long time um that's a

21:25

long time ago by the way and the

21:28

what I'm seeing today like today's calls

21:31

okay today I had a call with a company

21:32

doing AR Aral intelligence uh applied to

21:35

biology that was making a um in the last

21:38

week I should say it was making a

21:39

computer that had DNA that could compute

21:42

so it could actually go in measure the

21:43

gradient of a cell tell you if it the

21:45

cell was cancerous or not and then send

21:46

us the bat signal out to the immune

21:47

system to kill the cell like

21:49

unbelievably mind-blowing Quantum

21:50

Computing company we're debating what

21:52

today photonics versus chip what kind of

21:54

photonics I mean this stuff is

21:56

mindblowing it's mind-blowing like way

21:58

past the internet like the internet was

22:01

I mean really really I'd say in terms of

22:03

productivity Improvement in the economy

22:04

and what we're how we're going to live

22:05

in 10 years what we're seeing today is

22:08

revolutionary relative the internet so

22:10

be optimistic I mean the returns might

22:12

not be good somebody these managers but

22:13

in terms of Our Lives it's going to be

22:15

great so it's a great time that the the

22:17

structural changes are great cyclically

22:20

listen when you have no free money it's

22:21

free money people do crazy things and we

22:23

try to avoid that by keeping our

22:26

disciplines yeah one thing I think

22:28

everyone in the world knows but I state

22:29

it just for clarity despite the most of

22:32

the industry going into a cyclical

22:34

decline AI remains as if it were 2020 20

22:39

yeah as a category for sure with with

22:42

this caveat let me tell you where the

22:43

bubble is um our view I I'll speak for G

22:47

I think he agrees with us is we are

22:48

investing in AR artificial companies

22:49

that are we call verticalized so they

22:51

have a very specific data mode that's

22:53

protectable and therefore they can

22:54

create an Aug that's protectable and

22:56

often with a hardware integration the

22:58

llm business so you know uh open eyed

23:00

for 9 valuation that makes no sense to

23:03

us because what Gavin said earlier is

23:04

true the returns to this business are

23:06

creating from Capital allocation in

23:07

giant data centers so that's it that's

23:09

the only Advantage you have is how big

23:11

is your data center how fast is your

23:12

data center how many chips how many gpus

23:14

will Nvidia give you that's it the

23:16

models are free they're open in the

23:17

world the data is free it's open in the

23:19

world you need reinforcement learning as

23:21

Gavin said if you have enough money you

23:21

can do that that's those are all things

23:24

that can be bought by giant companies

23:25

which is why these companies doing so

23:26

well relative to the small compan

23:27

companies I think those Moes don't

23:30

survive the other thing I'd add in

23:32

addition I mean I just know because our

23:34

AI strategies are highly aligned yeah in

23:36

addition to the verticalized I think of

23:37

us as investing above the Frontier Model

23:40

layer yeah for sure in verticals or

23:43

below it an infrastructure that makes AI

23:48

more efficient an infrastructure that

23:49

drives up GPU utilization true deep Tech

23:52

because the data center is being

23:54

fundamentally rearchitecturing

23:58

three years ago the other thing go

24:00

deeper on that Gavin so obviously Nvidia

24:02

has been the most obvious big winner in

24:06

this pix and shovels which is a metaphor

24:08

people love to use but but what other

24:10

what other areas yeah yeah I'm happy I'm

24:12

happy to talked to it but the other

24:13

observation I just make is it does feel

24:15

to me that growth Equity so I think

24:19

Benchmark series a specialist series B

24:22

Specialists I don't see them as being

24:24

really disrupted because to me you guys

24:27

had real value at the early stage and

24:29

you do have like a brand that is

24:31

reinforcing it's like having Harvard you

24:33

know on your resume Harvard really sorry

24:36

hey come on brother I mean I'm sorry I

24:38

think I I think poor

24:41

I I think all these firms are being

24:43

assaulted just yes every every Alo can

24:45

fall wow every and I have a son there by

24:49

the way I don't be careful yeah but I do

24:51

think um well look if you're if you're

24:53

Harvard or if you're Benchmark if you

24:55

make mistakes eventually the brand EX

24:58

but the point I would make I think the

25:00

growth Equity series C and up industry

25:03

is going to Evol evolve in exactly the

25:05

same ways that private Equity evolved

25:08

you know so 25 years ago you know you

25:10

know Henry kravis and um others were

25:12

running around and you know it was an it

25:13

was a relatively inefficient Market um

25:17

and then now everything is done in an

25:18

auction price is set in a manner much

25:21

closer to public markets than the way

25:23

Venture and growth Equity is set um so

25:25

that I I think there's probably more pay

25:27

in coming but what private Equity firms

25:30

realized is they had to add a vast

25:32

amount of value yeah and to me that's

25:35

kind of what I what I admire about Val

25:37

strategy but for you know a GPU an

25:40

Nvidia GPU is half the size of this

25:42

iPhone okay it is made with three

25:46

tablespoons of sand a Taiwan

25:49

Semiconductor in Taiwan Invidia buys

25:53

this from TSM for

25:55

$700 and then sells it to Google or

25:58

whoever open AI for

26:00

$50,000 and you can think of a data

26:02

center as like a restaurant um and the

26:06

GPU is the single most important and

26:10

expensive part of that restaurant it's

26:13

the star Chef you want that guy being a

26:16

star all the time instead because the

26:21

systems that surround the GPU have not

26:23

kept up the gpu's gotten 50x faster in

26:27

less 4 years years the rest of the data

26:28

Center's gotten four times faster um the

26:32

GPU does nothing 70 to 80% of the time

26:36

and while it's doing nothing it is

26:38

sucking full power a vast amount of

26:40

power even when it does nothing it's

26:41

sucking power and you're depreciating it

26:44

and that's very expensive um and the

26:47

reason is is that the food that gets

26:49

delivered the Sue Chef they the you know

26:53

the the chef has gotten a lot faster and

26:56

the rest of the restaurant has not so um

26:59

a thesis I have had in Venture growth

27:02

equity and public equities for four

27:03

years now just cuz yeah I was actually

27:05

the Nvidia Analyst at Fidelity um 25

27:09

years ago I used to talk to jinen weekly

27:11

we owned 15% of the company um is that

27:15

this was a problem that needed to be

27:17

solved by fundamentally rethinking

27:19

storage networking and memory every time

27:21

we see a platform shift of this nature

27:23

we always go to infrastructure and

27:24

Gavin's right I mean this is this is the

27:26

key problem is how to make INF go faster

27:27

behind the data center for sure you see

27:29

any public winners that take advantage

27:31

of that oh yeah and I mean we like we

27:33

own Sienna coherent Optics are going to

27:35

have to come inside um the data center

27:38

in 2025 no later than 26 when that

27:41

happens

27:43

that's an unimaginable change to the

27:46

architecture of a data center you know

27:47

coherent Optics sit on the outside of a

27:50

data center today they're going to have

27:51

to come inside um all hard drives are

27:53

going to be replaced by flash storage um

27:56

you're going to actually

27:58

you know storage you can think of it

27:59

sitting the layer below something like

28:01

snowflake um storage used to be thought

28:03

of as the best way to invest in data if

28:05

you go back you know the days of EMC

28:07

when you were writing reports how do you

28:08

want to invest in data storage EMC those

28:11

days are coming again um and you know

28:14

lots of opportunity yeah oh yeah public

28:17

and private so so so going to AI which I

28:20

knew we'd already go to so that's fine

28:23

um if if the if the Standalone llms are

28:27

are you know fast depreciating

28:29

commoditized whatever who do your

28:31

vertical successful vertical players end

28:34

up buying you are they buying it you

28:36

know by the drink by the hose are they

28:38

running models internally you're asking

28:40

where they getting the data no where are

28:41

they getting their llm type Tooling in

28:46

the long run well I mean the vertical

28:47

self word investing and like example

28:49

give is um we called zip line which is

28:51

has more autonomous flowing miles than

28:52

any company on Earth because they went

28:54

to Africa built a system to deliver

28:56

blood and Drugs in five countries AF

28:57

including Rwanda they power the entire

28:58

Rand U System I mean it's extraordinary

29:02

I they lower the maternal mortality rate

29:04

at the edge of their wed system so out

29:06

in the field by 88% because they deliver

29:09

a package of drug blood and drugs to a

29:11

woman who's had a baby and she's

29:12

bleeding out they can coagulate the the

29:14

bleeding and then give her some plasma

29:16

um they Ed those miles and all that

29:17

autonomy come back to the US they the

29:19

first autonomous system approved in the

29:20

US to deliver packages and now they're

29:22

building another platform to drone that

29:24

will be more of a quadcopter but there

29:27

that is full autonomy right that was

29:29

built custom by them in Africa they've

29:31

got millions and millions of miles

29:33

that's a custom data set K house a

29:35

custom data set I mean there's there's

29:36

there's a spectrum of this that is fully

29:39

custom and almost impossible replicate

29:41

you know Google's trying with with wing

29:42

but almost impossible POS replicate all

29:44

the way to I train on the internet and

29:46

get some humans to do reinforcement

29:48

learning that's the Spectrum we're

29:49

trying to be on this side of the

29:50

spectrum and we have a bunch of

29:51

companies are doing this you agree with

29:53

all of that but I would just say I do

29:55

think there is you are going to open

29:57

source llms are going to be a winner and

29:59

you know it looked like it was going to

30:00

be llama now Mr straws come out of

30:01

nowhere um but I think it is very hard

30:04

if you're Frontier Model company that

30:06

raised at 5 to 15 billion like I think

30:08

you're lucky if you get sold for the

30:10

preference because you're going to be

30:11

squeezed between these Giants with

30:14

internet distribution who are getting a

30:15

lot of rhf Y and really high quality

30:19

open source and a you know uh Mark

30:21

Zuckerberg is a brilliant man but I

30:23

often wonder why he does not enter cloud

30:25

computing and say Hey you can use llama

30:27

for free but just you need to run it in

30:29

my data center um I often yours running

30:33

llama right now what's that Microsoft's

30:36

running llama right now as we speak but

30:38

Facebook has a lot of data centers yes

30:40

yeah yeah they're Commodities would why

30:43

wouldn't that happen I have no idea in

30:45

the same way I can't figure out why they

30:46

haven't already entered search unless

30:48

they're just not aspirational about the

30:50

web about the mean or or or the capital

30:52

what they figure out you look out 3 to 5

30:54

years the capital is a commodity it's

30:55

all a commodity So eventually

30:57

you know I was in the connector business

30:59

in uh in in 2000 I saw this happen in

31:01

the internet where all the uned backbone

31:02

stuff everyone triped everything you

31:04

overbuilt and then it crashed at some

31:06

point someone will build a competitor

31:07

GPU and this is a commodity so if you

31:08

can buy commodity Focus your resource in

31:10

other areas they higher return I could

31:12

see that yeah I'm not saying he's right

31:14

but I can see the cation question of the

31:16

board yeah can ask Peter ch's coming on

31:18

next I um Gavin you know this I have a

31:21

bit of a pet peeve about an issue that

31:23

relates to this which is I don't

31:26

disagree with you about how this is

31:27

going to play out does that mean you

31:29

agree no yes I agree with you you get

31:32

rid of the double negative so I I agree

31:34

with you about how this is going to play

31:36

out but the some of the players that are

31:41

running these Standalone models these

31:44

companies um have organized politically

31:46

in a way that the only other human

31:49

that's organized this way early this way

31:51

that I've seen was SBF actually um but

31:55

they have like three different super

31:56

packs Politico wrote an article and

31:58

they're literally trying to talk

32:00

legislators into doing things that would

32:04

either restrict open source and some of

32:06

them have said specifically out loud you

32:08

should make open source AI illegal yeah

32:11

I so profoundly think I mean it's

32:13

obviously unethical and as a human being

32:16

what we want most is a multipolar world

32:20

where there's lots of AIS where we have

32:23

our own AI um you know one reason it's

32:26

easy to see why AI is different from the

32:29

Internet is the closer you are to AI the

32:34

more worried you are about it has an

32:36

extinction level risk for Humanity

32:39

nobody thought that you know the

32:41

internet might lead to the extinction of

32:43

humanity and you know there's all sorts

32:44

of people like Yan laon who runs

32:46

Facebook's lab who says this is

32:48

ridiculous but there are a lot of people

32:50

who are deeply knowledgeable including

32:51

Jeffrey Hinton who invented deep

32:54

learning was basically the kind of

32:56

chairman of AI guy at uh Google um and

32:59

left Google cuz he is so worried about

33:01

the extinction risk um and so what we

33:04

want to mitigate that risk as human

33:06

beings is a multi-polar world where we

33:09

have many AI the most dangerous world

33:11

for human beings is one where there's

33:13

only two or three and so if you were

33:15

worried about AI safety we should have

33:18

like there are racing Dynamics we're

33:19

going fast we're not slowing down maybe

33:21

we should have but we're not um you

33:24

should be in favor of Open Source let

33:26

let me out of this which is um the

33:29

internet I think when in 2009 20 2001

33:32

nobody thought the internet would enable

33:34

political volatility and Revolution and

33:36

actually uh allow governments to

33:38

constrain and manipulate their

33:39

populations we all thought it would be

33:40

tool of Freedom it wasn't be very

33:42

careful here this technology not only I

33:44

think regulatory capture that you're

33:46

describing is not only unethical it's

33:48

unamerican it's anti-American it's anti-

33:51

Freedom why because our Che competitors

33:53

around the world are building the same

33:54

models and they're building them and

33:56

weaponizing them as fast as they can

33:57

trust me this is happening if we don't

33:59

have the best technology in the world we

34:01

will not be safe this technology is so

34:02

powerful it makes a nuclear weapon look

34:04

like a small fry small fry I mean I'm

34:07

telling you this and Gavin's right about

34:09

this the closer you are to it the more

34:10

worri you are if you want America to be

34:12

safe and our our allies around the world

34:14

we need to be competitive strategically

34:16

this requires us to have an open

34:18

platform so we can develop the best

34:20

models and the best training data and

34:21

have the best technology that's kept us

34:23

safe in the entire portal period we

34:25

should continue with that program

34:27

I yeah I can't help but think that it's

34:30

um driven by an attempt at regulatory

34:33

capture for sure it is it's pure greed

34:35

and it's anti-American and I probably

34:37

aided by Foreign adversaries yes of

34:40

course and I would I would add there

34:41

could be one more motivating factor on a

34:44

generic text llm so different from the

34:47

work that zip lines do on their own data

34:49

center um open eye and whatever yeah

34:52

just just text you know and a machine

34:54

that can talk to you you know I think

34:57

the parameter count has diminishing

34:59

marginal Returns the attention window

35:01

has diminishing marginal returns and the

35:03

data sets have there's no what what what

35:06

new data sets well you know I think we

35:08

are going to see a new data set I I

35:10

spoke about this yesterday but Yan laun

35:12

observed that you know gp5 has been

35:15

trained on the entirety of human content

35:17

ever created the entire internet every

35:19

book everything but human beings we have

35:22

an IO problem input output um and

35:25

through vision we take so much more

35:27

information I heard this so an infant by

35:29

the time it's 4 years old has taken in

35:31

100x more data than gbt 5 I actually

35:34

think a synthetic data is going to help

35:36

scaling laws continue but B I think

35:38

you're going to see video games be an

35:40

incredibly useful place for training AI

35:45

so you we we actually um our earliest

35:47

exposure of ourselves was actually uh

35:49

expert systems deploying Vision in

35:51

factories this was a form of Ral

35:52

intelligence was it was data science and

35:54

vision and um they kind of got the the

35:57

language stuff got jumped vision went

35:58

much further ahead what Gavin's saying

36:00

now you for all of you here in the

36:02

audience it looks like that language

36:03

looks a lot better than Vision but

36:04

vision is actually very very Advanced

36:06

which is why we can do autonomous

36:06

driving it' be interesting to see how

36:08

you embed that into the intelligence

36:11

part and like how you learn from video

36:14

if if you were an agent you know and

36:15

we're going to go from Models to agents

36:17

Frontier models Foundation models to

36:19

foundational agents I think that's the

36:20

trend of the next 18 months you don't

36:23

care whether you're looking at the

36:25

internet you're in a video are you're

36:28

embodied an Optimus robot right and I

36:31

think there's going to be this is going

36:32

to be an enormous source of advances and

36:34

I do think I don't know if it's 24 or 25

36:37

but Robotics are going to have an iPhone

36:40

chat GPT like moment sure you mean this

36:43

is an analogy human brain right just

36:44

think about that always remember it's an

36:46

artificial neuron Network this is a real

36:47

neuron Network and it learns this way it

36:50

starts with vision then language and

36:51

then it integrates the vision language

36:52

to cognition and then Consciousness and

36:55

we are on the same path you know where

36:56

we are in the emergence who knows but

36:58

we're on the same path at or

36:59

intelligence fair by the way and this is

37:00

why it's so interesting you know if you

37:02

talk to gp4 if you want to get a good

37:04

answer speak to it the way you would

37:06

your high school kid before a test go

37:10

slow yeah yeah yeah no no just hey go go

37:13

slow double check your answers be

37:16

careful that will make the llm perform

37:18

better

37:20

because they really are very human in

37:23

many ways but please before we run out

37:25

of time and I I I would love just um if

37:29

you have a moment Antonio to talk about

37:31

Elon you know you've had a very special

37:33

relationship with him it goes way back

37:36

um talk about like how you met why you

37:38

think that relationship is bidirectional

37:42

and why it works so well and and and

37:44

maybe you only have three minutes yeah

37:46

what makes him so unique I mean only

37:48

have three minutes three minutes um so

37:52

yeah I first met ELO invested in PayPal

37:54

in like 99 2000 so a long time ago and

37:56

you know we've invested in many

37:58

companies with him over the years and

37:59

I've gotten a chance to work with him

38:01

and it's been I'd say in many ways a

38:03

career defying for me because being near

38:05

him and probably true for you too Gavin

38:07

it I I have this saying I told which is

38:09

you can only achieve the thing you

38:10

conceive and it has moved the conception

38:12

curve the possible for for us for sure

38:15

that we're close and for everyone

38:16

probably here the things that are

38:17

possible Landing Rockets human brain

38:19

Earth fit isn't this is insane right so

38:22

what we have done and what we're good at

38:23

is like making stuff I'd say the old

38:25

economy things right making Factory run

38:27

making a process run making a sales

38:28

process run and so when a great engineer

38:31

world you know once in 100 Year engineer

38:32

like that is building companies guys

38:34

like us who are the garbage men the joke

38:35

I make we you know you got to take the

38:36

garbage out we cannot be uh genus

38:39

Engineers but the garbage got to take

38:40

out and we're good at that um I would

38:42

say what makes him special I'll tell you

38:43

I've had a couple of moments that I've

38:45

seen in 2018 in the factory in in uh at

38:47

Tesla I saw him you know in at about 3:

38:50

in the morning in the body shop sit down

38:51

with the engineers our body shop wasn't

38:53

working and and and take about 30 welds

38:55

out of the car by saying we don't need

38:56

this window this one he was running the

38:57

math in his head and we were going to

38:59

run the cars inventory um the bodies and

39:02

if we had been wrong if he had been

39:03

wrong we'd have gone bankrupt nope don't

39:05

worry run it guys R in the simulation

39:07

came back it was right it was like

39:09

watching Michael Jordan play basketball

39:11

times 10 and we just had one of these

39:12

right so the neuralink interface um

39:15

there is a there's a thing called Utah

39:16

Ray it's been around for a long time

39:17

it's a brain computer interface and it

39:19

causes scarring the brain because the

39:20

mechanical interface Electro too is too

39:22

big um the thing Elon did there is this

39:25

is uniquely him he's a the martial

39:26

Engineers with his mind they Shrunk the

39:29

mechanical interface to a size and made

39:32

it flexible that would fit between the

39:34

in the dead between the synapse little

39:35

space in the synapse so that it would

39:37

not Scar the brain that's uniquely him

39:39

that's the one 100e brain that is his

39:41

engineering mind Material Science

39:42

mechanic engineering software that

39:44

integration I've never seen anything

39:45

like it it's exceptionally special and

39:49

at the same time he's a guy who's deeply

39:51

compassionate who cares about humanity

39:54

and wants to do the right thing like all

39:55

these things are true you know and

39:56

having all those things in one mind I

39:58

think makes them very unique Gavin yeah

40:01

know I'm I'm grateful to Elon for so

40:04

many things not least of which is

40:05

introducing US 10 years ago um yeah but

40:10

um I I would say two things like first

40:12

to his his motivations you can think of

40:15

every single company that he has been

40:16

involved with has adding value to the

40:20

world in a profound way you know the

40:21

internet obviously added value to the

40:23

world and you know the payments

40:25

associated with that that was PayPal

40:27

um he was very concerned about global

40:28

warming that was Tesla and Solar City um

40:32

you know he wants Humanity to be

40:34

multiplanetary that's

40:36

SpaceX um you know the boring company is

40:39

actually another way to reduce um to

40:41

help make the planet green and make

40:43

cities green because you know we've

40:44

essentially given all our space in

40:46

cities um to roads um nurlink exist to

40:50

help bring about this multi-polar AI um

40:54

future because you know the ideal state

40:55

for human humans is you know we have a

40:58

on device AI that loves us and we

41:01

communicate with it through our neur

41:04

link We merge we merge we kind of

41:06

co-evolve with AI and then the reason he

41:09

started xai is to you know make sure

41:12

that it is not just dominated by um open

41:16

AI Google um and to lesser extent you

41:20

know two open source models you know you

41:22

want more of these true models X is a

41:25

new corporate entity yeah yeah for grock

41:27

which I actually think is great grock's

41:28

going to be grock actually is in a

41:29

commodity because and Twitter owns a

41:31

piece of it Twitter owns 25% of it yeah

41:33

awesome well we are out of time thank

41:35

you gentlemen thank you Bill thanks

41:38

[Applause]

41:40

everybody

Interactive Summary

The video features a discussion between veteran venture capitalist Bill Gurley and two industry experts, Kevin and Antonio. They explore the changing dynamics of the venture capital industry, the impact of AI, and the importance of deep operational partnerships. The conversation covers the 'Magnificent 7' stock trends, the operational philosophy of firms like Valor, and the critical role of hardware infrastructure in the AI era. Additionally, they touch upon the ethical implications of AI development and the unique engineering contributions of figures like Elon Musk.

Suggested questions

4 ready-made prompts