HomeVideos

Semiconductors Are Gushing Cash… Here’s What’s Next in The AI Trade | Ben Pouladian

Now Playing

Semiconductors Are Gushing Cash… Here’s What’s Next in The AI Trade | Ben Pouladian

Transcript

2282 segments

0:00

I invested in Nvidia in in the fall of

0:02

2016. There's been 20 years of lack of

0:05

investment in in the hardware capex

0:08

cycle. There's not an actual GPU

0:12

shortage anymore.

0:12

>> Does our portfolio positioning make

0:14

sense? Why are we so long semiconductors

0:16

if the true shortage is in powered land,

0:18

not chips other than memory? Got a

0:20

special conversation today. I'm joined

0:22

by Ben Pulandian of BEP Research. Ben is

0:26

a specialist investor and analyst in the

0:29

semiconductor world and the

0:31

semiconductor supply chain. Of course,

0:33

that is what powers AI. Ben, welcome to

0:36

Monetary Matters.

0:36

>> Thanks for having me, Jack. Excited to

0:38

be here. Love your podcast and would

0:41

love to dive in on some interesting

0:43

topics and some things that your

0:45

listeners care about.

0:46

>> I'm I'm really glad you're here, too. I

0:48

really like your work. You're very in

0:50

the weeds on the semiconductor uh world.

0:54

I want to start by asking kind of the

0:56

the I propose the bare argument. You

0:58

know, Ben, perhaps many people watching

1:00

this, many institutional investors are

1:03

who are a little skeptical about AI,

1:04

skeptical about semiconductors, they may

1:07

think, you know, that this is the repeat

1:09

of the dot bubble. And so my first

1:12

question to you is Cisco was a very

1:14

profitable company. The earnings and the

1:16

growth experienced in the do-com bubble

1:17

was extreme just like it is now in AI.

1:19

Why isn't Nvidia Cisco? Why isn't this a

1:23

replay of the dotcom bubble?

1:25

>> Thanks. Uh, a lot of people would bring

1:27

up Cisco overlay the Nvidia chart. The

1:31

the challenge with Cisco and comparing

1:34

it to fiber in my opinion, things like

1:37

that are sort of like a commodity. Uh,

1:40

so when you're talking about dataccom or

1:42

telecommunications, it's the idea of

1:44

transmitting the data, right? So it just

1:46

goes from point A to point B. With

1:48

compute and Nvidia, you have the chance

1:50

of actually creating intelligence,

1:53

something from nothing. Everybody wants

1:55

intelligence. It's not a commodity that

1:58

anyone else can make. And I think that

2:00

is a discerning difference. You needed a

2:03

company like Cisco to basically

2:05

overbuild or global crossing to die on

2:07

that hill to bring that capacity and

2:09

bandwidth to have the compute that we

2:11

have today. Little different.

2:13

>> So here's I'll start where I I disagree.

2:16

I think intelligence is kind of a

2:19

commodity like open AI creates geniuses

2:22

and anthropic creates digital geniuses.

2:24

What sometimes some geniuses are better

2:26

than others. Now the other one company

2:28

pulled pulled ahead and there some are

2:29

better at math, better at writing. Okay.

2:31

But that is kind of like it is kind of a

2:34

commodity. But here here's where I agree

2:36

with you that semiconductors are not a

2:37

commodity. The challenge is is people

2:39

are just still using AI to do routine

2:43

work like hey help me plan my trip you

2:46

know obviously write software or how do

2:49

I make this recipe what's this bug that

2:52

I took a picture of right the next

2:54

inflection of AI which we'll see coming

2:56

and what I'll be writing about soon is

2:58

the intersection of artificial

3:00

intelligence and the bigger sciences

3:03

mostly material science biotech and

3:05

other things once you start discovering

3:08

new materials, new medicines. That

3:10

impact of doing something 10 years in

3:13

the lab trying to figure out if you can

3:15

model it with AI and the actual uh GPUs

3:18

and computers and find drug targets that

3:20

is a big unlock. You compress 10 years

3:23

of work into one year and people need to

3:25

realize the speed up that you get with

3:27

intelligence. So you're saying that your

3:30

bullcase is not only 15% of the

3:34

population is using AI every day to plan

3:36

their trips and do routine tasks and

3:38

that 15% is gradually going to head to

3:40

70 or 80%. That is not your bullcase.

3:43

Your your bull case is that mainly the

3:47

intelligence is going to be advanced at

3:49

the frontier that can do tasks that

3:52

previously required millions, tens of

3:54

millions, billions of dollars in human

3:57

intelligence and now that can be done

3:59

much more cheaply and at scale. That's

4:00

what you're saying.

4:01

>> Yeah. I mean, going back to what Jensen

4:02

has been saying at GTC for a while from

4:05

Nvidia, the whole point of all this is

4:08

can you do your life's work in your

4:10

lifetime. So uh when you look at R&D for

4:14

medicine and people working in the labs

4:17

there's a lot of trial and error if you

4:20

can scale that with and compress the

4:22

time to get to better patient outcomes

4:25

with better options that is the unlock

4:28

you couldn't do that with classical

4:29

computing you can only do that with high

4:31

performance computing larger clusters

4:33

more data the more data points you throw

4:35

into it genomics like organs NHS data

4:40

from different uh places of the world.

4:43

Once you have multivariable data points,

4:45

you can all of a sudden triangulate into

4:47

things that you weren't able to do

4:48

before and find that needle in the

4:49

haststack to help that one patient.

4:52

>> Yes. And that bullcase for uh

4:55

semiconductors and AI is something that

4:58

I'm you know seriously entertain and I

5:01

encourage my my you know people watching

5:03

to to to entertain. I also think Ben

5:05

that a short-term 12 to 18month bullcase

5:08

is that a tremendous amount of capital

5:11

way more than has already been spent is

5:13

going to be spent on that goal with the

5:16

anthropic open AI basically trying to

5:18

build a digital god or you know a

5:20

digital IQ person that never sleeps and

5:22

has you know it's a billion years of a

5:25

160 IQ person in five minutes you can

5:28

you can do and whether or not that is

5:30

going to be achieved within a short

5:31

period of time so much capital is going

5:33

to be spent And that money is going to

5:35

go to Nvidia, Lamb Research, ASML, the

5:37

entire semiconductor supply chain. So I

5:39

think that that's something I want to

5:41

see is that the in over the next 12

5:43

months, the bullcase doesn't need, you

5:47

know, building the 100 IQ person in a

5:50

data center to become true. It just

5:52

needs the accelerated capex. That's what

5:55

I would say. What's your reaction to

5:56

that?

5:56

>> Yes. And the parallel to that also is

5:59

obviously the best, smartest, fastest AI

6:02

from a national defense perspective is

6:05

the best military. So if we step back

6:08

and say, "Oh, this is all a waste and

6:10

we're not going to do it," then you have

6:12

other countries or bad actor nations

6:14

that could basically have the best AI

6:17

and infiltrate all of our digital

6:18

systems and basically our

6:20

economy and virtually take over our

6:23

country, right? So people need to

6:25

realize it's just not again chat bots.

6:28

The the race of the best AI is the best

6:30

military and the best military in the

6:32

world basically sets policy around the

6:34

world. And that's where you know I've

6:37

written a lot about it in the the my

6:39

thesis of the token dollar how

6:42

everything's denominated in tokens how

6:44

the world has enough oil. You can't

6:46

close a straight of compute, right? It's

6:49

only power constrained and the country

6:51

that leads in the highest compute per

6:54

watt at scale wins and it's a race

6:58

against us against China. So, it's sort

7:01

of like the space race reversed. Uh

7:04

instead of Russia, it's China this time.

7:06

explain very briefly what a token is and

7:10

then why is there such a shortage of

7:13

tokens that you forecast for to for

7:15

there to be many many years and why

7:17

won't there be a an excess of tokens

7:20

such as there was an excess of oil you

7:22

after the the the increase in the price

7:25

of oil in 2022 there was a there was a

7:27

surplus that lasted for many years until

7:29

the Iran war why isn't there going to be

7:32

a shortage in tokens that ultimately

7:35

leads to a glo glut. You know, in most

7:36

commodities and most things, shortages

7:38

leads to gluts because there's overp

7:40

production. Are you saying that you

7:42

don't think that's ever going to happen

7:43

or it's going to be, you know, 5 10

7:44

years, it's unlikely? Explain what gives

7:47

you that that confidence in your view

7:48

here.

7:48

>> To draw a parallel to oil, all tokens

7:51

aren't created equal. So, when you start

7:53

with a barrel of oil, it's either West

7:56

Texas crude or Brent Brent. And then

7:59

from there you refine kerosene and or

8:03

gasoline or diesel. And the the way

8:07

compute is heading based on the scaling

8:10

laws if you see from anthropic and open

8:13

AI the more money and more compute they

8:16

throw out these bigger models they're

8:18

getting better more intelligent results.

8:21

And the idea is if you're doing compute

8:24

what model are you getting your

8:25

intelligence from? If you're getting it

8:26

from a free I don't know 30 billion

8:29

parameter llama model for meta from a

8:31

few years ago like that's like it's like

8:34

water at this point. It's like

8:35

worthless. Like it's it barely does

8:38

anything. But if you want frontier

8:40

intelligence with the best model at the

8:42

highest speed

8:44

answers and tokens, that's almost like

8:46

jet fuel, right? The most expensive type

8:49

of fuel. So you're going to see this

8:51

segmentation in the market on different

8:53

types of tokens and the speed and the

8:56

intelligence that that you get it at.

8:58

And will there be a supply glut of

9:01

intelligence? I don't know. What I know

9:04

right now is that me, just one guy

9:06

trying to use Fable 5 for the past

9:09

weekend, like I've hit my rate limits

9:11

over and over again and I had to buy

9:13

more credits and compute and it's it's a

9:16

scary feeling when like you're mid

9:17

through a project and it says sorry,

9:19

come back in four hours before I can

9:22

finish it. Like it it it's it's not

9:24

good. I mean, if they're doing that to

9:26

me, who else are they doing it to? And

9:28

it it just another data point that was

9:31

just very compute constrained.

9:33

>> Explain the difference Ben between the

9:36

frontier model like Fable from Enthropic

9:39

or OpenAI news model that is is going to

9:41

come out in early July. What is the

9:43

difference between what the frontier

9:45

models can do and what the decent models

9:47

like you know a model from 12 months ago

9:50

that was considered a cutting edge 12

9:51

months ago can do?

9:53

>> I think it just comes down to the data

9:55

that it's trained on. Obviously like

9:57

there's cut offs in intelligence. So

9:59

some stuff is cut off because they

10:01

closed the books like oh this I'm only

10:03

recent up until January of 2026. So the

10:07

more history and time you put into it

10:09

obviously the bigger the model is and

10:11

then there's also things called world

10:13

models that you can input audio and

10:16

video. So the more multivariable it is

10:19

and the more flexible it is obviously it

10:21

provides more intelligence. And then

10:23

some of these models are tuned for

10:25

specific tasks like agentic coding

10:27

software development where basically you

10:30

can turn English into computer language

10:33

to build things in the virtual world or

10:35

software. And the better the frontier

10:38

model is at these things the better

10:39

results you get and your code or your

10:42

software is stronger and made with

10:44

possibly less lines of code and less

10:46

bloat. So, so what percentage right now

10:48

of the value and maybe of the

10:51

consumption and and spending on the

10:52

frontier tokens is specifically in

10:54

software engineering

10:55

>> from an enterprise standpoint from what

10:58

you gather from companies. Almost all

11:02

software developers are using agentic

11:04

coding at this point because if you're

11:06

running an enterprise, it's not uh it's

11:10

not all you can eat. They're all running

11:12

APIs. So it's consumptionbased and

11:16

that's where you see the huge inflection

11:18

in anthropics ARR is they made a bet on

11:22

the enterprise and I remember I was

11:24

using last summer my friend showed me

11:27

Claude sonnet he's like oh I'm using

11:29

cloud I'm building all these things I'm

11:31

multiple windows open and I remember I

11:33

was trying to build a few things and

11:35

Claude would tell me he would do it and

11:36

then I'm like okay where is it and he's

11:37

like oh I'm sorry I lied and I was like

11:40

dude like come on like I spent hours

11:42

coding and I didn't get anywhere and

11:44

then I let it go and then in November

11:47

he's like hey they came out with this

11:48

thing called opus it's much better it

11:50

doesn't hallucinate as much and that

11:52

really was the inflection point for

11:54

anthropic once people realize that the

11:56

coding model improved and it

11:58

hallucinated less and it lied less and

12:01

obviously it has those agentic workflows

12:02

where it's controlling parts of your

12:04

computer from Xcode to other opening

12:08

windows and looking at things you saw

12:11

the future in front of you and it was

12:12

pretty amazing.

12:13

>> So you feel like you kind of have def we

12:16

have definitive proof that in the world

12:18

of coding the the advancements here are

12:21

are revolutionary and uh certainly are

12:24

going to generate a lot of revenue. What

12:26

do you think the odds are though that

12:27

it's limited to coding?

12:28

>> The idea of coding is just one

12:30

application. So the idea is to take this

12:34

and how do you make like a cloud code

12:35

for law? How do you make a cloud code

12:37

for finance? How do you make a cloud

12:39

code for science? How do you make a

12:42

cloud code for education? How do you

12:44

turn natural language into a tool to

12:46

build things and learning? I think

12:48

that's the idea. And then run loops

12:50

around that. There's a repetitive task

12:52

in your organization. How can somebody

12:54

who doesn't have a computing background

12:56

build a script with cloud code or some

12:59

coding assistant to automate that task

13:01

so they don't have to waste their time

13:03

on something mundane to work on

13:05

something more productive to grow the

13:07

business to grow their minds. I think

13:09

that's the unlock for a lot of the AI

13:12

stuff is like, you know, stop trying to

13:15

build spreadsheets that you that you've

13:17

already built a template once, right?

13:19

And invest in banking analysts,

13:21

sensitivity tables. Like that was like

13:24

the hardest thing. Just give the inputs

13:25

and have Claude make it. Go focus on

13:27

something else. Focus on something

13:29

something more strategic. I think that's

13:31

that's where I see the the unlock and

13:33

the higher productivity for for

13:35

enterprises and and people. Now tell us

13:38

the role of semiconductors. The

13:40

semiconductor stocks have absolutely

13:42

been on fire. Just what is it about AI

13:47

that demands so much semiconductors in a

13:51

way that semiconductors have so much

13:54

pricing power such as as they have? I

13:56

mean Nvidia's uh revenues and profits

13:59

have just been unbelievably unbelievably

14:03

high. you know, you know, from in 2023

14:05

to 27 billion to last 12 months, $250

14:09

billion and in operating profit, you

14:12

know, over the next 12 months, I think

14:14

it's going to make $200 billion. Um,

14:16

that that would be a conservative

14:18

estimate. Just looking at it made more

14:19

than that in the last quarter. And by

14:22

the way, none of that included any

14:23

markups. I'm not talking about net

14:24

income. I'm just talking about operating

14:25

profit. So that is pre-tax. And by the

14:27

way, Samsung reported and they had a

14:29

quarterly operating profit that was

14:30

higher than Nvidia's because the squeeze

14:32

in memories is so high. So I I think

14:35

that the semiconductor stocks have gone

14:37

up, but the multiples have gone flat to

14:41

down. This has not been a at all a

14:44

valuation increase. This is this has not

14:46

been a a bull market driven by

14:48

valuation, the multiple going up. It's

14:50

been the earnings going up and going up

14:52

so much. So I just want to set the stage

14:54

for you there. I think you have to

14:55

really go back over 25 years. I

14:58

graduated college in ' 04 right after

15:00

the dotcom bubble of electrical

15:02

engineering. I got a job in investment

15:04

banking in San Francisco at Jeffrey's

15:06

Broadview. Uh the guy that hired me, the

15:10

associate, Alvin Lynn, the first day on

15:12

the job is like, "Hey, actually, you're

15:14

a great candidate, but I'm quitting. I'm

15:15

going to go work for this company called

15:16

Nvidia." He's still there. I think he

15:19

reported stuff to Jensen. Great guy. And

15:21

then at the same time we actually had a

15:23

mandate to sell this accelerated uh

15:26

digital media software company for

15:30

mobile processors to Nvidia and I think

15:32

they eventually absorbed it was called

15:33

Paceoft Silicon and Nvidia at that time

15:36

was just a graphics computing company.

15:38

There was a lot of hardware start

15:40

companies in in Silicon Valley. I mean

15:42

Intel was a leader and from ' 04

15:46

then on it was sort of the birth of the

15:49

new internet. That's when Facebook took

15:51

off with AWS and Microsoft and

15:55

Salesforce. So you've had this regime

15:59

give or take of 20 years of

16:01

classicalbased computing which was just

16:04

software as a service. So if you would

16:07

go up and down Sand Hill Road or to any

16:10

investor in New York, they're like, "Oh,

16:12

you want to raise $20 million to make a

16:15

chip? Oh, that's too expensive. you got

16:17

to like engineer it and then you got to

16:19

tape it out with TSMC and you know like

16:22

it's just it's just I can put less money

16:24

in this this like B2B SAS and I know I'm

16:28

going to get you know 10 times ARR and

16:30

it's going to be amazing and that's why

16:31

if maybe you or your readers or your

16:34

listeners can actually chart maybe the

16:37

Bessemer CLOU index or IGV over the last

16:42

20 years kind of see the multiples and

16:44

how it's gone up a lot and obviously

16:46

there's a lot of stockbased compensation

16:49

and rule of 40 and like all this stuff

16:50

that they would hype up into SAS and

16:53

ARR, right? And the hardware guys, all

16:56

the semi guys for the last 20 years were

16:58

just like no one loved them. Like I

17:00

remember in college I had an internship

17:03

at this company called Simer. Bob Akens

17:06

>> was the the founder CEO. He went to UC

17:08

San Diego. him and his partner Rick

17:10

Sandstorm developed the DUV Xrimer

17:13

laser. Right. So our customers then at

17:17

Syber were obviously ASML, Nikon and the

17:21

end users were TSMC, Intel and other

17:24

fabs around the world. And he's like at

17:27

that time the market cap was only a

17:29

billion dollars and he was he was like

17:31

stuck in small cap hell and he was like

17:33

struggling and eventually they sold the

17:35

company to ASML. So without that laser

17:38

and ASML making the fabrication

17:40

equipment, we wouldn't be where we are

17:41

today. So, you know, going full circle

17:43

to what I'm saying is there's been 20

17:45

years of lack of investment in in the

17:48

hardware capex cycle. And all we've been

17:51

doing the last 20 years is just building

17:53

regular data centers with Intel CPUs or

17:56

AMD CPUs or whatever Amazon's doing with

17:59

their with their CPU chip and just

18:01

hosting email and you know some browsing

18:05

and web pages and maybe the only company

18:08

that was actually doing AI at the moment

18:10

was Google with their TPU program

18:12

optimizing stuff for Alph Go and search

18:16

and recommendations. And then all of a

18:19

sudden in uh I mean I invested in Nvidia

18:23

in in the fall of 2016 when DGX came out

18:26

and all that other stuff. But

18:28

>> not bad. Not not bad. By the way,

18:30

>> I'm like it at that time it was called

18:32

par they had the the advertisement on

18:35

Facebook. It was like power your machine

18:36

learning or your AI journey. It was like

18:38

a $50,000 box. I have the photo. It was

18:40

like a Facebook ad. And I was like yeah

18:42

machine learning that makes sense. And

18:45

then but in in fall of 2022 when the

18:48

chat GPT app came out and everyone

18:50

downloaded was like holy like it's

18:52

actually pretty smart. It answered my

18:54

question. It's not stupid. And then that

18:56

was the inflection iPhone moment for for

18:59

AI. And I remember you know my 2007

19:03

iPhone moment. I remember when Steve

19:05

Jobs showed it and I went to the AT&T

19:07

store and I was like I'm gonna get a

19:09

Blackberry World because I'm a

19:12

businessman. businessmen use

19:13

Blackberries. But then I saw the iPhone

19:15

and I was like all of glass and it was

19:18

like beautiful. I was like, "Holy

19:21

this is like amazing." And like that was

19:24

the iPhone moment. No one looked back.

19:27

What's Blackberry? I mean, what's

19:29

Motorola? Like everyone forgot about

19:31

that stuff. So then you basically the

19:34

iPhone moment for for 2007 till now was

19:37

a huge supply chain shock in itself for

19:39

bassband processors, memory, cos image

19:42

sensors for the camera, capacitors like

19:45

they went through all that uh at Certino

19:48

with Tim Cook and they basically the

19:50

supply chain has matured. So fast

19:53

forward, you know, to 2000 15 years

19:55

later with this this Nvidia, was it H100

19:59

at the time that actually made all this

20:01

stuff and everyone was like, "Oh my god,

20:02

like this stuff actually works. You can

20:05

parallelize intelligence and the more

20:08

GPUs you put, the better answers you

20:09

get." And then like the AI boom took

20:12

off. So we're four years into that this

20:16

November. Okay, four years. And it's not

20:19

as easy as going to Taiwan and China and

20:21

build a supply chain and come out with a

20:23

new phone every year and have consumers

20:26

buy it. You have basically like the

20:28

largest companies in the world basically

20:30

as your buyer and then you have to go

20:33

get a piece of land, permit it, make

20:35

sure there's power, get a bunch of

20:37

tradesmen from all across the United

20:39

States that are very limited, build it,

20:42

energize it, make sure it works, and and

20:44

bring it online. So the two are not the

20:47

same. And that's why you see this lag

20:50

and this huge investment in

20:53

semiconductor capex regular

20:55

semiconductor stocks and obviously

20:57

Nvidia because there's been this 20-year

21:00

lag in investment and care for whatever

21:03

it's been doing because all the love and

21:05

attention has been going to capital like

21:07

businesses like software. I mean

21:09

>> and when you sorry Ben when you say the

21:11

two are not the same what are you

21:13

comparing to? I think I think I have an

21:14

idea but I just want to be clear. the I

21:16

mean the I mean I'm just drawing the

21:18

parallel between Apple and but they're

21:20

kind of like the same but they're not

21:22

but it's the same sort of inflection

21:24

when you're using as an inflection point

21:25

for iPhone moment. I think the idea is

21:28

the idea of a smartphone was always

21:30

there with like a web browser and like

21:32

all this other stuff but like it was too

21:35

clunky to use. I remember when I was at

21:37

UC San Diego, I was part of the Qualcomm

21:40

Kiosera uh like beta testing program and

21:43

they gave me this this like brick phone

21:46

that had a web browser and I was like

21:47

look I can check my emails but it was

21:49

like

21:50

>> it was this clunky crappy thing. It was

21:52

like it had no user experience, no user

21:55

feeling, no soul. But when the iPhone

21:57

came out it made sense like anybody can

21:59

use it. saving a chat GPT anybody can be

22:03

a data scientist anybody can ask a

22:05

question that's the idea is like tech

22:08

the technologies are all out there but

22:10

what does he unlock to open it up to

22:12

everybody and that is that moment

22:15

>> and I want to compare CPUs versus GPUs

22:20

CPUs are sequential

22:23

and GPUs that parallel processing so

22:26

they're running on on multiple nodes at

22:29

the same time and is that why there is

22:33

such a supply squeeze in the

22:35

semiconductor supply chain is that GPUs

22:38

are just so much harder to make or are

22:41

there other things in other words why is

22:44

there such a um why is there such a

22:46

shortage of chips right now in a way

22:50

that in most the time let's say okay

22:53

memory prices or chip prices go up in

22:55

1994 they went down in 1995 most of the

22:58

time they resolve quickly

23:00

What is it about about the specific

23:02

semiconductor supply chain about why it

23:04

is so hard? Because honestly, Ben, the

23:07

reality is and I, you know, I love

23:09

commodities, but oil like there's a

23:12

secret a secret about oil is that in

23:14

Saudi Arabia, like you stick a stick in

23:16

the ground and oil comes out. There's a

23:18

lot of oil in the world and of course

23:19

there are shortages and the straight of

23:21

our moves but you know if the price of

23:22

oil goes to $200 extremely intelligent

23:26

uh petroleum engineers around the world

23:27

are going to work extremely hard to try

23:30

and get oil out of very difficult to get

23:32

places and they're going to succeed but

23:34

and and the same is true over a

23:36

long-term time horizon about about

23:38

semiconductors but specifically what

23:40

about the semi supply chain is is so

23:41

hard over the over the past three years

23:43

looking back and then over the next

23:44

three years looking forward

23:45

>> Nvidia itself is sort of like a very

23:47

special company because it's not

23:50

strictly a semiconductor company. I

23:51

think more than half the company is in

23:53

the software space and there's a lot of

23:56

researchers and developers. They have

23:58

their own open- source frontierish type

24:01

of model. Neatron and the stuff that

24:03

I've written about is like they can

24:05

squeeze more performance per watt out of

24:09

the existing chips just based on

24:11

software optimizations. Okay, this is

24:14

like the same thing as getting an

24:16

overtheair iOS update on your phone over

24:19

the overtheair update on your Tesla,

24:21

right?

24:21

>> Yeah. By the way, there were times I saw

24:24

a like news that Tesla had to do a

24:26

product recall. I'm like, "Oh my god,

24:27

this is so bearish for this company."

24:30

But then I realized it literally is just

24:31

a software upgrade. Like they're not

24:32

going to have to send the trucks back,

24:33

>> right? So any hardware company that

24:36

obviously doesn't have like a software

24:38

layer that provides the customer benefit

24:41

over time commoditizes and obviously you

24:44

can make that argument for a lot of

24:46

parts in the the semiconductor supply

24:49

chain. Memory has always been like a

24:51

commodity. That's the argument.

24:53

Companies like Micron trade at a

24:55

multiple of book value. That was always

24:57

a metric when I would talk to funds and

24:59

people. But apparently this time it is

25:02

different because high bandwidth memory

25:05

is special. It's not standard. And you

25:08

need all this memory because the more

25:10

context you give your AI or your brain,

25:14

the more data points it has and the

25:16

better answer you'll get. That's all it

25:18

comes down to. It's just having a bigger

25:20

brain and remembering more things,

25:23

right? I mean, that's why you see this

25:25

huge inflection in in memory all of a

25:27

sudden. This huge demand for years. It's

25:30

been stable and going back to CPU. Yeah.

25:33

Because we were just running classical

25:34

computing every year. Like every 3 years

25:37

you had to replace your computer, right?

25:39

That was the the corporate upgrade cycle

25:41

for for desktops. Okay, it's been three

25:44

years. We're going to have a corporate

25:45

upgrade refresh cycle. Like all that

25:47

stuff's like out the window now.

25:49

Everything is changing. The dynamics are

25:51

changing. And I think you know Nvidia

25:53

it's like because they have the software

25:57

hardware co-design and then they work

25:59

obviously with anthropic and open AAI

26:01

and others like they're tuning the

26:04

software and hardware exactly to how

26:06

these models work to the spec and once

26:09

you do that you can squeeze out more

26:10

performance and I think that's where a

26:13

lot of people are missing uh those

26:15

things and it there's not an actual GPU

26:19

shortage anymore. there was at some

26:21

point, but I think I read the number. I

26:23

think Nvidia spent $110 billion on their

26:26

supply chain basically buying everything

26:28

up for I don't know how many years out

26:30

to make sure that say for example one

26:32

screw or one cable wire or whatever it

26:36

is. If that's missing and the rack is

26:38

like a million parts, that means your

26:41

whole data center deployment is delayed

26:43

and every day

26:44

>> you think there's not a GPU shortage

26:46

anymore. Then how come Nvidia has such

26:49

pricing power and as does to a lesser

26:52

degree the other GPU companies AMD comes

26:54

to mind if there's not a GPU shortage?

26:57

>> I think there's a shortage of powered

26:59

land and tradesmen to build data centers

27:03

as fast. I think that's where you the

27:06

disconnect is. People don't again you're

27:09

not building millions of phones and

27:10

selling them to consumers at AT&T stores

27:12

and Apple stores like this is

27:14

infrastructure. Infrastructure and

27:16

buildings take time. You have neighbors

27:19

uh petitioning. You have sequa. You have

27:22

uh water issues like like infrastructure

27:26

takes time and there's a lag, right? And

27:29

sequencing.

27:30

>> There's a shortage of infrastructure and

27:31

powered land, but there's not a shortage

27:33

of GPUs. Why is that a bullish scenario

27:37

for Nvidia? Nvidia, by the way, actually

27:39

on a forward multiple trades at a

27:41

discount to its past five or 10 years.

27:43

if we can, you know, put up a chart of

27:45

that. So, the market is kind of pricing

27:46

in that that lack of pricing power or

27:48

that their their pricing power is going

27:50

to go from extremely high to very high.

27:53

It's still going to be very high, but

27:54

just less so. And you know, their gross

27:56

margin is going to go down, their

27:56

operating margin is going to go down.

27:58

Why do you think that is or is not going

28:00

to happen? I think the the bearish

28:02

argument with Nvidia is that obviously

28:04

every large hyperscaler from Google to

28:07

Amazon, Meta, was it even Bite Dance?

28:10

Everyone's going to make their own

28:12

custom accelerator to try to not pay the

28:16

Nvidia tax. Obviously, you're paying a

28:19

higher price because you're getting a

28:22

dependable product that ships on time

28:24

with the software stack on top of it.

28:26

But maybe if you can use it as a way to

28:29

leverage on pricing or maybe you'll get

28:33

better performance. The the jury is

28:36

still out if you're actually saving

28:37

money on doing it yourself. I think the

28:40

only company that really has full use of

28:43

their internal silicon is Google and

28:46

their TPU, but they also buy billions of

28:49

dollars a year of Nvidia GPUs and racks

28:52

and serve it on the Google cloud. So,

28:54

and they make money on that, too,

28:55

because there's so much demand. So,

28:57

either way, there's more demand for

29:00

compute than supply. And it's just not

29:02

the chips. I It's just energized, ready

29:05

to go compute because like I said,

29:07

getting the data centers up is the lag.

29:09

It's not making these in factories or

29:12

like everything at Taiwan Semiconductor

29:14

is like fully automated to the max.

29:16

Like,

29:16

>> yeah,

29:17

>> you don't have to worry about that. Like

29:18

they're good. All these chip companies

29:20

are good. The lag is deploying it in the

29:23

real world.

29:24

>> Okay, Ben. So, I'm going to venture and

29:27

assume that that you own a lot more

29:30

semiconductor stocks, you know,

29:31

notionally in terms of value than you do

29:34

the infrastructure companies like iron

29:37

or cororeweave. I mean, prologus is, you

29:39

know, something like that or or the

29:41

power suppliers eaten, verdive. Okay.

29:44

And by the way, that is true about

29:45

myself. But if what you said is true

29:48

that the true shortage is in powered

29:49

land and not in chips, does does our

29:52

portfolio positioning make sense? Why

29:54

why are why are we so long

29:55

semiconductors if the true shortage is

29:57

in powered land not chips other than

29:59

memory?

30:00

>> Because I think the backlog is measured

30:02

in years and not quarters. So like I

30:05

said if if a macro investor doesn't want

30:08

to is like semiconductor agnostic is

30:11

just scared of semiconductors because of

30:12

the whole cyclicality then definitely

30:14

the way to really play this is power and

30:17

infrastructure power is everything. If

30:19

you can generate power profitably or

30:22

have the infrastructure for it, then

30:23

there's value today. And I think, you

30:26

know, I've been writing about one of the

30:28

most interesting companies that I think

30:30

since December is Bloom Energy. They've

30:33

been around for 20 years, gone nowhere,

30:36

and the guy wanted to like powerhouses

30:39

with like this small fuel cell box that

30:41

takes natural gas and converts it to

30:44

electricity. And now I think in less

30:46

than like 80 days they can deploy

30:49

modular stuff at a data center site,

30:52

hook up to the the natural gas and

30:55

produce electricity and at 800 volt DC

30:58

without all the the transformers and all

31:00

this the crap in in the middle of it and

31:03

it doesn't make any noise, right? So I

31:05

think a a lot of the challenge between

31:07

with General Electric and Verova with

31:11

their turbines and like that stuff is

31:14

noisy and weird. That's not the data

31:16

center of the future. That's to me

31:17

that's like a temporary solution because

31:19

you the grid doesn't have enough

31:21

capacity. We need to find long-term

31:24

better sustainable power solutions

31:25

because power is everything

31:26

>> and and so so so many data centers that

31:29

the the grid doesn't support because it

31:33

has to be approved by everything. So,

31:34

they want to go behind the meter. So,

31:35

okay, we're going to turn natural gas

31:37

into electricity. We're going to buy the

31:39

the turbines from the three companies

31:41

that do that. You know, Mitsubishi, uh,

31:44

G Venova, and okay, Genova, their

31:46

backlog is out until 2028, 2029. Okay,

31:49

what else we're going to do? We're going

31:50

to do turn this company that, you know,

31:52

Ben Padian has been talking about called

31:53

Bloom Energy. That stock has done uh,

31:56

tremendously, tremendously well. a

31:58

little bit of pullback and I actually

32:00

don't know that that much about it. But

32:02

why it seems to me like semiconductors

32:05

are so much more difficult to do than

32:08

this this energy thing because is it you

32:11

know is it really that hard to turn

32:13

natural gas into

32:15

um into energy?

32:16

>> I mean there's even the there's this guy

32:19

Boom Aviation who's making a supersonic

32:21

airplane. instead of work focusing on

32:23

the airplane, he's converting his whole

32:25

manufacturing plant to making turbines

32:28

because he thinks he can make turbines.

32:30

Like everyone's running into this type

32:32

of uh place. Uh but I do think that

32:36

sustainable efficient energy generation

32:40

is a net benefit for society and for

32:42

these data centers and for the future.

32:44

Obviously, you have guys like Elon

32:46

saying if we covered was it a part of

32:49

Nevada with solar panels like it would

32:52

be enough to power all the United

32:54

States. It's possible. I think there's a

32:56

combination of natural gas, uh, solar

33:00

and batteries that I think will

33:02

definitely be powering the future with

33:03

some nuclear, not SMRs, but just

33:05

probably just traditional nuclear

33:06

reactors, which is a clean energy source

33:10

because our electricity demand is just

33:12

only going to go up. It's not going to

33:14

go down. If we're going to add more

33:15

electric cars, more electricity, more

33:18

electronics, more electricity, more data

33:21

centers, more GPUs, more electricity.

33:23

So, like, we're not going backwards

33:24

anymore. We're only going forwards.

33:26

>> So, Ben, the question that I asked of if

33:29

the shortage is in the powered land, not

33:31

the chips, why invest in the chips?

33:33

Shouldn't you invest in the in the

33:34

powered land? You know, that's what uh

33:36

famous now hedge fun manager Leopold

33:38

Ashen Brener has has done with

33:39

situational awareness. I don't think

33:41

there are, you know, there are not as

33:43

many chip stocks nearly as there are

33:45

powered land stocks like iron or Bloom

33:48

Energy. Do I I asked you for a push back

33:50

to that. I don't it sounds like you're

33:51

not giving that much of a push back. So

33:53

maybe is is that sounds like you think

33:54

that that actually is wise.

33:56

>> You have to kind of really look at the

33:58

assets of each powered land player and

34:01

at the end of the day powered land is a

34:03

quintessential real estate play. You

34:06

need the powered land needs a quality

34:08

tenant and that quality tenant needs to

34:10

be paying a good price. So if you can

34:12

line all those things up together and

34:14

you think all those things will work out

34:16

then it'll it will be a great

34:17

investment. But at the end of the day

34:19

it's a simple landlord tenant real

34:21

estate play which could be uh lower on

34:25

on the risk curve, right? But you need

34:28

but the question is there's a

34:30

bifurcation in in how

34:35

powered land players are playing. I

34:37

think I went to the Nebius event.

34:39

They're buying different software

34:40

companies. They're trying to build a

34:41

full stack different solutions. They're

34:44

trying to be like the hyperscaler versus

34:46

other guys who were like doing Bitcoin

34:49

before. The Bitcoin market is dead.

34:51

Who's doing Bitcoin?

34:53

>> Yeah. The IR name Ben. I just struggle

34:55

when you use a term like less risky. I

34:58

mean, some of these companies are

34:59

borrowing billions of dollars to build

35:01

out physical infrastructure as opposed

35:03

to Nvidia, which is actually going to be

35:07

borrowing like $20 billion for for

35:08

liquidity purposes, but is just printing

35:10

so much cash or even companies like ASML

35:12

or Lamb Research that optically are a

35:14

very high valuation, but are just so

35:17

critical and their their uh their market

35:20

position is so dominant, just

35:22

igopolistic, or in the case of the EUV

35:24

for ASML, literally a a monopoly that I

35:29

I think that those sound a little bit

35:30

less risky than borrowing $20 billion to

35:33

build data centers in in Texas.

35:36

>> There is a lot of risk in that. And I

35:37

think the Do you remember that scene

35:40

from the movie Batman where Bane is in

35:43

the plane and then he looks at the guy

35:45

he's like one of us has to be die in the

35:47

wreckage brother.

35:48

>> So figure there's a bunch of neoclouds

35:50

on that airplane. A few of them are

35:53

going to die in the wreckage or get

35:54

absorbed. I don't know who they are, but

35:57

the whole idea of of a NeoCloud and

36:00

obviously a high leverage. I think what

36:01

Fermy is one of them. There's a crazy

36:04

IPO and the CEO did all these weird

36:06

things and they have power land. It's a

36:07

ground lease. Like I got pitched it a

36:09

few times. Like it was just like way

36:10

over my head. Like I think from an

36:13

investing standpoint, KISS, keep it

36:15

simple stupid sometimes is easier. But

36:18

if you really really want to like you

36:20

have an itch for for powered land or

36:22

data centers maybe buy utility maybe

36:26

maybe buy Blackstone I don't know

36:29

>> black okay no one is really talking

36:32

about that Blackstone's position in the

36:34

data center market is very large and

36:38

that is there okay what do you think

36:39

about the

36:41

um the the powered land names like Texas

36:45

Pacific land or landbridgeidge which

36:47

owns land out in West Texas where data

36:49

centers may or may not be developed and

36:52

in the case of TPL uh a former executive

36:55

of of Google is trying quite hard to to

36:58

build a data center there. Do what do

36:59

you think of that?

37:00

>> I mean those things just like like I

37:02

said you're it's a quintessential real

37:05

estate development play high risk high

37:07

reward real estate in itself as an asset

37:11

is filled of debt. I mean it's a

37:13

leveraged asset. So, if you want to put

37:16

leverage on leverage and hopefully get

37:19

that awesome tenant and win and make it

37:23

a home run, then go in that direction.

37:25

But for me, sometimes it's a little bit

37:28

too uh hard to to quantify because I

37:31

don't have I don't know what's going on

37:34

in that market specifically who's there.

37:36

I'm not looking at every county report.

37:39

There's a lot of guys analyzing what

37:40

things are filed. I mean, I even had

37:43

this guy put together a bunch of land in

37:45

Northern California. He's like, "This

37:47

this this land will be amazing for a

37:49

data center." But the funny thing is,

37:52

I'm like, "How are you powering it?"

37:54

He's like, "Oh, we're powering up a

37:55

bunch of Bloom Energy." So, I was like,

37:56

"Oh, that's an interesting data point."

37:58

So, I think uh that to me was like,

38:01

"Okay, another data point for Bloom

38:02

Energy." So, like people are using it in

38:04

these these different places like I

38:06

rather just invest in that a little

38:07

easier for me.

38:09

>> That makes it. So, you've been an

38:10

investor in Bloom Energy. Yeah, it's it

38:12

to me it's obviously misunderstood. 20

38:15

years, no product market fit and all of

38:17

a sudden it became like the killer app

38:19

because it's quiet energy for the data

38:22

center and it ships fast, right? Time to

38:25

power is everything. So if you're a data

38:27

center developer and you're borrowing at

38:29

7 8% you want to wait for this power

38:34

thing to come or do you want to wait for

38:35

the utility to finally hook you up when

38:38

you have the GPUs and everything ready

38:39

to go or you going to be like you know

38:40

what Oracle is doing like give me the

38:43

bloom let's be online let's energize

38:45

this project let's start charging the

38:47

customer and let's move on. So that's

38:50

that's the way I look at it. Yes, for

38:52

for Texas Pacific land and landbridge,

38:55

they probably are not going to do the

38:56

development. People would be building it

38:57

on their land. So less debt, less capex

39:01

that they would be doing. And for full

39:03

disclosure, I have been an investor in

39:04

TPL. I actually sold my entire position

39:06

as I record this, but that may or may

39:08

change. I may reenter for for for

39:09

various reasons. Just want to have no

39:11

position. So

39:12

>> yes. Yes. Ben Ben, have you heard of I

39:14

don't own this series Energy or S series

39:18

C. They're trying to compete with Bloom

39:20

Energy. Uh, no I have not. I think the

39:24

one that's kind of run up recently is

39:27

Fuel Cell or FEL. Yes, that's like an

39:29

older company which basically it's like

39:31

the same type of technology. Fuel cells

39:33

I I guess are getting business. I

39:35

haven't like looked.

39:36

>> So, so in the chip world, Ben, how are

39:39

you allocating your capital to invest in

39:41

semiconductors and share your philosophy

39:43

behind that?

39:44

>> All chips aren't created equal. I think

39:46

people need to really understand that.

39:49

There's obviously memory chips, there's

39:51

FPGAAS, there's AS6, there's even like

39:55

diodes. Remember, I started a commercial

39:58

LED lighting company from 2005 to 2019.

40:01

An LED diode, a light is like the

40:04

dumbest type of LED you could use. It's

40:06

just off or on. It's light, right? And

40:09

you can go all the way up to the the

40:11

harder stuff which is obviously like a

40:13

GPU which is processing massive

40:17

computational loads and is creating

40:19

intelligence. So you got to pick where

40:21

you want to go but I think obviously you

40:23

have players like Nvidia then you have

40:26

their MI series. I think they have an AI

40:28

event in a few weeks in San Francisco.

40:30

They want a piece of the market. Intel

40:32

is trying again with investments in

40:35

Sambanova and other companies, but you

40:38

have a whole host of startups like

40:40

Etched or Posatron

40:44

or Unconventional AI. There's like

40:47

everyone's like everyone sees like a $5

40:49

trillion market cap and it's like every

40:52

entrepreneur's dream or investor's dream

40:54

is like let's get a crazy team together.

40:56

We're all smart. we're ex Google or ex

40:59

Nvidia, whatever it is, and let's just

41:01

build a better chip than they can. And

41:04

if we can just get 1% market share,

41:07

we'll be successful. And then one of

41:09

these other companies will just buy us

41:11

because we'll be a nuisance. But can

41:14

they really scale the supply chain? Do

41:16

they have a hundred billion dollars to

41:17

buy all this memory and fly to Taiwan

41:20

and move with all these suppliers and

41:22

cables and racks and like like like have

41:26

President Trump on speed dial and like

41:29

it's just very multifaceted. It's a it's

41:32

a rich man's game and it's hard to pick

41:35

smaller companies to think that they can

41:37

really grow in but there's different

41:39

parts of the stack that win. I think the

41:42

one of the most interesting parts for me

41:43

is obviously optics has been interesting

41:45

with communication and lasers and moving

41:48

the data faster between GPUs. And then

41:51

there's been this big push in uh it's

41:53

called CXL which is memory pooling. The

41:56

idea is that because memory prices are

41:59

so high instead of buying more memory

42:01

you kind of pull your memory in one

42:02

place and you share it and you process

42:04

it at a central location. So companies

42:07

like Astero Labs was like Left for Dead

42:10

and then all of a sudden shot up 400%

42:13

and the same thing with Credo and Marll

42:15

which focus on that space as well. So

42:18

but these are all like inflections and

42:21

moments in time. uh you know holding

42:24

Nvidia for 10 years coming up uh in

42:27

November you know I've been through a

42:30

lot of draw downs the big crypto draw

42:32

down in 2018 and then the 2020 boom in

42:36

the 2022 I remember every day was going

42:39

down these things aren't easy to hold

42:42

everyone thinks it's like glorious but

42:44

you know you just have to pay attention

42:46

to the company the long-term road map

42:48

management what are they saying are they

42:51

being honest started doing what they're

42:53

saying and just look at how things are

42:55

executing. Obviously, the next when I

42:57

was at GTC in March, all this stuff is

43:00

being built for this huge token

43:02

explosion and I think the next big

43:04

explosion in tokens is physical AI and

43:07

edge AI which is basically robotics

43:09

doing agentic work, right? So like you

43:12

can think of robotics or robots as

43:17

like when you're running claude code or

43:18

cloud the CPU is telling these agents to

43:22

do certain things orchestrating. So what

43:25

if the CPU is orchestrating physical

43:28

agents which will be robots? That's the

43:31

way that's the way it's headed. And

43:33

you're telling a robot a sequence of

43:35

things to do on the factory floor or a

43:37

sequence to do in the lab makes these

43:39

chemicals, right? It's sequencing in

43:42

parallel with tokens and a loop. I mean

43:45

that's basically what what it is. So

43:47

Ben, if I you your number one choice for

43:51

a stock or company in the AI supply

43:53

chain is what?

43:55

>> It's Nvidia. I mean

43:56

>> I knew you'd say that. Okay. What is

43:58

what is number two?

43:58

>> I mean I like Apple.

44:00

>> Really interesting. Tell me about that.

44:02

>> Apple is always going to be the company

44:04

that's going to bring useful AI to the

44:06

world, right? In a way where it's

44:09

hopefully humanistic and relevant to

44:12

your everyday life, right? I think AI is

44:16

not going to be some sort of product.

44:18

It's just going to be an upgrade to

44:20

whatever we have. And you can already

44:23

see uh I mean the iPhone is already

44:26

using AI. You can already sort your

44:28

album based on faces that you trained it

44:31

with that it recognizes and you can

44:33

create videos on I was with my friends

44:36

in this country. That's that's like

44:39

simple on the device AI. You just have

44:41

to

44:41

>> Ben I um actually I'll give a shout out

44:44

to the compound. I was listen you know

44:46

Josh Brown and Michael Batnik. was

44:47

listening to their podcast I think

44:48

yesterday about just how much money

44:52

Apple is going to make in services from

44:54

okay I'm a user and I'm using Claude on

44:56

my phone and I'm paying Claude and

44:59

paying anthropic Apple is going to get

45:01

20% of that 15 20% of that in the same

45:04

way they do that through you know Apple

45:05

has a hundred billion dollar it's called

45:07

services but really it's just taking a

45:08

cut of a lot of it is taking a cut of

45:10

you know money that of the apps that

45:12

people buy on the the app store and I

45:13

think that is going to be a big market

45:15

so even if Apple isn't an innovator AI,

45:17

which it very well could be. I think

45:19

that is going to be a driver for the

45:20

stock. That being said, Ben, I think

45:23

Apple Intelligence is has been very

45:24

underwhelming to me in my personal

45:26

experience as a consumer.

45:27

>> Yeah, it sucks.

45:29

I thought they had they have all the

45:31

data and they and they want to keep it

45:33

private but for some reason something

45:36

hasn't clicked which is weird but

45:39

hopefully with Google and whatever doing

45:42

with Gemini or even anthropic or people

45:45

can use their own models we you can get

45:46

some ondevice AI that's like relevant to

45:49

what you're doing in your life and your

45:52

social context and it's private to you.

45:54

I think that's that's the most

45:55

important. I don't people need to

45:57

realize like even with meta my people I

46:01

was doing the photos yesterday with the

46:03

the Instagram app like the the thing

46:05

like we're basically voluntarily

46:07

training their models of of our own

46:09

data. Does that matter to you or not? I

46:11

mean from a privacy perspective some

46:13

people really care. I mean but you have

46:16

to understand Apple's ethos from the

46:18

beginning is your data belongs to you.

46:20

It won't train on your data. And I think

46:22

that over time gets important when you

46:25

have photos and text messages and things

46:27

like that that should all belong to you.

46:28

It shouldn't belong to any frontier

46:31

model lab,

46:31

>> right? So you like Apple as a is with

46:34

this AI exposure. Technically though it

46:36

is not you know in the semiconductor

46:38

supply chain even though it it does

46:39

design it its own chips and stuff. So if

46:41

strictly sticking to like stocks that

46:43

would be in the you know VNX

46:45

semiconductor ETF or the the ICE semi

46:48

index or Philly whatever index like pure

46:50

semi stocks what is your number two?

46:53

>> Oh that's a good one. uh

46:55

>> why

46:55

>> I still think even though

46:59

we're in this crazy

47:02

memory is sort of constrained and the

47:05

only US company that really does memory

47:07

is Micron but we're I think highinix is

47:10

going to list in the United States. So I

47:12

I still see three companies dominating

47:14

and memory is obviously a very

47:18

interesting name but it just trades very

47:21

weirdly. So, but I think you need to

47:24

have a small allocation to memory. What

47:27

do you make of the semicap equipment

47:30

companies like ASML, KLA, Lamb Research,

47:34

Tokyo Electron that applied materials

47:36

that actually need are totally necessary

47:40

for memory to buy and to to expand and

47:44

if Samsung and SKH highix and Micron are

47:46

going to expand their capacity, which

47:48

they're you know trying to do, they need

47:50

to buy so many machines so many machines

47:52

and there's recurring revenue that Lamb

47:54

researched like 30% of their revenue is

47:56

recurring revenue. venue because they

47:57

need to sell this they need to replace

47:59

the spare parts which obviously you know

48:01

they're investors who in in like

48:02

AutoZone or something they they get that

48:04

but they should know that this is also

48:06

true of of lamb research and also to to

48:08

maintain the machine software revenue

48:10

and the like so you know if lamb

48:11

research revenue is going to scale

48:13

massively which I think it very likely

48:15

is perhaps higher than expectations then

48:18

like it's going to get revenue on that

48:19

continuously like in the many you know

48:21

many many years into the 2030s even if

48:23

this is a giant bubble that you know

48:25

that that that does burst you know, in

48:27

this year, this year or next. That being

48:29

said, they are they do trade at by far

48:30

the highest valuations in the semi-. So,

48:32

how do you how do you think of these the

48:33

semicap names? They're like literally

48:35

five.

48:35

>> I mean, the the the two cannot be the

48:38

same. I don't think Nvidia can be at

48:39

like such a low multiple and then

48:42

semicap which has always been the low

48:44

multiple guy be at such a high multiple.

48:46

So, there must be some sort of

48:49

mean reversion at some point. Uh things

48:53

have obviously run up a lot. Uh like I

48:56

said because there's been maybe two

48:58

decade two decades of a lack of

49:00

investment in any of these companies

49:01

like no one like no one cared if you

49:03

were about any of these companies for

49:05

the last 20 years. It was all about

49:07

Salesforce and Adobe and all this like

49:11

Twilio or whatever like that like that's

49:13

that was was sexy and like Splunk right?

49:17

>> Yeah. Yeah, the companies that their

49:18

names were in some instances were just

49:20

ridiculous. Like you should not be

49:21

naming a company that

49:22

>> didn't matter because they were capital

49:25

efficient, right? They were printing

49:27

money. But like now like applied

49:29

materials or ASML like like they need to

49:31

spend millions of dollars building out

49:34

more fab uh space and construction.

49:38

Yeah, applied materials is like super

49:39

busy. But obviously uh I feel like there

49:42

is some sort of

49:45

quasi cyclicality when it comes to these

49:47

types of names and people need to be

49:48

cognizant of that. There will be at some

49:51

point some sort of stasis and overbuild.

49:54

Trees don't grow to the sky and I think

49:57

maybe this generation of younger

49:59

investors have forgotten that. And

50:01

remember what you're investing in and

50:04

why and what your long-term thesis is. I

50:07

think that's important.

50:08

>> Yes. I I think we can safely say that

50:11

the 30 to 100% growth or over 100%

50:14

growth in some like micron like that

50:16

literally cannot continue for the next

50:18

50 years. Like I'd say the chance of

50:19

that happening is zero. Um of course

50:22

people have predicted that the the

50:24

semicycle would turn for the past two

50:26

years and and it hasn't happened yet.

50:29

What are you going to be looking for

50:31

that when you see A, you see B, you see

50:34

C, you say, "hm, Ben, this is kind of

50:37

looking like the cycle is turning and

50:41

maybe I am either going to sell my semi

50:43

stocks or definitely not buy more and

50:45

just just hold out and go into

50:47

protection mode like a little porcupine

50:48

because is this is this is the cycle is

50:50

turning. What are you going to be what

50:51

is ABCD those?"

50:52

>> Yeah, BAP research for my institutional

50:55

subscribers. If I'm tracking GPU

50:58

capacity, GPU rental rates, uh,

51:01

gigawatts of construction planned,

51:03

obviously looking at Taiwan, what are

51:06

what are the contract manufacturers

51:08

building, what are what is their growth?

51:10

Also looking at obviously the

51:11

Bellweather Nvidia, what is their road

51:13

map, how is that tracking? And then

51:16

looking at the uh, Frontier Labs,

51:19

Anthropic, OpenAI, what are they

51:21

building? How are they growing? How much

51:23

more computer they taking? Are they

51:25

growing headcount? And you kind of look

51:28

at all those different things and you

51:30

try your best to triangulate where you

51:32

are in this cycle. I don't know. But,

51:36

you know, based on my research and

51:39

industry conversations and speaking with

51:42

customers, feels like AI hasn't

51:45

penetrated as much as everyone thinks it

51:48

has. And I I just saw Anthropic just

51:51

leased 160,000 square feet on Hudson

51:55

Street in New York for their new New

51:56

York headquarters. You know, they're

51:58

going to put a thousand employees there.

52:00

Like, so San Francisco, New York, where

52:02

you are, are going to be the two big AI

52:05

hubs. They'll be there. So, you get to

52:07

say hi to them.

52:08

>> Yes, I do. And the AI has not penetrated

52:12

as much as people think. Is that bearish

52:14

or bullish? Just to be clear,

52:15

>> I think it's bullish. Uh, like I said,

52:19

Chad GPT was November 2022.

52:22

We're hopefully going four years in this

52:24

November. I mean, and this isn't like

52:28

the iPhone where you can scale

52:31

production and just ship a bunch of

52:32

stuff to to Apple stores and people just

52:34

pick them up. Uh, this is more

52:36

intricate. There's more parties

52:38

involved. There's fewer bigger pocket

52:41

buyers. Uh, and there's planning and

52:44

road maps involved. So I think the race

52:47

for comput is still there and like I

52:49

said classical computing died and what

52:52

Jensen is just saying it's like the era

52:54

of HPC and there's still time to really

52:58

grow and go in that direction until God

53:01

knows when you can do data centers in

53:03

space which is something for another

53:05

time. Yes, that that that is a a really

53:08

key point that the semiconductor supply

53:11

chain is so complicated and I'm not even

53:13

saying that this is the hardest thing,

53:14

but just to give people a sense, there's

53:16

there's a company like atomic layer

53:18

deposition, ASM, they used to own ASML,

53:20

I think, and they literally are putting

53:23

layers onto the chip that are one atom

53:26

thick or less than one atom thick. So

53:28

like I think that it's really really

53:30

really hard to do and there are certain

53:34

maybe false bare signals that people

53:36

could see of like oh shipments have

53:38

flattened that actually are a sign of a

53:40

constraint or a shortage rather than a

53:43

lack of demand.

53:44

>> Yeah. I mean there's there's a lot of

53:46

that going on. I I tried not to there's

53:49

a lot of noise. Just just look for

53:51

signal. Look for the productivity. Look

53:53

for the demand. Look how look how you're

53:56

using these these AI models how you're

53:59

getting or it's not allowing you to use

54:02

it. I think those are better signals

54:04

where we are until more capacity comes

54:07

online and you see more of this AI

54:09

actually diffuse into your everyday

54:11

life. I think that's where a lot of

54:13

people are missing. A lot of a lot of X

54:15

is concentrated in tech and obviously in

54:18

the Bay Area. So over there everybody is

54:21

doing AI.

54:22

>> Yes. in Los Angeles, nothing. Right? New

54:25

York, maybe a little bit, right? Is the

54:28

bodega down the street using AI?

54:31

Probably not. So, there's a way to

54:34

really there's a way there's a ways to

54:36

go to really see it permeate in the rest

54:39

of society. And I think it will be a net

54:41

benefit if you if used in the right way

54:43

for the right purposes. What are you

54:46

following in terms of the frontier labs

54:48

and their monetization in terms of

54:51

anthropic in terms of open AI? What are

54:54

you seeing in terms of their revenue and

54:57

just how fast is that growth relative to

54:59

that revenue and how does that compare

55:01

to how their costs scale as well?

55:04

>> The the beauty of this business

55:07

obviously it's very capital intensive.

55:09

Almost think about it as it's almost

55:11

like a bakery type operation. You build

55:14

this huge bakery plant which is like the

55:16

data center and your inputs are flour

55:19

and water or in this case GPUs and

55:23

electricity and then your output the

55:26

tokens is the bread right so uh

55:30

>> but the flour and water cost a lot of

55:31

money and the biggest expense for

55:34

building a data center is GPUs the

55:37

biggest expense for running a data

55:38

center from a gap perspective is GPU

55:41

depreciation

55:42

>> I think it's GPU are actually lasting

55:44

longer than people expected. I think you

55:46

have H100s and A100s that were like over

55:49

3 years old, still running, and they're

55:51

still useful. Not so much for training,

55:54

but you can use them for inference. So,

55:56

useful life is uh is still very very

55:59

there. But the thing is because there's

56:02

so much money going into these training

56:04

runs, you make your money off the

56:06

inference and the gross margin on

56:08

inference with the API pricing seems

56:11

like it's trending towards, you know,

56:12

the high 70 maybe even 80% gross margin.

56:16

So this is like the new basically

56:18

software paradigm. The new SAS is

56:20

inference, right? The question is is if

56:23

you're a software company, are you

56:25

buying tokens wholesale and adding your

56:28

intelligence and selling retail? Do you

56:29

have enough margin to survive against

56:32

these frontier model companies that are

56:33

coming after your business who own the

56:35

whole stack who control their whole

56:37

their whole margin profile? I mean

56:39

that's why you've seen this huge

56:41

derating in software like software was

56:44

unassalable.

56:45

>> Yes.

56:46

>> Until now. I wonder why. But Ben, the

56:49

core point that software had very high

56:52

gross margins that you would spend a lot

56:55

of capital, hire a lot of expensive

56:56

software engineers to make pay software

56:59

um sellers a lot of money to make to to

57:01

sell the software, distribute the

57:03

software, but that once it was running,

57:04

it was very very high gross profit

57:06

margins. AI does delivering AI does have

57:09

lower margins.

57:10

>> Delivering AI does have lower margins. I

57:12

mean, not from what I've been reading.

57:14

The profitability on inference is there.

57:16

I think again going back to the bread or

57:21

oil analogy, I think if a company like

57:24

Anthropic is made truffle infused gold

57:29

flaked bread at a low cost and is

57:32

selling pieces, thousands of pieces at a

57:34

at a high price, then they're really

57:38

making good money and they're probably

57:40

heading towards cash flow positive at

57:42

that. I mean, the guys, he said in

57:45

February they they 8x their revenue

57:47

plan. I mean, that's crazy. It's like

57:49

the fastest growing company in the world

57:52

at at this point.

57:53

>> So, yeah, I just I just pulled up

57:54

Salesforce, a classic SAS business.

57:56

Yeah. Gross margins of like 72 to 77%.

57:59

You're So, you're saying that you've

58:01

read or heard that anthropics gross

58:03

margins for inference are are what you I

58:05

just want to be clear.

58:06

>> I think in the 70s or higher.

58:09

>> Yeah, that that um that is pretty pretty

58:11

high. What about OpenAI?

58:13

>> I haven't seen their numbers. I mean,

58:16

from a user perspective, I do use some

58:18

chat GPT and things like that, but for

58:20

deep commercial work, it's mostly Claude

58:22

and Fable and all this other stuff. I

58:24

think they've really won on the

58:26

enterprise, but I don't know what Open

58:28

AI is trying to do. Maybe 5.6

58:33

is it? I know they have way more compute

58:35

than than Anthropic, that's for sure. Do

58:38

you think that companies are happy with

58:40

the money that they're spending? I know

58:42

you watched Alex Karp on CNBC

58:46

just absolutely trashing um

58:50

I won't say trashing. He he was very

58:52

stern that the executives in corporate

58:54

America are displeased with the cost of

58:58

AI, the the value that it provides in

59:02

terms of outputs and also the the data

59:05

lake that like anthropic could be like

59:06

taking the data or the companies aren't

59:08

allowed to own their own data. Set

59:09

setting that aside and and then you know

59:11

the CNBC people were saying well what

59:13

are what are you saying and and and Alex

59:15

Karp said I am a vessel I am speaking

59:17

for corporate America. It was honestly

59:19

pretty pretty entertaining TV, but that

59:21

Yeah. What do you What do you make of

59:22

that argument that the companies are

59:23

like, "Whoa, I'm spending a billion

59:25

dollars. This is ridiculous."

59:26

>> Yeah, Alex is uh I love him. He's like

59:29

my spirit animals. I think he just says

59:31

whatever's on his mind and he doesn't

59:35

care. And I think that's the way people

59:37

should be. And I that's really how

59:40

things are being done. Even at Nvidia, I

59:42

posted a few times when I was there at

59:44

Marchant GTC, a VP of AI Abdullah

59:47

Hollik's like we use uh Opus to

59:51

basically orchestrate and we use Neotron

59:54

which is our own open- source model and

59:57

we can achieve frontier level results by

60:00

combining these two and we own our own

60:03

compute. So all those the grunt work of

60:07

of tokens is owned by us and we don't

60:10

pay anybody for it. So you so the idea

60:13

of using frontier models for everything

60:15

is that's like when you blow your token

60:17

allowance and you spend too much money

60:20

on wasted projects and or like what am

60:22

someone on Amazon spent like a million

60:24

dollars or something on tokens. It just

60:27

it it doesn't work. And I think that's

60:30

where enterprises are heading with this

60:32

like router approach where if it's

60:34

really hard, use the frontier. If it's

60:36

not, use a local model and have the the

60:40

frontier orchestrated. Does that make

60:41

sense?

60:42

>> Yeah, that that does make sense. And so

60:44

short term that may may lead to less

60:47

demand for frontier tokens, but longer

60:50

term you think it actually is is

60:52

bullish.

60:52

>> Yeah. Cuz at the end of the day, the

60:53

frontier is always going to be like

60:56

pushing the limits and it's sort of

60:59

maybe like the luxury

61:01

car. Maybe it's like the Ferrari of the

61:03

market. There's always going to be

61:05

buyers for that who want the speed and

61:09

they want to be the best, but maybe some

61:11

people don't want that or maybe some

61:13

people want to mix. I mean, that's what

61:15

I'm saying. Like the the AI market is

61:17

sort of maturing. Not one not one

61:20

sizefits-all. There's different ways to

61:22

use like for say you're like a CPG

61:26

business and you want to have like a

61:27

chatbot about like your your consumer

61:30

products. Just load all the data and

61:33

then train it with like a like a open-

61:35

source model with the weights and

61:37

everything and that's it. Like talk

61:39

about the product. It's not going to

61:40

like solve math or find new chemicals or

61:43

whatever for you. It's just going to be

61:45

talking about hey yeah the frosted

61:48

flakes has this much sugar in it. There

61:50

you go. Whatever. Like like the

61:53

different parts of your stack are going

61:55

to use different types of models. It's

61:57

overkill to use something like a

61:59

chainsaw for everything when you just

62:00

need like a a butter knife,

62:02

>> right? Yeah. You don't need Albert

62:03

Einstein for you doing data entry or

62:06

honestly even sending emails that aren't

62:07

that important. Ben, what do you make of

62:10

opensource? This is the another bare

62:13

thesis. Okay. Yes, AI is transformative,

62:16

but open-source models that charge so

62:19

much less, so so so much less are just

62:22

going to sap the pricing power of the

62:25

American Frontier models. What's your

62:28

reaction to that? Number one, and where

62:29

does Nvidia's Neatron come into this?

62:32

>> Yeah, I think you need both. It's just

62:34

not, like I said, again, it's not one or

62:37

the other. It's a combination of the

62:39

two. And what I've told people is like

62:41

with Nvidia you get like a free open AR

62:44

anthropic like Neotron is just as good.

62:47

Like they have like you should look at

62:48

the team of researchers like the guy's

62:50

like oh I just got hired from Meta Super

62:52

Intelligence because I'm working on

62:54

Neatron to solve to solve science and

62:56

hard math problems and enic workflows. I

62:59

was like whoa like these are the people

63:01

that Nvidia is hiring. Part of doing all

63:03

these things is to keep your customers

63:05

honest, right? Like what if a company

63:08

like Anthropic are so smart they're like

63:10

oh you know what we'll just make our own

63:12

Nvidia we'll make our own chips we'll

63:14

make our own models like we're just

63:16

going to outdesign you on everything. So

63:18

like if that happens like what what leg

63:20

does Nvidia have to stand on? they need

63:22

to have their own model, right? So, it's

63:24

a this is also a part business. It's

63:27

it's a business decision also to make

63:29

sure your your customers don't put you

63:31

out of business, right? And I think a

63:34

lot of the world wants open source. I

63:36

think like the parallel again going back

63:38

to Apple uh Frontier models are sort of

63:40

like iOS, right? And it's sort of like

63:43

closed and the the the open source is

63:45

like Android. It can be anywhere and you

63:48

can use it on anything. But the the cool

63:50

thing is is that Neotron in itself is

63:54

optimized on CUDA and CUDA with the

63:57

software layer is optimized for Nvidia

64:01

hardware. So like you have basically

64:03

developers all around the world on an

64:05

open source contributing figure out ways

64:08

for free to make this product better for

64:10

you. You don't have to do anything. You

64:11

can wake up like oh look the community

64:13

came up with this and look we we made

64:16

this a little bit better. Oh that's

64:17

awesome. like I get free software

64:19

updates. Oh, it's great because I bought

64:22

this and I have this. So that's like the

64:25

benefit of open source and and the

64:28

silicon that it comes with.

64:29

>> So that's good to know about Nvidia has

64:31

this ecosystem. I I didn't know this Neo

64:34

Neotron that is really good to know.

64:36

People should look into that and you

64:37

know if it's not obvious you're giant

64:38

Nvidia bull which has obviously worked

64:40

out well. But Ben just go back to open

64:42

source. I'm let's say there's a company

64:44

five people and they are going to do AI

64:48

agentic workflows for coding that really

64:50

are going to transform their business

64:51

and provide a million dollars worth of

64:54

value. The problem is that they're that

64:57

you know anthropic or openi is going to

64:59

charge them like four or 500k to do

65:00

that. So it's still a good deal but it's

65:02

really expensive. Then comes in Quen,

65:05

comes in Deepseek, comes in Jeep, all

65:08

these Chinese models that instead of

65:09

charging $500,000 or four $500,000 are

65:12

going to charge $6,000.

65:15

How is that number one are my priors

65:18

wrong? Like is that just not accurate?

65:19

Or number two, how is that not wildly

65:22

bearish for the Western AI things that

65:24

are closed source?

65:25

>> But where is your compute? Is it are you

65:28

are you do you have your own compute and

65:30

you're running your models locally or

65:33

you're running these models hosted on

65:35

some something else and trying to get it

65:37

to work?

65:38

>> And the question is is will China block

65:42

open source models out of their country?

65:45

And then if you're building on a model

65:47

that's like blocked and you're halfway

65:49

through building in your business then

65:51

what happens? What kind of business risk

65:53

are you introducing to your company? So

65:56

the question is is like how do you build

65:58

your business in a way where you're the

66:01

CIO or the CTO and you're not so model

66:04

dependent on one company where tomorrow

66:07

you're building on some sort of volcano

66:10

and they erupt pull your access or

66:12

increase your pricing. What do you have

66:14

to fall back on by then? They have you

66:16

by the balls and then you're

66:18

>> Okay. So, so people are going to pay a

66:20

ton of money for Western models rather

66:22

than Chinese models because they're

66:24

worried about the Chinese government and

66:26

China taking their data. That's what

66:27

you're saying

66:28

>> that or at the same time you just don't

66:30

know where that's going to head. I think

66:33

with with anything with obvious China I

66:36

mean like their playbook has always been

66:38

let's deflate the cost out of anything

66:40

that we make and just try to export it

66:43

around the world. And what I've coined

66:46

in other segments, it's called inference

66:49

through influ influence through

66:51

inference. So the idea is like what

66:53

China's been doing with like companies

66:56

in south countries in Southeast Asia

66:58

like Frontier Africa is like like we

67:00

don't have any running water. We don't

67:02

have an airport. We have no

67:03

infrastructure. Don't worry, China will

67:05

come in. We'll build it for you and

67:06

we'll we'll lend you the money and you

67:08

know all these natural resources that

67:09

you get out of the ground and these rare

67:11

earths, we'll take it. Thanks. So, I

67:15

think the next thing China is going to

67:16

do is like, you know what? Oh, you're in

67:19

Zimbabwe. You want AI? No problem. We'll

67:21

build you a Huawei data center and we'll

67:24

give you the models to run on it. And

67:26

it's the uh GLM or DeepSeek. And by the

67:30

way, if you look up Tenement Square, it

67:33

never happened. And they basically they

67:36

basically influence this is like a this

67:39

is like a global policy perspective from

67:41

America and democracy, right? How the

67:43

world views America through the lens of

67:46

China in these models. So you're

67:48

influencing through inference and I

67:50

think that's another thing that America

67:53

can afford to lose on the race for AI of

67:55

the world. So your argument that China

67:58

is not going to displace the pricing

68:00

power of these western models is based

68:02

on geopolitics

68:04

rather than tech. I am not saying that

68:07

you're wrong and that totally like the

68:08

reason that people all around the world

68:09

in Europe use Microsoft as opposed to

68:11

like you know some technology developed

68:13

in Singapore is is precisely for that

68:15

reason or just that we have kind of

68:16

network effects in the American tech

68:18

stack. But don't you think with the vast

68:20

sums that are being spent and will be

68:21

spent by companies on AI that you know

68:24

if it really is so transformative

68:26

wouldn't you want to save $2 billion a

68:28

year like if you are I don't know uh

68:31

Coca-Cola or something and you know in

68:33

many years and you're spending let's say

68:35

$50 million a year as Coca-Cola wouldn't

68:37

you want to cut that to $15 million are

68:39

you heavily heavily incentivized to do

68:40

that

68:41

>> sometimes there's career risk with

68:43

putting all your eggs in one basket and

68:46

I do see somewhat of a contingent hybrid

68:50

approach when it comes to model

68:53

selection by CIOS and CEOs of companies.

68:57

You can't go all in on one. You have to

69:00

have like a a few that you're basically

69:03

routing around and then you'll have like

69:05

a blended lower cost hopefully.

69:08

>> Ben, what do you think is the most

69:09

overrated stock or seg segment of the

69:14

supply chain?

69:14

>> Overrated.

69:16

uh

69:17

>> like like like I don't I suspect that

69:19

you're not short any semiconductor

69:20

stocks, but if you were like running a

69:21

long short company hedge fund and you

69:23

had to be short, which ones would you be

69:25

and why? I think there's a lot of these

69:26

companies that are doing like optical

69:29

materials like AXTI or indium phosphate

69:32

like like again like it's just you're

69:35

just going after like a raw material

69:37

that's supposedly like very high in

69:39

demand that will have like boom and bust

69:42

and things like that or it's just to me

69:44

it's like I like to be in places that

69:47

have some sort of defensible moat as

69:50

good management uh that will last over

69:53

time and Those types of names to me are

69:56

just like very esoteric. And there

69:59

there's obviously there's some cartoon

70:01

characters on X who shall not be named

70:04

that have large followings who tell

70:06

people to to go into these names which

70:09

to their own risk uh they can do all

70:11

that stuff.

70:12

>> Yes. You know I understand that there

70:13

are some commodities that actually are

70:15

very rare like the the photo resist and

70:17

they're very hard to make and like two

70:19

to four Japanese companies make them.

70:20

But yeah, I mean like it that makes

70:22

sense to me that why if if if the

70:25

commodity is literally in the um you

70:28

know in the periodic table that sounds

70:30

like something that shouldn't have

70:33

pricing power in the long term.

70:34

>> Correct. I mean the whole idea is like

70:36

the idea of modes and how hard is it? I

70:39

think that's where uh you know I live

70:43

through it with LED lighting right? It

70:44

was like a commodity. It's like a diode

70:46

and we had competitors from China and

70:49

Korea and like everyone was doing it and

70:51

Amazon. So it's like if you're getting

70:53

squeezed from all different directions

70:55

like that's not a good feeling to be in

70:56

because everyone's chasing the same

70:58

market. You want to be in something

70:59

that's very hard and has definitive

71:02

layers against it. And I think when you

71:05

look at from a macro perspective, like I

71:08

said, all hardware eventually

71:09

commoditizes, right? The last scalable

71:14

consumer or electronic device that

71:16

hasn't commoditized is what you're

71:18

talking to right now, your MacBook, your

71:21

iPhone, right? How come it's just a

71:23

computer, right? It's just like a phone.

71:24

Like, why hasn't it why is it $1,000?

71:27

How are they getting these? Like,

71:29

because the software layer matters. The

71:32

code design matters, right? And I would

71:34

say brand which I think in in the

71:36

semiconductor world brand kind of from a

71:38

consumer perspect doesn't really matter

71:39

like no one is like oh I'm going to buy

71:40

this phone because it has this

71:42

particular type of NPU.

71:44

>> It's not brand but you the thing is you

71:47

know an iPhone 9 has an operation of

71:50

49s. It's going to work 99.99%

71:53

of the time up time versus like these

71:57

like weird phones that were coming out.

71:59

you're like, I you had to reset it a

72:00

bunch of times and it was like a iPhone

72:02

wannabe. Like, you know, this phone

72:04

works, dude. So, like that's like you're

72:06

paying for reliability. The same thing

72:08

with Nvidia. You're gonna get four 9s

72:09

and if something goes wrong, someone's

72:11

there to like fix it. You're paying for

72:13

that. There's you're paying for that

72:15

certainty. But if you want to take the

72:16

risk and make your own chip or buy from

72:19

AMD or one of these startups, go for it.

72:21

Be, you know, be a guinea pig. See where

72:23

that takes you. I mean, you'll save

72:25

you'll save money on the front end, but

72:27

you're going to pay on the back end.

72:29

I've I lived through this many times,

72:30

you know, buying the cheapest thing and

72:32

on the back end I I pay for it. So, I

72:35

like I'm done. I rather just, hey, you

72:37

want to make this margin, okay, I'll pay

72:38

for it and then just move on. Ben,

72:40

obviously I'm not going to ask you to

72:42

give, you know, all of your alpha away

72:43

for free, but could you give us one name

72:46

or sector that you think is

72:48

underappreciated in the semiconductor

72:49

supply chain right now, as was perhaps

72:52

like, you know, you wrote about Bloom

72:53

Energy in in the winter of of last year.

72:55

>> Yeah, I mean, I wrote about this and

72:57

people are going to give me a lot of

72:58

crap. This company called Super Micro, I

73:01

think it was like a Catrini favorite. I

73:03

think

73:04

>> Shout out. Yeah.

73:05

>> Yeah. went up to like 600 bucks and then

73:08

like they managed to burn through all

73:10

their cash and then smuggle like GPUs to

73:13

China. I don't know why the guy was

73:15

doing that, but like it it's a real

73:18

company in San Jose. Like they have

73:19

people working building these server

73:21

racks and like like they're Nvidia needs

73:24

them to to survive. AMD needs them to

73:27

survive because they make a good liquid

73:30

cooled product. They can make AI racks

73:32

and hardware, right? Dell. Obviously, I

73:35

love Michael Dell. Like, he's like the

73:37

American He's like the American dream

73:39

guy out of college, out of his dorm

73:41

room. I I love him, right? And you have

73:44

companies like HP doing the same thing.

73:46

I think Super Micro just had maybe some

73:49

bad family members that were doing wrong

73:52

things, but I think from a valuation

73:54

standpoint and the IP that they have and

73:57

obviously they just raised about $7

73:59

billion of diluted funding recently. I

74:02

mean JP Morgan led it. If people are

74:04

putting $7 billion into this company and

74:06

it's probably we'll figure out what

74:08

institutions did then there's an order

74:10

book behind it and if SpaceX just raised

74:14

$85 billion they're going to be adding

74:16

more capacity to Colossus in Memphis and

74:20

Super Micro is going to get that call. I

74:22

don't know what their gross margin is

74:23

going to be. is going to be low, but

74:25

hopefully they can squeeze a few points

74:27

out of it and really rebuild this

74:29

business of what was and get back to

74:32

their glory days and probably not $600 a

74:35

share, but you know, something

74:36

reasonable. And I think that from a

74:39

fallen angel governance perspective uh

74:42

needs to be, you know, looked at again.

74:44

>> That is interesting. I remember when

74:45

when uh talks about it on my show and it

74:48

had an accounting scandal then and then

74:50

it you had huge demand from AI. It's

74:53

went up a tremendous amount and it's c

74:55

capital expensive. There was some bad

74:57

thing that people should look into. Um

74:58

but yeah. Okay, that's interesting. Ben,

75:00

one question I wanted to ask you. What

75:03

do you make of the bare case for the

75:06

software in the semiconductor supply

75:08

chain? Not talking about Nvidia, I

75:10

guess, although I kind of am maybe, but

75:11

I'm in particular the two companies are

75:13

Cadence and that they to explain for our

75:16

audience. They designed the software

75:18

that the engineers are going to use when

75:20

they make the and design the chips and

75:24

this has been the ultimately like high

75:26

power software and like a lot of

75:28

software super high retention and then

75:30

they they get you know net dollar

75:32

expansion upsells yada yada yada so

75:35

great business but I mean if AI really

75:37

is so transformational then maybe the AI

75:40

companies are going to design their own

75:42

software and save money on the uh you

75:43

know hundreds of millions of dollars

75:44

that it probably costs to to license

75:47

this software. So, you know, this is

75:50

probably the the stocks that are up the

75:52

least this year, Cadence and Synopsis.

75:55

What's your outlook on this on these uh

75:57

on these two names and the overall the

75:59

bare case on semisoftware that like you

76:02

know this AI AI can make software if it

76:04

cost software is zero?

76:05

>> Yeah, I mean that's I think when open AI

76:09

released the jalapeno chip they said

76:11

they did it themselves. I mean I don't

76:12

know the details of what they used but

76:16

EDA electronic design automation

76:18

synopsis and cadence have been a duopoly

76:20

for a long time and they were sort of

76:23

unassalable and obviously now with

76:26

software multiple headwinds people are

76:28

wondering if AI companies can just do it

76:30

themselves. I think the the jury is

76:33

still allowed. You you still get a lot

76:35

of libraries and fies and things like

76:38

that that these companies offer. And if

76:42

Jensen put five was it $5 billion or $2

76:45

billion? How much you put in synopsis?

76:47

>> Two billion.

76:48

>> Two billion. Okay. That's two billion

76:50

more dollars than I ever put into

76:52

synopsis. So I mean I have a lot of

76:54

respect for him. Nvidia is not a company

76:57

that likes to spend money on nothing. I

76:59

mean I was there. I remember people

77:00

wrote articles about it. I'm like, "Oh,

77:02

there's no free food." But the the

77:04

burrito bowl was like four bucks and I

77:06

had to pay $5 for a cold brew and

77:08

there's only free black coffee. Like

77:10

it's not like meta. It's not like Google

77:12

with like fancy

77:14

>> ball. You're not getting your massages.

77:15

Yeah.

77:16

>> None of that. Like these people are like

77:17

grinding. No one was like remember I was

77:20

I was out there at like 1250 and I was

77:23

like I was checking the stock price. No

77:25

one was on their phone looking at the

77:26

stock price. Everyone's just like happy

77:28

to be there. kid brought his daughter to

77:30

work. There's no parking in the parking

77:32

lot. They're expanding, building another

77:34

facility. Like they're just mission is

77:36

the boss. They're focused on the

77:38

mission. And like when I speak to some

77:40

people that even worked there for 20

77:42

years, I'm like like dude, like you're

77:44

worth probably way more than me. Like

77:46

why are you still here? He's like this

77:48

is my moment. Like you want me to retire

77:50

and stay home and get in fights with my

77:53

wife or like like you want me to like we

77:55

designed this company for accelerated

77:57

computing and we're doing it now. you

77:58

want me to like just stop? I'm like I

78:00

guess not. So coming back to EDA, yeah,

78:03

I mean the jury is still out. We don't

78:05

know. I don't want to bet against

78:07

Jensen, but at the same time, I think

78:10

where the investment in synopsis and I

78:14

think the solid systems also they have a

78:16

partnership. The idea is how do you use

78:20

the libraries and the models to model

78:22

the physical world into the digital

78:25

world uh omniverse. And if you can model

78:30

the real world into digital world at

78:32

scale with compute then you can solve a

78:35

lot of problems and physical things

78:37

digitally before you have to actually do

78:39

it physically. And that in itself is a

78:43

big moneysaver. That's how they're

78:45

designing all these data centers and

78:47

products and things like that.

78:48

Everything is virtual, right? Rather

78:50

than physically trying to do trial and

78:52

error. So the idea of doing things

78:54

physically, trial and error and wasting

78:56

money and waste and time and virtually

78:59

doing it with EDA tools, I think there's

79:02

a net benefit to society and people are

79:05

still early and they haven't seen it.

79:06

There's also medical devices. It's not

79:08

just semiconductors, right? They do a

79:10

lot of things on the design front. And

79:13

what about the IP licensing business

79:15

that synopsis and to a lesser degree

79:17

cadence have? The big leader in this of

79:19

course is ARM that IPOed like two years

79:22

majority you know owned by SoftBank and

79:24

then the other players I guess are

79:26

Rambis. Um but but I've heard this bare

79:28

argument on IP licensing like Nvidia

79:31

they have all these geniuses working at

79:32

Nvidia. They're not going to be paying

79:35

Synopsis or Cadence or Rambis or ARM to

79:37

to do all this stuff. I mean maybe they

79:38

will be paying ARM but that's a

79:40

different story. But what do you and at

79:41

the same time if that argument is wrong

79:43

the royalty type business has a you know

79:46

gross profit margin quite close to 100%

79:48

that's an extremely good business

79:50

>> from a business perspective it would be

79:52

weird if you invested in a company and

79:54

then all of a sudden you tried not being

79:55

their customer anymore kind of hurting

79:57

your own investment.

79:58

>> Yeah but so Nvidia invested in in

80:00

Synopsis and um former CEO of Intel now

80:03

Liputan former CEO of Cadence. So just

80:05

saying is you know is he gonna cancel

80:07

the contracts? I don't know. Ben, final

80:09

question. Tell me about capacitors,

80:12

specifically MLCC's, multi-layer ceramic

80:15

chip capacitors. Investors, whether

80:18

they're, you know, individual investors,

80:20

retail investors, specialists, or

80:22

institutional investors, the big banks

80:23

are now writing reports about this, are

80:25

saying the new memory cycle, it was

80:27

either Goldwind or JP Morgan that said

80:28

the new memory, the new bottleneck is in

80:30

MLCC's, not memory. So these would be

80:33

stocks like um Viche comes to mind which

80:35

I actually think Catrini said on the

80:37

show like three three years ago but

80:39

these stocks are certainly catching a

80:41

bid to put it mildly. Is this hype or is

80:43

this there's something there? there.

80:45

>> Yeah. Again, chasing capacitors and

80:47

resistors which are like on the low end

80:50

of semiconductors which like a business

80:53

that I never wanted to be in that will

80:56

tomorrow some company out of China will

80:59

just pop up and be funded by the

81:01

government and flood the market with a

81:03

resistor capacitor. Like that's not a

81:06

business you want to be in. But again,

81:09

people love this notion of chasing

81:10

bottlenecks. I think that will probably

81:13

end in tears at some point. Not for me.

81:15

>> Yeah. Well, actually, Vich actually is

81:16

down 35% from the peak earlier late late

81:20

June. Okay. But Ben, that whole

81:22

argument, I'm not saying you're wrong,

81:23

but people said that that

81:24

>> No, but we went through it. If if you go

81:26

back in time in history back to the the

81:28

iPhone super cycle from 2008 or 2007 to

81:32

2010 like when I was building uh I think

81:36

LED products and like we couldn't get

81:39

power supplies because all the

81:41

capacitors were in shortage because the

81:44

Apple was eating up the world's

81:46

capacitors and resistors for their

81:48

iPhones, right? And the same thing is

81:51

sort of happening now. You have maybe

81:53

it's bifrocated. You have a new iPhone

81:55

coming out and you have exist existing

81:58

iPhone cycle of peop of like there's

82:01

like there's a stasis of capacitor

82:04

demand and then if you look at the the

82:06

board with the GPUs on it yeah there's

82:08

like a million of these like barrel

82:10

looking things which are the capacitors

82:12

on it and obviously they're using a lot

82:14

and Nvidia is selling more racks so then

82:16

you see this spike up in demand that

82:20

they haven't uh been able to catch up

82:23

but eventually will catch up. So, it's

82:25

like it's a moment in time before they

82:27

just catch up. You don't think they're

82:28

going to they want to sell more

82:29

capacitors? They will, but there's just

82:32

a lag to catch up to the demand.

82:34

>> Everything you said is true, but it also

82:35

is a true argument about memory and yet

82:38

you're bullish on on memory. What's the

82:40

difference?

82:40

>> Think of the the memory obviously

82:42

there's three players and then the HPM

82:46

which I've written about it is

82:47

>> high with memory which requires a lot

82:49

more wafers. Yeah. It's that there's

82:51

like wafers and wast like it's it's

82:55

almost like making like a lasagna that

82:57

you have to like stack multiple layers

83:01

exactly on top of each other. And then

83:06

the wires that go through that connect

83:08

all these

83:10

uh the stacks of memory have to be like

83:14

nanometers

83:15

precise to make sure they basically all

83:18

connect and then land on the board.

83:22

Okay. So it's not like the memory that

83:25

goes like you would go to Fry

83:26

Electronics or Computer World where you

83:29

like stick it in like I got got some

83:31

crucial memory. It's all good. Like this

83:32

is this is a little different. Like when

83:34

you're stacking layers like that and not

83:38

all of them go perfect every time and

83:40

you throw away a little bit and you have

83:43

your yield isn't there. That's where it

83:45

gets a little special and challenging.

83:47

Maybe at some point they'll make like a

83:49

robot that can fully do it and it's like

83:52

99% accurate, but until then it's a

83:55

little harder. And then I think they

83:56

wanted to do they wanted to go up I

83:59

think highest is like 14. They wanted to

84:01

go to 16 and they weren't able to do it.

84:04

Adding that extra layer was just too

84:05

hard aligning everything. So there you

84:08

go. It's like that's the difficult part

84:10

at this point.

84:11

>> When do you think memory is going to

84:14

come online in sufficient scale to cause

84:17

prices to go down

84:18

>> prior early 2028? So you'll probably see

84:22

something mid 2027 where people like

84:26

freak out

84:27

>> freak out because memory prices are

84:28

going to go down.

84:29

>> Yeah,

84:29

>> I see. I see.

84:30

>> Everyone I mean, everyone's basically

84:32

like memory is like this. There's like

84:34

three doors and then everyone's just

84:36

going to try to like rush out of these

84:38

three doors and you'll see like this

84:40

huge like stampede. I feel like because

84:45

by then it's like, okay, like we we've

84:46

done all the capex, we built the fabs,

84:49

they're online, we're running 24/7,

84:52

you know, three shifts, like we're doing

84:54

it, we're caught up. Like at that point,

84:56

like what what else what's holding it

84:58

back? We've done everything. the market

85:00

is flooded. Okay. So then then what?

85:03

>> Yes. I mean Micron and and SKH Samsung

85:06

almost guaranteed to just be printing

85:08

absolute, you know, hundreds of billions

85:10

of dollars in profit, which is a

85:11

ridiculous thing to say over the next

85:13

year. But it is it is true that

85:15

generally the most money is made in

85:17

investing buying before that actually

85:19

happens. And that if you buy like the a

85:23

company that they are making tons of

85:25

money, but their pricing power is

85:26

gradually going down. And so, um, you

85:30

know, they're like, they're still very

85:32

profitable, but it's just the the rate

85:34

of change isn't very good. That's that's

85:36

a far less exciting opportunity.

85:38

>> Yeah, you're a good study of history.

85:40

That makes sense.

85:40

>> Ben, I love your work. Tell us about

85:43

where uh what kind of research do you do

85:46

on on semi? Who is it for and what

85:49

should people expect when when they

85:51

check it out? Uh yeah, you can find me

85:53

at BEP Research or Bonitos on X and I

85:57

really try to be a big system lover

85:59

thinker. So I connect the silicon to the

86:03

software to the models and it's been

86:06

like a really it's been like a closed

86:07

loop how the models and the software are

86:10

driving the hardware and it's sort of

86:13

like recursive and I'm looking at ways

86:16

how AI is being applied. I think the

86:19

next inflection is obviously the

86:21

sciences and what David Friedberg was

86:24

saying on allin and how anthropics

86:26

trying to use your data or or what Alex

86:29

Karp was saying. I think that will

86:32

probably be the next inflection for

86:33

applied AI and obviously robotics and my

86:37

audience is mostly high net worth family

86:40

offices investors and some institutional

86:42

funds which I consult with uh on deeper

86:46

thought pieces and research work for

86:48

them on a project basis. So overall it's

86:52

been pretty exciting. I like meeting

86:54

people in industry, going to

86:55

conferences, uh learning about new

86:59

technologies and new things. I generally

87:01

enjoy uh this stuff. It's exciting to

87:03

me. I get to use my degree and at the

87:05

same time it's something I'm comfortable

87:07

talking about. I I don't get into the

87:09

weeds about how many dyes some Nvidia

87:12

chip has or uh like this glass substrate

87:17

is missing or whatever it is. I think

87:19

you need to see the forest through the

87:20

trees and see the bigger picture and

87:22

connect all the dots to make a thesis.

87:24

And as an investor, your job is to make

87:27

sure your thesis is correct because when

87:29

you hold a position, you're choosing to

87:31

buy that position every day, right? So,

87:33

I think having that framework and that

87:35

mindset helps you figure out what

87:37

trajectories or things you're headed in

87:39

with those uh investments.

87:40

>> Thank you, Ben.

87:41

>> You're welcome.

87:45

>> Thank you. Just close the door.

Interactive Summary

The video features a discussion with semiconductor specialist Ben Pulandian on the AI industry and its hardware-heavy supply chain. Key topics include the structural differences between the current AI boom and the dotcom bubble, the shifting focus from chip shortages to infrastructure and power constraints, the crucial role of semiconductor companies like Nvidia, and the long-term potential of AI integration into science and robotics. Pulandian emphasizes the complexity of the semiconductor supply chain and the necessity of looking beyond superficial commodity arguments to understand the strategic, enterprise-level adoption of AI.

Suggested questions

4 ready-made prompts