HomeVideos

Who's Actually Funding the AI Buildout?

Now Playing

Who's Actually Funding the AI Buildout?

Transcript

1004 segments

0:05

Hi listeners, welcome back to No Priors.

0:07

Today I'm here with Neil Tuari of

0:09

Magnetar Capital. This is a $22 billion

0:12

alternative asset manager at the center

0:14

of the AI compute buildout. We talk

0:17

about the financial innovation

0:19

depreciation of GPUs and what's next in

0:22

AI compute. Welcome. Thanks so much for

0:24

doing this, Neil.

0:24

>> Absolutely. You know, really happy to be

0:26

here. So you are leading AI

0:28

infrastructure at Magnetar. You're at

0:31

the center of the buildout, enabling it,

0:34

financing it. For any of our listeners

0:36

who haven't heard, can you just explain

0:38

a little bit what Magnetar is?

0:39

>> Sure. Um, so Magnetar has been around

0:41

for actually this is our our 20th year.

0:43

Uh, we're an alternative asset manager

0:45

and that can mean a lot of different

0:46

things. Um, but we have three primary

0:48

strategies. The first one is private

0:51

credit. uh the second one is a venture

0:53

strategy and the third is more of a

0:55

systematic or quantitative focused uh

0:58

public strategy as well. And so I think

1:01

you know when when people look at us and

1:03

and you know why are we here in this

1:04

moment especially on building out AI

1:06

infrastructure um I think a lot of it

1:09

has to do with kind of our unique lens

1:11

on helping to build uh capital intensive

1:14

businesses and using creative financing

1:16

whether it's venture or other structures

1:19

with unique elements and I think we're

1:21

going to talk a lot about that but um to

1:23

build out uh and optimize the balance

1:26

sheets for these capital intensive

1:28

businesses. So, I remember hearing about

1:30

you guys originally. So, you're the

1:32

first investor I think we've ever had on

1:33

the podcast. I'm excited about that.

1:35

Thank you.

1:35

>> Uh I remember hearing about you and

1:38

Magnetar initially around I was like

1:41

who's this big owner of Corewave and

1:43

also um you know helping OpenAI with

1:46

some of their early buildouts. When did

1:47

you guys first start looking at the

1:49

problem and thinking about how to how to

1:51

solve it?

1:51

>> Yeah, so we actually you know stumbled

1:53

across the the compute problem before it

1:56

was compute. Um, you know, we met uh

1:59

Coreweave back in uh 2021 and that was

2:02

when they were actually transitioning

2:03

from uh mining Ethereum into uh high

2:07

performance compute and at that time it

2:09

was using the GPU as a you know an

2:13

instrument to mine uh cryptocurrencies

2:16

and interestingly that same instrument

2:18

could be used for high performance

2:19

computing applications. Uh and the first

2:22

one was uh visual effects uh which so

2:25

think of like things like movies, Marvel

2:27

movies and things like that. And so they

2:29

were transitioning um at that point

2:30

between crypto mining into the first

2:33

kind of uh high performance compute use

2:35

case. And this is all before AI

2:37

>> and so we made our first investment

2:39

before the AI trade started. Um but we

2:42

added a lot of optionality where you

2:44

know we could envision a world where uh

2:47

the GPU could be used for a lot of

2:49

different high performance kind of

2:50

computing applications. I think um you

2:52

know AI was on the radar, machine

2:54

learning was on the radar for us. Um but

2:57

I wouldn't say that we could foresee

2:59

everything that happened. we just

3:00

happened to be, you know, at the right

3:01

place at the right time and we continued

3:03

to double down um as the company

3:05

progressed and started, you know,

3:07

shifting into more workloads that were

3:09

machine learning and and kind of AI

3:10

training based.

3:12

>> Did you have like an existing

3:13

significant data center investing

3:16

footprint?

3:17

>> No, I mean I think you know uh

3:18

interestingly at Magnetar there, you

3:20

know, we have invested across asset

3:21

classes. Um so we we've done a lot of

3:24

property investing, real estate

3:25

investing as an example. um investing in

3:28

energy. We had an energy business

3:29

historically and so a lot of the

3:30

elements for you know what constitutes a

3:33

data center power energy land uh real

3:36

estate you know we had a lot of the the

3:38

background in those spaces I think we

3:40

were new to compute right like that was

3:43

a new sector for us and so kind of those

3:45

two worlds merging um you know we we

3:48

obviously you know came up on the curve

3:50

on the compute side but we had a lot of

3:52

you know background on um the the

3:54

elements that constitute what it means

3:56

to build a cloud. So you guys just

3:58

really you were in this company, you saw

4:00

the demand and you said like it's going

4:02

to grow and we're going to make this a

4:04

big part of our business.

4:05

>> Exactly. I think you know what was

4:06

interesting is we made our first

4:07

investment in 2021 um and then about a

4:10

year later we continued to see expansion

4:12

of use cases uh for at that time it was

4:15

called high performance compute and then

4:17

it was kind of towards the end of 22 the

4:19

whole AI uh discussion started and as we

4:22

entered 2023

4:24

uh coreweave uh started to train models

4:27

for open AI

4:29

>> um and that's when things really started

4:30

growing because the sheer amount of

4:32

compute that was needed to train an LLM

4:34

this was like the first time had ever

4:35

been done. And what was interesting was

4:38

what kind of allowed them to take

4:40

advantage of that opportunity was the

4:42

historical kind of backgrounds of a lot

4:44

of the founders uh were in energy asset

4:47

management. And when you fast forward to

4:50

today and you look and like what is what

4:52

constitutes your ability to build a GPU

4:55

cloud, it's your ability to manage these

4:58

highly complex assets. And it

5:01

fundamentally comes down to access to

5:02

power and energy. And so they had these

5:04

elements with them. They obviously

5:06

brought on a lot of talent on the cloud

5:08

side. And to put all these together and

5:11

at that moment it allowed them to um you

5:13

know build very large scale reliable um

5:16

clusters for OpenAI and obviously many

5:19

other customers since then. And I think

5:21

the last comment I'll make is what

5:23

really allowed them to kind of win this

5:25

market early on was focus on two things.

5:27

It was scale and reliability. And I

5:30

think those were the two things that um

5:33

are really difficult or a lot of the new

5:35

entrance since then because scale has to

5:37

do with your access to capital, your

5:39

access to energy, power, data center and

5:42

then reliability really had to do with

5:44

their their ability to manage a giant

5:46

fleet of GPUs uh which is actually quite

5:49

complicated. um you know whether it's

5:51

reliability from you know GPU failures

5:53

or software challenges you know building

5:55

a fleet that can healthfully be online

5:58

all the time at you know 99.9%

6:00

reliability is incredibly difficult and

6:02

that's something that they had started

6:04

back in 2017 2018 time frame and and

6:06

they were at the right moment at the

6:08

right place with the right technology

6:10

stack um to really build um the optimal

6:13

cloud for that moment

6:15

>> I've definitely experienced that with

6:16

you know our portfolio of companies that

6:18

are building large training clusters uh

6:21

uh it corewave has a reputation for

6:24

reliability that not everyone has

6:26

reached. Can you just help characterize

6:28

if you fast forward like two and a half

6:30

three years now like what is the scale

6:33

of the problem today?

6:34

>> Yeah. So if you look at um kind of capex

6:37

right let's starting with that. So capex

6:39

for AI compute and infrastructure in

6:41

2026, you know, at least from the

6:43

hyperscalers is projected to be between

6:45

660 and 690 uh billion dollars. And over

6:49

the next several years um you know that

6:52

scales to trillions of dollars, right?

6:54

And so the the scale of the problem is

6:57

how do you build um you know that size

7:01

of capex efficiently? And I think a lot

7:04

of that has to do with not only, you

7:06

know, your ability to have access to,

7:08

you know, those core elements, um,

7:10

energy, power, you know, uh, and and

7:13

your ability to have data center space,

7:15

etc. But I think one of the things

7:17

that's not talked about as much is

7:19

capital and access to capital and how is

7:22

capital structured. Um, and what I mean

7:25

by that is this is, you know, billions

7:28

to trillions of dollars of capex

7:30

>> and just using equity dollars alone is

7:33

not an efficient way to scale this.

7:35

That's obviously massive dilution. You

7:36

know, there's there's it's not an easy

7:38

problem to solve.

7:39

>> When we first met, I had like slowly

7:41

come to this realization. I was like, I

7:42

don't think we should take the dilution

7:44

for the cluster.

7:45

>> Yeah. Right. Exactly. And so that's

7:47

where I think, you know, when you and I

7:48

have talked about like structuring and

7:49

and I can give a couple examples um if

7:52

that's helpful. I think the first one

7:54

was DDTL structures or SPV debt

7:57

structures that um had a think of it as

8:01

like an SPV. Inside of the SPV are the

8:05

cap is the capex, the collateral um

8:06

which is the GPUs

8:08

>> and the contracts themselves. Um and so

8:11

in this example, the actual asset or

8:14

collateral was not really just the GPUs

8:18

themselves. It was really the contracted

8:20

cash flows

8:21

>> from in this case investment grade

8:23

counterparties and so I think the reason

8:25

>> this is the consumer of the

8:27

>> the consumer of the exactly you know

8:29

your Microsofts your your metas etc of

8:31

the world

8:31

>> and I think the reason um that was done

8:35

is is really twofold when when you look

8:37

at the scale of the problem uh you know

8:39

those particular contracts uh needed

8:42

billions of dollars of debt to finance

8:45

the capex you know obviously for a nason

8:47

and new growing company that's that's

8:49

really hard to raise. Um so part of

8:52

structuring it this way is ensuring that

8:55

you have kind of guaranteed offtake on

8:57

the back end to uh minimize the risk for

9:01

you know debt holders and I think that's

9:04

a lot of what the market got wrong um

9:06

especially when there was a lot of press

9:07

about this early on where it was

9:10

>> there's billions of debt on these highly

9:12

depreciating assets and it's extremely

9:15

speculative and the what was oftentimes

9:18

characterized in the media was uh these

9:21

debt structures had GPUs as collateral

9:24

and that's like putting a used car as

9:26

collateral which is obviously just going

9:27

to depreciate incredibly fast. You know

9:29

that's a very risky kind of structure

9:32

and I think what got missed was the the

9:34

GPUs themselves were actually like the

9:36

second second or tertiary level of

9:38

collateral in those instruments. The

9:40

primary collateral uh was the contracted

9:43

cash flows from investment grade

9:45

counterparties.

9:46

Microsoft or Nvidia or somebody like

9:49

that saying, "I'm committed to pay you.

9:51

I know you can pay me."

9:52

>> Take or pay contracts and they're like 5

9:54

years in length. So, I think that was

9:56

like one feature

9:57

>> uh that that's unique to talk about. And

9:59

then the second one really has to do

10:01

with um the debt itself and how it

10:04

amortizes. And so, like in simple terms,

10:07

you know, when you have debt, you have

10:08

principal and interest and you have to

10:09

pay it off over time. And in these

10:11

structures typically the payback period

10:14

on the capex was roughly 2 to 3 years.

10:18

Um and the uh structures themselves the

10:21

debt was over five years you know four

10:23

to five years in length where the entire

10:26

debt amortized during the um outstanding

10:30

period that the that the debt was out.

10:32

And so at the end you ended up with zero

10:35

balance uh for the debt and there was no

10:38

balloon payment or or anything that was

10:40

really due on the back end. And so the

10:42

question that often you know comes up uh

10:45

is you know isn't that a very risky uh

10:48

type of structure because these things

10:49

are depreciating incredibly quickly. So

10:51

I think know there's there's two

10:52

comments here. first is on that

10:55

depreciation question. In these kind of

10:58

debt structures, it doesn't really

10:59

matter because the debt's fully paid off

11:02

by the end of the debt term against

11:04

committed contractual um you know

11:06

contracts from investment grade

11:08

counterparties. Um and then at the very

11:10

end the the actual upside or residual

11:13

value and I know there's a lot of

11:14

questions on on residual value is is

11:17

held by um you know the uh the cloud

11:21

player in this example right Courte

11:22

right or or you know any others

11:24

>> um and that's a really interesting

11:26

prospect because you can see a world

11:28

where all of this capex is paid off

11:31

incredibly quickly and there's an

11:33

opportunity to redeploy it um where you

11:36

can redeploy it um without having to pay

11:38

for any additional uh debt obviously

11:41

against that redeployment.

11:42

>> How have the instruments changed?

11:44

>> They've changed in several ways where uh

11:46

you know the first is you when you look

11:49

at these SPVS I think you're starting to

11:51

see ways to change the portfolio

11:54

construction of who can go inside of one

11:57

of these debt structures. And so, you

11:58

know, early on in the early days, these

12:00

were all only investment grade

12:02

counterparties

12:03

>> because there was the the space was so

12:05

nent, the operators had no experience.

12:08

And I think now what you're starting to

12:09

see is a blend of investment grade and

12:12

non-investment grade. So, like what does

12:14

that actually mean? What that means is,

12:15

you know, you're you're seeing these

12:16

structures with investment grade

12:18

counterparties like your hyperscalers

12:19

and your other corporates that that are

12:21

IG um mixed alongside uh some of the AI

12:25

native companies. And so think of the AI

12:26

model companies, the labs, software

12:29

companies that are building AI startups.

12:31

You're seeing those companies get mixed

12:33

in alongside um the IG companies to

12:35

build a portfolio because now you have,

12:37

you know, the the history that you can

12:39

do this and now you have structures

12:40

where you can kind of balance the risk

12:42

uh wi with IG and nonIG. And we're

12:45

continuing to see that kind of move to

12:47

be able to help finance, you know,

12:49

really the model companies and a lot of

12:51

these startups. Obviously, that was

12:53

difficult to do, you know, three or four

12:54

years ago. starting to become easier um

12:57

as these companies have more runtime and

12:59

ability to uh you know make the compute

13:01

fungeible.

13:02

>> All are uh portfolio companies that buy

13:05

compute tell me it's a supply constraint

13:08

market today. One is that true and two

13:12

when you think about like uh continuing

13:15

to grow your business or grow this

13:17

ecosystem like what's going to stop it

13:20

like what could slow down a buildout?

13:22

>> Yeah. Yeah, I mean I think what's

13:24

interesting is uh if you look at like

13:27

2023 2024 we were very supply

13:30

constrained and the supply constraint

13:32

was chips and no one could get access to

13:34

chips.

13:35

>> Yes, we bought chips.

13:36

>> We bought chips, right?

13:38

>> And you know there was this thought that

13:39

okay there's going to be an overbuild of

13:41

chips and then the supply constraints

13:42

will go away. Well, you know, fast

13:44

forward to 2026 and what we see is, you

13:46

know, there is obviously more

13:48

availability of chips, but to build and

13:51

operate these uh, you know, data centers

13:53

requires people, power, infrastructure,

13:57

a lot of these things that uh have a lot

13:59

of of bottlenecks. And so, actually

14:01

taking these chips and then making them

14:03

into useful revenue generating assets is

14:07

really the bottleneck. It's also not

14:08

clear that there is supply of chips at

14:11

the latest generation at scale.

14:14

>> That's true.

14:15

>> Soon, which is how everybody wants them.

14:17

>> Exactly. I think, you know, you see um

14:19

not only you're starting to see

14:20

interesting and not only just the the

14:22

high-end players want access to the

14:24

latest chips. You're seeing the latest,

14:25

you know, obviously startups want access

14:27

to those. And I think it has to do with

14:28

efficiency. Mhm.

14:29

>> Um, you know, one of our friends or one

14:31

of your friends as well, Dylan Patel

14:33

over at Semi analysis, posted this

14:35

interesting article last week on

14:37

inference and inference spend an

14:39

inference kind of performance. Um,

14:41

>> and you know, there's a lot of, you

14:43

know, jokes made about Jensen math. Um,

14:45

and it was interesting because the

14:47

>> seems pretty good at math.

14:48

>> He's actually great at math. Um, and so

14:51

for the uh hoppers, the H100 or H200

14:55

series of GPUs into the black wells, uh,

14:58

there was a claim made that it could be

15:00

30 times more efficient. And I think the

15:02

data from, you know, some analysis

15:04

showed that it was 90 to 100 times more

15:06

efficient in terms of inference

15:08

performance.

15:08

>> And so I think part of the the need to

15:11

go to these new chips is not is yes,

15:13

more computing power, but it's actually

15:15

the it can be cheaper to operate more

15:17

performance. Price performance. Exactly.

15:19

>> Mhm. Yes. My favorite Jensenism is the

15:22

more you buy, the more you save.

15:24

>> Exactly. It's actually true.

15:26

>> Yeah. Um crazy. Um help me address like

15:30

this uh criticism around circular

15:32

financing.

15:33

>> Yeah, I know. Um it's obviously a topic

15:35

dour and I think you know the way we see

15:38

it and frame it really has to do with

15:40

the demand signals um and who are the

15:44

eventual buyers and and how is this

15:46

being used? And so at least from what

15:48

our perspective, we we continue to see

15:52

uh insatiable demand. Um and if you go

15:55

back to, you know, the previous kind of

15:58

big tech buildout back in the early

16:00

2000s, there was obviously a lot of

16:02

fiber that was being built and you had

16:03

dark fiber, you know, in in an overbuild

16:06

happening. And I think what you see here

16:08

is I I have, you know, you don't see any

16:10

dark GPUs, any GPU. Exactly. Any GPUs

16:13

used. Yeah.

16:14

>> Um and then number two, you're starting

16:16

to see uh actual economic value. Um so I

16:20

think last year enterprise AI had about

16:22

37 billion of total TAM. Um and it's

16:25

continued to grow like crazy and at

16:26

least personally and and I'm sure you

16:28

see this too, but I use these tools all

16:30

the all the time and I find incredibly

16:32

valuable, right? The actual tokconomics

16:35

of positive uh ROI is is actually here

16:39

now I think from our perspective. Um and

16:41

so that the circularity you know comment

16:44

I think applies when you're building um

16:47

you know speculative uh compute and

16:50

capacity uh or if you're you know purely

16:53

doing vendor financing and it's you know

16:55

you're trying to do some type of you

16:56

know unique some type of you know

16:58

revreck type item related to that and

17:00

that that's not what we see like what we

17:02

see is financing to support to build out

17:05

the demand against uh use cases that are

17:08

very positive in their ROI and so like

17:11

our perspective is that that's uh you

17:13

know not a real real concern that we

17:15

have um and and it really has to do with

17:17

who are the ultimate buyers here.

17:19

ultimate buyers have been and at scale

17:21

the hyperscalers they're deploying this

17:24

uh at scale and the economics are

17:26

positive uh when you look at a unit

17:28

economic basis in terms of uh deploying

17:31

intelligence um and I think we're at a

17:32

moment in time where you we're really

17:34

starting to see that

17:35

>> in my own experience um I have been a

17:38

heavy AI user for several years

17:40

>> but reasoning advances the ability to

17:42

scale up inference especially around

17:44

code

17:45

>> means I'm up against my max limit all

17:47

the time in a way That was not true uh

17:50

uh uh initially. How does the inference

17:53

workloads actually growing? I mean it's

17:55

a it's a good demand signal that there

17:57

is value but how does that change your

17:59

business?

18:00

>> Yeah. So I think one thing that's

18:02

interesting that we're seeing is

18:03

obviously there's been the shift from

18:05

training to inference you know over the

18:07

last few years that that split continues

18:09

to grow on the inference side as usable

18:12

uh and ROI positive applications get

18:14

developed. I think the two things I see

18:17

on the inference side now is um

18:21

inference has is a lot more complex than

18:24

I think initially thought and what I

18:25

mean by that is it's not as simple as um

18:29

you you train a model and then you it's

18:31

easy to inference it in some certain

18:32

cases you can do that on similar

18:34

infrastructure but there are issues

18:36

around latency um fungeibility of that

18:39

uh and and really optimizing the cost of

18:42

your compute on the inference side um

18:44

how do you manage uh you know peaks of

18:47

inference demand and and obviously it's

18:49

not linear like training you your GPUs

18:51

are on all the time you know 100% of the

18:54

time and so with inference you have a

18:55

lot more variability

18:57

>> um and so there's a lot more nuances uh

18:59

in in optimizing inference I think the

19:02

second thing that's observed um that

19:04

I've seen is uh inference is definitely

19:06

a memory problem a memory throughput

19:09

problem um you know on the inference

19:11

side you know you have these kind of

19:12

phases called prefill and and decode,

19:15

right? And how you optimize that across

19:17

a fleet of GPUs is actually unique

19:19

technical problem.

19:20

>> Um, and then the third is what I would

19:23

say is distribution.

19:24

>> Um, you know, a lot of times training

19:26

infrastructure is is quite centralized.

19:28

What you're seeing with inference is in

19:31

many use cases as this becomes more

19:33

ubiquitous, you're going to have more

19:35

and more decentralized

19:37

uh, inference clusters. And actually one

19:39

of my favorite companies is one of your

19:41

companies, B 10, which is really, you

19:42

know, optimizing distributed inference

19:45

at scale. And I think one thing that's

19:48

interesting when you look at companies

19:49

like that and and other inference clouds

19:51

is how do you optimize the uh compute

19:55

and and build out these clusters that

19:58

could actually look very different than

20:00

a training cluster where training

20:02

cluster might be 50, 100, 150 megawws in

20:05

one kind of four walls. Mhm.

20:06

>> I think you're starting to see

20:08

distributed inference which could be,

20:10

you know, four or five megawatts and

20:12

five separate data centers and stitching

20:14

them together in different areas, right?

20:17

And that looks very different from a

20:19

kind of power perspective, how you, you

20:22

know, the software matters a lot more

20:24

when you're doing like distributed

20:25

inference. And then in terms of your

20:27

question how it impacts us I think one

20:29

of the things that we've been you know

20:31

focused on is um you know where we

20:33

started this conversation with you on um

20:35

financing compute that was really

20:38

obviously uh it started with mostly

20:40

training um a lot of those hyperscalers

20:43

are now doing a lot of inference on that

20:45

same infrastructure but these are

20:47

investment grade counterparties you know

20:49

it's easy to it's easier to lend uh

20:52

money to build out these clusters to

20:53

those customers I think now that you

20:55

have this new crop of inference clouds

20:57

and application layer companies that are

21:00

needing tons of inference. I think the

21:02

the key question that we're really

21:04

focused on is how can we finance the

21:07

next build which is distributed

21:09

inference. Um and maybe the last you

21:12

know one or two takeaways would be uh

21:14

one thing I'm seeing is you know for

21:16

every application layer company out

21:17

there the highest line item from cogs is

21:20

compute

21:21

>> um and then the inference companies and

21:23

inference clouds out there most of them

21:26

are um purchasing up compute from either

21:30

other clouds or unused act uh capacity

21:34

and when you look at like margins for

21:35

that you've got like layered margins

21:37

>> and so there's a push to kind of own

21:39

your own infrastructure

21:41

>> um to really drive and increase you know

21:43

uh profit margins but also it's the

21:45

ability to kind of have control of your

21:47

own destiny and I think a lot of folks

21:49

are starting to the application layer

21:51

companies and inference clouds are

21:52

grappling with how can we build and own

21:54

and operate our own infrastructure um

21:57

and that's something I'm I'm really

21:58

looking into

21:59

>> I am too and I think one of the things

22:01

that uh is going to make a big

22:03

difference in this ecosystem is like can

22:07

the inference clouds like base And can

22:10

they deliver reliability that you would

22:12

expect from a a cloud like a traditional

22:16

cloud?

22:16

>> Um because the like uh distributed data

22:20

center operations that you know they

22:23

consume today do not offer that

22:24

reliability. Right.

22:26

>> And the other thing that's interesting

22:27

is um you know this is additional

22:28

reporting from last week. Um if you're

22:30

familiar with silicon data they they put

22:32

together a lot of you know data on spot

22:35

pricing and price per token performance.

22:38

This is Kerman Lee's company. And one

22:40

thing that that I think was really

22:42

interesting in some some in an article

22:43

she uh published last week uh had to do

22:46

with how two pieces of compute that look

22:49

identical on paper have wildly different

22:52

performances. Everything from

22:53

reliability to cost to speed. And I

22:56

think as you distribute um you know have

22:59

distributed inference, how do you m um

23:02

you know mash together very different

23:04

types of compute and try to optimize for

23:06

reliability I think is super

23:07

interesting. Um and that gets to kind of

23:10

one thing I I find really interesting

23:12

that Nvidia is doing is is this concept

23:14

of AI factories

23:16

>> and building AI factories um you know

23:19

behind corporates and AI companies. And

23:22

maybe the way I unpack that is you've

23:24

got kind of more large monolithic cloud

23:27

players, the hyperscalers and the

23:28

neoclouds that are building large scale

23:31

um you know cloud environments. uh and a

23:34

lot of where I think Nvidia and others

23:36

see this going is yes those are going to

23:38

be important components and those are

23:40

going to be huge markets but corporates

23:43

fortune you know 500 AI companies that

23:46

use a ton of compute will want dedicated

23:48

AI factories associated with workloads

23:51

that they run and that they have control

23:53

over. And so I think you're starting to

23:54

see, you know, the early indications of

23:57

how do you finance and build out uh

24:00

almost think of like literally AI

24:01

factories that sit on prem with a

24:04

company that can operate their

24:05

workloads.

24:06

>> Uh

24:07

>> you're talking about my Mac mini farm.

24:09

>> Exactly.

24:10

No, but but all joking aside, I I think

24:12

one thing that is another supporting

24:15

factor for use of all of the compute we

24:18

have is and and can create over the

24:21

coming years is um power is clearly the

24:24

limiting factor.

24:26

>> Um it's easier to get more power in

24:28

smaller

24:29

>> units. Yeah,

24:30

>> I think that as inference demand is

24:33

growing these uh anyone who has uh

24:37

usable compute for inference is going to

24:39

find a lot of partners for offtake.

24:41

>> Exactly.

24:42

>> Okay, let's look at the future a little

24:44

bit while we while we have 10 minutes.

24:46

Um uh let's talk about the the macro.

24:49

Like people talk about energy, they talk

24:51

about um natural gas, uh the grid, the

24:57

slowness of nuclear. like what do you

24:59

think about over the next 6 or 12

25:01

months?

25:02

>> Over the last year, I've been spending a

25:03

ton of time in the power and energy

25:04

markets um and looking at interesting

25:07

solutions that can help scale power, you

25:09

know, for the gap that we see. I think a

25:12

few observations that we've seen. The

25:13

first is um we do have a power problem,

25:17

but I think it's a bit more nuanced than

25:18

than a lot of the reporting out there

25:20

where

25:22

>> it just we can't generate.

25:23

>> We can't generate. Yeah. I think there's

25:24

actually quite a bit of stranded power

25:27

across the grid across the country. And

25:29

what I mean by that is, you know, a lot

25:30

of the utilities are built in a way

25:32

where they're focused on peak power,

25:34

right? So they've got natural gas

25:35

peakers and they're focused on, you

25:37

know, providing peak power for those

25:39

moments where demand is is kind of off

25:40

the charts. Um, and that's obviously

25:43

only for a few days out of the year. So

25:45

there's lots of generating assets out

25:48

there. Uh, the question is they're a bit

25:49

stranded, right? And so there's kind of

25:52

I I look at the power problem as being

25:54

kind of multiplefold. The first one is

25:56

how can you take the power we have on

25:58

the grid and actually make it usable.

26:00

And and a lot of that has to do with

26:02

flexibility and storage. And so we've

26:04

been spending a lot of time looking at

26:06

an energy in the energy storage business

26:08

and distribution. How can you store

26:10

unused capacity, peak demand shave uh

26:13

capacity, store it and then distribute

26:15

it when it's needed.

26:16

>> Um we made an investment in a company

26:18

called Taurus. I think I I mentioned to

26:20

you which is building like this

26:21

distributed utility layer uh almost like

26:24

this mesh infrastructure to um takes to

26:28

store excess capacity or store capacity

26:30

from a variety of of sources and then

26:33

distribute it at the time when it's

26:34

needed. And so I think that's kind of a

26:36

critical layer that that needs to be

26:37

built. Um and then longer term there is

26:39

a generation problem but I think in the

26:41

shorter term it's really it's more on

26:43

the distribution and storage. Uh and

26:46

then um the other piece I would say is

26:48

you know the true bottleneck um at least

26:50

in the short term the next 6 to 12

26:52

months is is incredibly I don't want to

26:54

use the word simplistic but it's things

26:56

like uh structural steel it's uh finding

27:00

electricians uh that can you know build

27:02

>> sorry there's you can't get enough steel

27:04

>> you can't get enough steel you can't

27:06

>> this is not something I was aware of

27:07

like you can't get steel you can't get

27:10

uh you can't find enough electricians to

27:11

build out you know the power

27:13

infrastructure uh substate

27:15

transformers, air chillers. These are

27:17

like very specific power infrastructure

27:20

needed to just get to a point where you

27:23

can start to build a powered shell on a

27:25

piece of land. And so the bottlenecks in

27:28

the short term really are uh people

27:31

equipment. Um and then the other

27:33

interesting thing is that on the

27:36

generation side, what you're seeing is

27:38

regulatory obviously is is a big

27:40

challenge. And so there's a combination

27:41

of bring your own capacity. There's a

27:43

lot of that that's that's interesting

27:45

right now. And so a site that can

27:47

potentially grow to 50 megawatts might

27:49

start with only 10 megawatts of grid

27:51

interconnect, but can you add solar net

27:54

gas um turbins, put these various bring

27:58

your own capacity kind of pieces of

27:59

technology together to make that site

28:01

usable? And so I think a lot of what's

28:03

being looked at and a lot of what I'm

28:04

looking at right now is really on on the

28:07

bring your own capacity at least in the

28:08

short term. Yeah, I think um if people

28:11

don't know the uh origin story of Crusoe

28:14

and Flur gas, like it's actually really

28:16

interesting as an example of, you know,

28:18

there is actually lots of energy, lots,

28:21

you know, some energy out there and, uh

28:24

you can make much more of it consumable.

28:26

>> Yep. Exactly.

28:27

>> Couple topics to hit before we lose you.

28:30

Um

28:32

>> uh new players, how do you think about

28:33

the sovereigns and what they're doing in

28:34

their buildouts? Yeah, I think um

28:37

>> they seem to be able to fund themselves

28:38

just like

28:38

>> Exactly. Right. Um you know, you saw the

28:40

news from India last week. Uh obviously

28:42

a lot of the news in the Middle East,

28:44

Southeast Asia.

28:45

>> I think you know, we're continuing to

28:47

see that sovereigns view compute and AI,

28:50

you know, as and and even we do here in

28:52

the in the United States as as as a

28:54

matter of national security.

28:56

>> Um and obviously the funding of those

29:00

clusters is is very different than

29:02

funding like a private cluster. And so

29:04

you've got, you know, government capital

29:06

that can be used for that. I So I think

29:09

there's two things that, you know, I

29:10

find interesting in that space. I think

29:12

one is who are the partners um that are

29:15

going to build those that capacity

29:18

>> and what are the cyber security kind of

29:20

implications and environments for that.

29:21

And so those those are the two nuances I

29:24

think with sovereigns is they need to

29:26

find players that can rapidly scale

29:28

compute um in the in their countries.

29:31

and often times they don't necessarily

29:32

have these players that know how to

29:33

build and scale GPU comput

29:37

and help build you know sovereign

29:38

ecosystems around the world and then

29:40

there's a matter of cyber security and

29:42

how do you make it into a a a truly um

29:45

you know safe ecosystem for for those

29:47

sovereigns and so I think there's a lot

29:49

of work to do still on the cyber side um

29:52

especially as you look at you know

29:53

scaling sovereign AI

29:54

>> what is your thinking on physical AI

29:57

it's another you know if it works capex

29:59

intensive

30:01

Absolutely. And you know, maybe I'll

30:02

just take a second to say one of the

30:04

things that we observed um from 2010 to

30:07

like, you know, the early 2020s was we

30:10

were in a very capital asset light mode

30:12

of build. Like SAS was, you know, you

30:14

never heard Magnetar and SAS, right?

30:16

Because it was just purely asset light.

30:18

>> Compute and everything we saw starting

30:20

in, you know, 2021 is asset heavy.

30:23

That's where you started hearing a lot

30:24

more about us. And I think physical AI

30:26

is actually an extension of that. And so

30:28

what you're seeing is part of the reason

30:30

I think and I think we all have scars

30:32

from the 2010s of hardware companies

30:33

that did not make a lot of money for us.

30:36

Part of the scars was it was so

30:37

difficult to scale hardware companies.

30:40

Um you know because the software was so

30:42

difficult to build. You needed to spend

30:44

so much money building the hardware. The

30:46

software was an afterthought. What

30:48

you're seeing now is now that you have

30:49

more generalpurpose uh software via AI

30:52

uh it can make the hardware easier to

30:55

scale because you have you know software

30:56

that can be you know can interact with

30:58

more more hardware and so I think the

31:01

natural kind of extension of what we see

31:03

is kind of what happened in the compute

31:06

markets where you really needed flexible

31:08

capital where it wasn't just equity it

31:10

was debt and you know a variety of

31:12

project finance to really scale capex

31:15

you're going to see that same kind of

31:17

need uh in physical AI and it simply has

31:20

to do with capital intensity right you

31:22

know on the compute side for like

31:24

cororeweave as an example they needed

31:26

billions of capital to scale uh you know

31:29

that cloud and I think whether it's a

31:31

robotics company or whether it's a you

31:34

know uh a manufacturing uh focused

31:36

company drones defense all of these

31:38

areas are incredibly capital intensive

31:41

and then now that you add AI into them I

31:43

think it can help them scale faster uh

31:45

quite frankly and uh capital intensity

31:48

is still there. And so there's a moment

31:49

in time now where you're going to have

31:51

to really look at optimizing balance

31:53

sheets um for physical AI to really grow

31:55

and scale.

31:56

>> I think to your point of how the um

31:59

early AI compute contracts were

32:02

structured um

32:05

I I went from you know learning to be an

32:07

investor in an era and an environment

32:10

where robotics was a great way to lose a

32:13

lot of money for a long period of time.

32:15

you remember that.

32:16

>> Um, now I sit on the board of two

32:17

robotics companies. So, let's hope it's

32:19

not true anymore. But I I'd say like

32:21

it's just a question of capability to me

32:23

like you know whether it's in the home

32:25

or in industrial settings where like it

32:28

is simply not a good human job or we

32:30

don't have the labor.

32:30

>> Yeah.

32:31

>> Um, you are going to have if I I think

32:34

the products will support investment

32:36

grade buyers

32:38

>> who are going to have contracts that say

32:40

like we want it and you can raise debt

32:43

against it.

32:44

>> Exactly. Right.

32:44

>> Um and so I think actually that that

32:46

feels of a very similar um shape. Last

32:49

question for you because it is so

32:50

timely. What do you make of the general

32:53

capital rotation out of out of software

32:56

the end of software and it's all it's

32:58

all infrastructure labs and AI natives I

32:59

guess.

33:00

>> Yeah. Yeah. It's interesting to see that

33:01

every day there's another industry that

33:03

kind of tanks whether it's you know you

33:05

saw the wealth advisor tank for a few

33:07

days you saw the consulting consulting

33:08

companies you saw real estate payments

33:11

real estate right. I mean I think what

33:13

you're seeing at least is at least in my

33:15

view what I saw was towards the tail end

33:17

of 2025 and into 2026 like there was at

33:20

least in my view a big step up in

33:23

performance of usable AI and I think you

33:25

know what Anthropic was doing really and

33:28

claude and like we use it all you

33:30

obviously we use all the models but you

33:31

know there was a definite step up in

33:33

performance in making AI usable and

33:37

seeing that it can you know truly

33:39

disrupt these you know nonAI native

33:41

industries

33:42

Uh I think the reaction and rotation out

33:44

of each of these names is a bit much

33:47

because when you I think there's there's

33:48

two factors I look at. One is when you

33:51

look at valuations as an example, I

33:52

think um from a free cash flow

33:54

perspective, SAS companies are are are

33:57

valued at at the lowest they've been in

33:59

in in years, you know, and there's a

34:02

huge margin difference between, you

34:04

know, what those rev multiples are today

34:06

and what what they've been in the past.

34:07

And so free cash flow margins have

34:10

steadily increased significantly for SAS

34:12

as a whole over the last four or five

34:14

years and revenue multiples have stayed,

34:17

you know, you know, the same or gone

34:18

down.

34:19

>> And so to me that's a bit of an

34:20

exaggeration because it really has to do

34:22

with individual names versus sectors.

34:24

And I think that's kind of at least my

34:26

take is like in all of these sectors

34:28

there are individual names that will

34:29

learn how to maximize their, you know,

34:32

uh, value using AI and there's those

34:34

that won't. Uh but what's happening

34:36

right now is there's you know a hammer

34:38

being hit across all names and not you

34:40

know specific individual names that

34:42

might not be using it as well. Um and

34:44

then the second point at least you know

34:46

my view is there are a number of

34:48

applications that you know on paper

34:50

sound really interesting like oh AI

34:52

could just rebuild Slack or it could

34:53

rebuild Salesforce or could rebuild you

34:55

know X Y and Z. I think you know the

34:58

it's not just the product it's the way

35:00

that's integrated across multiple

35:02

services and systems across the

35:04

enterprise that is a lot more difficult

35:06

to just replicate

35:07

>> than I think some of the public markets

35:09

are are kind of reacting to

35:11

>> and I do think there's um you know

35:13

fundamental question in addition to what

35:14

you said which I agree with of like does

35:17

anybody want to rebuild it and own it

35:19

and uh you know there are to your point

35:22

of like within the software sector in

35:24

particular Um there are companies where

35:28

uh uh they're structurally more

35:30

protected than there are companies that

35:32

are at more risk, right? And I I think

35:34

it's as simple as like you got to go

35:35

select.

35:36

>> Yeah, exactly.

35:37

>> Um this has been so fun. Thanks so much,

35:38

Neil.

35:39

>> Yeah, I really appreciate.

35:39

>> Congratulations on all the innovation

35:41

and uh on building out all the compute.

35:43

>> Awesome. Thank you. Good to be here.

35:47

>> Find us on Twitter at no prior pod.

35:49

Subscribe to our YouTube channel if you

35:51

want to see our faces. Follow the show

35:53

on Apple Podcasts, Spotify, or wherever

35:55

you listen. That way, you get a new

35:57

episode every week. And sign up for

35:59

emails or find transcripts for every

36:00

episode at no-briers.com.

Interactive Summary

The discussion features Neil Tuari of Magnetar Capital, a $22 billion alternative asset manager at the forefront of AI compute financing. The conversation delves into Magnetar's unique approach to funding capital-intensive AI infrastructure, detailing the evolution of GPU cloud buildouts, starting with Coreweave's transition from crypto mining to high-performance computing and eventually AI for OpenAI. A significant portion covers financial innovations like DDTL/SPV debt structures, explaining how contracted cash flows from investment-grade counterparties serve as primary collateral, not just depreciating GPUs. The discussion also addresses current supply chain bottlenecks beyond chips (power, skilled labor, materials), the increasing efficiency of new chips for inference, and counterarguments to circular financing criticisms, emphasizing actual economic value and ROI. Future trends include financing distributed inference, the concept of AI factories, and macro challenges in power generation and distribution. The conversation concludes with thoughts on the rise of physical AI as another asset-heavy sector requiring flexible capital and the nuanced perspective on capital rotation from software to infrastructure.

Suggested questions

10 ready-made prompts