HomeVideos

Brad Gerstner: Companies Will Pay 5x More for the Best AI

Now Playing

Brad Gerstner: Companies Will Pay 5x More for the Best AI

Transcript

53 segments

0:00

Jason, you talked about summarizing a

0:01

document. May take 20,000 cheap tokens

0:04

to do. Of course, shoot that to a

0:06

lagging model or an open-source model.

0:08

But if you're talking about replacing a

0:09

software engineer for 2 hours, that may

0:12

take 2 million expensive tokens. And the

0:14

consequence of using something that's

0:17

95% as good is really high,

0:20

right? Because you have a long-running

0:22

task, and if the task breaks early, or

0:25

it breaks in the middle, or breaks at

0:26

the end, there's a huge cost to that. So

0:29

>> You still pay

0:29

>> the tokens, right? You And back to this

0:32

analogy I was using, you're pulling the

0:33

slot machine and you lose.

0:35

>> And the time and the compute. So, if an

0:38

AI agent is replacing a $200 an hour

0:41

consultant, right? Take that as an

0:43

example. So, three consulting firms,

0:45

they're competing, they need the

0:47

smartest consultant. If they're charging

0:49

200 bucks an hour, the difference

0:51

between spending three bucks on a cheap

0:54

model or 15 bucks on an expensive model

0:57

to replace a $200 an hour consultant,

1:00

it's just irrelevant. That inference

1:02

cost difference is irrelevant. If you're

1:04

getting something that's bulletproof for

1:06

15 bucks, and so I think that's what

1:08

we're seeing play out. The best evidence

1:10

for all of this is just revenue growth.

1:12

I'm talking about what is Anthropic's

1:14

revenue growth compared to OpenAI,

1:16

compared to the open-source models.

1:18

Millions of independent actors are

1:19

choosing every single day. The

1:21

open-source companies are growing,

1:24

right?

1:24

>> Yeah.

1:24

>> But they're growing selling something

1:26

that is really, really cheap. And

1:28

there's room in every single market for

1:31

premium products, for mid-tier products,

1:33

and for commodity products. And I think

1:35

we see a lot of this token growth.

1:38

People are speculating that the

1:40

intelligence gap between that commodity

1:43

stuff and the frontier stuff is going to

1:45

collapse to the point that people won't

1:46

pay for the frontier stuff. There is no

1:48

evidence of that on the field today.

Interactive Summary

The video discusses the economic trade-offs of using expensive frontier AI models versus cheaper alternatives for complex tasks. It emphasizes that when AI agents replace high-value professional work, the reliability of the model is more important than the cost of tokens, as errors in long-running tasks incur significant time and computational penalties.

Suggested questions

2 ready-made prompts