HomeVideos

Nvidia CEO Jensen Huang on the AI Boom in South Korea

Now Playing

Nvidia CEO Jensen Huang on the AI Boom in South Korea

Transcript

221 segments

0:00

I think we just start with the basics. Like career is incredibly important to

0:04

to the I build out globally. We'll get into high bandwidth memory.

0:07

But just from this summit, uh, from the president being here, what is the

0:11

takeaway? What is it you're trying to achieve?

0:13

Well, we're announcing a whole bunch of partnerships with them.

0:15

This is the golden ages for Korea. As you know, their semiconductor

0:19

business is booming. Their industrial business is booming.

0:23

You know, this is a country that has the ability to help the world build out the

0:26

AI infrastructure that they're incredibly adept at, uh, adopting new

0:32

technologies and is a really technologically, uh, forward leaning

0:36

society. And they they love using AI.

0:39

AI has has really diffused throughout their, uh, society and, and their

0:43

industry. And so, so this is a great time for

0:46

them. We're announcing several things.

0:47

We announce, um, a big partnership with uh, SK Group, where our companies are

0:54

going to enter into a business partnership where we do over $500

1:00

billion of business with each other. Whether it's consumption of and

1:04

purchasing of memories or selling supercomputers to them as they scale out

1:09

to gigawatts of factories. There's a whole bunch of other

1:12

announcements. We're investing $1 billion in never to

1:16

help. They're the, uh, Korea's leading a

1:20

cloud. They're going to scale up in Korea up to

1:22

two. They're going to scale up 200MW, I think

1:25

it is. And, uh, they're going to expand, uh,

1:27

across the world. And so we have a whole bunch of

1:30

announcements that we're making today with the, the, the expanded

1:33

relationship. There's also sort of more direct

1:35

involvement with Nvidia on the roadmap for HBM, future generations of HBM.

1:41

Talk about that. You know, I remember being on stage

1:43

earlier this year saying five years ago, we told our supply chain what was going

1:47

to happen and it did happen. And you gave some credit to the memory

1:51

makers in in going with you on that journey.

1:54

But clearly, you want to be involved in the direction of travel for future

1:58

generations of HBM. Yeah, we're working together on of

2:02

course. We started with HP and two worked on HP

2:04

and three three E4, four E and then beyond.

2:08

And so we've got, we've got a whole roadmap of memories that we're working

2:11

on together. Uh, it is also the case that the the

2:15

semiconductor industry has really changed.

2:17

And the reason for that. Um, because we used to build computers

2:21

for people to use and we're going to still continue to build incredible

2:24

computers. These are now eight processing eyes for,

2:28

uh, humans to collaborate with. But in the future, we also have eye

2:32

agents and robots, and they're going to be using computers.

2:36

So instead of just a billion people using computers, we're going to have 100

2:39

billion agents and billions of robots all using computers.

2:43

The computer industry, the chip that's built on top of the chip industry,

2:47

surely is not big enough. And so this is one of the realizations

2:50

of the semiconductor industry that now computers are built not just for people

2:56

to use, but computers are being built for computers to use.

2:59

My guess is that that the semiconductor industry is probably going to have to be

3:04

ten times larger than it is today. Over the next decade or so and, and, um,

3:10

uh, and so working with our partners in Korea and around the world to scale up

3:14

the supply chain of semiconductors so that we're prepared for this AI future,

3:18

it's really important. I've had the opportunity to ask you

3:19

about this more than once this year, but how much do you need the Korean economy

3:23

to kind of get going to increase the supply of HBM bits?

3:27

Uh, for Nvidia based systems, wherever they are?

3:29

Well, we we don't have enough bits. Uh, we're constrained in HBM memories,

3:34

Lpddr3 memories. We're constrained in just about every

3:37

part of the supply chain. We're even constrained now with land and

3:40

power and construction workers to set up the data centers.

3:44

I think this is one of the areas that's that's, um, is going to make sure that

3:48

we continue to build out in a throttled way.

3:51

You know, for a decade. And the reason for that is because these

3:53

infrastructure, unlike electronics, Electronic devices like PCs and phones

3:58

and things like that. It's really, really hard to scale up

4:01

land, power and shell. And so all of, all of the supply chain

4:04

just really needs to get built out over the years.

4:07

I think we have the ability as an industry to double each year, but we're

4:11

going to have a hard time going much faster than that.

4:13

The $500 billion number is large. Would you just talk a little bit more

4:17

about what it encompasses? We've gone over a lot on your commitment

4:19

to the US in terms of spending. Is that Nvidia's spending in the Korean

4:24

economy or it's SK fronting capital expenditures?

4:28

Just a little bit more detail. We're going to we're going to be

4:31

purchasing memories from them for many years to come.

4:34

And as you know, we buy we build a lot of computers in order to build $1

4:39

trillion worth of. There are room in systems.

4:41

You're going to have to buy a lot of system memories to go with it.

4:43

And so we have we have large purchase agreements and large purchase intentions

4:49

with SK Hynix. Meanwhile, SK Telecom is going to become

4:53

an AI cloud there We're starting to build already.

4:56

They. They're intending to build up to two

4:59

gigawatts in the near future. And, um, and in that, in that agreement,

5:03

we will be selling supercomputers to them.

5:06

So between us, we're going to we're going to we're going to do half $1

5:09

trillion worth of business, over half $1 trillion worth of business.

5:12

I was able to sit down with SK Group chairman one very recently for about 40

5:17

minutes, and at the end of the conversation, we got to what is the

5:20

difference in approach, the academic difference in approach on AI between the

5:23

United States and China. And his view on it was that China is

5:27

very focused on lowering the dollar per token.

5:30

In America, we're still focused on the quality of tokens.

5:34

I wonder what you think of that. Um, the goal of the goal of AI is to

5:40

produce an intelligent, smart answer. Now, you could approach it in a couple

5:44

of different ways. You could, of course, make all of the

5:46

tokens smarter and smarter, and as a result, uh, result in using less tokens

5:51

to do so. You could also, um, uh, produce eyes

5:54

that are much more efficient and maybe you can think longer, explore more

5:58

options and as a result, as a result, produce a smart answer.

6:02

There are a couple. There are many different ways to to

6:05

reach intelligence and deliver smart answers.

6:08

In the end, really, I think you have to take a step back and just realize that

6:13

both countries has extraordinary AI researchers and whatever, whatever, um,

6:19

conditions and whatever resources that they have, amazing people will find

6:23

great answers. And so you're going to find you're going

6:25

to you know, my expectation is that China and the United States will

6:28

continue to advance AI, um, the conditions are different, the resources

6:32

are different, their constraints are different.

6:34

But they're all there. You know, these amazing researchers will

6:36

find answers. And and I think that that, um, in the

6:40

case of China, they're producing more AI researchers than probably all of the

6:45

world has, you know, in any given year. And so they're producing it.

6:50

Manufacturing intelligence is important. They manufacture the most the most

6:56

important version of it, which is the researchers.

6:58

And so. So this is a this is an area a country

7:01

that is going to produce excellent AI technology.

7:04

And we are to keep an keep uh, continue to learn from them, work with them.

7:08

As you know, you're here in Silicon Valley right here in San Francisco.

7:11

But the number of AI researchers here that came from China that are Chinese is

7:15

really quite significant. And so, uh, you know, we're really

7:18

fortunate to have them here. And, and, um, you know, we just got to

7:22

keep on racing. You made your first post on X.

7:25

I did, and you did. So, uh, by sharing a letter signed by

7:30

many of your peers, American companies, to talk about the importance of open

7:35

models to America, to to the industry, to the development of AI.

7:39

And in the letter, it's pretty well explained, you know, your rationale.

7:42

But what what was the catalyst for now? What why did you and Satya Nadella and

7:47

others need to do that in this moment? What we sense we sense that there's,

7:52

there's, um, uh, a growing, uh, um, sentiment that that, um, and the

8:02

consummate sentiment for open models. It's really important to realize that

8:07

open models is essential for safety. Open models is essential for security,

8:12

for cybersecurity. Open models are essential for

8:14

innovation. It's necessary for startups.

8:17

It's necessary for sovereignty, company sovereignty.

8:21

We I see a future where the world uses tons of closed models.

8:26

And I, I encourage everybody, including my company, to use OpenAI and Clyde and

8:31

cursor and, and, uh, cognition and perplexity use everything that you can

8:37

because uh, of of the cloud. Because it's just easier and and you

8:43

build only what you must. Um, and so in order to build what you

8:47

must, you need to have open models to do that with and the areas where we must.

8:50

Maybe it's because we have expertise that we we simply cannot afford to

8:54

share. This is our companies alpha, our

8:57

companies intelligence, and we have to make sure we keep that proprietary.

9:00

Maybe it's because our company works in a in an industry that's regulated, and

9:04

therefore we simply can't pass along the service level agreement.

9:09

And we have to make sure that we can deliver fully on the service and the

9:12

promise that we sign up for. Maybe it's something to do with

9:15

sovereignty that that, um, you simply in a particular country, you have to have

9:21

your own eye, you have to control your own eye.

9:23

Whatever those reasons are, there could be cost reasons.

9:26

But but I think I think that largely I would recommend people build their own

9:31

eyes, especially when they need to control it for whatever reason.

9:34

And so I think the future is going to have lots and lots of use of eye that's

9:38

closed and an eye that's open that you can build your own AI.

9:43

Now, one of the things that that people, you know, misunderstand about, uh, these

9:48

open models is. Yes.

9:50

Uh, you can host it yourself, but you can build your own computer.

9:54

But most people use used computers in cloud.

9:56

Frankly, I think close models are cheaper.

9:59

You know, if you don't have to build yourself, if you don't have the training

10:01

yourself cost a lot of expertise to fine tune and maintain and guardrail and keep

10:07

it safe and evaluated and, and of course, even build computers to host it.

10:11

So there's nothing cheap about doing that.

10:13

The reason why you need open, open models is because you need to have

10:17

control, because you need to adapt something for for your own very

10:21

specialized use cases. And so I, I think there's a lot of

10:25

misunderstanding about about closed versus open.

10:27

We felt that it was important for people to understand that there's a world for

10:30

both open weighted versus, uh, open source as well.

10:34

There is a distinction, um, uh, open, open waited as much, as much as open as

10:40

that you can. The more open it is in the way that we

10:43

work. We put the weights, um, out there.

10:46

We also teach people how to train the model from the data that we also open

10:51

source. And the reason for that is we want to

10:53

enable you to completely reproduce the eye model that we've open.

10:58

Wait. And so that a built by by us teaching

11:00

you how to do that, you can then do it for yourself.

11:03

You know, I think I think the um, the idea that the world is going to be

11:08

one or the other is just completely wrong.

11:10

And, and, um, the idea that, uh, open models is somehow unsafe is also

11:15

fundamentally wrong. And so we just want to make sure that

11:18

people understand to finish our conversation, you know, the two big case

11:21

studies where the release of communique three, which on an open way to basis

11:25

releases for the July 27th, and then the case study of two open AI models

11:31

mistakenly accessing hugging faces systems and hugging face, trying to use

11:37

an open model in its defense, where the guardrails were a factor, which you just

11:41

reflect on those two. I know that you've been asked about

11:44

them, but they were they seemed to be like really big moment today.

11:47

Those are perfectly perfect canonical examples.

11:50

Just because something is closed doesn't necessarily therefore make it safe or

11:55

secure. It is possible for a model to be

11:58

jailbroken. Is it possible for a model to be, if you

12:01

will, stolen? It could be possible that that somehow

12:03

is leaked from the inside. It's possible that the guardrails or the

12:07

sandboxes of an eye closed AI model wasn't properly engineered, and as a

12:13

result, it was able to attack another and another company in some way.

12:19

And so. So just because something is closed and

12:21

just because something is proprietary doesn't necessarily make it secure and

12:25

safe. Of course.

12:27

Thank thank goodness we have two companies.

12:30

Well, I guess more than that. Several companies have built closed AI

12:34

models. And these are extraordinary technology

12:36

companies. And they're doing their best to keep it

12:38

safe and keep it secure. But it is also the canonical case that

12:43

single points of failure is where we have the greatest vulnerability.

12:47

We cannot have single point of failure as an industry, as a world, we should

12:52

have distributed massively distributed self defense.

12:56

And so in the case of in the case of the example you just mentioned, hugging face

13:00

thankfully was able to access an open model and I think they use the GLM 5.2

13:06

as my understanding. Um, they, they couldn't get a

13:09

proprietary model. They could not get a close model, uh, to

13:13

help them figure out what happened. And but this is exactly the reason why

13:17

you want to have open models. Because in that case, they use GLM 5.2

13:21

to identify where the vulnerability was, where the penetration was, and were able

13:26

to quickly identify them and patch it up.

13:28

And so so this is a perfect example of self-defense.

13:33

That's necessary is a perfect example of diversity of AI technology being

13:38

necessary. And it's a perfect example of why open

13:41

models and open capabilities for self-defense is really important.

Interactive Summary

The video features a discussion about the importance of Korea in the global AI infrastructure, detailing major partnerships and investments. The conversation also explores the evolving semiconductor industry, the necessity of both closed and open AI models for innovation and security, and why single points of failure in AI models should be avoided.

Suggested questions

3 ready-made prompts