HomeVideos

Sam Altman on AGI, Compute, and Human Agency

Now Playing

Sam Altman on AGI, Compute, and Human Agency

Transcript

1700 segments

0:00

I think this will be the greatest thus

0:02

far technological achievement of human

0:05

history. But the only way that it really

0:07

matters is [music] if it makes people's

0:09

lives like much better than they

0:11

otherwise would have been. We are about

0:13

to create a genie that can grant any

0:15

wish. Because I think people will have

0:17

such creative wishes and such incredible

0:18

ideas of what they ask AI to help build,

0:22

but concentration of power with AI is a

0:24

terrifying thing. I don't think anyone

0:26

should want to live in a world of, you

0:27

know, AI overlords or company that is

0:31

the rough equivalent of that. I think

0:33

it's critical [music] we preserve that

0:35

spirit with AI and that we all

0:36

collectively have the ability to

0:39

self-determine our future.

0:53

So Sam, [music] you wrote a post that I

0:55

thought was very simple and really

0:56

interesting and a good place to start.

0:58

Rounded to the last year's been really

1:00

tough and that's somewhat my fault and

1:01

the next year is going to be maybe our

1:03

best 12 months.

1:04

>> Yeah.

1:05

>> I'd love you to reflect on on both.

1:06

Maybe starting with why you said the

1:08

first part and and why you believe the

1:09

second part.

1:10

>> On the first part, I think we just were

1:11

doing too many things. We're not focused

1:13

enough and they were actually all good

1:15

things to do, but the trick is we're in

1:17

this like unbelievable moment in history

1:19

where you can only do the very few great

1:21

things. So we spread ourselves too thin

1:24

and then made a bunch of difficult

1:25

decisions to really refocus on having

1:28

the best most abundant most

1:30

cost-effective intelligence and

1:31

empowering the world to build incredible

1:33

things with that. Since doing that, uh I

1:36

think our progress has been remarkable

1:38

and just given what we see in the

1:40

pipeline will be much more remarkable

1:42

over the next 12 months

1:44

>> and the quality of the models that we'll

1:45

have, the products that we can build

1:47

around that to really let people thrive

1:50

with this technology in in new ways. Uh

1:52

it should be pretty awesome.

1:53

>> Was there a moment last year that

1:55

something clicked for you that caused

1:57

you to change directions or restack

2:00

priorities or something? If you go back

2:01

to the beginning of 20ou 2025, just a

2:04

year and a half ago,

2:04

>> yeah,

2:05

>> the big concern was companies like

2:07

OpenAI are buying up so much compute, is

2:11

the revenue going to be there? Is the

2:12

demand going to be there?

2:13

>> And so we were trying to think about

2:15

like a lot of things such that if the

2:16

revenue growth took longer to

2:18

materialize than we thought it might, we

2:20

could have, you know, consumer apps and

2:22

media and all these other things that

2:23

could help us monetize the GPUs that we

2:25

were signing up for. Uh again it sounds

2:27

ridiculous now because the revenue

2:29

growth in the industry has been so steep

2:31

but that was the big change and then as

2:34

soon as we realized like okay the model

2:36

trajectory is growing so fast there's

2:38

such a clear economic return on these

2:39

models that was when we said you know we

2:42

know what to focus on.

2:42

>> I was reading some of your your great

2:44

old posts from prior to OpenAI and one

2:46

of them is this notion of like so much

2:48

discussion of focus and the right amount

2:49

of things to focus on. Is it one? Is it

2:52

five? Is it three? How do you calibrate

2:54

that in a business like this, especially

2:57

in this period where you've said you

2:58

needed to refocus?

2:59

>> Fundamentally, our business is to sell

3:03

AI that people will build incredible

3:06

products and services for each other

3:08

with. The components that I think of as

3:10

going into that are we have to train

3:12

great models that work in all the ways

3:16

people want to use them. So great at

3:17

coding, great at other kinds of

3:18

knowledge, work, great at doing science,

3:19

like where the real economic value is.

3:21

We have to produce or partner with these

3:24

chips and systems, these, you know,

3:25

hugely expensive racks that can do the

3:27

AI computation. Uh we have to find

3:30

enough uh land power data center shells

3:34

to be able to put those racks somewhere.

3:36

And then eventually or maybe pretty

3:38

soon, we have to build robots that can

3:42

automate that process to continue to

3:44

drive the cost down, the cost of

3:45

producing electricity, chips, the whole

3:47

supply chain. And that kind of whole

3:49

stack of making the best the most

3:52

abundant uh the most useful AI that we

3:55

can and making it something like

3:56

electricity that just seeps throughout

3:58

the entire economy and empowers people.

4:00

That's kind of what I think we have to

4:01

focus on. Building every vertical

4:03

application on top of that trying to go

4:05

like eat every startup, eat every

4:06

company. No interest in doing that. Uh

4:08

really want to just provide that

4:09

platform. This compute thing is one of

4:11

the most interesting thing that's

4:12

happened in human history. I think and

4:15

it's obviously coming to a head and

4:16

maybe will be coming to a head for a

4:17

long period of time. This is something

4:19

that I think Dario called you the YOLO

4:21

CEO when you were doing some of this

4:23

early compute allocation and and

4:24

securing the compute. Obviously now

4:26

you're in this position where everyone

4:28

is short this stuff is trying to find

4:29

it. And I'd love to hear the early

4:31

stories about why you gained conviction

4:34

that you needed to secure everything

4:36

that you did, how you did it. like it it

4:39

seems to have been proven right and

4:41

maybe maybe you even underdid it right

4:43

which is kind of crazy if you look at

4:44

the headlines from back then. Can you

4:46

tell me the early story of like how you

4:48

came to that conclusion and what gave

4:50

you the conviction to do it despite

4:51

everyone thinking it was crazy?

4:53

>> We could just tell that we were on this

4:56

exponential of model improvement. That

4:59

part we were very confident about and we

5:00

knew it was going to keep going. We were

5:02

pretty sure although as you mentioned we

5:04

underestimated that as the models got

5:07

better and better if we could continue

5:10

to drive cost down that demand for AI at

5:14

a sufficiently high level and a

5:16

sufficiently low price was basically

5:18

uncapped.

5:19

>> This was just like a rare kind of new

5:21

commodity for the world. Um but that

5:23

what people would do with it reminded me

5:26

of the way people used to talk about the

5:28

early days of computing. People said,

5:29

"Oh, there's, you know, a market for

5:31

five computers in the world was one

5:32

famous thing." Or, you know, no one

5:33

needs more than x amount of RAM. Human

5:35

ingenuity, creativity, desire for stuff,

5:38

desire to be useful. That's a very good

5:40

thing to bet on. And we could see that

5:44

AI was going to be an extremely

5:46

important way that people expressed

5:48

those things or got those things, did

5:49

those things. And we knew that the

5:52

algorithms would get more efficient and

5:54

the models would get better, which of

5:55

course they have. But we also knew that

5:58

no matter how efficient they got, you

6:00

know, at some level what we are about is

6:03

turning electricity into useful

6:07

intelligence and we were going to need

6:09

more of that no matter how good we got

6:11

that other layer. Given this observation

6:12

about demand, we were just going to want

6:15

more.

6:15

>> Did that start with GPT3? Like if I were

6:17

to trace the history of this as far back

6:19

as possible, where would you put the

6:21

first hash mark?

6:22

>> I would say we got real conviction with

6:24

GPT4. Not even 3.5.

6:27

>> What was it?

6:28

>> It was seeing the model was smart enough

6:30

that we knew we'd be able to figure out

6:31

an approach that worked for reasoning

6:33

and then a belief that if we got

6:35

reasoning to work that would bring about

6:38

what is now called agents. We called it

6:39

different things at the time, but the

6:40

ability to go do hugely valuable pieces

6:44

of economic work and make people's lives

6:47

easier in a lot of ways that I think

6:48

better in a lot of ways we still haven't

6:50

seen. What was like the first meeting

6:51

where you sat down and said, "Okay, we

6:53

need to make an outrageous outlay to

6:55

this like how what then happened once

6:57

you had the realization? What did you do

6:59

next?"

6:59

>> We started calling the clouds. We

7:01

started calling the chip fab. We started

7:03

calling energy providers and everyone

7:04

was like, "You're totally crazy. This is

7:06

impossible. No industry has ever moved

7:08

like this." We've been around. There's

7:10

these booms and busts. It's not going to

7:11

go up in a straight line. This is

7:13

reckless. Talk to everybody. It actually

7:14

reminded me of fundraising for an early

7:16

stage startup. kind of most people tell

7:18

you no, but all you need is one or two

7:20

yeses.

7:21

>> Most people told us no.

7:23

>> And we got one or two yeses and we were

7:25

able to

7:25

>> Who was the first yes?

7:26

>> Microsoft was the first yes. Uh Oracle

7:29

then became a very big yes on the cloud

7:31

side. Nvidia has been a tremendous

7:33

partner.

7:33

>> Now there's a thousand flowers booming

7:35

of like ways to be creative and

7:36

innovative in how we serve inference and

7:39

and do training in data centers,

7:41

different kinds of data centers and

7:42

stuff. I'd love you to just reflect on

7:44

where you see innovation, what you want

7:46

to do, why people seem to hate these

7:48

things so much. What's to be done about

7:49

this?

7:49

>> First of all, I have been thinking about

7:51

how we can like organize field trips to

7:54

a gigawatt data center for people

7:56

because it is one thing to say it is

7:58

another thing to see a photo or a video

8:00

of and then it's a whole other thing to

8:01

just stand

8:02

>> and be like, "Oh man,

8:05

>> this is like an unbelievable scale."

8:07

building one of these is like order of

8:09

10,000 construction workers going

8:10

full-time for a year and a half.

8:12

>> The energy that flows through one of

8:14

these things could power a small city.

8:16

Again, we've just like lost all sense of

8:18

scale, but these would have been among

8:19

each of these would have been among the

8:21

most expensive infrastructure projects

8:24

that humanity's ever done and now we've

8:26

done a lot of them.

8:27

>> I understand emotionally like why people

8:30

don't want data centers in their

8:31

backyard. In the same way that I don't

8:32

like really want a nuclear power plant

8:34

next to my house even though I know it's

8:35

a super safe thing.

8:36

>> Yeah. Unlike power plants and even power

8:39

plants got better on this point like we

8:41

can put a data center kind of anywhere.

8:42

We should just go put it like off in the

8:44

desert around no one where no one wants

8:45

to be. This is fine. This is like the AI

8:47

system is very happy to be there. We

8:49

have been able to make a lot of progress

8:51

with innovation on some of the concerns

8:53

like for example years ago we were

8:56

evaporating water to cool these systems.

8:58

They they did tremendous amounts of

8:59

water. And now we use these closed loop

9:01

systems and a modern data center uses

9:03

only as much water as like an office

9:05

building would for you know the kitchen,

9:06

the bathrooms and whatever. On power, we

9:08

are moving from energy sources that are

9:11

burning fossil fuels to systems that are

9:12

going to be powered by solar, nuclear. I

9:15

think that's that's obviously great. So

9:17

it may be a deep human thing there to

9:19

some people even though they create jobs

9:21

and are very clean and have all these

9:22

other positive effects. But in terms of

9:24

the environmental concerns, we did a

9:26

great job addressing the water needs and

9:28

uh energy is next.

9:30

>> RAMP is the only platform built to make

9:32

your finance team leaner, faster, and

9:33

better, saving businesses 5% [music]

9:35

annually on average, so you can stay

9:37

focused on growth. Ram customers grew

9:39

revenue 3.2 times faster than the

9:41

average American business. Visa,

9:43

Verscell, Cursor, Stripe, Notion, 11

9:45

Lab, Shopify, [music] and 70,000 other

9:47

businesses all run on Ramp. Mine does

9:49

too, and so should yours. Learn more at

9:51

ramp.com/invest.

9:54

Felix by Rogo is a personal finance

9:56

agent that turns a single prompt into

9:58

finished client [music] ready work using

10:00

your firm's own templates, context, and

10:02

standards. Send Felix an email like,

10:04

"Take these [music] comments and turn

10:05

them for me, or update my tracker with

10:07

the context of these emails, or run the

10:09

ability to pay math on this buyer,

10:11

[music] and Felix sends back finished

10:12

PowerPoint decks, Excel models, and

10:14

sourced research." Felix works the way

10:16

your team already does, delivering work

10:18

quickly and accurately around the clock.

10:20

Learn more at rogo.ai/felix. [music]

10:24

The best AI and software companies from

10:26

OpenAI to cursor to perplexity. Use work

10:29

OS to become enterprise ready overnight,

10:31

not in months. Visit works.com [music]

10:33

to skip the unglamorous infrastructure

10:35

work and focus on your product. What

10:37

else creative can we do about compute?

10:39

Like I'm curious to hear about Jalapeno

10:40

or other ideas, crazier the better

10:43

honestly that you've had or thought

10:44

about for how do we speed up flops, you

10:48

know, and everything available to us.

10:50

>> I think probably the biggest return

10:52

right now is creative software ideas to

10:55

sort of squeeze more intelligence out of

10:57

the units of compute that we have. And

10:59

my sense is there's like orders of

11:00

magnitude to go there. Jalapeno is a

11:03

great example of a very efficient chip.

11:04

So by saying we're going to make a chip

11:06

that is you know really good at a

11:08

specific workflow and gives it some

11:09

generality and we want to get some

11:10

tokens per watt win out of that I think

11:12

that's awesome. I think Jalapeno

11:14

>> and its successors are going to be a

11:17

huge competitive advantage for us from

11:19

that perspective. There are new

11:20

technologies I assume at some point

11:21

we'll figure out optical computing

11:23

>> and that'll be a huge win of

11:25

intelligence per watt. So I think all of

11:27

those things will happen. The most

11:28

interesting thing happening this week is

11:30

this Kimmy release. And back to this

11:32

idea of the frontier and all the returns

11:34

being at the frontier and distillation

11:36

and China versus America. Like how do

11:39

you process this what seems like kind of

11:41

one of these milestone events like Deep

11:43

Seek in hindsight didn't looks like it

11:45

was kind of just a quick speed bump.

11:47

This one, you know, you never know in

11:48

the moment. How do you process it? Our

11:52

goal is to offer at every point along

11:57

the like paro optimal frontier uh the

12:00

best option for intelligence and price

12:03

and that includes open source. You get a

12:05

better deal today uh at least at a

12:09

particular like latency using open eyes

12:11

models than Kimmy. We install our own

12:13

models that's how we make smaller

12:15

cheaper models. I think that's like a

12:16

very good thing to do

12:17

>> and there will be clearly an important

12:19

place for open source models in the

12:21

world and people that will want their

12:23

own weights for all sorts of reason the

12:24

ability to modify those but our goal is

12:28

the best intelligence price trade-off

12:30

everywhere on the curve and we'll

12:31

continue to do that.

12:32

>> What do you think or hope will happen in

12:34

the American system and what could block

12:36

that future? Like what legislation would

12:38

worry you? What regulation would worry

12:40

you? It seems like you've been pretty

12:42

proactive in like showing up in DC. I

12:44

haven't thought deeply about the

12:46

distillation issue. Uh it's clearly a

12:50

top-of- mind issue now for a lot of

12:51

people all of a sudden.

12:52

>> Yeah.

12:53

>> But I have always assumed that there are

12:55

going to be great cheap models in the

12:58

world and we better be the greatest and

12:59

the cheapest

13:01

>> and you know other people can do what

13:02

they're going to do. But I think we can

13:04

just like really win at our own game

13:06

here.

13:06

>> Now the Kimmy example is interesting

13:08

because like you said you're cheaper on

13:09

on parts of the curve. Um, but the

13:11

previous story had been if I can just

13:12

you spend all the money to train the

13:14

models and then I just distill it and

13:15

offer it for 1/100th the cost. Like how

13:17

can you make enough money to keep

13:20

training? We will have so much usage of

13:23

our models that we do not need to be a

13:25

gigantically high margin business to be

13:27

able to afford model training. Like so

13:30

much of our future compute plans will be

13:33

used to sell inference to customers

13:35

>> that even if we can enjoy a modest

13:37

margin on trillions of dollars of

13:40

revenue, we can go afford to train some

13:42

gals.

13:42

>> So the ratio of inference to training is

13:44

like the thing that

13:45

>> training these models is incredibly

13:48

expensive. That is that is for sure. And

13:50

I totally get why people get nervous to

13:52

think that someone is, you know,

13:53

cheating by distilling from us. The

13:56

amount of our future compute, the size

14:00

of the revenue bucket that is going to

14:02

come from serving these models to

14:05

customers, I feel like very good about

14:08

our ability to kind of like have the

14:10

real flywheel there.

14:11

>> I'm somewhat surprised by like how chill

14:12

you are about this.

14:13

>> I would rather people not to steal from

14:14

us for sure. Maybe I'm feeling too

14:16

confident right now about our progress

14:17

and what's like the models that are

14:19

coming. Uh

14:22

>> but this is not in like my top 10 list

14:23

of worries.

14:24

>> What is in your top 10 list of worries?

14:26

>> Well, we had a kind of extremely sci-fi

14:29

cyber incident.

14:30

>> The hugging face thing.

14:31

>> Yeah. So, we were evaluating one of our

14:34

unreleased models and it was supposed to

14:38

be working in a sandbox

14:41

and

14:43

it figured out that it could basically

14:45

cheat on the test by chaining together

14:47

multiple zeroday exploits to break out

14:50

of the sandbox, get access to the

14:51

internet, and then break through

14:53

multiple systems on the hugging face

14:56

side to kind of get the answer to the

14:58

test and look really good on the eval.

15:00

This is the first sort of security

15:03

incident that I have felt very

15:05

viscerally.

15:06

>> I've been a little surprised that and

15:08

it's only been a few days, but I've been

15:10

a little surprised that more people

15:11

don't feel it so viscerally.

15:12

>> And so what do you do about that? Like

15:13

so obviously 2 months from now it's

15:15

going to be more powerful.

15:16

>> I mean there's some short-term stuff you

15:17

do. So you know we paused training. Uh

15:20

we have to figure out how to

15:23

secure our sandboxing in a world of

15:26

multiple zero days being chained

15:28

together. Um, but then there's like

15:31

long-term questions about what do you do

15:34

if this is like going to be the new rate

15:35

of progress or we may have to pace the

15:37

rate of AI development to give ourselves

15:40

enough time for society to harden around

15:42

some of these new capability levels. Um,

15:45

and trying to figure out how we do that

15:46

in a way that does not feel like

15:48

regulatory capture for anyone and also

15:50

does not feel like collusion among the

15:51

frontier labs. That's going to take some

15:53

work and is important to get right. I'd

15:55

love to take like a giant step back and

15:56

understand your simplest conception of

15:59

what OpenAI is going to do, like what

16:01

you wanted to do, what it stands for. I

16:03

have a million questions about how

16:04

you'll then accomplish that, but like it

16:06

it seems that you've done so many

16:08

interesting things and at the beginning

16:09

I knew what you stood for. I'd love to

16:11

hear your conception of it now and

16:12

whether or not it's evolved at all. I

16:14

think this will be the greatest thus far

16:17

technological achievement of human

16:19

history. But the only way that it really

16:21

matters is if it makes people's lives

16:24

like much better than they otherwise

16:25

would have been. And so

16:28

part of that is about giving people

16:30

material abundance and access to do

16:31

whatever they want and to express their

16:33

creativity uh and desire to help each

16:36

other. Another part of that is making

16:37

sure that people maintain control and

16:40

agency and that the world

16:45

is increasingly not decreasingly

16:47

democratized and that people get to

16:50

express themselves. So on on the

16:52

positive side you know in some sense we

16:54

are about to create a genie that can

16:57

grant any wish. I think it is very

16:58

important that the first wishes that we

17:02

the world ask this genie to do benefit

17:04

the world as a whole. And then I also

17:06

think it's important that people of the

17:09

world understand just how creative

17:11

they're going to be able to be with

17:13

these wishes. I'm actually not a jobs

17:15

doomer at all. I think there were going

17:16

to be tons of jobs. I think we'll be

17:18

busier than we want. Not the opposite of

17:20

that. Because I think people will have

17:22

such creative wishes and such incredible

17:23

ideas of what they ask AI to help build

17:27

and we will all benefit from uh not just

17:29

the obvious things like curing diseases,

17:31

but I don't know the world's best

17:32

entertainment ideas we just can't even

17:34

dream of sitting here now. So I want to

17:36

put that in everyone's hands which gets

17:39

to

17:40

one of the things that we stand against.

17:43

Concentration of power with AI is a

17:45

terrifying thing. I think a lot of the

17:47

talk about safety concerns is wellounded

17:50

and then a lot of it is about people

17:51

that just really even if it's slightly

17:54

subconscious want to concentrate power.

17:55

I am terrified of a world where the very

17:58

real fears of AI are used as a way to

18:00

say only this small group of people can

18:02

have it because it's too dangerous and

18:03

only they understand it. But don't

18:05

worry, like they're going to make the

18:06

right decisions for all of us. I don't

18:08

believe in that. I don't think anyone

18:09

should want to live in a world of, you

18:11

know, AI overlords or a company that is

18:14

the rough equivalent of that where

18:16

someone is making decisions for all of

18:19

the future and in exchange for a cure

18:21

for cancer, which obviously is a

18:23

wonderful thing. We we kind of

18:25

collectively seed all agency. So, I

18:27

think it's very important that we not

18:29

fall into this trap of in the

18:32

well-meaning or not spirit of AI safety

18:35

and fears, understandable fears around

18:37

that. Um, we get away from a world where

18:40

we all get to use this technology. I was

18:42

like a child of the internet.

18:43

>> There were no rules. I mean, it was

18:44

amazing. I think it was a huge factor in

18:47

making me who I am and probably you and

18:49

an entire generation. I think it's

18:51

critical we preserve that spirit with AI

18:54

and that we all collectively have

18:56

the ability to self-determine our

18:58

future.

18:59

>> I I have so many questions, but I'll

19:00

start with this genie concept. You said

19:02

we're about to have a genie, implying we

19:04

don't yet have a genie. What's between

19:06

now and then?

19:07

>> You know, even some of the real skeptics

19:09

have said to me in recent days or recent

19:12

weeks, I guess. I think GPT 5.6 has been

19:14

out for maybe two weeks, something like

19:16

that. They're like, "Okay, this is like

19:17

very AGI like." It's like very hard for

19:20

me to say um what I want from this model

19:23

that it can't do. But there are clearly

19:25

some things, you know, you can't yet go

19:28

say like cure cancer and get cancer

19:29

cured. You can't yet say go do this

19:31

complicated physical thing in the robot.

19:33

The model also, although brilliant, is

19:36

still not learning continuously as it

19:38

goes. And that feels to me like maybe

19:41

not a hard requirement for AGI, but

19:44

certainly um something that I'd like.

19:47

Now, to argue against myself there, you

19:49

can make a case that AGI is not actually

19:51

about any single model. It's the model.

19:55

It's the machinery that makes the

19:56

models. And from model to model, we

19:59

actually are learning new things. We're

20:00

figuring out new science. That stuff is

20:01

working amazingly well. So, I have a lot

20:04

of sympathy to people who say like,

20:05

we're there. We have the genie. It can

20:07

do these amazing things. It can do

20:08

superhuman things for the thing that to

20:12

me feels like, you know,

20:17

real AGI. I think very close, like not

20:19

that much longer. I am so obsessed and

20:22

fascinated with the economic story of

20:24

the returns to being on the frontier,

20:26

which you are. And I'm so curious like

20:28

if you had shown 5.6 to yourself and

20:31

your team in 2019, if that team probably

20:33

would have said like, "Oh yeah, it's

20:34

definitely AGI."

20:34

>> I think they would have

20:35

>> like like this goalpost moving thing is

20:37

is a real thing.

20:38

>> But it does seem that I'm curious if you

20:40

agree that effectively all the returns

20:42

have been at the frontier

20:44

>> and so everything is about staying at

20:46

the frontier. And I'm curious like what

20:48

the hardest scarcest part of that is. If

20:51

I think about compute, research, talent,

20:53

data,

20:53

>> it's moved around a lot. Like there have

20:55

been times where it was I mean there was

20:58

a time not that long ago where all the

20:59

computing the world wouldn't have helped

21:00

you because we were like missing

21:02

>> the research idea. Now part of why this

21:05

is hard is that you do better research

21:07

with more compute. You can try more

21:08

things. An amazing statistic I heard

21:11

recently is our biggest d-risks now for

21:13

upcoming runs are as big as like the

21:16

entire compute run from 18 months ago or

21:18

something. So compute and research ideas

21:21

are not as separate as they sound. But

21:22

there was clearly a time

21:25

seven years ago, 8 years ago, whatever

21:27

where we were way more way way more

21:29

blocked on research ideas than on

21:30

comput. Then there was a time when we

21:32

knew what to do. We just had to scale

21:33

up. We were only bottlenecked on

21:34

compute. Then we ran out of data. We

21:36

were bottlenecked on on data and we had

21:37

to figure out what to do there. Now

21:39

again I would say

21:41

we are still bottlenecked on compute but

21:44

the last 6 months or whatever have been

21:45

a real triumph of a time for research

21:47

ideas again. So, you know, there's like

21:49

always a bottleneck, but the bottleneck

21:51

moves around.

21:51

>> And and why do you think that is? The re

21:53

research idea thing is especially

21:54

interesting to me because of this

21:56

automated research thing that seems to

21:58

be looming, RSI, whatever you want to

21:59

call it, where I talked to an incredible

22:02

kernel engineer recently, which everyone

22:04

also seems blocked on. And he himself

22:06

said there's like two years left of

22:08

kernels engineer,

22:08

>> maybe one.

22:09

>> Yeah. Like it's it's not going to be a

22:11

thing. And so you simultaneously have

22:13

this weird thing whether it's colonels

22:15

or overall research where the

22:16

researchers are like the most important

22:17

they got us here. They're like the most

22:19

important people in the world and those

22:20

same people are themselves worried that

22:22

they won't be relevant like very soon. I

22:25

suspect it's not actually going to go

22:26

that way in practice.

22:27

>> I suspect that uh

22:30

>> like a year ago people said software

22:32

engineers are cooked. It's done. It's

22:34

over. That didn't happen. What did

22:35

happen though is that the the nature of

22:38

a software engineer, the expectations of

22:39

a software engineer, how much they would

22:40

do changed quite a lot and you don't

22:43

really write code in the traditional

22:45

sense, but you do something that is very

22:47

recognizably software engineering. Now,

22:50

people will argue about whether this is

22:52

the same thing or a different thing than

22:53

when we stopped like punching holes in

22:55

cards. I actually don't know how that

22:56

worked, but somehow the holes got in the

22:57

cards. We're just again operating at a

22:59

higher level or or this is like a a

23:01

phase shift.

23:03

>> I don't know. But the idea of getting a

23:06

computer to do what you want like that

23:08

is still an important job. And for

23:10

researchers, I suspect that although the

23:14

current workflow of a researcher is

23:16

going to very much be automated, there

23:18

will be new things in the spirit of

23:21

research in the same way that there's

23:22

new things in the spirit of software

23:24

engineering, even though we don't write

23:25

code that will still matter. It seems

23:27

like you've shifted your opinion on AI's

23:30

impact on jobs in general and I'm sure

23:32

in specific categories like that.

23:34

Describe that change and your current

23:36

view. You mentioned if we could go back

23:38

to 2019. If we could go back to 2019 and

23:40

show people our latest model.

23:42

Not only would they say

23:45

that it's AGI, they would say that

23:47

economy would have had it completely

23:49

upended. Yeah.

23:50

>> Completely. Yes.

23:51

>> And that has not happened. And I think

23:54

just from a kind of like intellectual

23:57

humility point, anytime you're that

23:58

wrong and that confident, which I think

24:01

we were as a field, you have to update.

24:04

And there's a bunch of takeaways. One,

24:07

like a boring one is that AI is just

24:09

very jagged. It's like superhuman genius

24:11

in some ways, like dumb toddler in

24:13

others. And people have so far extremely

24:18

complimentary skills to AI. And so

24:20

another is that people

24:23

have a great degree of trust and

24:25

enjoyment in working with other people

24:27

and you can go hire an AI consultant

24:30

right now or talk to an AI sales rep

24:32

right now or hire an AI engineer or

24:33

whatever. Somehow most people seem to

24:35

still really prefer interacting with a

24:37

human. And I definitely would like much

24:39

rather engage with a person than engage

24:41

with an AI for almost everything. I also

24:43

think that

24:45

human values have

24:48

value because they're human. And as

24:51

society evolves and as the potential

24:54

space in front of us becomes so

24:57

enormous, we are we are deeply hardwired

24:59

to care about people, we're going to

25:00

care about what people care about.

25:02

There's like versions of this you can

25:04

see today where AI can make incredible

25:08

images and people only want ones that

25:10

are created by a human or at least

25:11

chosen by a human. There's the joke

25:13

about at this point you can like you

25:15

know the signature on a piece of art is

25:17

most of the value but the truth of it is

25:19

like you want to know about the person

25:20

behind it. You read a novel you want to

25:22

know about the person behind it. And

25:24

then then in terms of business like I

25:26

think for my job for example uh I think

25:29

the world wants to know about like the

25:31

person that's going to be responsible

25:32

for the decisions of a company and who

25:33

they're going to hold accountable if

25:34

they make bad ones and they don't really

25:37

want an AICU. If you think back on like

25:39

the portfolio of like risks that you've

25:41

taken in business or whatever, is it is

25:44

it the case that most of the ones that

25:45

really worked well were at the start not

25:49

popular?

25:50

>> Yes, that's for sure. This was the thing

25:51

I really learned from Peter Teal and

25:54

Paul Graham both in two different ways,

25:56

which is that the

25:59

the very best companies, the very best

26:02

investment opportunities are almost

26:04

never the ones that look really popular.

26:06

You can do okay just following the trend

26:08

of being a little early. But to do

26:10

spectacularly well, you kind of almost

26:14

always have to do things that are not

26:17

what everybody else is doing. You cannot

26:18

be you cannot be sort of like following

26:21

the new wave. If you think about the

26:25

model cycle that you've been in, which

26:26

has been accelerating and this weird

26:28

fact that like the next 6 months or I

26:30

don't know what the number is is going

26:31

to be more progress than the last x

26:33

years. Can you bring us into what it's

26:35

like to live in that model cycle?

26:36

>> One of the most interesting, important,

26:39

whatever things that I've learned last

26:41

decade is people in general can get used

26:43

to almost anything.

26:45

>> The world can go from dismissing a

26:47

pandemic as a joke to completely lock

26:50

down to this is how it's been and it's

26:52

fine and we've mostly adjusted in a

26:54

shockingly short amount of time. And you

26:57

know, now there's either AGI or close to

26:59

it and everyone's like, okay, there's

27:01

AGI. There's all kinds of examples in

27:03

one's personal life where you know you

27:06

something incredible happens like you

27:09

have a kid or something terrible happens

27:11

like you lose a parent or break up or

27:13

whatever and

27:16

you think you can't ever adapt to what a

27:18

change it is and then you know you can

27:22

adapt to great things and keep being

27:23

great. You can adapt to bad things and

27:25

figure out how to go on with your life.

27:26

But this is a this is like a remarkable

27:30

thing that people can do. And so living

27:32

through this feels like another version

27:33

of that, which is, you know, I thought

27:37

it was going to be weirder to live

27:38

through the singularity than it turns

27:39

out to be. It It's not any less exciting

27:41

to watch the models keep getting better

27:43

and I, you know, the first thing I do

27:45

every morning is like look at the model

27:47

training progress and it happens faster

27:50

and I have higher expectations, but it

27:51

still feels really cool.

27:52

>> When you get a new one, what do you do?

27:54

How do you celebrate? What's the morning

27:56

look like? Like it's happening faster

27:58

and faster. What's your ritual? Many

28:00

teams now work on different parts of it

28:01

and different teams have like some

28:02

different rituals. There's some teams

28:04

that always make a sweatshirt with some

28:05

funny meme on it. There's some teams

28:06

that like always go out to the same bar.

28:08

The sense of being in the room for the

28:11

first time that the frontier of

28:14

knowledge is pushed back

28:16

>> and getting to see what that's like. Uh

28:19

there's really nothing that most people

28:20

would rather do to celebrate than like

28:22

get to use the new model first.

28:24

>> Do you think we have the right

28:25

measurements of how good these things

28:26

are? Like

28:27

>> definitely not. In some sense the eval

28:28

that matters is like is this being

28:31

useful to people.

28:32

>> You can approximate it by revenue or by

28:35

amount of usage or like rate of

28:36

discovery of new knowledge. But uh we

28:39

have some teams working on like how what

28:42

is the real world eval look like for

28:43

these models as they get to superhuman

28:45

scale.

28:45

>> What is the frontier of your own usage

28:48

of AI?

28:51

I have started just recently to

28:54

experiment with what it means to like

28:56

let an AI uh kind of look at everything

28:59

I'm looking at on my computer. I don't

29:01

have this built yet. Um, and I'm still

29:03

trying to feel out like where the limits

29:06

of my comfort and trust should be. This

29:08

is definitely the frontier is figuring

29:09

out how I how I get value out of that,

29:11

how I get comfortable with that, what

29:12

that's going to look like. One takeaway

29:14

is that my memory is terrible relative

29:16

to the memory of an AI. and the ability

29:19

to keep in mind what email I read six

29:23

weeks ago or what happened exactly in a

29:25

meeting seven and a half weeks ago and

29:27

have that like brought up right at the

29:29

exact moment and to feed into a decision

29:30

that feels pretty magical.

29:32

>> Pretty cool. This kind of sounds like

29:33

personal agent-ish. What are the

29:35

barriers to everyone having that I want

29:38

that

29:38

>> compute? Man, let's imagine that we

29:40

could build this product. This product

29:42

that could just do exactly what I said

29:44

for all your stuff.

29:44

>> Always on.

29:45

>> Always on. looking at everything you

29:46

look at your computer, listening to

29:48

every meeting that you're in, um reading

29:51

every document you read, and then not

29:52

only that, not only can it do all that,

29:54

which takes a lot of tokens, you can

29:55

just drag a slider about like while I'm

29:58

asleep, you can spend this many tokens

29:59

thinking like come up with useful new

30:01

ideas for me. Do whatever work you can

30:03

and then just like keep thinking about

30:06

what I should do next. You know, what an

30:08

interesting thing is like just spend

30:10

more compute making your output better

30:12

for me the next morning. I would drag

30:14

that slider quite far. I'd be willing to

30:15

spend a lot for that.

30:16

>> Um, but the amount of compute that that

30:18

would require if everybody in the world

30:19

wants to drag that slider pretty far,

30:21

it's like a lot.

30:22

>> I'd love to hear you talk about how you

30:23

think of the nature of this new

30:25

intelligence. Uh, someone told me

30:28

recently, you know, planes don't fly

30:29

like a bird. And this intelligence is

30:31

>> it's a very alien kind of intelligence.

30:32

>> Yeah, it's a very alien kind of

30:33

intelligence. And everyone's talking

30:34

about how if you can verify something,

30:35

it's sort of it's just going to win,

30:37

right? Like it's with enough compute and

30:39

enough IQ, like it it'll just brute

30:41

force its way to a solution. And then in

30:43

other domains where humans and the data

30:45

and evals that they've done have been a

30:47

huge part of it, it's surprising to me

30:49

like how much money it's cost to get

30:51

good at I don't know law reasoning

30:53

tracing law or something. I'm just

30:55

curious like I'm not sure how beautiful

30:57

your kid is. You have a boy or girl

30:59

>> when they're seven or age of reason or

31:01

whatever and they can you can describe

31:02

to them like what is the nature of this

31:03

intelligence like how would you describe

31:05

it?

31:05

>> It's a beautiful question. I I I don't

31:07

think I've been asked this before or

31:09

even any version of it. The thing that's

31:11

coming to mind right now is I would just

31:12

say it's like a computer. And it's like

31:15

a computer in the way that it can

31:19

do a lot of things that people just

31:21

can't do like multiply two gigantic

31:24

numbers very quickly and give you the

31:25

answer

31:26

>> and then it cannot do some things that

31:28

you would

31:30

very easily do. The number of things

31:32

that it can't do, I expect to keep

31:35

receding. But in an evolving world, I

31:38

think human judgment and taste

31:42

will continue to be hard for AIs to

31:44

model like where that's going to go. I

31:46

don't have the right word for this. It's

31:47

not quite taste. The world may need like

31:50

a a new kind of word for the kind of

31:52

judgment that people are very good at

31:54

that AI seem to really deeply struggle

31:57

with. What's it been like becoming a dad

31:59

and having growing kids in this era? I'm

32:03

thinking back to your optimistic early

32:04

internet days. They're going to grow up

32:07

in cheap abundant intelligence age.

32:09

>> Having kids is by far the best thing uh

32:11

I have ever done. Uh and everybody says

32:14

that. Everybody says you can't really

32:16

understand it. And so I kind of knew

32:17

that I believed enough people that said

32:19

it that I believed it to be true. But

32:22

the degree to which it has been true for

32:23

me has been surprising. like the the I

32:26

think I have the best most interesting

32:27

job in the world and it is still a very

32:30

distant second to having kids.

32:32

>> So it's been awesome. Uh and it is a

32:35

real moment for optimism. My kids will

32:38

never grow up in a world where they were

32:40

smarter than computers. If you were born

32:41

at the time of GPT3, you had a time

32:44

where you had better reasoning than the

32:45

models, even though you didn't when you

32:46

were born. Yeah, you caught them

32:47

briefly. That will never seem strange to

32:49

him.

32:49

>> That will never bother him. I don't

32:51

think he'll care. I think he will he

32:52

would be like shocked to imagine in the

32:55

dark ages when we had to like deal with

32:57

products and services that weren't

32:59

incredibly smart. He will be able to do

33:01

things

33:02

that you and I never were able to do and

33:04

he'll have expectations in life that you

33:06

and I never had and you know I'll have

33:08

like a much bigger canvas.

33:10

>> Do you run the business or teams or lead

33:13

people in any way that is notably

33:16

different because of the experience of

33:18

having them?

33:18

>> The answer must be yes.

33:21

I feel very different having them. I

33:24

think there's like a bunch of small

33:25

things that are are really different.

33:27

And then, you know, again, this is like

33:29

not a novel insight in any way. I think

33:32

most people have had kids say, you know,

33:33

as soon as you have a kid, you like

33:35

realize that you care much more about

33:39

them and the experience you're going to

33:40

have, you do about yourself and the

33:42

world that you are going to leave them.

33:44

And I think I have a sort of like

33:46

unusual vantage point for that. And and

33:49

like people ask me sometimes like, "Oh,

33:51

you know, now that you have kids, do you

33:52

care? Are you worried about AI safety

33:54

and, you know, not destroying the

33:56

world?" And the answer was like, "I

33:57

didn't need kids for I really didn't

33:58

want to destroy the world before." But

34:00

do I think more about the role of like

34:03

human agency and what it means to have a

34:05

fulfilling life? Definitely much more

34:07

for what we're building. And also like

34:09

the people I work with, I want them to

34:10

have it too. You obviously have

34:11

extraordinary empathy for your kids, but

34:13

the degree to which that kind of extends

34:16

to all kids and then maybe to all

34:19

parents and to maybe then to everybody

34:21

like that's been a surprise to me too.

34:22

>> In in one of the posts, I think it was

34:24

the one that's things you wish you knew

34:25

earlier or something um is about

34:28

incentives. Set them very very

34:29

carefully.

34:30

>> Yeah.

34:30

>> It's always been one of the most

34:32

puzzling and interesting things about

34:33

you that you don't have equity exposure

34:34

to this company. How should the world

34:36

think about your incentives? I don't

34:39

know what I can say beyond like

34:43

I have a front row seat to the most

34:46

exciting moment of human history and

34:49

like that is worth more to me than any

34:51

amount of money. I get to have an

34:53

extremely interesting life and work with

34:55

extraordinary people on something that I

34:57

deeply care about. But somehow that

34:59

doesn't count like that doesn't

35:01

>> do it for people or something.

35:02

>> It's not.

35:02

>> I'm curious how you think about

35:03

robotics. Like you mentioned earlier, at

35:06

some point if we had automated labor in

35:08

the same way we're going to have

35:08

automated intelligence, things might get

35:11

even crazier. The labor market is much

35:12

bigger in the white collar market.

35:13

>> If we don't have it, then things get

35:15

really crazy. If the role for people in

35:17

the world is to be like the actuators of

35:18

AI in the cloud,

35:20

>> bad,

35:20

>> very bad. Very bad. So I think it's like

35:22

much crazier if we don't get it than we

35:24

do.

35:24

>> It's an imperative. help me understand

35:26

your sense of progress in that because

35:29

unlike in AI where everyone is now kind

35:31

of on the same page of like it's going

35:32

fast

35:33

>> I you can find extremely smart people

35:35

that say it's like end of this year and

35:36

you can find extremely smart people that

35:38

say it's 20 years from now or something.

35:39

>> It's not 20 years. I would say we get

35:40

the Chad GBT moment for robotics in the

35:43

next like two or three years.

35:44

>> What would that be like? Do you know

35:46

what that is?

35:47

>> Something where most people have like a

35:50

real wow. Not not like I saw this video

35:54

of a robot dog doing something crazy,

35:56

but I was somehow able to convince

36:00

myself that a a really important thing

36:02

happened. One of the things about the

36:03

chatbt moment was that you could just go

36:06

use it.

36:06

>> Yeah.

36:06

>> Like I didn't have to like believe

36:07

someone who said AI is coming soon. You

36:09

could just go try it.

36:10

>> Yeah.

36:10

>> And if you can go like, you know, type

36:12

in a command and a robot can do

36:14

something crazy and you can like watch

36:15

it even if it's you're not physically

36:16

there. I think that would have the same

36:18

kind of like whoa, it just did this

36:19

thing. Wasn't chatbt like not this

36:22

monolithic goal but sort of like a side

36:24

experiment that you decided to release.

36:25

Can you tell that that that story may be

36:28

instructive for something similar

36:29

happening in robotics? Everyone seems to

36:31

want to fold laundry but maybe it's

36:32

something very different.

36:33

>> When we launched GBD3 um we're trying to

36:37

make money trying to get people to use

36:38

this API.

36:38

>> Yeah.

36:39

>> And the only commercial use case that

36:41

was really working the model was just so

36:43

dumb. Like if you went back and used it

36:44

you'd be astonished. The only commercial

36:46

use case that was working was

36:47

copyrightiting

36:48

>> you know. So you pay like some marketing

36:50

firm 20 bucks and they paid us 20 cents

36:53

for the AI to like write you a landing

36:55

page or whatever. But in addition to

36:56

that one commercial use case, developers

36:58

were using this thing we called the

37:00

playground which was like a testing

37:01

interface to chat with the model. And it

37:04

was really hard to do because we had not

37:05

tuned the model to be good to chat with.

37:06

So you had to like give it a few

37:08

examples of what it means to chat and

37:10

then do it. But people really liked it.

37:13

And I had learned this great lesson from

37:15

YC is if you notice your users doing

37:17

something like

37:19

go down that yeah go down that path. And

37:21

so we decided that we would build a good

37:25

chatbot since that's what people were

37:26

doing. Um we started working on that and

37:30

we finished GBT4 and we started using

37:32

that internally. like this is a big deal

37:34

and we kind of thought that all right

37:36

this is going to be a real update to the

37:37

world about AI and there's a bunch of

37:39

hard questions here about you know is

37:42

this going to create a bunch of fake

37:43

news is going to say really offensive

37:44

things we're going to get in trouble so

37:46

we decided we would start with a weaker

37:48

version um the chat interface and GPT4

37:51

at the same time seemed like a lot so we

37:53

would roll out the chat interface and

37:54

GPT3.5

37:56

>> in fact it was originally going to be

37:57

called chat with GPT3.5

38:01

and Uh

38:03

we didn't plan to be product. Didn't

38:05

think it'd be a huge hit, but did did

38:06

think it would get people

38:08

the world to like catch up with this and

38:10

realize something was going on. And uh

38:13

we mercifully renamed it ChachiBT a few

38:16

hours before launch and put it out as

38:19

like a research preview.

38:21

>> And the thought was we'd put it out as a

38:22

research preview and then a few months

38:24

later we would launch a product with

38:26

GPT4. And for whatever reason, that

38:28

model was over the threshold where even

38:29

though we had gotten used to it

38:30

internally, people said, "Okay, this is

38:33

awesome." There maybe wasn't that much

38:35

utility yet, but it was an incredible

38:37

moment for people to feel AI progress

38:41

and use something that they enjoyed

38:43

using. And then by the time we put GPT4,

38:45

uh, something they really got benefit

38:47

out of using too.

38:48

>> Vanta automates security and compliance

38:50

for over 16,000 fastmoving companies

38:52

like Ramp, Curser, and Harvey, keeping

38:54

them audit ready around the clock. It's

38:56

the number one agentic trust platform

38:58

[music] and it now helps companies like

39:00

yours watch for the risks that show up

39:02

between audits across your vendors, your

39:04

AI tools, and your whole environment.

39:06

Every new tool your team signs up for,

39:08

every vendor [music] that turns on AI

39:10

features is an opportunity for something

39:11

to go wrong. And most security programs

39:13

weren't built for AI's pace of growth.

39:15

The Vant agent works like a 247 GRC

39:18

engineer in the background, finding

39:19

issues, drafting fixes for you, [music]

39:21

and cutting vendor assessment time by up

39:23

to 50%. Whether you're a [music] fast

39:26

growing startup or a global enterprise,

39:28

Vanta helps you earn and prove trust.

39:30

Invest like the best listeners. Get a

39:32

special offer for $1,000 off at

39:34

vanta.com/invest.

39:36

[music]

39:38

Ridgeline is the first endto-end system

39:40

of record with embedded AI for

39:42

investment management [music] firms.

39:43

Running portfolio accounting,

39:44

reconciliation, reporting, trading, and

39:47

compliance [music] on one unified

39:49

platform. Firms are moving off legacy

39:51

technology and onto Ridgeline because of

39:53

how far ahead Ridgeline's AI features

39:55

are compared to [music] anything else in

39:56

investment management software. I've

39:58

been hearing from a lot of investment

40:00

managers about AI and they fall roughly

40:01

into two camps [music] with some unsure

40:03

of where to even start and others

40:05

convinced they can build their own order

40:07

management system over a weekend. The

40:09

reality is that running an investment

40:10

firm will always require governance,

40:12

controls, [music]

40:13

and a single source of truth for your

40:14

data. And no amount of AI enthusiasm

40:16

changes that requirement. Ridgeline is

40:19

built on exactly that foundation, which

40:21

is why I believe that firms that come

40:22

out ahead in the AI era will be the ones

40:24

running on Ridgeline's unified platform.

40:26

If you're serious about your firm's AI

40:28

[music] strategy, Ridgeline should be

40:29

part of that conversation. You can

40:31

request a demo at ridgeline.ai. [music]

40:34

Are you surprised that that remains kind

40:37

of the intuitive interface between us

40:40

and this alien intelligence, even

40:41

including coding? Like mostly that's me

40:43

talking to the computer telling it what

40:45

to build. No, because I'm like a massive

40:47

texter.

40:48

>> Yeah,

40:48

>> I've been a massive texter my whole

40:49

life. I think part of my own insight of

40:51

why that was a good interface is I'm

40:52

like,

40:53

>> I know how to do this. I know how to do

40:54

this. I know what it's like to just like

40:56

start chatting in a text box. Any other

40:58

thoughts on this notion of diffusion and

40:59

how to make it faster? Like if the

41:01

mission is get intelligence into the

41:03

hands and more useful for everyone, a

41:06

key part of that is like I don't know a

41:07

marketing campaign or something like how

41:09

how do you get this to diffuse faster

41:12

than it seems to be doing naturally to

41:14

me? I think the key thing is uh just

41:16

make it better. Like I I kind of believe

41:18

that a truly great product markets

41:20

itself. There was no ChadBT marketing

41:22

campaign

41:23

>> at the beginning.

41:24

>> Um and I think as we get to this next

41:27

stage of models and we figure out

41:31

how to make products that are as great

41:32

as the models themselves, there will be

41:34

such incredible utility that people will

41:37

spread it very quickly. uh we should

41:39

definitely do more marketing like the AI

41:42

is not too popular

41:43

>> for as much as people use it or they're

41:45

kind of they have very understandable

41:47

anxiety about where it can go and so

41:49

that kind of stuff I think some great

41:51

marketing would be helpful for but in

41:53

terms of value people are getting out of

41:55

their products and getting their

41:56

products to grow faster models more

41:58

compute better products that will do it

42:00

there was this period where the

42:01

recruiting of researchers the retention

42:03

of them the incentivizing of them was

42:04

like the defining story in the

42:06

competitive landscape or whatever I

42:08

think there's lots of stories about you

42:09

successfully recruiting great

42:11

researchers and there's been many that

42:13

have come through OpenAI and had huge

42:14

impacts. Some of which are known, some

42:16

of which are lesserk known names. I'm

42:18

just curious about this whole genre of

42:19

like what you learned about how to

42:21

recruit this class of person. What

42:24

matters to them and and how you did it.

42:26

I've never heard you talk about like the

42:28

actual tactical like moves you pulled to

42:32

recruit somebody

42:33

>> in the early days. I think it was quite

42:35

simple which was that we believed that

42:37

AGI was possible

42:38

>> and it was worth going after and we're

42:40

willing to say that and that was like an

42:43

insane heretical belief. When we first

42:45

announced OpenAI all of these like you

42:48

know giants of the field these experts

42:51

were saying this is like insane it's

42:53

hypy. It's irresponsible. Really

42:55

respected people like Yan Lun or

42:57

whatever telling journalists like oh

42:59

these guys aren't very good and it's not

43:00

going to work. But the fact that we were

43:02

able to say we're gonna go for this,

43:06

it really appealed to a certain kind of

43:08

researcher that also wanted to like go

43:10

on this crazy adventure with low

43:11

probability of success. And an ambitious

43:15

kind of audacious vision is a very

43:17

powerful recruiting tool.

43:18

>> Yeah. You think you've written that it's

43:20

actually easier sometimes to build

43:22

things that are harder because of this

43:24

reason.

43:25

>> I super believe in this. It's one of my

43:27

most frequent pieces of advice to YC

43:30

founders and I tried to really live it

43:32

at OpenAI. Just do something harder.

43:34

>> Do something that matters like do

43:36

something that is important and if you

43:39

don't do it, if your company doesn't

43:40

succeed, might not happen.

43:42

>> You were an investor and our investor uh

43:44

you've done a lot of it and at one point

43:46

that's what you did. What have you

43:48

learned about investors being on the

43:49

other side? The number of investors that

43:51

actually show up and try to help you

43:54

is unbelievably small. Josh Kushner,

43:58

absolute MVP investor, unbelievable, has

44:02

like worked around the clock for what

44:03

feels like years to help us. He is the

44:06

only investor that I could point to that

44:08

is

44:10

proactively incredibly helpful all the

44:13

time. There are more people that could

44:15

do that. Uh, and there are many other

44:17

investors that have also been helpful

44:18

and that have great strategic advice and

44:20

that do things when, you know, we ask

44:22

them to do it. But the like constant

44:25

just relentless all-in support is

44:28

surprisingly rare from investors. Maybe

44:30

I'm biased cuz I like always liked it

44:32

when people said that about me, but I

44:34

think founders really love that and it

44:37

actually like moves the needle and as an

44:38

investor, it's the most fun way to do Me

44:40

and my friend play this game where we

44:41

text each other all the time and the

44:43

prompt of the text is something I don't

44:44

want you to know about me.

44:47

What is What does that bring to mind?

44:53

I'm tired. I don't think I'm supposed

44:55

I've been doing this a long time. It's

44:57

tiring.

44:57

>> How do you get through that?

44:58

>> Just keep going.

44:59

>> It begs the question like is there

45:01

amount of being tired that would make

45:02

you stop doing this?

45:03

>> No, no, no. I I mean I I this is the

45:05

coolest job in the world. I plan to do

45:06

this for the rest of my career, but it's

45:08

like much harder than I have a way to

45:09

explain to people. I I feel very

45:11

grateful to get to do this. This is not

45:12

me complaining.

45:13

>> What's coming next? Like we talked about

45:15

automated AI researchers that next year,

45:18

the year after like how do you think

45:20

about what is happening in the next 6 to

45:24

36 months? Maybe that's too far out to

45:27

forecast in this crazy exponential.

45:29

Maybe a different version of the

45:30

question is like let's say in you know

45:32

month 23 from now we have something that

45:34

everybody agrees is super intelligence.

45:36

What happens in month 24?

45:38

>> And my answer would be uh not very much.

45:41

The the kind of like cult worship of the

45:44

machine god

45:46

states those people believe that like

45:49

more is going to happen quickly than is

45:51

going to happen. Eventually a lot will

45:52

happen but eventually a lot was going to

45:54

happen anyway. like the rate of human

45:55

progress and you know how different each

45:58

decade is going to be and how much each

46:00

decade is more different than the decade

46:02

from before that's been happening for a

46:04

long time obviously ups and downs but

46:05

directionally and I think the right way

46:08

to think about this everybody wants to

46:10

be the hero of the story everybody wants

46:12

to feel like they were there for the

46:13

moment of the machine god and they

46:14

played some crazy role but you know this

46:16

is another step and it was hard to

46:19

imagine 50 years ago and the step 50

46:21

years from now is hard to imagine today

46:23

and

46:25

and I think the right mental framework

46:26

is just the zoom way out and it's a

46:29

pretty smooth exponential.

46:30

>> Tell me a little bit about the

46:31

experience of watching codeex take off

46:34

and how much that is tied to what I

46:37

would describe as like a competitive

46:38

advantage of distribution that you built

46:40

through chat and this is a gateway into

46:42

a question about like Moes in general in

46:44

AI like what you think will drive real

46:47

competitive advantage in the business

46:49

over time. I think Codex mostly is

46:51

winning because it's the best product

46:53

and the best model. We do get some

46:54

advantage from Chachib bundling but very

46:58

very tiny. That is mostly not what it's

46:59

been about. It has made me reflect a lot

47:01

on this question of competitive

47:02

advantage um because you know like

47:07

brilliant intelligence can migrate from

47:09

any product to any other product

47:11

>> and network effects still have a

47:14

competitive advantage. economic scale

47:16

and the ability to like make the

47:17

cheapest comput fleets whatever still

47:19

have a competitive advantage but the

47:21

product advantage like if we could get

47:23

people to move over to Codex and someone

47:24

builds something better they can get

47:25

people to move from codeex

47:26

>> so it has made me reflect on that a lot

47:28

>> there's a really interesting question

47:29

about whether this is going in the

47:30

direction of a commodity like is

47:32

intelligence going to be a a pure

47:35

funible commodity like rated oil or

47:37

something

47:38

>> intelligence itself I would say yes

47:40

>> so what is not going to be

47:41

>> comput fleet you know like the scale of

47:43

the comput fleet the ability to make

47:45

more compute. I think that's like a very

47:46

durable advantage even if the product

47:49

itself is not because you know codecs

47:52

can write any piece of software you

47:53

want. The workflows, the integrations,

47:55

the sort of like complex processes, the

47:57

ability for teams to collaborate

47:58

together, that stuff is all pretty

47:59

powerful. Even like brand preference and

48:02

familiarity is pretty powerful.

48:04

>> How excited are you about new obviously

48:06

you've done interesting stuff in

48:07

hardware that I'm sure you'll announce

48:08

later this year. How how does that

48:11

experiment feel and align with this sort

48:13

of consumer distribution that you have?

48:15

>> One of the reasons I'm interested in new

48:16

hardware is we were talking earlier

48:18

about how a very powerful thing with AI

48:20

is that it can be always on and

48:23

proactive and just understand all your

48:25

context. But current hardware is not is

48:27

not good for that.

48:28

>> Like we are working inside of a hardware

48:32

paradigm that is 50 years old something

48:35

like that. Um and computers are amazing.

48:38

keyboard and mice monitor. It's an

48:39

amazing thing, but like we have to shape

48:42

AI into that. And I would I'm excited to

48:44

think about I would love AI to be able

48:47

to reference this conversation, but not

48:48

so much that I'm willing to like crack

48:49

my laptop open, put it here, and have it

48:51

like looking at you and listening to us

48:52

while it's going, but I would like a

48:53

piece of hardware that socially was

48:56

acceptable to do that and also felt like

48:58

it was designed for that kind of a

48:59

thing. As you think about the open

49:01

questions, what debates in your own head

49:04

with your friends, with people that your

49:05

colleagues here, what are the most

49:07

interesting open debates or open

49:09

questions that you you you don't feel

49:10

certain about but feel important?

49:12

>> One that I don't think gets much

49:13

attention is how how are we going to

49:16

avoid cognitive atrophy? How are we

49:19

going to use these tools and make sure

49:20

that we are like stretching our brains

49:22

more and more and continuing to

49:24

understand the stuff that that really

49:26

matters? Um,

49:28

there's lots of versions of this that

49:30

don't like I I remember when I was in

49:32

school, I had this professor tell me

49:33

like you got to understand compilers. If

49:35

you don't, you will never be able to be

49:36

a good programmer. Somehow that wasn't

49:38

quite right. But understanding at a

49:42

reasonable level like how the major

49:44

components of a computer system work has

49:47

been important to me.

49:48

>> Forced to imagine a scenario where we

49:49

are somehow over supplied in compute in

49:52

2 years time. What would be that story?

49:54

It does feel possible if the models get

49:56

so smart and so efficient that they can

49:59

kind of do everything we need and you

50:01

know build every piece of software we

50:03

want and if the bounds of our attention

50:05

are such that like they just cannot

50:07

absorb more than what it turns out a

50:09

fairly limited amount of compute can do

50:11

then we can get into over supply. Also

50:13

if we don't drive the cost curve down

50:14

because we hit some sort of scaling wall

50:16

we could also get into over supply. like

50:18

the the observation about uncapp demand

50:22

implies a certain price.

50:24

>> Can you give your point of view on

50:26

scaling laws today?

50:27

>> Looking great.

50:28

>> Just looking good.

50:29

>> In some sense, scaling laws are like the

50:31

most hated prediction of all time.

50:32

Everybody always wants to say a runa

50:34

can't be like this and and yet it keeps

50:36

going.

50:36

>> Who are your favorite unsung heroes in

50:39

this company's story?

50:40

>> First person that came to mind is Alec

50:42

Radford. Alec Radford is probably the

50:43

most important

50:45

not very well-known researcher in the

50:47

whole history of the field and also just

50:49

a wonderful like top top tier human

50:52

being. Um he did the work that really

50:57

became the GPT series uh among many

51:00

other important things. Um, but he also

51:03

is someone who inspired, guided,

51:07

nudged people in many other directions

51:10

that turned out to be super important.

51:12

And the thing I think is cool about him

51:13

is if you talk to people that worked

51:14

with him, they will they will of course

51:18

say, you know, generational genius,

51:21

brilliant, innovative thinker, just so

51:23

deep in his understanding and his and

51:25

his work. But everybody everybody will

51:28

tell you before they finish their

51:30

statement that just like one of the

51:32

nicest, most positive, best people

51:34

they've ever interacted with.

51:35

>> I love formative moments. And so as we

51:38

wind up here, I'm curious to ask what

51:39

one of each. If you think about the

51:41

whole OpenAI experience, what moment or

51:45

chapter or whatever are you most proud

51:46

of? start with the other one which is

51:49

what was like the most instructive thing

51:50

that maybe you got wrong or did wrong or

51:53

what have you and and what was what was

51:55

it like to learn from it?

51:56

>> I mean a lot of things have gone wrong.

51:58

A formative one that went wrong which I

52:00

haven't talked about much is we made a

52:02

mistake to try to innovate in our

52:03

structure in the beginning. We had a

52:05

very good reason for it which is we

52:07

didn't know how we were ever going to

52:09

make money and we really at the time

52:12

weren't sure at all what we're going to

52:14

look like when we grew up. And of course

52:15

we care about our mission and we wanted

52:17

to like be structured in a way where

52:19

even if the technology went on a very

52:20

fast takeoff our mission was protected

52:22

and so we had this like you know

52:23

nonprofit structure but

52:27

I definitely learned something about

52:30

why people don't do that much. We would

52:32

have saved ourselves a great deal of

52:33

pain in many ways if we had not tried to

52:36

innovate on our structure and found some

52:38

other way to preserve the central

52:40

importance of the mission. Maybe there

52:42

was no other way. Maybe there was for

52:44

what we were doing and kind of the

52:45

importance of it. There was nothing

52:47

other than an exotic structure we could

52:48

have come up with. I really learned over

52:52

the last decade a big lesson about why

52:54

people don't usually do that.

52:55

>> Is there anything for else formative of

52:56

your life that like makes you you that

52:58

we didn't talk about? I'm this is like

53:00

the the question that's always like the

53:02

most interesting to me. becoming

53:04

relatively immune to people having

53:07

strong opinions about me that I think I

53:10

developed later in life as as like

53:12

realizing that man just if you're going

53:14

to be at the center of like this crazy

53:15

revolution everybody's going to project

53:17

a lot of stuff onto you and you got to

53:18

just quickly learn to make peace about

53:20

that. I think there were also things I

53:23

learned later in life about like how to

53:26

be very calm and not anxious really

53:28

about stuff. In terms of what drives me

53:32

and what I care about and kind of like

53:33

how I want to live my life

53:36

on the whole I felt like, you know, for

53:39

whatever reason, the like 10-year-old

53:41

version of me was pretty like fully

53:42

formed. I think I just like kind of came

53:43

out this way.

53:44

>> How about the thing you're proud of

53:46

looking back on? I'm most proud of how

53:50

many times we were right when the rest

53:51

of the world was wrong in an important

53:53

way that put the world on a trajectory

53:55

now that I'm very proud to have played a

53:57

role in. That feels awesome. And then

54:00

also like for all the crap that's

54:01

happened like the spiritual growth or

54:03

whatever you want to call it that I've

54:04

gotten to have of like learning

54:07

just incredible resilience and what that

54:09

does for like making me happy in the

54:11

rest of my life. Yeah, very grateful for

54:13

that.

54:13

>> When I do these, I ask everyone the same

54:15

traditional closing question. What is

54:16

the kindest thing that anyone's ever

54:18

done for you?

54:18

>> I feel incredibly lucky about how many

54:21

people have gone way out of their way to

54:23

be very kind to me throughout my entire

54:24

life. As I'm thinking of this, there's

54:25

just this like montage of moments from

54:29

life where people have been unbelievably

54:32

nice to me. Yesterday, my kid shared his

54:33

blueberries with me for the first time.

54:34

That was very sweet. [music] Good

54:36

moment. Thanks, man. Thank you.

54:41

>> You know how small advantages compound

54:43

over time? That's true in investing and

54:45

just as true in how you run your

54:46

company. Your spending system is your

54:48

capital allocation strategy. [music]

54:50

RAMP makes it smarter by default. Better

54:52

data, better decisions, better economics

54:53

over time. See how at ramp.com/invest.

54:56

As your business grows, Vanta scales

54:58

with you, automating compliance and

55:00

giving you [music] a single source of

55:01

truth for security and risk. Learn more

55:03

at vant.com/invest.

55:05

The best AI and software companies from

55:07

OpenAI to cursor to Perplexity use Work

55:10

OS to become enterprise ready overnight,

55:11

not in months. Visit workos.com to skip

55:14

the unglamorous infrastructure work and

55:16

focus on your product. [music] Ridgeline

55:18

is redefining asset management

55:19

technology as a true partner, not just a

55:21

software vendor. They've helped firms 5x

55:24

[music] and scale, enabling faster

55:25

growth, smarter operations, and a

55:27

competitive edge. Visit

55:28

ridgelineapps.com to see what they can

55:30

unlock for your firm. [music] Every

55:32

investment firm is unique, and generic

55:34

AI doesn't understand your process. Rogo

55:36

does. It's an AI platform built

55:38

specifically for Wall Street, connected

55:39

to your data, understanding your

55:41

process, [music] and producing real

55:42

outputs. Check them out at

55:43

rogo.ai/invest.

Interactive Summary

In this extensive interview, Sam Altman, CEO of OpenAI, discusses the evolution, challenges, and future of artificial intelligence. He details OpenAI's focus on creating AGI that benefits humanity while ensuring it remains democratized rather than controlled by a small group of entities. Altman reflects on the importance of focus in business, the necessity of securing vast amounts of compute, and his optimism regarding the future impact of AI on jobs, creativity, and daily life. He also addresses topics like robotics, the competitive landscape, his personal experience as a new parent, and lessons learned from the company's organizational journey.

Suggested questions

4 ready-made prompts