One thing I find crazy about these

scenarios is just how much of the

world's future labor supply ends up in

very few companies. And also how fast

the labor supply grows year over year.

So, basically the effective AI

population size at the frontier labs is

increasing 10x year over year. But, if

the current trend continues, you have a

world where OpenAI goes from having,

say, 10 million basically AI laborers

this year to 100 million next year to a

billion the year after that. And then

pretty soon even if computer scaling

slows down, it doesn't take many more

years before each company individually

has more labor equivalents than there

are people on Earth. And I think that's

like a thing that is very plausible by

the end of this decade. So, we talk

often about centralization of power

because of nationalization or whatever,

but we don't think enough about the fact

that we're actually moving very fast

into a regime where most people, like in

terms of like the work output or

something, is just like concentrated

within two labs where consuming more and

more of the world's compute. And so, if

these AIs are misaligned, then most of

the world is misaligned basically, cuz

like most of the world's minds are

there. But even if they're not, it's

just very few companies have like a lot

of influence or a lot of control with

>> Yeah, it's it's it's sort of ultimately,

you know, if you believe in RSI, you

believe in the labs are the most

effective user of compute and can

generate the most value from the

compute, then the only thing that's

going to happen is centralization of

compute. And that's scary as hell.

>> Yeah.