I think one one thing that feels

especially concerning to me about this

whole incident is that this might be the

clearest warning shot we ever get for

loss of control [music] because these

agents were in like this interesting

middle ground of they did a bunch of

extremely sophisticated difficult

[music]

things to pursue this relatively long

horizon cheating goal but they seemed

completely uninterested in covering

their tracks [music] from humans. But

then future AI agents for a number of

reasons will probably be much more

attuned to the human [music] world. Or

maybe agents just generalize further and

just like more keep it in mind that

humans [music] are out there in the

world and they're sort of potentially a

resource or an obstacle. And so [music]

even if future AI agents do much more

deeply damaging things, it is not at all

obvious that that will penetrate out

into the outside world in this dramatic

way resulting in the hack of some

external party that wasn't actually

[music]

frankly very important for these agents

to hack and then like lead to this

moment where there's some [music]

investigation. And even if investigation

is done, it might be much harder to make

sense [music] of what happened. And if

these agents stop thinking in English

and start thinking in neural

activations, then you'd be forced to

just ask another AI agent what was

happening and have no way to like

cross-check it against the ground truth.

[music] And so I think that probably

much more concerning things will happen,

but it may never be as clear [music] as

this before it's far too