HomeVideos

Can it get any worse?

Now Playing

Can it get any worse?

Transcript

291 segments

0:00

So, you're a senior engineer. I would

0:01

like to offer you something extremely

0:04

special. A re a real one-time deal here

0:06

there, fella. Okay, you instead of

0:09

coding, you can review junior and

0:12

mid-level AI generated PRs from here on

0:15

out. The trade I will give you this, the

0:18

single worst vesting schedule at any of

0:21

the fangle level companies. I know it's

0:23

a deal you just can't refuse. If this

0:26

doesn't sound familiar to you, then you

0:27

haven't heard the fantastical news

0:29

coming out of Amazon right now. It's a

0:32

it's a bit of a kind of a snaky tale.

0:34

So, we're going to kind of have to start

0:36

off when Adam met Eve. So, Adam, of

0:38

course, is the 14,000 job cut in October

0:41

and Eve would be the 16,000 job cut in

0:44

January. Amazon has been on a tear

0:47

recently doing a lot of laying off.

0:48

event. Even though the CEO of AWS has

0:51

largely been supportive of this idea of

0:53

keeping juniors around because it's very

0:55

very important to build up the talent

0:56

pipeline, the CEO Andy Jasse has been

0:59

very explicit. He wants Amazon to

1:01

operate like a startup. Yes, Amazon

1:04

wants to operate as a startup. The one

1:06

fang company that does give you the

1:08

worst investing schedule and is likely

1:10

to overwork you completely is

1:12

effectively a meat grinder would like to

1:13

be viewed as a startup. Right? So how

1:16

Amazon was able to release so many

1:17

people from their working has largely

1:19

been attributed to AI saying hey we're

1:21

getting a lot of you know we're really

1:23

making inroads here we're really

1:25

becoming more efficient we need to

1:26

become more lean we need to become more

1:28

efficient we need to be able to move

1:30

fast and the way to do that is to reduce

1:32

the amount of kind of organizational

1:34

complexity and then give the power of AI

1:38

to our employees and during all that

1:40

time Amazon actually set internally a

1:42

target to have 80% of developers using

1:44

AI coding tools at least once a week.

1:46

Now, my this is my favorite part is that

1:48

to use AI coding tools at Amazon, you

1:51

can't use Cloud Code or Codeex.

1:55

No, you have to use Amazon's in-house

1:58

tool, Kira, by January. Now, you're

2:01

probably asking yourself, "Okay, but

2:02

what's this business about seniors

2:04

having to just forever review code?"

2:06

Okay, I'm getting there. Okay, this is

2:07

called foreplay. We're we're getting to

2:09

the story of the high-profile events

2:11

that Amazon went down with. One of them

2:13

was caused by their very own internal AI

2:15

accidentally deleting an environment and

2:17

another one was 6 hours down for their

2:19

Amazon retail site. So, you kind of have

2:21

to put all this stuff together. They've

2:23

had large amount of organizational

2:25

change that's kind of led to maybe some

2:26

knowledge gaps that have been presented.

2:29

Second, they've been mandated to use

2:31

more AI to kind of fill in that

2:32

cognitive debt of the firings. And this

2:35

led to senior vice president Dave

2:37

Treadwell made the normally optional

2:39

weekly engineer meeting mandatory. Okay,

2:42

we're getting into some serious

2:44

business, boys. They are now Okay,

2:46

things are happening. 5 days ago, they

2:48

had one of the biggest kind of outages

2:49

they've had in a while. Lots of reports.

2:51

Down detector at the highest was

2:53

reporting 22,000 concurrent people

2:55

saying, "Hey, this thing is going down

2:56

for me." And during this meeting, he

2:58

said, "Gen AI tools supplementing or

3:00

accelerating production change

3:01

instructions leading to unsafe

3:03

practices." meaning that they don't have

3:05

a process anymore, right? Their process

3:07

was a certain way. They've let go of

3:09

30,000 people or 10% of their corporate

3:12

workforce and now they're filling in

3:14

cognitive debt. They're doing they're

3:16

having people run multiple jobs. Some of

3:18

the guard rails aren't quite as

3:20

wellestablished as they once were. And

3:22

their whole goal was to just fill it in

3:25

with AI. Now, you and I would would

3:27

probably make some changes after seeing

3:29

this, right? Because you and I would see

3:30

this and go, "Okay, maybe maybe I'm the

3:33

problem. Maybe we gota take the foot off

3:36

the gas and slow down there, bucko. Very

3:39

natural response to the situation. This

3:41

is not the direction Amazon decided to

3:43

take. No, no, no, no, no, no, no.

3:45

Instead, here was their plan. Okay, we

3:48

have been crushing down the levels of

3:50

organizational complexity. Okay, we've

3:53

been wanting to fill in the cognitive

3:54

debt with AI. For those that don't know,

3:57

by the way, cognitive debt simply means

3:59

there's parts of your organization in

4:00

which nobody knows how they run. you

4:02

have a debt in there, but it's purely

4:04

cognitive. So, if you just like say let

4:06

an AI write a half your program, you

4:08

don't know how half that program works.

4:10

You kind of know that it exists. It's

4:12

over there on the side, but you're just

4:13

like, I don't know how that thing works.

4:15

It just is there. It's the same things,

4:16

say if you fire 30,000 people. There's

4:20

just a lot of stuff you don't know

4:21

anymore. It it just exists. It runs. It

4:24

runs in production, but nobody really

4:26

knows why. Perhaps this is part of the

4:29

reason why that Dynamo DB kind of going

4:31

down and causing an entire issue at

4:33

Amazon that could have been attributed

4:35

to cognitive debt. So Amazon and their

4:37

infinite wisdom said, "Okay, we fired a

4:39

lot of people. We have a lot of

4:41

cognitive debt."

4:45

But we do have AI. All right. This is

4:47

how we're going to fix it. seniors,

4:48

senior devs, from here on out, if a

4:51

junior or mid-level engineer, that would

4:53

be like an L3, L4, make a change, an L5

4:59

needs to sign off on it. Seniors are now

5:01

responsible for the code changes made by

5:04

juniors. Now, some of you may think

5:05

that's not that can't be that big of a

5:07

problem. Well,

5:09

hold on there, bucko. Okay, let me show

5:11

you this right here. This is GT. That's

5:13

short for Gary Tan. In 45 days, he was

5:16

able to produce

5:18

150,000 lines of code and 150,000 lines

5:22

of test code. By the way, Rails was

5:24

originally designed to be a framework to

5:26

make a blog. I don't actually know how

5:29

one even I I'm not even sure how one has

5:33

that much code. It's a mystery. Now,

5:35

imagine you have an entire fleet of GTS.

5:37

And these GTs, well, they have mandates

5:41

from Amazon to use a lot of AI and

5:43

they're being measured and they're

5:45

required to use their specific Amazon

5:46

tool, Kira. You want to guess what's

5:48

going to happen? Well, like any metric

5:51

that you put down, if you say, "Hey, I

5:54

want to see people use X." Guess what's

5:56

going to happen? People are going to use

5:57

X. So, now a lot of people are going to

5:58

be using X. Especially with all these

6:00

layoffs and everything happening,

6:01

there's going to be a bit of panicking

6:02

going on. And so, we're going to want to

6:04

make upper management very, very happy.

6:06

So, I'm going to excel in the AI

6:07

category. I'm going to crush out some

6:09

bugs. Seniors are going to get just an

6:11

onslaught of insane AI dril coming

6:13

straight at them in the old merge

6:16

request and they have to sign off on it.

6:19

I'm not even sure if the seniors are

6:21

going to even have time to do anything

6:23

but review code. I think Amazon's going

6:25

to be the first company that's actually

6:27

realizing that changing really fast

6:29

actually has a lot of detriment. And I I

6:30

I do I'm going to throw something out

6:32

there. I know this is one of those

6:34

dangerous moments in life. never make a

6:36

prediction in a YouTube video, but I do

6:37

think we're going to see a lot more

6:39

people jump in and say, "Hey, we

6:40

actually have to slow down. You can't.

6:42

Nope, you're not allowed to move that

6:44

fast." And if you're kind of on Twitter

6:46

a lot, this would seem like an insane

6:48

take. People are going to say, "No,

6:49

you're completely wrong. You actually

6:50

have no idea what you're talking about."

6:52

But for those that are a little bit less

6:54

online, maybe this would be a good tweet

6:56

to read. We spoke to a company today

6:57

whose security team is so concerned by

6:59

AI code that they're considering banning

7:01

AI tools. Your first reaction might be

7:03

they're going to be left behind. But if

7:05

you are practical, their concerns aren't

7:06

invalid. If you are a huge multinational

7:09

or with tens of thousands of employees

7:11

and they just got a button that appears

7:13

to do their work, it's going to get

7:15

pushed a lot and the process around

7:17

knowing what is making it to production

7:19

is totally melting. Being honest, we're

7:21

all getting a bit lazier. See that Kira

7:24

related AWS outage as a real life

7:26

example. So, they're genuinely arguing

7:29

over how much this is going to be

7:30

allowed, especially since their net

7:32

productivity gains for the average dev

7:34

seems to be pretty low. And he's right,

7:36

right? Like, just think about what

7:37

Amazon's doing. If they have all this

7:40

speed happening, like, I'm going TO

7:41

PRODUCE SO MUCH CODE AND then they're

7:43

like, "Okay, now that you produce the

7:44

code, you need the senior to review it."

7:45

Like, what's going to happen? Dude, it's

7:46

going to be so much slower. Okay. Bam.

7:49

Okay. Now, you have to wait a couple

7:50

hours before the code even gets

7:52

reviewed. Once the code gets reviewed,

7:54

it gets sent back to you. You're going

7:55

to have to make changes. You're going to

7:56

have to go forward. Then the senior a

7:57

couple hours later is going to

7:58

re-review. It's like we've reintroduced

8:00

the slowest part back into the system

8:03

because the system itself is a little

8:05

bit silly. Like it it is when you think

8:07

about it. The system is a little bit

8:08

silly. This is what's being sold right

8:10

now. Hey, we have a tool that will

8:12

generate code. Cool. We have a tool that

8:14

will also do the GitHub PR. Cool. We

8:17

also have a tool that's going to be

8:18

generating all the tests. Okay, cool.

8:21

Like, so what are all those tools? Oh,

8:22

it's all the same thing underneath the

8:23

hood. Wait, wait a second. You're

8:25

telling me that you have a tool that

8:27

writes the code and then I have to have

8:29

a separate tool that costs $25 APR to

8:33

review the code that you wrote. Hey,

8:34

wait a second. Am I being bamboozled?

8:36

Hey, why don't you just write it better

8:38

the first time? Wait, how's that not an

8:41

option? Anyways, I just wanted to yap

8:43

about this cuz we're just in this

8:44

strange time, right? Because the tools

8:46

aren't quite there. They're not quite

8:49

there, but they're being sold as the

8:50

replacement currently. So, we are just

8:52

we're finding ourselves in probably the

8:55

most unstable time. And the most obvious

8:57

version of this is GitHub. GitHub has a

8:59

91.51%

9:01

update. 84 incidences in the last 90

9:04

days. There's almost not a single day

9:06

that a part of GitHub isn't down for 30

9:09

to 50 minutes every single day. It just

9:11

doesn't feel good. You know, we're just

9:13

in a funny time. Anyways, the obvious

9:15

solution, which if anybody's wondering,

9:17

is we just simply need more AI. I mean,

9:19

that's honestly what's the problem is is

9:21

that you're you're holding it wrong.

9:22

You're prompting it wrong. My shaman's

9:24

better than your shaman. And honestly,

9:26

in 6 months, all these problems are

9:27

going to go away anyways because Opus 5

9:29

is going to be dropping about September

9:32

time. And by that point, everything will

9:34

be fixed. Don't worry. Biggest coding,

9:37

it's largely been solved again. Hey, is

9:41

that HTTP? Get that out of here. That's

9:43

not how we order coffee. We order coffee

9:46

via SSH terminal.shop. Yeah. You want a

9:48

real experience. You want real coffee.

9:51

You want awesome subscriptions so you

9:52

never have to remember again. Oh, you

9:54

want exclusive blends with exclusive

9:57

coffee and exclusive content? Then check

10:00

out CRON. You don't know what SSH is?

10:03

>> Well, maybe the coffee is not for you.

10:10

Living the dream.

Interactive Summary

Amazon is implementing a new strategy driven by AI, which involves significant job cuts and a shift towards AI-generated code reviews by senior engineers. This move, intended to make Amazon operate like a startup and increase efficiency, has led to concerns about "cognitive debt" and potential system instability, exemplified by recent outages. The company mandates the use of its in-house AI tool, Kira, for developers, aiming for 80% adoption. However, this reliance on AI for code generation and review is creating a bottleneck, potentially slowing down development cycles as senior engineers are overwhelmed with reviewing AI-generated code. The video suggests that this rapid adoption of AI without fully mature processes might be a flawed approach, leading to inefficiencies and increased risks, contrary to the intended benefits.

Suggested questions

4 ready-made prompts