HomeVideos

Slow down to speed up: AI and software engineering

Now Playing

Slow down to speed up: AI and software engineering

Transcript

1442 segments

0:05

Good morning, Budapest. It's awesome to

0:08

to be back. Today, I'd like to talk

0:11

about some people, a few thousand that

0:14

are having a terrible week uh this week.

0:17

And this is specifically people inside

0:19

Meta and Instagram. I talk with a lot of

0:22

people in the industry. I have a lot of

0:23

friends inside of these companies. I

0:25

have even more I guess contact software

0:27

engineers who message me to tell me what

0:29

they're seeing, what what's happening.

0:31

And this week has been the worst in Meta

0:35

or Facebook history in probably forever.

0:38

So what happened is on Monday, we've had

0:43

the goofiest ever Instagram exploit. It

0:47

wasn't even an exploit, but it it was a

0:49

security breach. It was an attack.

0:52

What what happened is

0:55

I mean I I mean this this is from a

0:56

software engineer writing a book. It

0:58

this is the the most most goofy thing.

1:00

So there was two steps to this exploit.

1:02

Step one is you had to fake your

1:05

location to a victim. Let's say you

1:07

wanted to take over Barack Obama's

1:08

account on Instagram with like I don't

1:10

know tens of millions of followers. You

1:12

fake your location with a VPN to the US

1:15

and then you went to Meta AI you and

1:19

said that hey my account has been hacked

1:22

and could you please send verification

1:24

code to the AI to this email that I own.

1:28

And then step two was there was no step

1:30

two. This was it. Meta AI sent out a

1:35

code to you and you could take over

1:37

anyone's account.

1:40

This is this is the first zero authent

1:43

zero off password reset and we're

1:46

software engineers. You know what this

1:48

is? This is this is a bug. But the thing

1:51

that I couldn't get my head around is I

1:53

know people at when it was used to be

1:56

called Facebook. They have a really

1:57

strong engineering culture. They have

1:59

the globe's best automated rollout

2:02

canary system. They have so many layers

2:05

of verification. They have really good

2:06

engineers. They have manual code

2:08

reviews. and none of it. They have a

2:11

trust and safety team for God's sake.

2:13

Their trust, Instagram's trust and

2:14

safety teams is closer to 100 engineers

2:17

whose job is to keep this platform

2:19

secure. And you know, a few things

2:22

happened. The next day on Tuesday,

2:25

Meta's chief information security

2:27

officer sent an email saying, "I'm I'm

2:30

out. I'm quitting." This was very

2:32

interesting because Meta has just kicked

2:34

off a se an outage investigation. They

2:37

call it SEV inside of meta. And in the

2:39

middle of that and in even before it

2:41

concluded, the chief information

2:43

security officer stepping down. So I

2:47

asked around I I asked the people I know

2:49

at Instagram. I I happen to know people

2:51

on Instagram's trust and safety team.

2:53

Well, turns out they were only on trust

2:56

and safety team. So they even, you know,

2:58

shared me more details. You're hearing

3:00

this for the first time ever, by the

3:01

way. It's not an attack press. It

3:02

probably will be. It was AI. Of course,

3:06

it faking was AI. The thing that caused

3:09

the issue was AI written code that was

3:11

reviewed by AI and not humans at Meta.

3:14

And I'm thinking to myself, how could

3:17

have this happened at Meta? I mean, it

3:20

wasn't just AI. There's more to the

3:22

story. It was AI maxing, it was layoff,

3:24

and it was AI psychosis at Meta. And

3:27

what I mean with this is a AIX.

3:32

If in April I I wrote about this this

3:35

new trend called token maxing which was

3:37

happening across so many companies

3:38

including Meta, including Amazon,

3:40

including Uber, engineers were starting

3:43

to be measured on AI token usage at at

3:46

all these companies and they start to

3:47

inflate it. They just want to get to the

3:48

to the top leaderboard. They told the AI

3:50

let's do some like dumb stuff and you

3:52

know I get to more tokens but I I don't

3:54

need the work. And at Meta there was a

3:56

leaderboard and you could get status

3:58

like session immortal token and legend.

4:01

Uh in April meta killed this project but

4:04

but people were burning crazy amounts of

4:05

of things. Now AI usage inside of Meta

4:09

was part of performance evaluation.

4:12

It it wasn't like officially made up but

4:14

people inside of Meta are smart. They if

4:16

you had a low token count you know

4:18

that's not a great signal. So people

4:19

just start to inflate their token count.

4:20

So they start to use AI for anything and

4:23

everything. Write it by hand. Nah, why

4:25

why do it? Ask the AI. Read the

4:27

documentation. Nah, let let me use the

4:28

AI to to read it for me so it can just

4:30

burn a bunch of tokens. This is the

4:32

craziest thing that's happening, but you

4:34

know, inside a meta AI is free. And

4:36

again, these people want to have higher

4:38

bonuses. And they just use AI for

4:40

everything. Um, and yeah, the the code

4:43

that caused this SE was also AI

4:45

generated. Of of course, they use it AI

4:46

to review it as well. They use it to

4:48

triple review it, etc. The second part

4:51

to this thing was layoffs set meta. Meta

4:54

told the 10% of of of staff 8,000 people

4:58

will were laid off in 20th of May but

5:01

Meta told people or the press told

5:04

everyone that the layoffs are coming a

5:06

month before. So what people were doing

5:08

is as they were thinking oh am I going

5:11

to be laid off all of them they start to

5:13

use more AI because they didn't want

5:15

their token numbers to be down because

5:16

they didn't want to be fired for not

5:18

using enough tokens. You you see where

5:19

this is going, right? And they were not

5:22

really busy, you know, doing their work.

5:23

They were just worried about like, all

5:25

right, like let me get this inflated. So

5:27

inside of trust and safety team, people

5:28

were not thinking about trust and safety

5:30

were thinking about token maxing. And

5:32

finally,

5:36

I was wondering if I should call this AI

5:38

psychosis because psychosis is a very

5:40

serious psychological condition and

5:41

that's why I put it in brackets. But

5:43

I'll I'll show you why I I chose this

5:45

this name. Instagram had a tr thread a

5:49

trust and safety organization that was

5:51

built up over like seven or eight years.

5:53

A really good team mostly based in

5:54

London.

5:56

40% of this team before 20th of May was

5:59

reassigned to do manual data labeling.

6:03

They they were told on Thursday that

6:06

starting on Monday, you are no longer

6:08

working on this team. you are moving to

6:10

this new team in Alexander Wang's org

6:11

xscalei and you will be doing AI data

6:14

labeling which means you get these tasks

6:17

it's a GitHub GitHub pull request you

6:19

need to review it you need to add some

6:21

tests you need to add some feedback and

6:23

then then you do the next and then you

6:24

add some tests and you add some feedback

6:26

and you and you do the next these highly

6:29

skilled people they were not given a

6:30

choice now inside meta until now every

6:32

engineer was treated like royalty they

6:34

were given a choice they were not given

6:35

a choice so 40% of the organization just

6:37

boom gone There's five closer to 5,000

6:41

developers inside of Meta doing manual

6:43

AI labeling. And there's a running joke

6:45

inside of Meta that this is bigger than

6:47

OpenAI. This data labeling or Meta

6:51

clearly wants to build this amazing AI

6:54

model. Oh, and after the layoffs and

6:57

after the reassignments, most teams are

6:59

less than half the size. Some don't have

7:00

on call coverage anymore, which means

7:02

that in some services, there's just no

7:04

one picking up on call. This again has

7:06

never happened inside of Meta. And this

7:08

is what I mean by AI cycles. This is

7:09

fully self-inflicted. This is coming

7:11

from Mark Zuckerberg. This is coming

7:12

from Alexander Wang. This is coming from

7:14

the top. They're saying we don't care.

7:16

We it's so important for us to build

7:17

this model that we will risk our

7:20

business and we don't care if you know

7:21

we get hacked or something like that.

7:23

Morale is as low as has been in in Meta.

7:26

I've I've seen low morale. This is way

7:28

worse than the 20 2022 203 layoffs. Uh,

7:33

and oh, and yeah, if this wasn't enough,

7:35

in the US, they're recording your

7:36

screen. They're recording all your

7:38

screen strokes to train an AI. So, I uh,

7:41

it's the easiest time to hire to recruit

7:43

from Meta right now. Uh, and the

7:46

engineers that I talked to, they just

7:47

feel super let down. Meta used to treat

7:50

engineers like royalty and salary,

7:51

composition. You you could choose your

7:53

team. It was a good world event. And the

7:55

CEO, Mark Zuckerberg, he is a software

7:57

engineer. He wrote a lot of Facebook's

7:59

code. and they feel we don't matter

8:01

anymore. We're tools. We've been thrown

8:03

away. Uh a lot of people are are have

8:06

been given large retainer bonuses who

8:08

have not been fired. You stay. We're

8:10

giving you money. They are still

8:11

interviewing and they told me they're

8:13

interviewing not because of the layoffs

8:14

because they know they can find a job at

8:16

Meta. You know, these are super highly

8:17

paid people. They they can get a not as

8:20

highly paid jobs. They're in demand. But

8:22

they said, "I don't know if I'm going to

8:24

be assigned to data labeling." And as a

8:26

professional, I did not sign up to

8:28

become a manual data labeler. And a

8:31

bunch of my colleagues are doing that

8:32

and interviewing. So Meta is destroying

8:34

their engineering organization that

8:35

they've built up over 22 years. And I

8:39

think this might be end of the

8:41

incredibly strong Facebook engineering

8:44

culture that I know and I I I've learned

8:47

to actually love even though I've never

8:48

worked inside of Facebook and so many of

8:50

my friends have. So this is because of

8:53

AI. Now, not all companies are like

8:56

meta. This is pretty extreme, but it's

8:59

happening. It's happening right now. The

9:01

these are these are facts. But the

9:03

industry has a pretty interesting time.

9:06

And today, I want to talk about this. I

9:07

want to talk about what how everything

9:10

has changed in the past six months when

9:12

it comes to software engineering or or

9:13

well at least coding.

9:15

I'm going to give you a tour of the tech

9:17

industry of what what other tech

9:18

companies are doing. I'll give you a

9:19

brief tour uh because this is what what

9:20

what my head is in in day in day out.

9:23

And again, I'm I'm I talk with a lot of

9:25

these people. I I visit these companies.

9:27

I'm friends with a bunch of them. And

9:29

then I'll share a few trends that are

9:31

happening across the tech industry. And

9:33

then I'll close with advice to software

9:36

engineers and engineering leaders on how

9:38

we can navigate to prepare to to do the

9:40

best that we can and and also just you

9:42

know come out of this whole thing

9:43

stronger.

9:45

So everything has changed in this past

9:47

six month. This is a pretty dramatic uh

9:49

uh thing to say and but

9:52

it it it it has changed. So uh DHH David

9:56

Hellmire Hansen, creator of Ruby on

9:58

Rails, he was on my podcast in February

10:01

and and he told me that he actually

10:04

wrote this uh on on Twitter that just in

10:06

summer 2025, he spoke with Lux Freedman

10:09

in October and he said that AI was not

10:12

writing any of his his code directly.

10:14

But part of his resistance resistance

10:16

was that the models were not good enough

10:18

and it has now flipped by February.

10:22

Most of his code is being written by AI.

10:24

Now this is a person, you know, he's a

10:25

he's big into software craftsmanship. He

10:27

is not paid by any lab, but he decided

10:30

the models are now good enough. They

10:31

write better code than I can. He

10:33

actually told me this on the podcast. So

10:35

I I listen to to people like DHH uh in

10:38

in this sense. Simon Willis is someone

10:40

who is the one of the most uh quoted

10:43

person on Hacker News. He is an

10:44

independent software engineer. I love

10:46

Simon. Uh he uh he's he's also a friend.

10:49

Uh he created Django and he writes this

10:52

really good daily newsletter pretty much

10:54

where where he just experiments, he

10:56

builds open source and tries out all the

10:57

models. And he said that the models

10:59

released in November 2025, specifically

11:01

Opus 4.6 and GPT 5.4 uh have elevated

11:05

agents to being genuinely useful. we've

11:07

had the six months to get used to this

11:08

idea now. So, no wonder that companies

11:11

are now starting to spend big money to

11:12

spend this. So, he's also saying that

11:13

it's has changed. I got some data from

11:16

some of our partners, my friends at

11:18

Linear uh shared this data never never

11:20

shared before on how

11:24

how t how teams are using now agents to

11:28

ship more code. They are comparing teams

11:30

that are on linear and they're not using

11:32

AI agents and teams that are and by now

11:34

the teams that are using agents are

11:36

shipping five times as more code. We'll

11:39

talk about quality later but th this is

11:41

massive 5x increase. I mean we've

11:43

probably had five increp

11:47

like 20 years before and this is in less

11:49

than two years. uh

11:53

friends at cursor have shared uh details

11:56

on how devs using cursor are changing

12:00

the lines of code they produce in a year

12:02

and in a year it has gone up by almost

12:05

two and a half times from three up 4,000

12:08

lines of code to more than 8,000 lines

12:10

of code just on cursor so you know we're

12:12

we're seeing this acceleration the size

12:15

of PRs also from cursor is up by 3x so

12:18

if you combine those two that's six

12:20

times as much code and you know a lot of

12:22

you are kind of like I see smiling I we

12:24

know that there's six times as many bugs

12:26

yeah we'll again we're going to get

12:28

there

12:30

and also data from cursor the percentage

12:33

of devs using cursor who are accepting

12:37

changes from the AI without any manual

12:40

review is massively up in January this

12:43

is when opus 4.7 came out uh GPT 5.5

12:46

came out and what a lot of companies

12:48

realize that clock code cursor codecs

12:51

They're actually really really useful

12:53

and they're starting to trust it. And

12:55

again, remember when I told about you

12:56

about meta

12:58

merging to production without human

13:00

review? Yeah, that that was somewhere

13:02

there. So, what are tech companies doing

13:05

right now? And let me give you a bit of

13:07

a tour of the industry. So, uh at

13:08

Entrophic, I I visited their offices

13:10

last fall and I I talked with Boris

13:12

Churnney just in February, the creator

13:14

of Claw Code. And here's what they're

13:15

they're they're doing. Uh Boris

13:17

specifically runs five parallel agents

13:19

on his laptop all the time. He ships 20

13:21

to 30 pull requests a date and this is

13:23

on top of leading all of quad code. He's

13:25

very much a hands-on leader. He told me

13:27

that the PRDS writing documents to plan

13:29

are dead. They're using prototypes

13:32

across entropic to replace them.

13:35

Today 100% of cloud code is generated by

13:38

cloud code. Inside Entrophic is not 100%

13:40

but it's closer to 70 to 90% and there's

13:42

no target. This is just people using it

13:44

again but this is entropic. we shouldn't

13:46

be too surprised. Uh and then the

13:48

company built cloud co-work in only 10

13:51

days. Uh and it's become a massive

13:54

commercial success for them. Uh it

13:56

generates so much revenue. In fact, I

13:58

have some sources inside of Microsoft.

14:00

Microsoft tried to build a cloud co-work

14:02

because cloud co-work is really good for

14:04

for Excel and Windows to use it on

14:06

machine. Microsoft still doesn't have an

14:08

answer two and a half months later. I

14:10

heard that Sacha Nadella gave a deadline

14:12

of a month to this team to build it and

14:14

they couldn't build it. So don't forget

14:16

that there's differences between

14:17

companies and traffic is accelerated by

14:20

AI. Some companies are kind of held back

14:23

despite AI like Microsoft and again

14:25

we'll talk a little bit about that as

14:27

well. Open AI open AI also at uh a

14:31

friend from uh the pragmatic summit uh

14:33

in San Francisco in February. That's us

14:35

on stage uh with him and the Codex team.

14:37

We talked about a bunch of stuff and and

14:39

what he told me is uh some interesting

14:42

stuff. They have inside of OpenAI they

14:44

they have an internal version of the

14:45

chat GPT app and they have fix it

14:47

button. You can literally just take a

14:49

screenshot and say fix this bug and it

14:52

goes to codeex. It generates a a pull

14:55

request and an engineer can merge it. In

14:57

fact, even a non-engineer can merge it

14:58

and there's safety nets there. AI code

15:01

review obviously is everywhere. They

15:03

have multiple layers of it. uh they have

15:05

tiered versions. There's some code that

15:07

can go in with just AI code review into

15:09

production and there's some code the

15:10

critical path that humans need to

15:12

review, engineers need to review. Uh

15:14

most devs obviously run several agents.

15:17

There's this joke that uh when you're

15:19

walking around engineers are bringing

15:20

their laptop and it's slightly open.

15:22

It's slightly open so the local agent

15:23

can still keep keep running. And when I

15:27

was I did a video interview uh with one

15:30

of the OpenAI folks and I was just

15:32

jokingly asking like, "Oh, so like

15:34

throughout this interview, did you have

15:35

agents running?" He's like, "Did you

15:38

have an agent running?" He's like, "I

15:39

didn't have an agent running. I had

15:40

five." And I was like, "Oh, okay." Like

15:43

it's it's common for people to go into

15:44

meetings and their agents are running.

15:46

They're thinking about agents. They they

15:47

keep it on track. Like again, but these

15:49

are they are the most AI pilled people

15:51

in the industry. And of course, you

15:53

know, they they greatly believe in all

15:54

this. They all talk about AGI and and

15:56

when it's coming, not if it's coming.

15:58

But this inside of them, most people

16:00

don't really write code inside of

16:02

OpenAI. This has changed in October.

16:04

They still like there were devs who

16:05

wrote 30% of their code and 70% with AI,

16:07

but 30% by hand. And I think it's just

16:09

slowly going away. The Codeex team

16:11

obviously writes it all with Codex. And

16:13

they're telling me that taste, knowing

16:15

what to build is becoming pretty

16:17

important uh in inside the company.

16:19

Codeex also improves itself as as a fun

16:22

fact. It tests itself all the time. It

16:24

runs all the tests overnight. They kick

16:28

it off because most of the team is in

16:30

San Francisco. So it's one time zone. Uh

16:32

they have codeex run itself and look for

16:34

ways to improve itself. And by the

16:36

morning it comes up with improvement

16:37

suggestions which they either accept or

16:39

or reject. And when they have meetings

16:41

and debugging sessions when they start

16:43

the meeting they have voice notes that

16:45

they send to codeex as it goes and it

16:47

comes back by the middle or end of the

16:49

meeting with like results. It's it

16:50

sounds like science fiction, but again

16:52

that that's how they're working inside

16:54

of cursor. I I visited their office in

16:56

October in in San Francisco. Um they

16:59

they have you take off your shoes and

17:01

it's sometimes it's a mess, sometimes

17:02

it's super organized. There's like a

17:03

sorting algorithm invisibly happening

17:05

inside of their office. It's it's really

17:07

interesting slashcool. Uh but they're a

17:09

very nice group of of folks. Uh they

17:11

have gone all in on agents as of January

17:13

as well. They're like it used to be all

17:15

tabs and the editor. They're kind of

17:17

like moving on to agents. They still

17:19

have the old old experience but it's

17:20

increasing the old one. They they built

17:22

their own coding model. They're one of

17:24

the only companies outside of open air

17:25

and traffic who have a really good

17:26

coding model. I have no affiliation with

17:28

cursor. Uh but their composer model is

17:30

cheap which is going to be important as

17:32

as I'll talk about it. Uh and they

17:36

operate tens of thousands of NVIDIA GPUs

17:39

in massive data centers. They're leasing

17:41

it from Azure uh AWS and so on. And most

17:45

of their inference used to be uh

17:47

inference used to be so generating the

17:48

the response. It used to be their

17:50

biggest cost, but now they're also

17:51

training their models. So they're kind

17:52

of turning into this mini AI lab. And of

17:54

course now SpaceX is about to purchase

17:56

them or not or who knows, but it it

17:58

seems it's going to happen. Uh they're

18:00

also just everyone at Cursor is

18:02

technical. This is Lee Robinson

18:03

developer relationships at at Cursor. He

18:06

wrote u with Cursor. He migrated all of

18:09

cursor's sites to a different CMS with

18:13

and of course you know he's sharing how

18:14

how much he's cost to show that it's

18:16

very economical but this is this is not

18:17

a software engineer by job and everyone

18:20

a cursor is like that so these labs are

18:22

everyone goes there Google uh briefly

18:26

everything is custom at Google

18:27

everything including their ID Google's

18:29

internal ID is called cider they have

18:32

strange names for everything it used to

18:33

be a web-based tool now it's a visual

18:35

studio fork uh they have a thing called

18:39

jet ski which is anti-gravity but the

18:41

internal version which is integrated

18:42

with their their monor repo piper and

18:45

all of their other internal systems uh

18:47

they have critique a code review tool

18:49

which again they don't use github they

18:51

don't use all these everything is custom

18:52

inside of Google AI is of course

18:54

integrated gemini is integrated nicely

18:56

in there they have code search which is

18:58

the source graph for rest of the world

19:00

in fact source graph got inspired by

19:01

Google has some of the best code search

19:03

inside of Google they don't they don't

19:05

make it available uh uh outside and they

19:08

Google has so many internal systems.

19:11

Borg which is their version of

19:12

Kubernetes uh Monarch which is their

19:14

version of data dog uh many many more

19:17

piper their version of monor repo AI is

19:19

integrated into all of these things and

19:21

it's all integrated together really

19:22

really nicely so inside it's a really

19:24

good experience only problem inside of

19:26

Google is Gemini is just not as good as

19:30

Opus or GPT 5.5 and inside of Google

19:33

whenever engineers can use cloth code

19:34

they do but only they can only use it

19:36

inside the Gemini or which means that

19:38

Google doesn't have as good of adoption

19:41

of AI than some of the other companies.

19:43

Kind of weird, but they're working on

19:44

it. The CEO knows, he admitted it. They

19:46

want to get a better model about it.

19:50

And finally, Meta uh they they want to

19:52

build their state-of-the-art AI model.

19:54

Everything is about this. Uh they do

19:56

have an internal tool like Metamate.

19:58

That's their that's their AI tool for

20:01

coding. They have this thing called

20:03

trajectories. Whenever you you know when

20:06

you see GitHub commits inside of Meta,

20:08

you see the exact prompt that people

20:10

did. They rolled it out in December and

20:12

people in Meta got upset because no one

20:14

told them this would be public and you

20:16

could see like you know like staff

20:18

engineers saying like can you write me a

20:20

for loop and it it was all public and

20:22

everyone could see it. So some people

20:25

inside of meta, I talked with this dev

20:26

and he said like, you know, I started to

20:28

write my my my uh my uh chats with the

20:32

meta AI the code generation in Polish

20:35

because fewer people can read it now.

20:39

Okay, it but you know right now at Meta

20:41

they have bigger things to to worry

20:43

about. Uh this force reassignment to

20:45

build AI model force tracking of

20:48

everything. It's clear meta Mark

20:49

Zuckerberg wants Meta to have an model

20:51

that's better than Opus 4.8. eight. I

20:53

think either he's going to get it in a

20:55

few next few months or all of meta is a

20:58

lot a lot of meta is going to be like

21:00

disb not not disbanded but very very

21:02

demotivated.

21:04

Uh Uber my old company uh I talk with

21:08

them in detail. I have a deep dive on

21:10

the primatic engineer if you're

21:11

interested in learning about more of

21:12

these details. They built so much

21:14

in-house tooling and a lot of companies

21:15

do this but I'm just going to like

21:16

quickly show you how much in-house AI

21:18

tooling a company like Uber built. Uber

21:20

has about 3,000 engineers. So, just keep

21:23

that in mind. They have an AI, well,

21:25

they have a developer experience team

21:26

who is now pretty much an AI experience

21:28

team of like about 20 people or so. So,

21:30

they built an internal MCP gateway.

21:32

Pretty clear. You can, you know,

21:33

discover, register, do all do all sorts

21:35

of jazz. They built an Uber agent

21:37

builder, which is a no code way to build

21:39

agents for the rest of the business.

21:40

They have an Uber agent studio where you

21:42

can like drag and put together your

21:43

agents. Again, there's uh OpenAI has

21:46

something like this publicly. That's

21:48

open a As a Asian builder, but it's it's

21:49

for the nontechnical folks. They have

21:51

Uber Asian Builder Registry, which so

21:53

Uber is 3,000 engineers, but 20,000

21:55

other people. Those 20,000 people use

21:57

this thing. They create this stuff, they

21:58

plug it up, and engineers built this for

22:00

them. Uh Uber has an AI FX CLI. I'm just

22:03

going to call this the cloud code for

22:05

Uber pretty much. They built it

22:07

themselves, integrated with all their

22:08

system using all the different models,

22:10

etc. They have Uber Minion, which is

22:12

running background agents at scale. Uh

22:15

so you can again this is sim similar

22:17

thing as cursor background agents except

22:19

it's integrated into Uber's monor repo

22:21

and experimentation system called

22:22

morphus and and all of the other jazz

22:26

really really nicely and it works a lot

22:28

better. So even though devs can use

22:30

cloud code they will use minions because

22:32

it just works better and faster. For

22:34

example uber minions when you give it a

22:36

prompt it will analyze it and it will

22:37

give you a suggestion that ah these

22:39

prompts could work better results faster

22:41

cheaper etc. So this clock doesn't have

22:44

this yet. They have Uber code inbox. Uh

22:47

people are getting so many AI so many

22:49

pull code reviews that are are now you

22:51

know mostly AI reviewing code that

22:54

they're creating a system to show this

22:56

one needs your attention. This is

22:58

important. Focus on these things. So

23:00

people when they get into work they

23:01

start going through these things.

23:02

They're trying to make code a bit more

23:03

fun. They have something called smart

23:06

assignments where there's SLAs's where

23:09

you need if this is not this person

23:11

doesn't respond in like a day it goes to

23:14

the next one. It's a bit like on call

23:15

tooling again all all custom. They have

23:18

risk profiles. They will try to identify

23:20

this code change looks faking risky. You

23:22

need to you know like look at this

23:24

closer. And they have U review which is

23:28

the code rabbit or the uh the the sonar

23:32

uh for for for

23:35

Uber's internal again all all custom

23:37

work. So they build all this MCP agent

23:40

builder CLI minions etc. And the other

23:43

large tech companies they're doing the

23:45

same. I'm not going to run you all this.

23:47

Stripe has minions tool shed blueprints.

23:48

Z boxes ramp has inspect glass dojo

23:51

sensei. Sensei is a funny one. Shopify,

23:54

Sidekick, LM proxy, dev MCP server,

23:56

Airbnb, One everything, Catalyst and so

23:59

on. They all build their own own stuff.

24:01

Uh they have a dedicated infraorg

24:04

building all of these for all these

24:05

companies. So if you thought, you know,

24:07

you're pretty cool for like integrating

24:08

Slack into into integrating AI agent

24:11

into Slack, you are pretty cool. But

24:13

this is this is next level. I talk with

24:16

a bunch of startups and I'm not going to

24:18

go through all of them, but the general

24:19

trends I I see there uh it's kind of the

24:21

usual agents are are doing coding, doing

24:24

code review. There's a bunch of

24:25

creativity mostly about Slack. You know,

24:27

people tax Slack. I I saw a startup

24:29

recently that raised $70 million uh in

24:32

series B. They just told the agent like

24:34

fix all bugs in the codebase. Haha. And

24:36

everyone's laughing in Slack. And then

24:38

the agent came back like, "Oh, I

24:39

actually found like four critical

24:41

authentication issues where your back

24:43

door was wide open." And people were

24:44

like, Okay. I mean, that's that's what

24:47

startups are. They they didn't know like

24:49

their how their house is exposed. Uh uh

24:52

they're they're usually plugging in the

24:54

AI agents, integrating them, and some of

24:56

them are having fun vibe coding SAS. I

24:59

think it's just engineers having fun. I

25:00

don't think it's really a business

25:01

thing, but it's it's it's it's I only

25:03

see this inside of startups, not really

25:05

inside of big companies. And inside

25:07

traditional companies, so this is the

25:08

most interesting thing. It's all the

25:10

same. I mean, not the level of Uber.

25:12

They don't have dev platform teams, but

25:14

they are not really lagging behind. Uh,

25:16

for example, Cisco rolled out Codeex to

25:19

18,000 engineers back in January when

25:22

Codex was pretty small and they're doing

25:24

a bunch of complex migrations. JP Morgan

25:26

Chase built a multi- aent framework,

25:29

which is a fancy way of saying that it

25:31

just uses multiple specialized agents to

25:33

label customer interaction data. They

25:35

use evals, judgebased aggregates. Like,

25:38

it's it's kind of cool stuff like even

25:40

inside of these companies.

25:43

So this is what's going on inside. Now I

25:45

want to give you some of the trends that

25:48

I see crosscutting everywhere or most

25:51

mostly everywhere.

25:53

One of the big things that comes from

25:55

Laura Tacho. Uh this is me at the

25:56

pragmatic summit with Laura and and with

25:58

Martin Valor in San Francisco. She uh I

26:02

I messaged her last actually last night

26:04

and she replied this this morning. Uh I

26:06

was asking what do you see Lara? Uh

26:08

because she was C2 at DX. she's now uh

26:11

heading up pretty much developer

26:13

experience at AWS and she said that many

26:15

organizations get stuck uh not seeing

26:19

they see individuals doing great but the

26:21

teams are not like the team output is

26:23

not there and she said is because they

26:26

are thinking about AI as a productivity

26:28

tool for engineer for individuals and

26:30

she calls it of the individual speed up

26:32

juice things like email summaries slack

26:34

automations even code generation

26:37

however the companies that are moving

26:40

faster and they're seeing the result.

26:42

For teams, they are doing something

26:44

different.

26:46

They begin with a business outcome. For

26:48

example, I want to deploy to production

26:52

faster or I want to push more features

26:54

out with the same quality or I want to

26:56

improve quality. Spotify is a very good

26:59

example. We don't hear too much about

27:01

Spotify, but I talked with their CTO

27:03

about a month and a half ago. We had

27:05

lunch and he told me that their quality

27:08

for their their bar for using AI is the

27:12

quality needs to stay the same. So

27:14

they're not seeing a huge increase in

27:15

output but they have built a lot of

27:18

internal tools to check for the quality

27:20

and they're slowing down the rollouts of

27:22

AI versus you know what Meta is doing or

27:25

whatever they're not doing. And again,

27:27

that was their goal at Spotify. And

27:29

Laura was saying that you need you want

27:33

to build an agentic system that reduces

27:35

handoffs, that makes it easier to find

27:37

information and removes friction while

27:40

maintaining quality. That last part is

27:42

very important. Few companies do that.

27:45

And and you know, maturity comes from

27:47

applying AI to the system and not the

27:49

individual. And a lot of people are

27:50

focusing on the indiv individual and

27:52

that's why we're not seeing it. And she

27:53

wrote this mental model. She created

27:54

this. uh she was saying most companies

27:57

are in this thing where when you have AI

27:58

usage that is either individual or team

28:00

level and decision-m that is either

28:02

simple automation or agentic systems

28:04

most companies are in this bottom uh

28:07

left corner where you have individuals

28:10

doing simple automation where most

28:12

companies want to be is where they have

28:14

team level agentic systems but to get

28:17

there you need to do what I've shown you

28:19

Uber to do you you need to build a lot

28:21

of systems that integrate you need to

28:23

iterate on this it takes time. It takes

28:26

a massive investment. You're not going

28:28

to be able to buy claw code or cursor or

28:30

whatever vendor tells you to do that uh

28:32

that it does it because you need to

28:33

build it into your system with your

28:35

engineers. That's what Uber is doing for

28:37

sure.

28:39

Now, other trend token maxing and

28:41

tooling addiction. Um

28:44

hopefully some of you might be doing it,

28:46

some of you might not. It's going out of

28:47

style by the way just just I'm talking.

28:49

There is just a big pressure to look

28:51

productive and to not have a low token

28:53

count, especially inside of US tech

28:55

companies that don't really care about

28:56

budget until they do. But right now,

28:58

they some of them still don't. It's it's

29:00

it's ending. A token maxing is is when

29:03

you're just burning all these tokens

29:04

without value shipped on purpose. And

29:06

again, I I've talked to this happens at

29:08

Meta, Amazon, even in Microsoft

29:10

everywhere where they have internal

29:11

leaderboards. Microsoft still has it. I

29:13

don't know why they're not shutting it

29:14

down. They should listen to me. Uh there

29:18

uh also the pricing of these tools feels

29:20

a bit of addictive. You buy the $10 plan

29:22

or the $20 individual plan and then you

29:24

run into a limit and a generous limit.

29:26

But then you run to a limit and then

29:28

you're like ah let me buy the $100 plan

29:30

or the $200 plan. And once you buy it,

29:33

you now feel pressure if you're buying

29:34

it for yourself that you're not using

29:36

your your allowance. So you're starting

29:38

to use it more. And next thing you know,

29:40

you went out and you're now on on API

29:42

pricing. And also with every prompt once

29:45

you start using the AI agent the first

29:47

few months it's a bit like it's gambling

29:48

for some people get sucked into it

29:50

really like gambling. It's just one more

29:51

prompt one more prompt. People are not

29:53

sleeping that well. You're you're waking

29:55

up and thinking about your agents. If

29:57

you're paying if you're uh your company

29:58

if you're paying out of pocket you feel

30:00

AI being wasted. It's it's it's weird.

30:02

It's addictive.

30:04

Another trend is middle management

30:07

managers are just being cut either laid

30:10

off or inside of meta reassigned to

30:12

individual contributors or being told

30:15

you you need to be hands-on meaning you

30:17

need to manage less and and do more more

30:19

work. uh there's just a flattening

30:21

happening and the interesting and a and

30:24

whenever a management is fired or or

30:27

laid off it's said oh it's because of AI

30:28

whatever it doesn't help but the

30:31

interesting thing about this is

30:34

what happens if we have less middle

30:36

management I mean it's popular to hate

30:38

on middle management on managers senior

30:40

managers and directors top level

30:42

management is a sea level the CTO and

30:44

the middle management is everything in

30:45

between uh maybe until front line

30:47

management engineering management and

30:48

you know usually we don't know what

30:50

directors do uh or or if they're

30:52

necessary. However, in my experience,

30:55

good middle management, good directors,

30:57

good senior entry managers, they are

31:00

very technical. They could be hands-on,

31:02

but they choose not to. But they listen,

31:03

they see what's happening. They pay

31:05

attention and they make small changes.

31:07

Ah, there's a lot of outages we're

31:09

having right now. And software engineers

31:10

will just pile on and and do nothing.

31:12

They will stop and be like, "Okay, let's

31:13

create a task team. Let's build this

31:15

system. uh you you get I will pull you

31:17

off these teams and we'll make our

31:18

engineering culture better. Good

31:20

engineering management improves

31:21

engineering culture and a lot of

31:23

companies are getting rid of engine

31:25

management or or bidd management and

31:27

engineering culture will go down. This

31:30

is a fact as far as I'm concerned.

31:34

Another interesting trend at the same

31:36

time CEOs and CTOs are back to coding.

31:38

uh Gillor Moranch uh founder and CEO of

31:41

Verscell. I I had a lunch with him on on

31:44

one of the investor events in in

31:46

February as well. uh he was right saying

31:50

recently that he is seeing so many cos

31:53

and CTOs are back to coding with a fury

31:55

with all this enthusiasm and he has

31:58

public company CEOs DMing him saying hey

32:01

we're using Versell or cloud code and

32:03

you know like I'm I'm doing it I'm so

32:05

excited again and this is all the time

32:07

while we're having less middle

32:08

management now imagine having less

32:09

middle manager to protect engineers and

32:11

the co and CT are coding vibe coding and

32:13

they're saying oh it's they think it's

32:14

complete but you know it's it's not

32:15

really complete

32:17

a mega trend that is happening like and

32:21

it starts to like I noticed this a week

32:23

two weeks ago. So, I wrote about it a

32:25

week ago and then today uh

32:30

like to uh hold on and and then today I

32:35

I see uh Sam Alman, this is just from

32:40

this morning saying that he is noticing

32:44

that AI budgets are seemingly become a

32:47

huge issue for some companies and

32:48

something that has come up and something

32:50

that has never happened before. And I

32:52

was pinging people at OpenAI like does

32:54

he read my newsletter because I wrote I

32:56

I wrote about this last week for

32:58

subscribers and someone open said like

33:00

someone posted into Slack and like Sam

33:02

read it and but it's happening and this

33:04

is coming out of the blue. There's this

33:06

joke going around as of yesterday on

33:09

Reddit saying hey uh oh baby I see

33:12

$15,000 are gone from your from your

33:14

shared account. Like is this what I

33:16

think it is? engagement Frank.

33:22

Yeah, I I feel for that guy. He's soon

33:25

going to be single,

33:27

assuming it's it's it's not a joke. Uh

33:30

but it's it's happening and it's getting

33:31

worse. Uh Antropic has turned on API

33:35

pricing for enterprise customers,

33:36

meaning anyone who's not a startup or an

33:38

individual is not getting discounts.

33:40

GitHub Copilot turned it on just two

33:43

days ago on the 1 of June and people are

33:45

pissed because they are have burned

33:47

through their usual budget of let's say

33:49

$200 or or however much it was in three

33:52

days that used to take a month and they

33:54

are and this is hitting everyone right

33:56

now. Everyone will be paying a lot more.

34:00

Now Uber is an interesting case again

34:02

because in March their CTO uh said that

34:07

they have burned through the whole

34:08

budget for the year with AI costs and we

34:11

were wondering what they're going to do

34:12

but we now know they are now setting a

34:15

cap of $1,500 $1,500 per month per

34:19

engineer on AI and if you hit that

34:21

you're going to use the free models and

34:24

I've been doing research this is what a

34:26

lot of companies are doing a lot of

34:27

companies not doing this much some doing

34:29

$200 and then you're going uses zero

34:31

models on GitHub copilot and now

34:32

engineers want to do it but this is a

34:34

very very fresh trend costs are it's

34:37

ridiculous when it's as much as an

34:38

engineer and no one no one wants to pay

34:40

that no matter what the AL apps say

34:43

and finally some trends across the

34:44

software craft we've talked about like

34:46

kind of business trends and and and AI

34:48

trends but what is happening to software

34:49

engineering and and the craft the

34:50

conference that we're here one is a huge

34:53

drop in quality everywhere this one

34:55

comes from yours truly that's my account

34:58

I was so pissed off at claude.ai,

35:02

their flagship website, for about a

35:03

month for a month. Every time I went to

35:06

the website, this is the website itself.

35:08

Uh I I did a screen recording after I

35:10

got pissed off enough uh because it kept

35:12

happening and no one was fixing it. You

35:14

went to the main website, cloud.ai, and

35:16

I immediately start typing my my quote.

35:18

And here I'm starting to type, how can I

35:20

do this? And as soon as I type, how can

35:22

there's a refresh? Now, there's a React

35:25

uh life cycle component happening here

35:26

where the page finally refreshes and it

35:28

loses all that I've typed before and I

35:32

maybe I'm old school. I use the website

35:33

so much it just kept happening and

35:35

happening and finally I tweeted about it

35:37

saying like how on earth does Entro oh

35:39

and I'm paid user. I'm not a free user.

35:41

There's millions of people hitting this

35:43

every single day and Entrophic doesn't

35:45

care and they're building AGI. So, I

35:47

tweeted about it. Uh and the product

35:49

manager on the team said, "Oh, great

35:51

feedback. I dug into this. this it will

35:53

be fixed. This is the short way of

35:54

saying, "Oh, thanks. We have no clue

35:56

that millions of people every day are

35:59

doing this. Oh, and we are not even dog

36:00

fooding our own stuff." And this was

36:02

there for a month. So, and oh, and we're

36:04

the fastest moving and biggest and most

36:06

profitable company, but we don't like a

36:09

a bank does so much better in this

36:12

sense. There's not these I mean, we can

36:15

argue if if they fix it that quickly,

36:16

but and they did fix it eventually, but

36:18

this is entropic. And and it's not just

36:20

entropic. Open AAI OpenAI

36:24

bragged about how they built this

36:25

amazing agent builder that is similar to

36:27

Uber's internal agent builder in only

36:29

six weeks with one engineer with, you

36:31

know, codecs. Amazing. Great. Um,

36:34

quality is terrible. People on launch

36:37

tried to use it and they kept running

36:39

into so many issues. Their forum is full

36:41

of of comments which are unresolved.

36:44

OpenAI did not come back and fix it.

36:46

This is from three months after launch.

36:48

someone saying I was bullish on agent

36:50

builder when it came out but for example

36:53

P 0 type bugs are not getting fixed or

36:56

takes ages it just seems like

36:57

abandonware so I mean was it worth it

37:00

for them building this thing and then

37:01

just forgetting about it and AI clearly

37:03

didn't help build higher quality

37:04

software it's faster but it's just

37:08

Amazon uh

37:11

a AWS

37:14

an engineer allowed the internal Cairo

37:17

AI coding tool to make certain changes

37:18

and the agent opted to delete and

37:20

recreate an environment inside of Amazon

37:22

causing a massive outage. Amazon had AI

37:26

bugs that were happen because the AI

37:28

generated code where Amazon stores their

37:30

com's flagship website part of it went

37:32

down. This never happened with Amazon.

37:34

Same thing as it never happened with

37:36

with meta and this is over reliance on

37:38

AI or not caring about quality. Amazon

37:40

has has made this change uh that it now

37:42

requires a senior engineer to review any

37:44

AI generated change because they realize

37:46

the junior engineers will just say looks

37:48

good to me and it causes an issue.

37:50

Open code uh is the leading AI hardness.

37:54

Uh they're they're like the cloud code

37:55

for open source and they use all

37:57

different models. Daxrad is the founder

37:59

and I love DAX because he's super

38:01

honest. They are building a super

38:02

popular AI tool. They have almost a

38:04

million daily active users. They're

38:06

growing. They've grown 10x since the

38:07

last four four or five months and he's

38:09

very and he doesn't he's kind of

38:11

skeptical of AI hype but this is a guy

38:13

who's built developer tools but it's I I

38:15

love Daxis he's really authentic on my

38:17

podcast just last week he told me we're

38:20

shipping way more hacks where we should

38:22

have first rethought the whole system

38:24

from the ground up redesigned it to make

38:26

more flex make it more flexible so I

38:28

think our judgment meaning the open code

38:30

team's judgment is off and he was also

38:32

saying how you know we're in the AI

38:34

coding tool space but you know what's

38:36

not happening?

38:38

No competitor is beating us because

38:40

they're using AI better than we do. And

38:42

he said that frankly, I don't think

38:44

we're using AI that well. Like we're

38:47

actually telling ourselves to use less

38:48

AI and there's no competitor that is

38:51

beating us because they're doing faster.

38:54

In fact, they're kind of winning because

38:55

they're still one of the most quality

38:57

harnesses because they're slowing down.

39:00

Do you know what is a contradiction?

39:02

a CEO and founder of an AI company

39:04

saying we need to use a bit less AI and

39:07

he he actually told me we need to do

39:09

more thinking we should build fewer

39:11

things and build the things that matter.

39:14

I'm paying attention to him

39:21

I'll I'll

39:23

I'll send that to Dax. And another trend

39:26

related to this is just everything is

39:27

broken. Uh GitHub is is such a prime

39:29

example. Uh this was two weeks ago. all

39:32

your poll requests were gone on GitHub

39:33

for about 8 to 12 hours. Uh there's a

39:37

there's an alternative GitHub uptime

39:39

tracker. I think it's you just have to

39:41

search for the actual the missing GitHub

39:43

status. Uh something like that which

39:45

tracks all outages that they report and

39:47

it estimates and B based on this

39:48

estimate they don't even have one nine

39:50

which is means they're down some part of

39:52

GitHub is down 10% of the time which is

39:53

absolutely unserious but this is a

39:56

serious company. I talked with the

39:58

GitHub team. I talked with their COO and

40:00

they gave me data that they didn't give

40:02

anyone else because they published

40:03

graphs without the numbers but they gave

40:04

me the numbers and they told me it's

40:06

because of the load. Now the load is

40:08

this. It is a 3x load increase over 2

40:11

years time. And they were like, oh, you

40:13

know, like this is a huge load increase.

40:15

We could have never prepared for that.

40:16

And I'm saying

40:19

really

40:21

that's it. This is bringing GitHub down

40:24

to nines. I I'm I do not buy this. Maybe

40:29

there's other things, but something was

40:31

really broken inside of GitHub. I'm not

40:33

going to say this is AI generated code

40:35

but if GitHub cannot

40:38

deal with a 3x increase over two years

40:40

and sure this will be 5x increase later

40:43

you're doing something wrong guys like

40:46

other startups pick up this load

40:48

laughing and there there's there's

40:50

details github has a has a Ruby on rails

40:54

model and so on and so forth but yeah um

40:57

it's just breaking and uh Mario Zechner

41:00

the creator of pi which is what powers

41:02

open code uh this is the Austri it's

41:04

with Armenure the Austrian AI mafia who

41:07

are on my podcast he told me it just

41:09

feels software has become a brittle mess

41:11

everywhere 98% uptime feels like the

41:14

norm on most services user interfaces

41:17

have the weirdest bugs I showed you one

41:18

and on on on cloud but it's everywhere

41:21

and he says that I give you that it's

41:23

been the case for longer than agents

41:24

exist we've always had it but it feels

41:26

to be accelerating everywhere you feel

41:29

you see this I even saw with modar

41:31

telecom the other I don't think I was AI

41:33

generated because I don't think they use

41:34

AI but yeah I had a big like software

41:36

issue with them and I needed to call

41:38

customer support.

41:40

One more trend is slob buries the

41:42

software engineer who still care. Here's

41:45

what's happening.

41:48

There's a lot more poll requests. Uh

41:50

there's just a lot more code. Uh and a

41:52

lot more are AI generated. Uh most

41:55

developers inside a company uh have

41:57

review fitting and they see it's AI

41:59

generated. their AI review went and they

42:01

said let's they said it looks good to me

42:02

LGTM or you know I'm not sure how uh but

42:06

they just do a thumb and they never

42:08

reviewed it. There are a few developers

42:11

who do review it. Hands up if you

42:13

actually like still review code like

42:15

properly. Hands up if you if you give it

42:17

an honest shot.

42:20

Yeah. But there there are many of you

42:22

who still try and you still catch the

42:24

bugs and you still push back and you

42:26

still see that the agent has duplicated

42:28

code or well the developer is the agent.

42:31

You push back and they are being

42:33

overwhelmed. They are being burnt out.

42:35

They are being fed up. They are feeling

42:37

that they're not rewarded. Oh and when

42:39

it comes to performance review time,

42:40

they're not going to be rewarded.

42:42

They're not seen as the ones pushing out

42:43

all the features. So some of them are

42:45

burnt out and some of them just quit.

42:47

Dax told me that at open code they are

42:49

hiring a bunch of these people who are

42:51

leaving their companies h because

42:53

they're just burnt out being the sole

42:55

person still keeping things alive and no

42:58

one care. Engineering management is

42:59

gone. They've either let them go or

43:01

they're now now less hands-on. So

43:03

there's no one left to care.

43:05

Finally, I I talked with Kent Beck. Uh

43:07

he'll be this keynote peer tomorrow and

43:09

he summarized this really well. Kent is

43:10

amazing at summarizing findings. He

43:12

said, "We're accumulating code faster

43:14

than we accumulate trust." He said that

43:16

with code you need to trust it. You need

43:17

to understand it. We don't have time to

43:19

do that right now.

43:22

AI also amplifies software engineering

43:24

experience. So seniors gain the most uh

43:26

judgment is rewarded. And we see this

43:29

everywhere. Hill Wayne, he'll be a

43:30

speaker tomorrow. But he was telling me

43:32

how some people are saying oh AI will

43:34

help with formal verification with TLA a

43:36

very complicated language. He'll show

43:37

you a demo tomorrow. And he said the

43:40

only people who have been successful

43:41

with AI generating TLA plus

43:42

specifications that work are TLA plus

43:45

specification experts who in the prompt

43:48

gave the exact specification of what

43:49

kind of prompt to generate. Everyone

43:51

else good luck with that. And this is

43:53

true for software. If you're a junior

43:54

engineer, if you've never built a mobile

43:56

application, you can prompt a native iOS

43:59

app, you can prompt the agent, it'll

44:00

build something, but you know, it's not

44:01

going to be maintainable.

44:04

Uh old patterns are seeming to coming

44:06

back. Uh Dax told me how domain driven

44:10

design and verbals guardrails they're

44:11

using this open code all the time

44:13

because agents are the new junior

44:15

engineers. You can start off a lot of

44:17

them but these junior engineers I mean

44:19

if you think of it like that they need a

44:20

lot of guardrails and we used to these

44:23

boring enterprise patterns used to

44:25

become unpopular because they're long a

44:28

long winded you have to explain you have

44:30

to type out but they keep agents in

44:33

check. So, it might be time to dust off

44:36

some of these books and start to use

44:37

design patterns again. I'm actually dead

44:39

serious about this.

44:41

So, this is where we are. Uh, it's it's

44:43

just a lot of change, all all sorts of

44:45

of things. It's confusing. I'll leave

44:47

you with with a little advice. One is is

44:50

the the title of the talk, slow down to

44:52

speed up

44:54

you. My suggestion is to cap your daily

44:56

agent usage to what you can either

44:59

review or verify. You might not need to

45:02

read the code. Peter Shamberger, creator

45:04

of OpenClaw. I did a podcast with him.

45:05

He said that he ships code that he does

45:07

not read, but he builds his own

45:09

verification systems. He thinks in

45:11

architecture. He always looks at the

45:13

module. He has the AI draw AI diagrams

45:15

for him. So verify, do not ship more

45:17

than you can verify or this might mean

45:20

reviewing. By the way, as well, uh, tech

45:22

depth is now very cheap to remove. We're

45:25

talking about how it's built up. Have

45:27

the eight kick off the 80 to remove the

45:29

tech deb. Be the chief tech deck remover

45:31

on your team. you will feel better for

45:32

it and it's much easier. Forget that

45:34

it's hard to remove it. It's not. And if

45:36

you're not removing it, you're not using

45:38

AI efficiently for yourself.

45:41

Uh experiment with different different

45:43

usage of AI agents because there's no

45:45

one-sizefits-all and and you know,

45:47

listen to talk with with with friends

45:49

how they're using it. Get ideas, tell

45:50

them what you're doing. And you know,

45:52

like just spend more time thinking and

45:54

understanding. This is what Dax, the

45:56

creator of Open Code, he says that he

45:58

used to spend 95% of time thinking and

46:00

5% of time coding. And he said like,

46:01

"Yeah, AI is cool because now I can uh I

46:04

can now spend 25% less time coding. So I

46:06

spend 96% of time thinking and 4% of

46:08

time coding." You're not going to have

46:11

the luxury, but you know, like it's a

46:13

good way to think about it

46:16

and you just spend time thinking and

46:18

understanding

46:22

one thing about working in different

46:24

way. Michelle Hashimoto is the creator

46:26

of GOI uh founder of of Hashikarp, a

46:29

really nice guy. He was also on the

46:30

pragmatic engineer podcast in March and

46:33

his rule for building software. He came

46:36

up with this. He is not an AI maxi but

46:38

he likes to be productive. He has one

46:40

agent in the background always doing

46:42

something. He said if I'm coding I want

46:44

an agent planning. If they're coding I

46:46

want to be reviewing. And he always has

46:48

just one extra agent. He does not use

46:50

multi- agents. But this is what I mean

46:52

by experiment. Some people use five

46:53

agents and they can manage. I don't know

46:55

how personally. Michelle found that he

46:57

can use only one agent. He has like this

46:59

this buddy that he has all the time and

47:01

he said it works for him for now at

47:03

least. So just experiment, try different

47:04

ways of doing things. You don't need to

47:06

go overboard. He's a very productive

47:07

engineer. He does not care about AI. He

47:09

cares about like writing high quality

47:11

software.

47:13

From Addios Manny uh I I met him two

47:16

years ago back in Google and also also a

47:18

friend. He

47:20

said one of the best things, don't

47:21

outsource learning. It's just too easy

47:23

to let the AI write code while you skip

47:25

all of the learning. The bug get fixed,

47:27

but your mental model does not. We're

47:29

trading off your capacity for present-

47:31

day speed, and the tools don't force us.

47:34

So, you need to just whenever you use

47:36

these AI agents, do not skip the

47:38

learning. Understand, learn something

47:40

when you use an AI agent. And this is

47:41

what I mean. You don't need to review

47:42

all the code, but you need to learn

47:44

something from or build a system, have

47:45

it build something for you.

47:48

Uh when when I look around on a job

47:49

market, I have I have some good news.

47:51

The job market seems okay globally. I

47:53

they did a deep dive in the pragmatic

47:55

engineer. Uh and you'll have access to

47:57

to that deep dive, the full one, uh very

47:59

soon. Um the top tech companies are

48:02

hiring more than they have before. So

48:05

it's going up. It's not as good as as

48:06

before. Now the bad news is that in in

48:10

the US and in the UK, we're seeing 20%

48:12

increase in software engineering. This

48:14

is not AI engine. This is software

48:15

engineering. In Germany and France,

48:16

we're seeing 13% and 10% decrease, which

48:19

is it's not terrible, but it's not

48:21

great. This is from two years ago, and

48:23

in Canada, it's flat. I don't have data

48:26

deals from Hungary, but as we know,

48:27

Hungary is very much tied, as we know on

48:30

the press, to Germany a lot. So, a

48:32

similar trend might be happening. This

48:34

is data from indeed. It's a pretty

48:35

reliable data source. Uh, and I I I

48:38

trust them. uh now on the job market in

48:41

the US and and US tech companies the top

48:43

tech companies AI engineering is an

48:45

absolute blast in hiring so this is AI

48:48

engineering is part of software

48:49

engineering it's now taking up about 10%

48:51

of all software engineering is going up

48:53

so anything a engineering means you're

48:55

building rag you're building evals

48:56

you're building systems that are doing

48:58

something with LLMs

49:00

future profiting for your career my

49:02

personal advice build things that that

49:05

build on top of AI and LMS because you

49:07

will get hands-on with rag AI

49:09

engineering by the book by AI

49:11

engineering by Chip Huan. It's a very

49:13

practical book and try to build

49:14

something either on the side build your

49:16

own podcast recommendation system or

49:17

whatever or at work show off to your

49:20

colleagues answer and even your managers

49:21

and your your you know your your

49:23

colleagues will be happy to see oh

49:24

really cool like you just built an

49:26

internal tool to do XYZ.

49:28

Don't uh outsource your your your

49:30

thinking to AI. Try to think more on

49:33

product understand the business. Um

49:35

there's a book called product uh the

49:38

product-minded engineer. I have a blog

49:39

post called the product-minded engineer.

49:41

Talk to product managers. Uh and you

49:44

know just understand how the business

49:45

works. It it is more important and try

49:48

to become a domain expert. Uh try to

49:50

become this industry insider. If you are

49:52

working in agriculture company,

49:54

understand the agriculture because

49:55

there's a lot of software engineers but

49:58

there's very few who have talked with

49:59

farmers. If you're working at an

50:01

automotive company, talk with the

50:03

mechanical engineers as well. Again, if

50:05

you build that domain expertise outside

50:07

of software engineering, you will be in

50:08

demand the next time your company is

50:11

does either downsizing or you want to

50:12

move elsewhere.

50:14

If you are engineering leaders, my

50:16

advice to you, you need to be hands-on

50:19

or you need to stay hands-on. Some of

50:21

you will think, uh, not again, yes,

50:23

again, otherwise you will be out this

50:25

time. And it is easier to do this with

50:28

AI. You can turn to AI to explain stuff

50:31

for you. You can you can start to to

50:33

contribute stuff. I'm hearing at

50:35

companies where the top of the top

50:36

hundred committers, five are uh are

50:40

product managers and so on or or

50:41

engineering leaders. And also you can

50:43

just help integrate AI into the systems

50:45

level. That removes friction

50:48

except you will be doing less people

50:50

management. You will and the business

50:53

expects you to do less of it. If you

50:55

love doing people management,

50:57

either you know either you burn yourself

51:00

out or or you will do less of it. And if

51:02

you're an engineer, if you're a

51:03

developer, you will get less career

51:05

support. Also, we're probably going to

51:07

less pay rises and some of those things

51:08

for a while. But again, it's just we

51:10

will have less management with all the

51:12

good and and all all the bad parts of

51:13

it. Finally, I I'll close with this. The

51:17

change I I I talked with Martin Fowler,

51:19

I talked with Grady Bush, I talked with

51:20

all these people. They all said change

51:21

has never been this fast in the software

51:23

industry since the 60s easily in in in

51:27

12 months. We've had AI go mainstream

51:29

across coding tools. If you are

51:31

overwhelmed, absolutely okay. A lot of

51:33

us are overwhelmed. I I was overwhelmed.

51:35

Sometimes I still am overwhelmed with

51:36

with how fast this change and how not

51:38

predictable it is. But from just time

51:40

time to time, pat yourself on the back.

51:43

You are keeping up. It's hard.

51:47

Look around. just stop for a little bit

51:50

and make a change. How can I make this

51:52

more sustainable? How can I produce more

51:54

quality? How can I stop do how can auto

51:57

automate some of these things? And then

51:59

rinse and repeat.

52:04

Gerge Oros everybody.

Interactive Summary

The video discusses the dramatic shift in the tech industry due to the rapid integration of AI into software development. It highlights the chaotic situation at Meta, where AI-driven coding and internal policies led to security vulnerabilities, mass reassignments, and diminished morale. The presenter, Gergely Orosz, examines industry-wide trends such as the rise of agentic coding systems, increasing AI-related costs, a decline in software quality due to over-reliance on AI, and the 'token maxing' phenomenon. He advises engineers and leaders to adapt by slowing down to ensure verification, focusing on systemic improvements rather than individual productivity, building domain expertise, and remaining hands-on with technology to navigate this period of rapid and often overwhelming change.

Suggested questions

3 ready-made prompts