HomeVideos

The Pragmatic Engineer AMA

Now Playing

The Pragmatic Engineer AMA

Transcript

2417 segments

0:00

What made you switch from a full IC role

0:02

like at Uber to focus on tech content?

0:04

>> My plan was leave Uber, finish writing

0:07

the software engineers guide book in 6

0:08

months and afterwards start a startup,

0:11

join a startup. I was a little bit tired

0:12

of being a middle manager. They tell you

0:14

congratulations, you become a manager.

0:16

They should have said you became a

0:17

middle manager.

0:17

>> Have you seen how AI is impacting what

0:19

employers look for in candidates?

0:21

>> Hiring will honestly just be more

0:23

friction. It'll feel more unfair because

0:25

there will be no clear rules we have

0:27

about used to and it'll be messy.

0:29

>> What's one thing about software

0:31

engineering that will be the same in 5

0:33

years?

0:33

>> There will be just as a big demand for

0:35

[music] professionals who care about the

0:37

craft. You have no ego and you just

0:39

choose the right one for the right job.

0:41

>> Have you ever gotten in trouble over an

0:43

article? Has everyone tried to sue you?

0:45

>> Yes, once. Two articles actually.

0:52

Today's episode is a different one. It's

0:53

an AMA where I answer questions that you

0:55

submitted. Asking the questions is

0:57

Giggs. [music] That is Voldemir Gignak

0:59

C2 at Wartsmith. Wordsmith is a legal AI

1:01

startup where I'm an investor and know

1:03

the team well. And Giggs was just in

1:04

town to help out with this AMA. We've

1:06

grouped the questions as observations

1:08

across the industry, opinions on AI,

1:10

opinions on hiring, questions about

1:12

myself, advice [music] on specific

1:13

situations, and the pragmatic engineer

1:15

as a business. Thanks to antithesis for

1:17

being our presenting sponsor. With

1:18

antithesis, you can verify your systems

1:20

correctness without human review or

1:22

traditional interrogation tests and

1:23

avoid bugs or outages. With this, let's

1:26

jump in.

1:26

>> Hey Ger, welcome to this reversed

1:28

podcast. AMA,

1:30

>> it's really nice to be a guest on my own

1:32

podcast. This this is really cool and

1:34

and thanks for for coming here for for

1:37

some background. We know each other from

1:39

Wartsmith which is one of the very few

1:41

startups I still invest in because I

1:43

stopped investing but about two years

1:45

ago I invested with with a friend Ross

1:47

who I I worked together. It's really

1:49

nice to have you here.

1:50

>> Yeah and you know I'm very appreciate

1:52

you putting trust in us in investing and

1:54

let's get started. So first question

1:56

what made you switch from a full IC role

1:58

like at Uber to focus on sharing

2:01

reporting tech content? Yeah. So at Uber

2:04

I started as an IC and I was an IC for

2:07

about 10 years before Uber. I started as

2:09

a senior engineer. I I became an

2:10

engineering manager pretty quickly. It

2:13

wasn't an IC role but I guess a manager

2:15

role but the it doesn't change the story

2:17

too much. I was hitting about four years

2:19

at Uber and and two things happened at

2:21

the same time. One is Uber in 2020 had

2:23

layoffs because COVID hit Uber's

2:25

business really bad. I had access to our

2:27

internal dashboard where we saw revenue

2:29

for rides and it was just going down

2:31

very close to zero and I was actually

2:34

sharing it to my team because I I

2:35

figured transparency is is a good thing.

2:38

I'm not sure that was the smartest thing

2:40

but I probably still do it again. I was

2:41

people like this is not this is not

2:42

looking good and we were all

2:44

collectively freaking out a little bit

2:46

and layoffs came very predictably. It

2:49

was a 20% layoffs about a quarter of my

2:51

team was unfortunately gone and the

2:53

remainder of my team our mission no

2:55

longer made sense in this new world

2:57

where we were building stuff some

2:59

something for drivers when we thought

3:01

there would not be as many drivers or we

3:03

had to compete with them but because of

3:04

co drivers actually were flocking to the

3:06

platform and and so I I got a new team

3:09

to to work with but it felt to me for

3:12

the first time in 4 years that they were

3:13

going really well and I I just felt

3:16

demotivated. I I knew that the business

3:18

would be doing poorly and I also asked

3:21

myself like why you know what I wanted

3:23

to do after Uber and before right before

3:25

I joined Uber I got this offer which was

3:27

an amazing compensation package which a

3:30

bunch of stock and I told myself well

3:32

stock I mean who knows if Uber will go

3:34

public or not but I said if Uber does go

3:36

public and this this money turns into

3:39

stock I I had about I got about $500,000

3:42

worth of stock as a grant option. And

3:44

I'm like if if I have like 500k in my

3:46

bank account, well I can take a risk and

3:48

I for the next thing I can actually do a

3:50

startup. So I remembered this and Uber

3:53

had gone public and that 500k stock

3:55

turned into 400k because uh of um the

3:58

stock price was a bit lower and then you

4:00

have to pay taxes on it. So it it was it

4:02

was less but I still had a lump sum

4:04

sitting in my savings account and I was

4:05

like huh I don't have to work actually

4:07

for like a I could not work for like two

4:09

three years easily. So I like, well,

4:11

maybe I should take a risk. And my plan

4:13

was leave Uber, finish writing the

4:16

software engineers guide book, which is

4:18

something I started writing at Uber,

4:20

just finish it in six months, and

4:22

afterwards do what you've done, which is

4:25

start a startup, join a startup cuz I

4:28

was a little bit tired of being a middle

4:29

manager. They tell you you're a manager,

4:32

you know, congratulations, you became a

4:33

manager. They should have said you

4:34

became a middle manager because now your

4:36

job is to keep your team happy, to keep

4:38

management happy. and especially I was

4:40

in a different region. I was in Europe

4:42

so this was easy but but when layoffs

4:44

came it was a lot of politics a lot of

4:47

explaining regulations that I it wasn't

4:49

what I wanted to do also keep your peers

4:51

happy in terms of your manager peers it

4:53

was pretty tiring and I I was like I I

4:56

want to be in charge next time cuz I I

4:58

have a lot of ideas but I I felt I was

5:00

like fighting the machine if you will in

5:02

some sense. So that was my plan. I it

5:04

involved nothing with writing except

5:06

just finish this book. I have a legacy.

5:08

I can give this book to people. I can be

5:10

proud of it. But then what happened is

5:12

similar to software engineering when you

5:13

start a project in software engineer

5:14

you've never ever done before. You know

5:16

you're a junior engineer. You're doing

5:17

your first migration. You think it'll

5:19

take two days and then two months later

5:21

you're still stuck there. And it was the

5:23

same thing with writing this book. I've

5:25

never written a book. I know I knew it's

5:26

a big project but I was like yeah six

5:28

months should be enough. Six months

5:29

later I'm still I'm like treading water.

5:32

I wrote three other short books. So uh

5:36

but my main book was not progressing.

5:38

And I asked myself like okay like I gave

5:40

myself about six to eight months to like

5:43

all right get this book out and then

5:44

just go and have a real job. In my my

5:46

mind a real job was either just start a

5:48

startup be a founder or go back to being

5:51

an engineering manager or staff engineer

5:52

or a CTO some a smaller place. And I was

5:55

like okay well I should be honest with

5:56

myself like what am I doing right now

5:58

and what what will I be doing? And I was

6:00

like either I start and I raise funds to

6:03

start a startup. And my idea of startup

6:05

was just Uber and site had a lot of

6:07

platform engineering teams copy one of

6:09

the things that they were doing. My idea

6:11

was actually we had an internal RFC

6:12

system request for comments where we

6:15

actually had a system that put these

6:16

Google docs together and we we graded

6:18

and all that and it was pretty cool

6:20

system. I thought maybe I could

6:21

productionize that. A lot of Uber

6:22

startups actually came from people

6:24

looking at internal platform stuff and

6:26

taking it and either making it open

6:27

source. temporal is is is exuber

6:30

chronosphere exuber observability system

6:33

and many others. So actually it's not

6:35

all all that radical but then I was like

6:38

well if I if I did that I just have to

6:40

fully focus on that and on the side I

6:42

was doing writing I was I was writing a

6:44

few books actually I was blogging I was

6:45

doing YouTube videos out of fun and I

6:47

was like well I need to stop that if I

6:49

do that because if I raise money I owe

6:50

that to my investors I will hire people

6:52

and for about 5 to 10 years I'm going to

6:54

be happy to be just focus 100% on that.

6:56

I talked with my brother. He was on his

6:58

second startup and he said like look if

6:59

you start a startup do it because you

7:01

are ready to spend 10 years of your life

7:03

on it. Like you need to believe that

7:06

right now because if you don't he's like

7:07

it's not going to work cuz startups are

7:09

just really hard. It's not a popular

7:11

thing to say. And I I wasn't sure I was

7:13

right to spend 10 years on like an RFC

7:15

system. I wasn't that excited about it.

7:17

And then I asked myself like okay like

7:20

what is this drive? Like why do I really

7:21

want to do this startup or a startup?

7:24

And I was trying to be honest. I had two

7:26

two answers. One was the money in in the

7:30

sense of like this was 2021. It seemed

7:32

everywhere I looked ex Uber startups

7:34

they were valued a billion. They were

7:37

unicorns in like a matter of like you

7:39

know a year or two. It it seemed too

7:40

easy and I was reasonable. I was like

7:42

that will probably not happen to me. But

7:44

what might happen is I might be able to

7:47

build a unicorn in like let's say 10

7:49

years time. And by that time I will

7:51

still you if I'm a sle founder I might

7:54

have five or 10% stake because I'll

7:56

count with a lot of high dilution which

7:58

is $50 million and let's say we have an

8:00

exit and I leave and then I pay taxes

8:02

and I still have 25 million which is

8:04

like exactly 24 more than I would need

8:07

you know outside of buying house and

8:09

then I have this you know fu money what

8:11

would I do? The answer was like well I'd

8:13

probably like share what I know. I'd

8:14

probably like you know write a book. I'd

8:15

probably like you know do some YouTube

8:17

videos. I was like huh interesting. like

8:19

I could do that right now. And the other

8:22

reason I wanted to do the startup was

8:24

the small teams. I always loved working

8:26

both at Uber and at my previous

8:28

companies at Skyscanner where I met

8:29

Ross, co-founder of of Wartsmith. We

8:32

were a small team, us against the world.

8:33

And I love that feeling like being

8:35

either an engineer on that team or the

8:37

manager of that team. I didn't enjoy

8:38

being a manager of managers, but I no

8:40

longer had connection. And that was the

8:42

other reason. And actually that that was

8:45

I guess the more legit reason. But in

8:48

the end, I I didn't have this like

8:49

exciting idea and I actually I was like

8:51

if this startup was successful, I would

8:53

just be writing probably. So I was like,

8:54

let me try that. I saw Substack was

8:56

taking off. Lenny Rashiski shared that

8:58

uh he had 2,000 page subscribers for

9:00

product management newsletter. I thought

9:02

if Lenny has 2,000 page subscriber for

9:03

product management, there's 10 times as

9:05

many software engineers as product

9:06

managers in every single team and

9:08

they're not as likely to to buy. But

9:10

there was no paid newsletters for

9:11

software engineers. So I was like, let

9:12

me try it out. I gave myself six months

9:15

uh and I figured it it might not work

9:17

and then it just worked. It took off.

9:18

>> Yeah, makes sense. Um next question. Uh

9:21

have you seen engineering teams uh at

9:24

big tech that adopted AI native SDLC and

9:27

how do they collaborate across

9:28

engineering product and design?

9:30

>> Yeah. So AI native SDLC software

9:33

development life cycle e even the whole

9:36

uh you know like SDLC is an interesting

9:38

one before we go get into AI because

9:39

like what what is SDLC? It used to be

9:43

you plan, you code, you deploy, you you

9:46

monitor and some people used to call

9:49

this waterfall and then there was agile

9:51

where you just like iterate a lot

9:53

faster. And interesting thing like

9:56

outside of big tech or outside of these

9:58

large tech companies, if you go to a

10:00

large company that is not like a big

10:02

tech, not not one of the the Googles or

10:03

metas, they often have like pretty rigid

10:06

processes around scrum specifically.

10:08

They say we're very agile. We have scrum

10:10

or they have the safe system, the scaled

10:13

agile framework, which has a bunch of

10:15

meetings and and like a really rigid way

10:17

to be agile. And of course there there's

10:19

a bunch of like money and consulting and

10:21

all that, but they they think they're

10:22

very agile and then they're very

10:24

surprised to see how most of teams

10:27

inside of the likes of Uber or Meta or

10:29

or or even Google work, which is like,

10:31

oh, we kind of have this like, you know,

10:33

problem. We we actually plan, we sit

10:35

together, we kind of do like I don't

10:36

know a few days of planning and then we

10:38

code it and then we deploy it and then

10:40

we get some feedback and we might

10:42

iterate and they're like well that's

10:43

waterfall we're so much more agile and

10:45

actually like the whole thing about

10:47

waterfall and and and agile is it

10:49

doesn't matter anymore. Waterfall used

10:51

to be a thing I talked with Ken Beck

10:52

when it it literally used to be like a

10:54

year or two of planning and like having

10:56

like this much documentation and we

10:59

don't do that anymore. So the software

11:01

development life cycle is is an

11:02

interesting one and almost every modern

11:06

company up up to AI used to have RFC's

11:08

or or or RF RFDs or or design docs where

11:12

people would write down because they

11:13

realize that you should if you plan

11:14

things ahead and then you build you'll

11:17

have better results like plan thing in

11:18

terms of thinking through. Now, the

11:20

whole AI native uh SDLC, the closest

11:24

I've seen to a company who is big and

11:26

successful and making a lot of money and

11:28

and employing, you know, like hundreds

11:30

or thousands of engineers is Entropic.

11:34

They don't employ thousands of

11:35

engineers. They employ probably hundreds

11:37

of engineers right now. But they're a

11:38

very interesting place. They're not a

11:40

product company decisively. They're a

11:42

research lab and they just do everything

11:46

super fluidly like on on you can see it

11:48

in cloud code and I've talked with Boris

11:49

Churnney about this. They don't do

11:51

design docs. They they just do

11:52

prototypes all the time. They kind of

11:54

show it to to themselves. But I I wonder

11:57

if it's really replic replicable and I

11:59

also wonder when it will break down in

12:02

the sense that cloud code is a great

12:03

product. It's it's now the leading

12:05

coding harness. So like they did an

12:06

amazing job and and just with prototypes

12:08

and iteration and using AI and and

12:11

getting feedback and fixing it and

12:12

responding on social media they respond

12:14

to bugs bugs they fix it immediately but

12:16

there's a question to me like sometimes

12:18

like how much do they plan do they have

12:19

a strategy like with pricing they keep

12:21

changing the tiers back and forth and

12:23

tropic is the closest I can think of but

12:25

I I did not see any company that managed

12:27

to really retrofit anything what I'm

12:30

seeing almost every company do they are

12:32

building AI infra systems so for example

12:34

they will build according agent that

12:36

talks with all their internal services

12:37

that's plugged into Google is doing

12:39

this. Uh RAMP is doing this. Uber is

12:42

doing it. So I think what's happening is

12:45

they're betting building a lot better

12:46

tooling to make this easier. And I think

12:48

that's where we'll see and and I I still

12:51

have one last question which is if you

12:53

have a business that is working, it's

12:55

making money. It it has a rhythm. You

12:56

have customers who are used to certain

12:58

things. How much do you want to change

13:01

inside everything versus just changing

13:02

it slowly to make sure for example in

13:04

case of Uber people expect that when you

13:07

press the button the car arrives that

13:09

the drivers are there's there's

13:10

processes behind this which are non

13:12

non-software like you need to do

13:14

outreach campaigns for the drivers you

13:16

need to let them know weeks in advance

13:17

when there will be a big event so that

13:19

they can prepare for it like the pace of

13:21

the business has not changed because of

13:23

AI even though AI speeds up development

13:26

and and and finally like when when you

13:28

just go too fast, you might forget the

13:30

basics, which I'm I'm seeing a lot.

13:32

Spotify is a good example where I've

13:34

talked with their CTO on their team and

13:36

they say they're they do AI very

13:37

responsibly, which which is great to

13:39

hear. But then again, as a as a customer

13:41

and a user, I'm so frustrated cuz they

13:43

seem to be down so much. Like I I

13:45

couldn't publish an episode two or 3

13:46

weeks ago cuz they were down and they

13:48

don't have a status page and I don't

13:49

know if it's AI or not, right? It might

13:51

not be. But then the other they like the

13:54

whole site just went down and I'm like

13:56

if you're using AI you're sure not using

13:57

it for to make better reliability.

13:59

>> Have you seen how AI is impacting what

14:01

employers look for in candidates?

14:04

>> Yeah. [laughter] Well it's it's

14:06

impacting it because it it feels to me

14:09

that they just don't really know what to

14:11

look for. I mean I'm going to ask you

14:12

for this one. I'm going to turn it

14:13

because you you guys are are hiring. How

14:15

how did it change how you're hiring for

14:17

software engineering? And then I'll

14:18

answer.

14:19

>> Yeah. So in our case, we definitely

14:22

structure the interview quite

14:23

differently. So the main thing that

14:25

we're looking for now is uh the ability

14:28

to reason through what AI is doing and

14:32

correct it and do the appropriate

14:34

research. So actually it's interesting

14:36

like our interview process we give away

14:38

a homework which is you know pretty

14:40

classic but we expect that this homework

14:42

will be done with AI but then we

14:44

basically have a very long discussion

14:46

around this homework and we are checking

14:48

okay you picked this algorithm was it AI

14:51

picking it for you or did you actually

14:52

do research and you figured out what is

14:54

appropriate or here is a design decision

14:57

that you made how did you make this

14:59

decision again like is it automatic

15:01

decision by AI or you understand it

15:03

deeply and you can course correct And

15:05

then we are looking so we are peing into

15:07

different parts of the code and we are

15:09

seeing how candidate can react on the

15:11

spot whether they can spot an issue

15:13

whether they can come up quickly with a

15:15

solution to the issue. So basically the

15:17

ability to reason through and of

15:20

research and not just apply all the

15:23

solutions that AI generates

15:25

automatically. So, so this makes a lot

15:26

of sense and this is I've seen a lot of

15:28

similar things with startups doing it

15:30

and when we think of how hiring is

15:32

changing with AI before AI there were

15:33

two worlds in hiring. There was the

15:35

Google interview process which is the

15:37

lead code interview process and this is

15:39

because Google decided early on that

15:40

they they want to hire for raw

15:42

intelligence. They had puzzles initially

15:44

like you know like how many golf balls

15:45

fit in New York or something like that

15:47

but they realized that doesn't really

15:48

scale that well and they found coding

15:50

interviews algorithmical coding

15:52

interviews to to work really well

15:54

because it's selected for a few things.

15:55

It's selected for people who have

15:57

computer science basics which Google

15:59

needed specifically uh going to

16:01

universities where they teach uh

16:03

computational complexity and and some of

16:04

those things. It also selected to, you

16:07

know, like apply under pressure, explain

16:08

your thinking, and it's very scalable,

16:10

meaning you can train um, you know, like

16:13

a thousand interviewers and and give

16:14

them like a a pool of 200 questions, and

16:17

it doesn't matter if a few questions

16:18

leak, uh, the bar will be the same. And

16:21

it works great for Google. It it it

16:23

really does. Oh, and a bonus is that

16:25

people once they know that this is

16:27

expected of them, you need to prepare.

16:28

And if you're unwilling to prepare for

16:30

this, you're not going to be a good fit

16:32

at a place like Google where sometimes

16:33

you need to do stupid stuff. There's

16:34

performance reviews, we need to do this

16:35

thing. There's a new project coming up

16:37

which makes no sense, but we need to do

16:38

it. But we need to do it. And you know,

16:40

like corporate needs people who put up

16:43

with BS processes every now and then

16:45

without too much complaint. So it kind

16:47

of selects for that. So kind of

16:48

wonderful. And this is why most of big

16:50

tech has just adopted that. And Google

16:52

knows that you're not going to do that

16:54

work. You're not going to use those

16:55

those algorithms. But again, it works

16:57

good enough for them because they hire

16:59

people who are adaptable. You learn

17:00

stuff and and you pick up new things

17:02

anyway. And then startups, you just hire

17:04

for practicality. So this is where trial

17:06

weeks have been popular where a lot of

17:08

startups used to hire by just giving you

17:11

real work. Uh for example, take-home

17:13

fixed a real bug in in a a few hours or

17:16

a few days and they could actually see

17:18

like oh you're actually doing the work

17:20

and startups who are doing open source

17:22

often would just hire the contributors

17:23

to the repository. What AI has changed

17:26

is first of all the algorithmic will

17:28

interview it. It it just whizzes through

17:30

it. So remotely doing it no longer makes

17:32

sense. And with the take-home where you

17:34

used to give someone a difficult

17:36

take-home, you can do it in a in a AI

17:38

will complete it pretty well. So you

17:39

don't really get that signal. So my my

17:41

bet is that what will happen is these

17:44

worlds will stay except the imperson

17:47

part is well decision will be made.

17:48

You'll have a filtering like have a

17:50

take-home task that you can do with AI

17:51

and you can cheat if you will. But when

17:55

you will talk with them on and Google,

17:57

they will still have you come into the

17:58

office and you'll have to do those

17:59

whiteboard interviews and if you didn't

18:01

prepare like no AI is not going to save

18:02

you because you don't have access to it

18:04

and startups will probably want you to

18:06

what you did is explain what you did and

18:09

a small percentage of of startups who

18:11

can do they will just have the trial

18:12

weeks what ones at linear does come work

18:15

with us for a week like you need to

18:17

collaborate you can use AI of course you

18:18

can but it's it's not the the main thing

18:20

of it so I I think hiring will be

18:22

honestly just more there will be more As

18:24

a candidate, it'll be more friction.

18:25

You'll need to invest more time. It'll

18:28

feel more unfair because there will be

18:30

no no clear rules that we have been

18:33

gotten used to and it'll be messy. It'll

18:35

be also more subjective. Just a reality.

18:38

>> Yeah, work together by the way is

18:40

amazing way to hire. We did that at the

18:42

earlier stages. It's just a little bit

18:44

hard to scale, but it's interesting that

18:45

Linear managed to scale it. That's

18:47

>> well and by scaling you you mean that

18:49

yes, you know, it's it's hard to do it.

18:51

So most candidates will say yes because

18:52

you need to take time off. The only

18:54

reason linear can do it is they have

18:55

they are very very well known in the

18:57

industry and even like a lot of people

19:00

say that I'm sorry so I I cannot do it.

19:02

I'd love to work there but I just don't

19:03

have the time and so they lose a bunch

19:05

of bunch of those folks.

19:06

>> What kind of engineers are thriving and

19:08

excelling right now? We hear about

19:10

layoffs and slowdowns but surely some

19:12

are doing better than other.

19:14

>> Yeah. So we do hide layoffs, but I I I

19:16

talk with engineers who are very much in

19:19

demand just as so or maybe more so than

19:21

before. And what what these these people

19:23

have is they either work at startups or

19:25

well-known tech companies. They are

19:27

interested in the business. They're

19:28

so-called product minded. You know, they

19:30

don't stop at borders. And by this time

19:32

whenever when AI came around, they they

19:34

just got into it. They somehow whiz weas

19:37

their way either at their company uh

19:39

saying, "Okay, I'm going to work on this

19:41

this AI project building something on

19:43

top of AI." often AI infra like I I will

19:45

help build build this part and now they

19:48

actually considered experts in in in in

19:51

this and most companies that are hiring

19:54

and trying to hire positions. So ones

19:56

that are hard to fill is I'd like an

19:57

engineer who has a few years of

19:59

experience. They've actually built

20:00

something with AI like they're they're

20:02

not an absolute noob to this. They they

20:04

they will help me able to decide what

20:06

architecture should we use. Should we

20:07

use rack? Should we use fine-tuning?

20:09

Should we use an offtheshelf model?

20:10

Should we use our own model? Should we

20:12

write an on-prem? Should we do it

20:13

off-rem? What about the inference costs?

20:15

What about like should we use Grock?

20:17

Should we use Cerrus? So whatever it you

20:20

know like 5 years ago this was you hired

20:22

an engineer who knew about cloud and

20:24

could help you figure out at a startup.

20:26

Now you're hiring someone who knows

20:28

about inference and and some of these

20:29

things and so engineers who have been

20:31

doing this are in very high demand. The

20:34

only problem they have is sometimes if

20:35

they work at the likes of Google Meta or

20:37

or or a wellunded startup these other

20:40

companies are are surprised at how high

20:41

of a compensation ask they have. But

20:44

these people are very in high in demand.

20:46

The people who are having trouble is

20:48

either at their current work they just

20:50

have no exposure to use any AI so they

20:53

don't have this this experience with ba

20:55

building AI infra you know they still

20:57

build software and they use cloud code

20:58

and codec but everyone does that they

21:00

feel a bit stuck on on how to go about

21:02

this and they don't have good pedigree

21:03

meaning they don't work at a company

21:05

that is assumed to be a modern company

21:07

and those people are finding it hard to

21:09

make the jumps and now they're thinking

21:10

should I just do some side projects and

21:12

my my answer will be like well at the

21:14

very least if you want to make that jump

21:16

between the tiers of companies and in my

21:18

mind there's I have the tri model of

21:21

course but also I have this model of

21:22

like the company where you have like

21:23

consulting companies where you're just

21:26

like an Accenture or Capgeemini or one

21:28

of these where you're given the client

21:29

projects they're really struggling right

21:31

now you have the product companies where

21:33

you work and you build products and

21:35

within the product companies you have

21:36

the venture funded uh product companies

21:38

where you actually have a bunch of money

21:40

to to build quickly scale compensation

21:43

won't be higher you're now competing and

21:45

hiring from the likes of big tech and

21:47

then at the very top you have right now

21:49

it's the AI labs the entropics the open

21:51

AI whatever Google used to be in 2004

21:53

and meta in 2010 that is right and Uber

21:56

and for a short time in in 2015 or so

21:59

now that's that's entropic and and open

22:01

AI and it's hard to jump between these

22:03

tiers so for example the pe a lot of

22:05

people are like oh I'd love to work at

22:06

entropic well I mean dream big but the

22:09

reality is that I know so many people

22:11

working at Google and meta and and

22:13

Facebook they want to get into those

22:15

places but these places are extremely

22:17

selective now.

22:18

>> So entry- level web product engineers is

22:21

saturated. Uh but what's the hiring

22:23

landscape for juniors in low-level

22:25

system hardware software integration

22:27

embedded or defense stack looks like? Uh

22:30

same surplus or genuine shortage of

22:32

system level thinking.

22:34

>> I'm less familiar with with with lower

22:37

level systems programming. I I would

22:39

just assume that it's not as saturated.

22:42

uh when I talked with the pragmatic

22:44

summit in February, I talked with an

22:45

engineer who was working on low-level

22:46

systems, mostly C++, some assembly and

22:49

we talked about who's using AI uh cloud

22:51

code, codecs, cursor, etc. And he was

22:54

the only one in the group. There was

22:55

about eight of us talking. Everyone's

22:56

like, "Yeah, using it almost 100% of my

22:59

code is generated by back then it was

23:01

Opus 4.5 or 4.6 or or I think it was

23:04

Codex 5.4." and he was dealing with

23:07

saying like we're using it but uh maybe

23:10

like 30% of my code cuz it's just very

23:12

low level. Uh these areas have always

23:15

been to me a different world than the

23:17

general big tech like big tech hires

23:19

these people. They feel a little bit

23:21

closer to electrical engineering,

23:22

hardware engineering. Now that area in

23:24

general I observe there's just a big

23:25

demand. There's a lot more startups.

23:27

There's a lot more money in hardware

23:28

tech. So hopefully it will be good. And

23:32

I also believe that knowing the basics

23:34

like knowing if you can code in C++ and

23:37

assembly like I think that's really

23:39

useful knowledge and and you can build

23:40

on top of that because most people who

23:43

know a high level language TypeScript

23:45

whatever like mo most of them will not

23:47

know how to go down to C++ if you know

23:50

C++ and you can build high performance

23:52

low latency systems you can learn easily

23:55

the the rest of a stack and if you're in

23:57

this situation I would just look for

23:59

those specific specific offerings. is in

24:01

junior positions. Uh either you have

24:03

pedigree uh which makes it easier which

24:05

means you're in a good school or you had

24:06

an internship at a good place or if

24:08

you're in school try to get that

24:09

pedigree try to get into an internship

24:12

program or build some impressive

24:13

projects either on the side or

24:15

contribute to open source which is a

24:17

still a pretty good way to stand out

24:19

especially with AI contributions being

24:20

rejected. You will have to work hard uh

24:23

if you want to get to prestigious place

24:25

and accept a stepping stone as well.

24:27

Like right now I think getting as a

24:28

junior a job is better than getting no

24:30

job. And once you have a job, try to

24:32

excel. Even if it's a if it's a shitty

24:34

job, try to be the the best there.

24:36

You'll you'll build up a good network

24:37

and at some point hopefully you'll

24:39

you'll have a stepping stone, a new

24:41

opportunity to come in to go to the next

24:42

level.

24:43

>> A few questions about big tech. Uh so

24:45

when a company like Meta lays off 10%

24:48

after a record year and then reassigns

24:50

another 10 10% without consent, how does

24:53

leadership fail to anticipate the

24:55

obvious heat to culture and morale when

24:57

everyone inside and outside can see it?

25:00

>> Yeah, this this is the question, right?

25:01

The interesting thing I talk with meta

25:03

inside of like some directors and and

25:05

even above and they see it. [laughter]

25:08

So so this is not a question of like

25:10

does leadership not see it. This is a

25:12

question of does the founder

25:14

specifically Mark Zuckerberg not see it

25:16

and why does he not see it or if he sees

25:18

it why does he not care and we're now

25:20

going to territory of like assuming what

25:22

a specific person thinks in the case of

25:24

Meta like Meta is the only one who's

25:26

done this no other company that has a

25:27

career CEO I'm looking at Uber I'm

25:30

looking at Microsoft I'm looking at

25:31

Google they have not done this because

25:33

they probably know what would happen and

25:35

they don't want they they don't want a

25:36

part of their business to go down for no

25:38

reason in terms of outages losing some

25:40

of their best people because what's

25:42

happening right now with meta is some of

25:43

the best engineers who up to a few

25:45

months ago thought you know I like meta

25:48

always treated me well we're investing

25:50

in AI we might or might not be winning

25:52

but it's it's it's doing good stock is

25:54

doing good I have a good work life

25:56

balance been here for 10 years now some

25:58

of them have been reassigned to do this

26:01

work that they don't want to do like

26:02

this data labeling you can make it

26:04

interesting and I talk with people who

26:06

are in this organization this a AI ADO

26:09

organization advanc AI that's as AI and

26:12

ADO is is a data organization but they

26:15

jo they joined and they're making the

26:16

most of it and they're engineers with

26:18

less experience but these people realize

26:20

like well I mean leadership specifically

26:22

co no longer cares about engineering as

26:24

a whole so we can only speculate clearly

26:28

it feels like Meta has had in the past

26:31

some existential times one of them was

26:35

when plus launched somewhere in in the

26:37

2010s and it's well documented there's a

26:40

book about a chaos uh I'm not sure if

26:41

Chaos Monkeys covers it, but but it has

26:43

been really well documented where

26:46

Meta went full on on wartime mode. It

26:48

was like look, Google is coming after

26:49

us. They they want to kill us and

26:51

everyone worked really hard because

26:52

everyone understood that the the fate of

26:54

the company was on the line. And my

26:56

sense is that Mark Tuckber probably

26:57

thinks that this is the case right now

26:59

for some reason that is not really

27:00

articulated and others don't necessarily

27:02

understand and he probably has his

27:04

reasons. I don't know why not he's not

27:06

telling people because this is Meta is

27:08

operating in wartime mode except

27:09

everyone's like where's the enemy like

27:12

revenue is is is record high. They're

27:14

doing amazingly well in in the ads

27:16

business. Their products are growing and

27:18

for some reason it seems existential to

27:20

Mark Zuckerberg to to own AI. But again

27:23

this this is where when you look at the

27:24

patterns like the metaverse also looked

27:26

existential to some extent and now AI is

27:29

looking existential. I think people are

27:30

starting to ask a question like okay can

27:32

you just pick a lane and in all fairness

27:34

it it might be hard for for meta or more

27:36

tucker because meta still does not own

27:38

any platform anywhere they they are an

27:40

application layer still and I think he

27:42

really wants to break out of that and

27:43

and I think it's just being a bit

27:45

reactive potentially this is all

27:47

speculation so I think the easiest thing

27:49

would be just ask him if you can answer

27:52

>> among uh big tech companies specifically

27:54

Google Amazon Meta Microsoft and Apple

27:57

how do they feel they're uh doing on AI

28:00

adoption in engineering who is

28:01

accelerating who isn't and who is

28:03

managing transition well

28:05

>> I think Google is trying the the most uh

28:08

they they have the one where they they

28:10

give a free reign to like everyone to

28:11

build AI tools is a bit chaotic but

28:13

people are building a lot of things

28:14

internally and they are the only big lab

28:16

who actually have an AI model with with

28:18

Gemini and they have a Gemini

28:20

organization and there's always talks

28:21

about how they're doing compared to open

28:23

AI and traffic but they're the only ones

28:24

who have any sort of competition in fact

28:26

Gemini is the only product which is

28:28

actually eating to Chad GP's market

28:30

share. My editor the other day was

28:31

telling me I don't use Chad GPT for my

28:33

queries. I use Gemini because I really

28:34

like Gemini and I think he also said

28:36

that it's free. So, okay, I guess there

28:38

you go. So, in in in this way, they're

28:41

actually, I think, way ahead of of uh

28:44

the others. Meta seems to be bogged down

28:47

by building and training their own AI

28:49

and morale is just going down because

28:50

people don't really see the the point.

28:53

Microsoft is in this weird place where

28:55

like it's it's still very political as

28:58

far far as I understand there's the

28:59

organizations there's the co-pilot for

29:01

there's the core AI organization GitHub

29:03

is under core AI now so is AI their

29:07

mandate or is source control they seem

29:09

to forgetting about that and their

29:10

reliability does not sell Azure is

29:12

fighting with everyone for capacity they

29:14

don't have enough Microsoft is focus

29:16

more focused on politics than AI in my

29:18

assessment Apple uh I talk with people

29:21

at Apple but like Apple is very

29:22

secretive And like Amazon is secretive

29:24

cuz their engine culture is is pretty

29:25

good. So I'm surprised they're so

29:26

secretive, but Apple is secretive

29:27

because their engine culture is absolute

29:29

trash from from all I gather is duct

29:32

tapes everywhere. I I'm not sure much is

29:35

happening at Apple, but because Apple is

29:37

not doing too much, I personally hope

29:38

that they will actually see local AI

29:41

locally running on your hardware because

29:42

they have a very strong hardware thing.

29:44

So one thing I think Apple is doing good

29:46

is they haven't forgotten about their

29:47

core business, which is making devices

29:49

and a software that's decent. It's not

29:51

great, but it's decent enough that

29:53

people don't leave. And maybe that will

29:55

actually be a winning strategy. Amazon,

29:57

they also, they're an interesting one.

29:59

So, Amazon is the example to me on how

30:01

difficult it is to retrofit innovation

30:04

compared to Google. They're trying so

30:05

hard to like have AI everywhere

30:07

internally. They built Kira, their

30:09

internal tool, and they have their own

30:12

models, but they're all subpar. It's

30:14

it's all people are dragging their feet.

30:16

They rather use clot code. And and

30:17

Amazon is full of smart people. So to

30:20

me, Amazon a good example of just how

30:21

Amazon, Microsoft, how difficult it is

30:23

to like bring AI to a large

30:25

organization. Companies that I think are

30:27

doing a lot better than all of these

30:30

companies are I guess the little tech,

30:32

not the big tech, but the publicly

30:33

traded companies who are smaller. Uber,

30:35

ramp, even intercom, block

30:40

say for the layout, but they're the ones

30:42

they're building AI in front because

30:43

they don't have an identity crisis. All

30:45

of these Amazon, Microsoft, Meta,

30:47

Google, they're like, "Look, we need to

30:50

own the whole stack. We need to build

30:51

the AI model. We need to build the

30:53

application layer." And then, you know,

30:55

we need to become a platform. And and

30:57

Uber and Ram is like, "No, like we we

31:00

know our place. We want to use these the

31:02

very best possible way. We will take

31:04

clock codeex. We don't care. We don't

31:05

want to build a one of those. We will

31:07

integrate it as much as we can inside of

31:09

us. We will not have a foundational

31:11

model. we will like buy or or use the

31:14

best one and so they're just focusing on

31:15

optimizing it for their business. So I

31:17

think they're the ones who are kind of

31:18

the most ahead in terms of lar companies

31:20

right now.

31:21

>> Entropic and specifically cloud code are

31:24

shipping at extraordinary rate uh using

31:26

agents for implementation, tests,

31:28

reviews, incident response and many

31:30

other things. Is this how AI native

31:33

development will look like or is it very

31:35

extreme environment and others would be

31:37

wrong to copy that directly?

31:39

>> I think it's just very hard to copy on

31:41

traffic. So we cannot deny that entropic

31:43

is the best example for AI native

31:45

development at scale together with

31:46

potentially the codeex team. And when I

31:48

say entropic I actually mostly mean cla

31:52

code and and also their model but it's

31:54

all interwinded because in AI lab their

31:56

product is don't forget entropic's

31:58

product is claude. It's not cla code.

32:00

Cloud code is is a revenue generator

32:02

until claude is so good. their product

32:04

is the model that they they get a new

32:06

version every few months and they do a

32:09

bunch of work with with with training,

32:11

pre-training, post-training and then the

32:13

the tooling around it and everything is

32:16

it's it's like a beehive all around this

32:18

one thing. So the only way you could

32:20

copy it is you become an AI lab and the

32:22

product is just a byproduct which right

32:24

now is doing great even though Entropic

32:27

for example don't even have an

32:28

enterprise sales team that a lot of

32:30

other ventures would have. Maybe they

32:31

have but it's it's it must be pretty

32:33

small right now. I always feel that

32:35

they're a bit of a anomaly. Where I'm

32:37

interested and I I'm not seeing all that

32:39

much yet is is startups on how startups

32:41

are completely changing how they work.

32:44

And I suspect the reason I'm not seeing

32:45

it is when I talk with AI native

32:48

startups who are like okay you know

32:50

we're founders we will use AI for

32:51

everything and you start a company you

32:54

realize the first hurdle is like how do

32:56

you get traction and at wormmith like

32:58

you guys luckily have have gotten

33:00

traction you kind of pass that point but

33:02

a lot of founders it doesn't matter how

33:03

how AI native you are if if you don't

33:05

have customers if you don't have a

33:06

market segment if you don't have any of

33:08

this and I suspect that I wonder if

33:11

that's going to be more important that

33:12

like get traction doesn't matter how and

33:14

once you have traction it's a little bit

33:16

like even preAI you could assemble an

33:19

amazing engineering team and build a

33:21

first version of a product or you could

33:23

just like have like a really bad

33:25

engineer but have a really good idea and

33:27

launch that product and it takes off.

33:28

Uber was a good example where when it

33:30

when it took off Travis Ken just hired

33:32

some contractors made an ugly app but

33:34

but it it did something that was that

33:36

people wanted. Oh and here it was at the

33:38

right place in San Francisco. So I I

33:40

wonder if like AI native is overrated

33:42

and and like once you have a business

33:44

model, of course you can optimize it,

33:46

but will AI native make all the

33:48

difference? I'm not sure. And another

33:49

good example is Coinbase. You know,

33:50

they're really trying to be AI native,

33:52

do all those things, but they're in the

33:53

end they're a crypto company. If the

33:54

crypto market goes up, they will do

33:56

great. And now they did layoffs because

33:58

crypto market just went down. So like

33:59

you can be as AI native as you want and

34:01

maybe you'll be able to do the same with

34:03

like fewer people. But I'm I'm not as

34:05

sold on this.

34:06

>> Yeah. To me it feels like artificial

34:08

artificially trying to become a native

34:10

is a bad strategy right like just saying

34:12

entropic is doing that so we'll copy it

34:14

and try to implement what I think works

34:16

really well is when you're seeing the

34:18

problem and you understand that oh

34:20

actually this problem can be solved

34:22

really well with AI for example you know

34:23

incident response right so why don't we

34:26

try AI to do a first pass understanding

34:28

what's happening right like it seems

34:30

like an obvious idea and like if we have

34:32

problems with incidents and debugging

34:34

time is taking a we can try and if it

34:37

sticks then good but some other process

34:39

might not work in the company. So it

34:41

depends if there is a problem and it

34:42

feels like it can be solved with AI then

34:45

it's like a good idea to adopt the

34:47

practice.

34:47

>> I I I wonder if instead of AI native

34:49

which is just think about like companies

34:51

where like AI is a natural tool that you

34:53

reach for like you for any anything you

34:55

try it out and it might or might not

34:56

work but you're not precious about it.

34:57

You use it if it makes sense and you you

34:59

throw it away if it doesn't or you'll

35:01

revisit it later.

35:02

>> Yeah. And just you have another tool

35:03

that can help you. Next one. Uh, can you

35:06

share something about today's presenting

35:08

sponsor? Was like, is this really is a

35:10

question that people are asking?

35:11

>> No, this was actually not submitted by

35:13

by anyone, but I still want to talk

35:15

about it.

35:16

>> Now, I admit this was the one question I

35:18

sneaked in because I really wanted to

35:20

share something visually interesting

35:22

about our presenting sponsor, Anticys.

35:24

It's how different their UI is. Let me

35:26

show you with three examples. We already

35:28

know that Anticys verifies your systems

35:29

correctness by running your whole system

35:31

in hostile simulation and finding bugs.

35:33

Here's the UI for casualty analysis. You

35:36

can open a report for a bug and see the

35:38

probability of a bug occurring

35:39

throughout the timeline of the

35:40

simulation. In this case, we can see

35:43

that at virtual time 25, something

35:45

happened that makes this bug close to

35:47

100% to occur. So, we can jump into this

35:50

point in the virtual timeline simulation

35:52

to read the logs. This kind of bug

35:54

probably visualization is one that I've

35:56

just not seen before. There's also this

35:58

neat log explorer. You can filter on

36:00

error messages and then visualize how

36:02

common or uncommon the error is over

36:03

time. For example, here we're looking

36:05

for failing linearization failures, the

36:08

purple line, and you can understand how

36:10

rare or common a specific failure was.

36:13

Again, I've yet to see this kind of

36:15

error visualization, and I really like

36:16

the innovation on the UI here. And

36:19

finally, the multiverse debugger. You

36:21

can go back in time and replay a debug

36:24

timeline. And you can inject bash

36:26

commands at any time without affecting

36:27

the playback of the bug. How cool is

36:29

that? For example, here we're listing

36:31

files in the current directory, but as

36:33

you can imagine, you can debug the whole

36:35

environment much easier. I really like

36:36

how the team atysis are pushing what's

36:38

possible with both debugging and

36:40

verifying software. Head to

36:42

anticysis.com/pragmatic

36:44

to learn more. Is ignoring code quality

36:46

for speed with AI worse it longterm?

36:49

Some engineers still review the plan. on

36:51

architecture and code. Others rely on

36:53

SDDD plus harness uh and disregard the

36:56

code plus are shortterm but is AI good

36:59

enough to make up for worse code.

37:02

This is a big question isn't it like and

37:04

I I wonder if there there's like any

37:06

answer like I I I feel as engineers I

37:08

think we we know what want what answer

37:10

we want. We we we want the answer to be

37:13

yes, quality is important. Yes, care and

37:15

craftsmanship is important. And this

37:17

hasn't changed. Like even before AI,

37:19

like we we wanted this to be true. But

37:23

when I got inside of Uber, I I learned

37:26

about some horrible hack that hacks that

37:27

Uber did that was look really painful.

37:29

For example, the old Uber app before

37:32

2016, before we had the rewrite, you

37:34

would open the Uber app and and you

37:36

would see the the ETA of of the the

37:38

cars. you sell the products and you

37:40

could like pull the slider and then it

37:42

would show like how many minutes the

37:43

next category would be. Like for

37:44

example, Uber black is like 2 minutes,

37:47

Uber van is like 6 minutes and and you

37:49

pull it and you saw some other

37:51

information on the screen and what what

37:52

what happened is that app was pulling

37:55

the server every 5 seconds to give me

37:57

all the information. It was a package

37:59

and so every 5 seconds you would get an

38:01

increasingly large data package but by

38:03

that time it was a few hundred kilobytes

38:05

I believe that was coming back. And the

38:07

reason that they did this is is the and

38:08

this is just terrible like strategy.

38:10

It's it's it's inaccurate. It's slow. Uh

38:13

it it's it's really wasteful on

38:15

resources. It it's it's also just stupid

38:17

honestly. And this was in 2016. But by

38:19

that time we should have just pushed

38:21

this information. But the reason this

38:24

happened is the back end team was small

38:26

and the the front end the mobile and the

38:28

web teams were larger and they were

38:29

getting frustrated that whenever they

38:31

wanted to change on the back end to get

38:32

some information back it would take you

38:34

know like days, weeks, months and so

38:36

they asked the back end team like hey

38:38

can we do something about it and they're

38:39

like well there's this really hacky

38:41

solution where we just send this like

38:42

big blob together and you can go in the

38:44

back and you can add whatever you want

38:45

into this blob and they're like perfect

38:47

and it actually unblocked Uber for a

38:49

long time to like grow independently but

38:51

it was a terrible architecture. ure and

38:53

so this is an example where like this is

38:55

clearly tech depth but techdep can speed

38:57

you up and I wonder if with AI this is

39:02

also true that should we not look at

39:04

tech depth in the stages of a product or

39:06

a company early stage you're looking for

39:07

an idea just like go with techdup we

39:09

don't know if it'll work you'll probably

39:10

toss it out there's companies at this

39:12

stage where we just try out prototypes

39:14

and it doesn't matter if it's beautiful

39:15

or not once you found product market fit

39:18

there's this Kenbeck has the the three

39:20

X's the uh I explore, expand, extend.

39:25

And there's other other ways to to say

39:27

this, but in in the expand phase, you

39:29

found product market fit. You want to

39:31

scale up. You want to quickly reach a

39:33

bunch more users. And you're kind of

39:34

okay with hacks at this point to grow

39:36

faster. And and the last phase is is

39:38

when you're mature, you want to make

39:40

things good. And what I've seen at the

39:42

likes of Uber again pre AAI is when you

39:45

find product market fit, you have a

39:46

bunch of customers, you have a bunch of

39:47

demand, you will now have enough revenue

39:49

and money that you can hire people who

39:51

can help you fix these hacks. So I

39:54

wonder if it's the same with AI. Maybe

39:55

we're overthinking that if you're in the

39:56

early stages, you're just doing a

39:58

prototype, just go all in. Don't worry

39:59

about the code quality, which might hurt

40:01

you. If you're at a stage where you're

40:03

now scaling up, I mean, pay more

40:04

attention. And if you're a stage where

40:06

it's a mature product, it's actually

40:07

making money. We don't want to mess it

40:08

up. You know, I'm looking at Instagram's

40:10

product for example, which is a mature

40:11

one, but Meta still messed it up. That

40:14

is probably where you want to be very

40:15

careful and and pay attention,

40:17

understand it. Oh, and final thing is AI

40:19

doesn't only let us build faster. It

40:21

allow us to refactor faster. So, we have

40:23

no excuse not to do that every now and

40:25

then.

40:26

>> Yeah, I completely agree. I think it's

40:27

basically a false dichotomy that it can

40:29

be only speed or quality. Like it's more

40:31

about segmenting in time or in codebase,

40:34

right? So infrastructure maybe more

40:36

attention to quality product maybe more

40:38

attention to speed. There haven't been

40:40

repeated shifts in AI tooling and best

40:42

practices. I makes it easier to find

40:44

exploits and create them. An AI jungle.

40:47

What would it take for the industry to

40:49

seriously create standards rather than

40:50

hoping they emerge?

40:52

>> Yeah, first AI is so new it keeps

40:54

changing. Like I think like any

40:57

standards would would make no sense and

40:59

I think standards just naturally emerge.

41:01

Like I I I haven't seen any patterns to

41:03

it. MCP entropic when they're still a

41:06

small lab. They're not a leading lab.

41:07

They're very small. They created this

41:09

thing called MCP and everyone thought

41:10

it's kind of it makes sense and it comes

41:12

from a non-threatening place. It's a

41:13

small lab which we don't really know.

41:15

They're kind of cool but they're not

41:17

Google was bigger, open was bigger and

41:19

then like all these large companies

41:20

adopted it cuz there was a lot of

41:22

politics in it. So I think it's

41:23

accidental. Entropic today if they try

41:25

to do an MCP people will be like no like

41:27

they are we don't want to be locked in.

41:29

So I think they'll just emerge. I'm

41:31

sorry like I don't have a I I don't see

41:33

anything like planned happening here.

41:35

>> Companies like Entropic have engineering

41:37

managers coding a lot and at Meta and I

41:40

presume at Uber as well uh the

41:41

philosophy was actually the other way

41:43

around that EM should mostly focus on

41:44

people. What's the right approach for

41:46

engineering managers in AI era?

41:48

>> I mean this is a philosophical question

41:50

and like people have strong opinions

41:51

about that. I for example like we we we

41:54

know like from the when at at Twitter

41:56

when El Mus took over Twitter and and

41:58

then renamed it to X he fired a bunch of

42:00

people and he mandated that engine

42:02

managers should code while having 20

42:04

plus reports which which sounded like

42:06

pretty insane to do both. I'm not sure

42:07

there's a right or wrong model. I' I've

42:09

seen all sorts of models work out there

42:11

there's pros to both. There's like when

42:12

an engine manager does not code they

42:14

will care far more about people. They

42:16

will pay more attention to what is

42:17

frustrating people at the personal

42:19

level, at the organization level, and

42:21

they will try to fix those systems and

42:23

they'll try to take really good care of

42:24

people. Injury managers who code, they

42:27

will be more in the details. They will

42:28

be able to to give more technical

42:30

guidance. They will have better

42:31

technical discussions and they will care

42:33

a lot less about this first category of

42:34

things. Uh, and they also probably will

42:36

not have bandwidth to like make systems

42:38

level changes or go to like meetings to

42:40

to for example like you know like work

42:43

with HR to like actually like change

42:45

some policy that makes no sense and like

42:46

upsets a few people or work with a bunch

42:48

of other other teams to like have this

42:50

new system instead of everyone just

42:51

duplicating the work. So right now the

42:53

industry is definitely going very strong

42:55

in a direction that managers should be

42:57

technical. Let's forget about this

42:59

people management stuff. So I think

43:00

people need to unfortunately expect less

43:03

guidance and support from managers.

43:05

Managers who love doing this part and

43:07

are very good at the people part will

43:09

feel probably underappreciated for a

43:11

while. And I think there's a pendulum. I

43:13

think it'll swing back and I think I

43:15

think we've been at the side where we

43:16

have been very focused on on people and

43:18

has been very rewarded as a manager and

43:20

it was great to be an engineer at

43:21

companies like this. It's now going back

43:23

where it will be less so and I I wonder

43:25

if it'll come back again. at some large

43:26

companies that you reported on not using

43:29

AI aggressively is a career risk. How

43:32

should leaders prevent adoption from

43:33

becoming a theater? Uh talking

43:35

leaderboards, mandatory usage, code

43:37

volume targets rather than real

43:39

outcomes.

43:41

So I I wonder if this is like almost

43:43

over because there was a part where I

43:45

talked with CTOs and engineering leaders

43:46

at all sorts of companies and they were

43:48

really frustrated saying, "Oh, my

43:49

engineers are not using AI." But this

43:50

was before Opus 4.5. This was before uh

43:54

well mostly before open 4.5 and GPT 5.4

43:57

and before cloud code was used by by

44:00

many people. This was at the age of

44:02

autocomplete with like you know GPT 4.0

44:06

or or even worse models and like our

44:08

engineers aren't using it or or when

44:10

cursor was al was just the the tab you

44:12

know they have the golden tab key. I

44:14

think this is almost like a non-issue

44:15

like every everyone in most places I

44:17

know uses it and also that's when token

44:19

leaderboards made a lot of sense.

44:20

Shopify the token leader boards in that

44:22

era. No one knows about this about them,

44:24

but they they did it back then and now

44:25

they kind of deprecated it. So I think

44:28

it's kind of moot point especially with

44:29

these strong models. I assume everyone

44:31

will use it and I think it's almost like

44:33

meaningless to look at it a bit like

44:34

lines of code made no real sense to look

44:37

at it for most engineers.

44:39

>> What evidence would persuade you that

44:41

organization achieved an actual AI

44:43

productivity gain rather than just more

44:45

code, more PRs or more humans to review?

44:48

>> It's a good one. right before I entered

44:50

just like taking a step back like when I

44:51

worked at Uber it was the first company

44:54

where I joined where it kind of like

44:56

people told me like don't worry about

44:57

the revenue we just care about growth

44:59

like as long as we grow we're good like

45:01

we just raise more money and then we

45:02

hire more people and then we grow faster

45:04

and we raise more money and we hire more

45:05

people and even I remember my my manager

45:08

was telling me that headcount when I

45:09

became manager I was like how does

45:10

headcount allocation work is like you

45:12

know do you need to make business plan

45:13

or something it's like oh no no no like

45:15

it's it's kind of a black box here like

45:17

it's it's this weird thing where you get

45:18

a headcount allocation and if you fill

45:21

it quickly you get some more and I was

45:23

like how does that work and turns out

45:25

that because like in Amsterdam at the

45:27

time we could hire quickly the

45:29

headcounts were reset at the end of the

45:30

year and if you didn't use it they they

45:32

reallocated within the or it was a

45:33

really weird time and it felt off to me.

45:36

I'm like surely like if I hire a person

45:38

for and it cost they cost X like they

45:40

should generate at least as much value

45:43

right but they're like no not right now

45:45

like we don't live in an age like that

45:46

like oh this is like different I always

45:48

felt it wrong and and so there were

45:50

opportunities where I could have worked

45:51

on a team or led a team which was a

45:53

purely platform team with no direct

45:56

business value and it was kind of I was

45:58

unsure like it was a cool technology

46:00

there was a team who was building uh

46:02

something similar to React Native uh

46:04

just internally because React Native did

46:06

not fit our needs and I was like I'm not

46:08

sure I see the business use case. So I

46:10

always stayed on teams where I was very

46:12

comfortable that we are actually making

46:13

money. Like I knew how I was making

46:15

money. And I always had this in my mind

46:17

that if someone asked like what would

46:20

you do if you hired two more people I

46:22

would have an answer here's how much

46:23

more revenue you would generate. And if

46:24

someone asked what would happen if I

46:25

took away two of your people or half

46:27

your team or your whole team I'd be like

46:29

no problem. Here is the business impact.

46:31

Here's how much revenue we would make.

46:33

And so when it comes to AI productivity

46:36

can we really distinguish from business

46:38

productivity? I mean, there's only two

46:40

ways that a business revenue-wise can

46:42

make a difference. And this is just a

46:43

very capitalist way of thinking about

46:45

things, of course. But one is either you

46:46

make incremental revenue, meaning money

46:48

that you would have not made before. If

46:49

you would have made that money before,

46:51

it doesn't matter. Like if you're a

46:52

crypto exchange and oh, we're making

46:54

more money because there's more crypto

46:55

volume. Well, that's not AI, is it? It's

46:57

the market. But if we launch this new

46:59

product and it's now making money that

47:00

we didn't do and AI is helping with

47:02

that, that's I guess value for AI or

47:05

cost savings. And I wonder if AI's

47:08

biggest use case is just cost savings

47:10

which is kind of depressing to me. But

47:12

the AI native companies that are making

47:14

money uh I do see the ones which are

47:16

selling an AI product. You know the AI

47:17

labs are obvious ones. There are

47:18

startups let's say AI incident review

47:20

who are making money because of that

47:22

product. So I think that's a use case.

47:24

But otherwise it's it's pretty iffy

47:26

pretty finicky. And I I still have this

47:28

this private thought of like will AI be

47:31

a bit more like cloud in the sense that

47:33

cloud is everywhere now and including in

47:35

banks just said we will never go on

47:36

cloud and now they're in AWS but like as

47:38

a customer no one cares if you have

47:40

cloud or not. It used to be as a cost

47:42

saver more a more flexible way to to

47:44

control cost and I think AI it maybe

47:46

it's a more flexible way to control your

47:48

own cost or or like what people do work.

47:51

It's a weird thing, but to me it feels

47:53

closer to cloud than like technology

47:55

like mobile which created a whole new

47:56

market of everything.

47:57

>> What is a popular current belief about

47:59

AI and engineering that you think is

48:01

incorrect?

48:02

>> I think it's incorrect to think that it

48:04

just makes things easier. if you're

48:06

using AI and your life is getting a lot

48:08

easier, like you're are you trying hard

48:09

enough or are you like delegating to

48:11

stuff? And because to me like I I I use

48:14

some of it for for my business and it

48:16

actually like makes me think just as

48:19

hard if if not harder work is harder. So

48:21

I I think like believing that AI makes

48:23

work easier, our our jobs easier, it's

48:27

just it's just wrong.

48:28

>> How important are degree and university

48:31

prestige in hiring today? Is computer

48:34

science becoming a prestige field like

48:36

law or architecture leading to fewer

48:39

self-taught professionals?

48:40

>> Unfortunately, I believe it is. And and

48:42

this is less to do with the with the

48:44

degree and what they're teaching, but

48:45

more about the market. There was a time

48:48

around like 2015 to 2020 where you you

48:50

could get hired at a company for a

48:52

well-paying job by doing a boot camp,

48:54

which is like three months to 6 months,

48:56

sometimes 12 months versus a four year

48:58

or or five year degree in computer

49:01

science. And the reason was there was

49:02

just a huge shortage like the all all of

49:04

the people graduating from from

49:06

university were were swapped up. That

49:08

has ended. Majority of companies do not

49:10

hire from boot camps. Very very few in

49:12

pockets maybe in the UK or elsewhere do

49:14

apprenticeships but they're very small.

49:16

And the top universities are still

49:19

getting those graduates are getting

49:21

hunted down at the likes of of MIT,

49:24

Caltech,

49:26

Harvard, many others, Waterlue in

49:28

Canada, Imperial College in in the UK

49:31

and so on. But they're not getting as

49:33

many competing offers as as before and

49:35

and even at the mid-level of schools,

49:37

it's it's just harder. So when it was

49:39

hard to hire someone with a computer

49:41

science degree, people went for like

49:42

lower selftaught and and those things.

49:44

But now they they do it less. I even had

49:47

someone tell me who is selftaught,

49:49

worked in the industry for 5 years, lost

49:51

their job about two I think a year and a

49:53

half ago that for a year she couldn't

49:55

find a position even though she was

49:57

doing like SR work and infrastructure

49:59

work. And I think in the end she said

50:00

that she's either considering changing

50:02

fields or or just doing her own thing.

50:04

And that's the other thing that I think

50:05

it's easier than ever to do your own

50:07

thing, but companies I think will be

50:09

more picky. And the value of the degree,

50:12

it's a bit underrated if you're in

50:14

living in your current country and you

50:15

don't plan to leave, like it it might

50:16

matter a bit less. But first of all,

50:18

large employers often like have this

50:20

requirement just for filtering. Saying

50:22

we need a degree, it just filters out a

50:23

bunch of non-qualified people. Saying we

50:25

need a computer science degree just

50:26

filters out the art majors and and they

50:28

don't have to look through as many

50:30

resumes because they already have too

50:31

much even if they have this one thing.

50:33

But a degree is very important for

50:35

visas. If you're for example in in a

50:37

country and you'd like to move to

50:39

another country, typically more towards

50:41

the west and they like without a degree

50:43

it will be very difficult with the

50:44

immigration system. So like that's

50:45

something that's worth keeping in mind.

50:47

That thing can pay dividends even

50:49

decades later when you're not thinking

50:51

too much about it.

50:52

>> So a few questions about yourself now.

50:53

Do you still spend time programming

50:55

yourself or testing large language

50:57

models? And if so, what percentage of

50:59

the time? I spend most of my time

51:01

researching and and writing, but

51:03

increasingly now for my business, the

51:04

primatic engineer, I have a backend that

51:07

manages group subscriptions, some

51:08

customer support functionality that I'm

51:10

I'm building. I'm building it myself.

51:12

And now uh I might have like some folks

51:15

help me on my team as well. But when I

51:18

could get a SAS now, I'm like I don't

51:19

want to get a sauce. I I just want to

51:20

build it myself. So it's it's simpler

51:22

stuff. Honestly, it's like crud database

51:24

that it runs on on infrastructure like

51:27

render. I I use the tools. I I I use uh

51:30

Codeex. I I really like Codex and and

51:32

GPD 5.5. I also use uh clot code as

51:35

well. I I play with cursor. I sometimes

51:37

try factory. So I I try to rotate these

51:39

tools and it just makes it so much

51:40

easier for me to get back into it, but I

51:42

don't spend most of my time on it.

51:44

>> And in your own workflow as a creator,

51:47

writing, podcasting, researching, have

51:49

you seen productivity gains from AI?

51:51

>> So this is the interesting thing where I

51:52

I think I should have. So I don't use

51:54

any AI for my own writing. Like I

51:57

I I did a few of these experiments more

51:59

for curiosity saying, "Hey, here's

52:02

here's some notes. Generate an article

52:04

in the voice tone of the pragmatic

52:05

engineer. First of all, it isn't

52:07

addresses job on it. I don't think it

52:09

sounds like me. Second of all, like it

52:12

it just has those I don't know, it just

52:14

feels artificial like like the links.

52:15

And then most importantly, I really

52:17

really enjoy like like I love writing. I

52:20

don't like it's not the the thing of

52:21

writing, it's the thinking. Like when I

52:23

write I I keep thinking and a lot of

52:25

times on social media when I will post

52:27

something and and it gets a bunch of

52:29

likes or views. It's often I'm just

52:31

writing and I have this idea when I'm

52:34

like revisiting the you know this topic

52:36

for the third time and I'm like that's

52:37

an interesting idea. So I just post that

52:39

idea out there and I just go back to to

52:41

writing and then later I see like you

52:43

know people respond to it because I

52:44

guess what people see is is just an

52:46

original idea that comes like most of my

52:49

social media is my byproduct of writing

52:51

and researching like most people don't

52:53

know this like there there are so many

52:55

people who are optimizing social media

52:56

for likes or or things or or all of this

52:58

thing but for myself and a bunch of

53:01

people that I I know and and respect it

53:03

it's kind of like their side thing. One

53:06

good example I I read someone on on on

53:08

Hacker News wrote about this that their

53:10

favorite YouTube creators in

53:11

photography. This person was a hobby

53:13

photographist. Their favorite

53:14

photography creators are not

53:16

professional YouTube creators about

53:17

photography. They're photographers who

53:20

have a business and they actually like

53:21

do shots and then they have a YouTube

53:23

channel where they share every now and

53:24

then. It's infrequent. It's not there.

53:26

And I also think of myself as my my main

53:28

thing is I I research what's happening

53:30

in a tech industry. I talk with

53:32

engineers. I try to keep an ear on on

53:34

the ground as much as I can because I

53:35

talk with and I do this by just being in

53:37

touch with a bunch of software

53:39

engineering folks I know some friends

53:41

and when I see interesting things I dig

53:43

into it. You know that's for example how

53:44

I noticed that something was really off

53:46

at Meta. I I've only ever sensed things

53:48

being like slightly off at Meta for so a

53:50

long time but now I've I I have 10 or 15

53:52

people who I know there and I for years

53:55

and now like most of them were like

53:57

sounding the alarm bell. I'm like that's

53:58

new. I haven't heard that before. And

54:00

you know, turns out I I was right about

54:02

how just how bad things have gotten

54:04

there. But in in in my workflow, uh I I

54:07

use it for research when I'm like here's

54:09

a topic like all right, I'm going to

54:11

research RAMs engineering culture. All

54:12

right, deep research on all the

54:14

platforms like give me all the stuff.

54:16

And I would have thought that this would

54:18

have like freed up time and I guess it

54:20

frees up some of that time, but I I

54:21

would have never spent that much time

54:22

researching. So I don't feel that I'm

54:24

working less interesting enough. And

54:26

what capability do you worry I might

54:28

weaken in your personally? For example,

54:30

coding fluency or technical recall or

54:33

writing from blank page.

54:34

>> I I don't think like the the writing

54:36

will will suffer cuz I I just don't use

54:38

it there. I don't even have spell checks

54:40

on like I just don't like it or I know I

54:42

turn Grammarly off off as well cuz I I

54:44

hate when it like wants to reorganize

54:46

it. I think it's whenever you over rely

54:48

on something it it it could make it less

54:50

efficient. Like for example, one thing I

54:51

now overrely on is like just deep

54:53

research. like I I want to find all the

54:55

things on the web. So, my ability to

54:57

like find things on the web might be

54:59

worse, but I'm not too worried about

55:00

that cuz first of all, it was it was

55:02

just grudg. Second of all, I don't

55:04

really trust the internet that much.

55:06

Like in deep research, I still check

55:08

where it gets references from. When it's

55:09

too much Reddit, I'm like, [laughter]

55:12

I'm not sure this is going to be 100%

55:14

checked out. But with coding, u I I now

55:17

just prompt and and write the code. and

55:19

my ability to to write code by hand will

55:22

probably be degrading, but I don't

55:25

personally mind that part all that much.

55:27

So, I think it goes back to like look

55:29

like whenever using AI for a bunch of so

55:31

just know that that skill will go down

55:32

and are you okay with that? And I'm kind

55:34

of okay with it.

55:35

>> Has AI ever tempted you to go back to

55:37

building software?

55:39

>> It's now so much easier to build

55:41

software. like it probably would would

55:44

have tempted me, but right now I just

55:45

love what I do and I I actually love the

55:48

human connection of actually talking to

55:49

people and getting getting a window into

55:51

what other people are doing. But it is

55:53

making me build more software and being

55:54

more ambitious. So there's this project

55:56

that I've been putting off for a while,

55:57

which is a self-service signup flow for

56:00

for companies for the pragmatic

56:02

engineer. So like the whole company

56:03

domain and I'm actually just building it

56:05

because it's so much easier to get

56:06

started with. It's it's less

56:07

intimidating. Vladimir is QA engineer in

56:09

banking early sorties and he's worried

56:12

about staying relevant. So he's tempted

56:14

to quit for full CS education. Uh but

56:17

it's quite scary to give up good

56:19

paycheck. Uh feel stretched. How should

56:23

he think about f future proofing his

56:25

options? What I see in terms of future

56:27

proofing is the single best ways to

56:29

future proof it is work at a company

56:31

which is doing stuff that is very

56:33

relevant. You know this is building

56:34

products, building modern products,

56:36

building products that incorporate some

56:38

level of of AI where it's okay to

56:40

experiment. a banking where it's a rigid

56:43

place it might be the opposite but my

56:44

first advice would be inside a company

56:46

can you start a project uh where you are

56:50

just doing some experience with AI this

56:51

is why Google is is such a great place

56:53

right now I I I know it might not be too

56:55

popular to say but they encourage doing

56:58

this like oh you're you're on your team

56:59

you're building a product cool and you

57:01

have a you have a suggestion to like

57:02

build this new experiment with AI yeah

57:05

go ahead and do it and I have a feeling

57:07

that a lot of companies will be

57:08

receptive to this cuz right now there's

57:10

a bit of like every leader thinks like

57:12

we should use AI more and if someone

57:13

comes and says like I have an idea and

57:15

I'll do it on on part-time it's a

57:16

win-win worst case is you know you

57:18

learned about rag or you learned how to

57:20

implement this thing it can be an

57:22

internal tool and that's why there's an

57:24

explosion even at larger companies like

57:25

Uber with internal AI tools just just

57:28

start doing that I think that's the best

57:29

way to stay relevant because if you take

57:32

a a computer science degree or or do it

57:34

full-time it's it will still be it could

57:37

be behind the industry right now also

57:39

like you can do a degree part-time, but

57:41

because it's such a big technology

57:43

shift, like the best way is to be

57:44

hands-on. So, my my advice would be try

57:45

to do that as part of your job, that's

57:47

the easiest. Everything else is harder.

57:49

Leaving for a new place, interviewing

57:50

for a new place, all harder. Of course,

57:52

you can try to do side projects, but I

57:54

find that unless it's something that

57:55

truly motivates you, like unless you

57:57

have this thing that you really want to

57:58

build, like this health app that you

57:59

really want and it doesn't exist, then

58:01

do it. But other than that, it it could

58:03

be easier to do it at work. My two

58:04

cents. How can you surround yourself

58:06

with highly motivated top-notch

58:08

programmers when your classmates aren't

58:09

that at that level and it feels like too

58:11

much to catch up to?

58:13

>> I mean, if if if your your classmates

58:15

are not that motivated and you are, try

58:17

to find a different group of friends and

58:19

well, it depends on where if it's high

58:20

school, then you're stuck with them. Uh,

58:23

which is find even when I was at high

58:24

school, there was only two of us who

58:26

were coding and luckily there was

58:28

another person. Maybe we can find

58:29

someone from a different class, maybe on

58:31

an online community. I I've heard some

58:34

Alis real on my podcast when she was in

58:37

high school she joined online

58:39

communities and started to build uh she

58:41

actually started to contribute to some

58:42

software there. So like that's one one

58:44

way to find if this would be at work try

58:47

to either change teams if you can

58:49

internally to to move there or outside

58:52

of your project like take projects where

58:55

you can work with other people like like

58:56

seek out and and and try to follow those

58:58

people or get towards them because a lot

59:00

of people will be motiv and and also

59:03

this is the thing where when you're in

59:04

that situation you can change companies

59:05

it makes a difference when I worked at

59:07

uh in banking one of my first jobs my

59:10

colleagues were super nice they were

59:11

such nice people but they were not in

59:13

love with technology. None of them were.

59:15

And then when I moved to Skype, everyone

59:17

was and it was just such a big

59:18

difference.

59:19

>> So Akos is saying that his son is

59:20

heading for an IT focused high school

59:22

dreaming of becoming a game developer.

59:25

What does a pass and the job market

59:27

looks like in 5 years from now? And what

59:29

should he do to prepare himself?

59:32

>> Everyone's asking this question, right?

59:33

If if only we knew. I mean, I I

59:35

personally believe that I try to draw

59:37

parallels from other industries because

59:39

we we don't know what's going to happen

59:40

exactly with AI. you know this tool that

59:42

we know that coding is so much easier.

59:44

It will probably make some of the other

59:45

parts of the jobs easier. But I like to

59:47

think of of a parallel for example

59:49

construction where like like if if you

59:52

wanted to build a house today or at

59:54

least okay renovate your house

59:55

significantly. You could walk into the

59:57

the DIY store or you can go online and

59:59

you can order a bunch of equipment in

60:01

including professional equipment. You

60:02

can get the same equipment as

60:03

professionals. On YouTube you have

60:05

professionals making videos of how to

60:07

build a wall, renovate a wall, tear down

60:09

a wall, do that. You could do all of

60:11

that. You have you have the information

60:13

and you have the the tools and you have

60:15

the materials. You can buy the top-notch

60:17

materials. It just takes a bit of work.

60:19

So why do people in construction have a

60:22

job? Well, I guess most people don't

60:24

want to do all that and they'd rather

60:25

hire a professional. So I think what

60:27

will happen in the tech industry is

60:29

exactly this where and of course more

60:31

people are fewer people are are calling

60:32

out electrician to like change a light

60:34

bulb or or or even some of the more

60:36

advanced work you a lot of people are

60:38

using YouTube and DIY shops are probably

60:40

getting way more business but I think

60:42

there will be professionals so if you

60:43

want to be a professional in a field

60:46

there will be a path to that and to to

60:48

get into that it will will go to

60:49

university's education I'm fairly

60:52

certain that the game that will be

60:54

released in 10 years which Aquas's will

60:56

hopefully be working on. It will be

60:58

built by a studio that's either a

61:00

startup or AAA studio and if it's a AAA

61:03

studio they will hire graduates from

61:04

some of the top universities from people

61:06

who have been building games on the side

61:08

and for Acro Stan specifically uh I have

61:11

a episode with Jonas Tyroller who uh

61:15

builds games and one of his games got a

61:16

million sales with two of them building

61:18

it. I would suggest that to watch that

61:20

episode, but also Jonas, he shared a

61:23

video of all the games he built over

61:25

like 10 years or or 15 or 20 years and

61:28

he has been building games on the side.

61:30

So if if his son wants to become just

61:32

encourage him to start building games on

61:34

the side right now

61:35

>> in this hard market, what do you

61:36

recommend for engineers in the EU? Uh

61:39

keep aiming for tier one companies or

61:41

stick with tier two job.

61:42

>> Yeah. So so this is the in the try model

61:45

structure. I I I have a tier one. I I I

61:48

put it as as the the local companies,

61:50

like the local supermarkets, the ones

61:52

that are really competing for local

61:53

talent. Tier two is regional and tier

61:55

three is as is global. That's the big

61:56

tech. And like in in this job market,

62:00

well, first of all, like when the job

62:02

market is is really like volatile and

62:04

uncertain, like staying put can be a

62:06

good strategy. At the same point, like I

62:08

would not stop looking for opportunities

62:10

because on one end, like the job market

62:13

feels a bit different than in 2023. 2023

62:15

was a brutal market. It was layoffs

62:17

everywhere and no one was hiring. Right

62:19

now there are some layoffs but so many

62:21

companies are hiring. So now could be a

62:23

great opportunity to jump a tier up to a

62:25

startup to to to some to to building

62:27

products to having more autonomy to

62:29

using more of these AI tools. And if you

62:31

stick at a company that is just really

62:33

moving slowly, you might not have that

62:35

opportunity. I I talked about the

62:36

engineers who are really in demand. They

62:38

have a few years of hands-on experience

62:40

with these tools. They will be in demand

62:42

in a few years time as well. And if you

62:44

will still have zero years of that,

62:45

well, you're kind of sitting in one

62:46

place. So, I I would be opportunistic in

62:49

looking out, maybe looking at at job job

62:52

openings, talking with your network, not

62:54

ignoring fully recruiters, seeing what's

62:56

out there. Look, if you get a job offer,

62:58

you can always say no. If you have no

63:00

job offers, I mean, you're you're going

63:02

to stay at your current place probably

63:03

anyway.

63:04

>> How can engineers and students use AI to

63:06

learn and explore new technologies and

63:08

concept better? I

63:09

>> I think you can use deep research a lot

63:11

better. You can ask it to explain stuff,

63:13

but the way I see it like it it AI only

63:16

ever helped me learn about stuff when I

63:18

wanted to learn about something. So,

63:19

start with what you want to learn. It's

63:21

a tool. It'll help you, but I wouldn't

63:22

also fully like throw away things like

63:24

like like books, other resources like

63:26

like like maybe like videos, uh,

63:28

tutorials and also just building your

63:30

own thing like that. That's what I mean

63:31

like biggest miscon.

63:34

It's not going to make it easier to to

63:35

learn especially when you're not

63:36

motivated. So like decide what you want

63:38

to learn and yeah it can help you but

63:40

like just just learn it in that case

63:42

like just have no you have one fewer

63:44

excuse when you want to do it and if you

63:45

don't want to do it just just don't do

63:47

it.

63:47

>> So not IRS is asking a question so I

63:50

guess it's very safe to share all the

63:52

information. How much do you earn from

63:54

this and why start this instead of the

63:57

tech job? the the last time I shared

63:59

specific numbers was I think I think in

64:02

the first year of the publication where

64:03

I shared that I had like 2,700 paying

64:06

customers and it it's gone a lot beyond

64:07

that. It's now more than 10,000 paying

64:09

customers of the the newsletter. I also

64:12

now have some sponsors in the podcast.

64:13

And the reason I I don't like to talk

64:16

about the specific money, you know,

64:18

there there's people like here's exactly

64:20

how much I make is every time I do that,

64:23

I get so many questions coming in from

64:25

people like, "Oh, I also want to make

64:27

this much. Can you advise me? Can you

64:28

have a call with me? Can you coach me?

64:30

Can you mentor me? I want to quit my

64:31

job. I want to do this thing. And first

64:34

of all, I'm very grateful that it's

64:35

amazing business, but it's just not what

64:37

I'm good at. Like, I don't want to give

64:38

financial advice to people. And I didn't

64:41

even think this was possible, but to

64:42

actually not like be that like vague.

64:45

When I left Uber, my composition was

64:49

going down a little bit because of the

64:51

the four-year vesting. But in my best

64:53

year at Uber in in the Netherlands, I

64:56

made I I think it was like something

64:58

like €288,000.

65:01

Back then it was like 320 $330,000 or

65:04

something like that. And and 120 of that

65:07

was base salary. I think it was like a

65:10

26 or 27k bonus or maybe 30k bonus. It

65:13

was a big cash bonus and the rest was in

65:15

equity. And like when I started this, I

65:20

I didn't think it would go too far. I I

65:23

thought I'd give it a shot. But mo mo

65:24

most of why I didn't think it would go

65:26

go so far, just being realistic. Like

65:28

Lenny shared his his numbers of 2,000

65:29

page subscribers and you do the math as

65:31

$300,000 roughly, give or take. And and

65:34

he was going up. And I thought, well, I

65:36

mean, maybe I could I get there? Maybe

65:38

yes, maybe no. But we we'll see when we

65:40

get there. But I in the first week of

65:43

starting publication, I I had 100 paying

65:45

customers, which is like that was

65:47

$10,000. So that's paid up front, which

65:49

is okay. That's very nice. In 6 weeks, I

65:52

got to,000 paying subscribers. It was

65:54

still $100 before I raised and I started

65:56

to raise the prices back then, but it

65:58

was like around $100,000. And then I

66:00

kept going up and I started to be on a

66:03

higher annual run rate in about like I

66:05

think four or five months than my old

66:07

Uber best total compensation. and it was

66:09

still going up and I was like, "Okay,

66:12

what's going on?" So, I I just kind of

66:14

stopped looking at or or thinking too

66:16

much about the money or or these things.

66:17

I started to focus on just writing that

66:19

one really good article. I did this for

66:21

a year and a half uh two years actually.

66:24

And then I looked up and I was like,

66:25

well, I actually really love doing this.

66:27

It actually I didn't know that you could

66:30

you could make more than working at a

66:33

big tech by doing this thing your own

66:35

business. And this is also something

66:36

that you can realize if you're like with

66:38

your own business, you have the

66:39

potential to make more. And also, you

66:41

know, one of the reasons you probably

66:42

left Meta as well where you were

66:43

probably very highly paid is you have

66:45

the opportunity with a startup with your

66:48

own business. I I'm very lucky that this

66:50

has happened. But but also one thing

66:52

like I love my days. Uh I find it very

66:55

very exciting every day what what I'm

66:57

doing and that that is what keeps me

66:59

doing this. And I I honestly I just love

67:00

being in charge. like like right now I'm

67:03

sitting here because I'd like to sit

67:04

here and I'm having a a great time with

67:06

you, but if I didn't want to, I didn't

67:08

have to do this. And I I'm do I do well

67:10

when I create my own structure, but it

67:12

really helped me. I don't think I could

67:14

have done any of this without going

67:16

through that like 15-ish years as being

67:18

a developer, like just doing the I

67:20

always tried to do the best work that I

67:22

could. I had a lot of structure. I I I

67:24

have a lot of I made a lot of

67:25

connections who actually helped so much

67:26

with this business. Like a lot of times

67:28

my my guests are people that I know or I

67:30

reach out to them for to advice. So uh

67:33

luckily I I feel almost like like wow

67:35

like this was this possible and I didn't

67:37

think this was possible but now I'm just

67:39

kind of rolling with it and I'm like

67:40

yeah it's it's great. I love it. I enjoy

67:41

it. I'm also not too attached to it in

67:43

the sense that like look if business

67:45

wouldn't do that well or people for some

67:47

reason you know they they stop being

67:48

interested. It's like well I I can live

67:51

with it as long as I help some people I

67:53

give value to some people. And also,

67:55

this is an interesting thing, like I

67:57

could make more revenue by like juicing

68:00

it more. Like I could put more things

68:01

behind payw wall. I've gotten feedback

68:03

from people saying, "Why did why did you

68:05

put so much of this outside of the payw

68:06

wall?" And whenever I think something is

68:08

important and more people should get

68:09

access to it, I try to not put it behind

68:11

the payw wall even if it hurts the

68:12

business because again it's it's kind of

68:15

nice to be able to do that.

68:16

>> What's next, Gary? Uh any expansion

68:19

plans for the programmatic engineer?

68:21

>> Yes. So the interesting thing is if this

68:22

was a VC funded company and I took VC

68:24

funding, I would have to expand. Uh but

68:26

I don't uh the only plan I I have is I

68:29

would like to make the pragmatic summit

68:31

more regular. There was one in in in

68:33

February in San Francisco. Uh there will

68:36

be one in in the beginning of the year

68:38

also in San Francisco and I'd like to

68:41

get to a point where I can have one in

68:42

Europe as well. Uh and I'd like to be

68:45

able to do this on a more regular basis.

68:46

So ideally my dream but uh like this is

68:50

more down to logistics and and energy

68:52

and some of those things is is to have

68:54

one in the US or pragmatic summit and

68:56

one in in Europe in London or or or

68:58

somewhere else. And getting to that

68:59

point I will be very happy and also I'm

69:02

growing my team very slowly. Uh we now

69:03

have a small team. Uh so I'm I'm just

69:06

figuring out ways that uh I I can have

69:09

folks involved and help with with even

69:11

more ambitious research. I'd love to do

69:12

even going deeper. I have so many ideas

69:15

of of of companies to research,

69:17

industries to research, sometimes some

69:18

boring industries. Like at some point,

69:20

I'd love to go into a utilities company

69:22

and like go through like how they build

69:24

software. It's it sounds pretty boring,

69:25

but it's pretty darn important.

69:27

>> Have you ever gotten in trouble over an

69:29

article? Has everyone tried to sue you?

69:32

>> Uh yes, once. Two articles actually. Uh

69:36

one I never published uh because I

69:38

decided not to publish. Uh I this was at

69:41

the beginning beginning of the

69:42

publication. For some reason, I really

69:44

got upset at at Neoang Bunk in the

69:46

Netherlands uh because I read about

69:47

their hiring practices. They do

69:48

intelligence test, raw chart test before

69:51

uh doing a technical interview. And I

69:53

thought that's kind of messed up. And uh

69:56

I tweeted about this and a bunch of

69:57

people who were unhappy at the company

69:59

wrote to me like, "Oh, here's some juicy

70:00

stories about how terrible this company

70:02

is and here's all the things that they

70:04

do and here's I have and they had

70:06

evidence and and all that." And it it

70:08

was like some of it was like, "Whoa,

70:09

wow. This is like crazy." And so I

70:11

started to write an article about that.

70:12

This was in the first year of the

70:14

pramatic injury. This was December. So I

70:15

started in August and this was in

70:16

December. And I had an article ready

70:18

that was pretty pretty damning. It

70:20

probably probably read like a hit piece.

70:22

Like I didn't have any agenda, but it

70:23

was just like negative negative negative

70:25

and this and can you imagine this and

70:27

that. I was about to publish it. I even

70:29

sent it over to the company uh to Bunk

70:31

and saying could do because I my editor

70:34

uh was like you should probably send

70:35

this over to them like but then I slept

70:37

on it and I was thinking what what am I

70:39

going to achieve with this like at the

70:41

company inside a bunk I'm not helping

70:43

anyone because they'll be defensive and

70:44

it's it's actually a business it employs

70:46

people and it's growing and it's playing

70:47

more and more people and then uh I also

70:50

got a message from someone who who said

70:52

that they had a bad experience there but

70:54

it was also very helpful because this

70:56

person came from I think Egypt and no

70:59

company would hire him in a visa on the

71:01

Netherlands, but Bunk did and they were

71:04

pushing him really hard and some things

71:06

felt unfair, but it was a stepping stone

71:08

and that person now works at Facebook

71:09

and said it could have never happened

71:11

without Bunk and they took a chance on

71:12

me. And I was thinking like, well, I'm

71:15

not going to help the company. The

71:17

article has zero positives. It just says

71:20

don't do this, don't do that. And and

71:22

also despite this, they actually have a

71:23

business. And I was like, I'm probably

71:25

missing something here. And I decided to

71:27

not publish it because I decided that's

71:28

when I decided I I want to publish

71:29

things where I actually like share

71:31

things that work like and I wasn't

71:34

sharing any of the things that made Bunk

71:35

work. And actually they're now even more

71:37

successful companies. So they well and I

71:39

think this is the thing like every every

71:40

company has it ups and downs. So that

71:41

was a thing that I did not publish and I

71:42

didn't get in trouble for that. A bunch

71:44

of journalists reach out to me later to

71:46

like get all the juicy details because

71:47

they wanted to read but I I just deleted

71:48

the whole thing. The thing that I almost

71:51

got in trouble for I was really stressed

71:53

about is the deep dive on Poland.

71:55

Poland, the events company, who really

71:58

pissed me off because uh I I was just

72:00

covering layoffs across the industry. I

72:02

mentioned Poland was one of the many who

72:04

did layoffs and I knew people there who

72:06

left Twitter and and Deliveroo and some

72:09

good companies to work at Poland because

72:10

it was a good good company, good salary,

72:12

flexible perks and I just briefly

72:15

mentioned them in my article saying uh

72:17

like updated layoffs, it was poorly

72:18

handled. On an all hands someone brought

72:21

up saying the pragmatic I was the only

72:23

one who mentioned it. the pragmatic

72:24

engineer mentioned that we did layoffs

72:25

and it was poorly handled. what do you

72:26

think of it as a co and the co said like

72:28

ah this is this is not like it's like a

72:30

BBC or panorama it's like some some

72:32

small publication they have an agenda

72:33

against us don't worry about it it's

72:35

incorrect anyway and I was like and and

72:37

they shared this back with me and I was

72:38

like what and so uh the company did not

72:41

pay employees they lied about them they

72:44

canceled health insurance it was like

72:46

lots of lies and and unpaid salaries and

72:48

I just decided like this this thing was

72:50

me like the guy said I'm I'm not a

72:52

panorama so I did a proper investigative

72:54

article where I collected a lot of stuff

72:56

on how it went wrong, including a double

72:57

charging of a payment that was a a

73:00

deliberate double charge. This guy's at

73:02

an outage. There's now reporting out

73:03

about it from the BBC. I might or might

73:06

have not helped uh with some of that

73:09

reporting for the BBC, not for my I I

73:11

couldn't put it in my article because

73:12

when I sent it over to Poland, they said

73:13

that this is lielist, this is lielist,

73:15

this is lielist, meaning they could sue

73:17

me. And I had to think about like, do I

73:19

really want to do that? So I so I

73:21

actually self-censored and I put so much

73:23

effort into the article, so much stress

73:25

and I I realized that investigative

73:27

journalism is just not for me and it's a

73:29

it's a good read. The BBC later made it

73:31

made a a documentary. Uh I also helped

73:34

them with that but I realized this this

73:36

this world is not for me.

73:38

>> Other than the book and newsletter, uh

73:40

what's something surprising you have

73:42

found through your writing?

73:43

>> I usually just find find ideas as as as

73:45

they go because they fester. I I I I

73:47

also have a long list of of things that

73:49

I I collect. Like I'm not sure if I have

73:51

any specific things. Trends some

73:53

sometimes pop out

73:56

a bit more as as I'm seeing multiple

73:59

people talk about them at the same time.

74:00

For example, there there was this this

74:03

and sometimes it just reinforces the

74:05

things that I I'm kind of thinking could

74:07

happen. In January when I started using

74:10

o over the Christmas break clock a lot

74:13

more and I was really impressed with it

74:14

and I was like, "Wow, this is really but

74:16

is it just me? And I started to read

74:17

around and I did some research and I saw

74:19

a lot of people saying the same thing

74:20

and that actually encouraged me to like

74:22

write the article saying like I think

74:23

coding by hand is over. And this was

74:25

very early on and I actually got some

74:27

flack from it from some people like how

74:29

can you say this? You're an AI shill.

74:30

But I was like like actually like I felt

74:33

this is where it's going based on my

74:35

experience and then I got a bunch of

74:36

evidence and I talked with a few more

74:38

people. So it either reinforces some

74:40

opinions I have or it it also gives me

74:42

new ideas. Do you plan a new edition of

74:44

the guide book updated for AI era and

74:47

what would you change to better reflect

74:49

the LLM era?

74:50

>> Right now this book stayed surprisingly

74:52

durable for AI because it it doesn't it

74:55

didn't contain too much about coding to

74:56

start with. Uh but the non-technical

74:58

parts things like understand the

75:00

business think about software

75:01

architecture those are more relevant but

75:03

at the lower levels at some point I'll

75:06

probably be updated but I I think I want

75:07

to like wait until we figure out like

75:09

how like what are practices that

75:11

actually work like when we'll have like

75:12

so-called best practices for certain

75:14

companies. I I think it'll take a while

75:16

but I'll probably revisit it at that

75:18

point. Yeah.

75:19

>> What's your favorite technical book?

75:20

>> So uh I'll give you two. It's one is the

75:22

philosophy of software design. I I I I

75:25

just love uh this book. I I it's it's

75:28

still to this day the only book that

75:30

actually compares

75:32

architecture approaches between like

75:34

groups of students and and what we can

75:36

learn from that. I wonder with AI if we

75:38

could now replicate this like have

75:40

agents like build different software,

75:41

but it it still wouldn't be the same.

75:43

But it's it's just a really nicely

75:44

written book. I I I really like the idea

75:45

of of modules, shallow modules, deep

75:47

modules and and so on. And then uh I

75:51

also enjoyed Kent Beck's Tidy First

75:53

book. book. It's a really thin book, but

75:55

I just like how crisp every single idea

75:58

is. Even though like that book might be

76:00

a bit less relevant when you're writing

76:01

a bit less code, but I just like the the

76:03

thinking that's behind it.

76:04

>> Besides Craft, what are some of your

76:06

favorite software tech products?

76:08

>> I really like Granola uh for for

76:11

meetings. It it it not only takes notes,

76:14

it fills out your notes and it's just

76:15

like such a delightful example of what

76:17

like an AI added product could be. like

76:20

I'm happy to pay for that cuz I get more

76:22

value and it's it's easier note

76:25

takingaking less issues with it not

76:27

having to think about that. I wish

76:30

actually that I could see like more

76:32

products are that that are are like that

76:34

and and I also I still really enjoy

76:37

Perplexity's search functionality

76:39

especially the deep research every uh

76:42

product has ruled out deep research but

76:44

Perplexi is still the one that seems to

76:46

be the fastest. it like it's I I wish it

76:49

was what Google would do for for for

76:51

search and again it's something that I I

76:54

pay for and I have like no affiliation

76:56

for it and this is specifically a search

76:57

I don't like their new push for like

76:59

computer or any of that stuff but like

77:02

again like from the beginning like I

77:03

feel there's some some things where like

77:04

AI can really add just a new experience

77:08

I'm like oh I didn't know this could

77:09

exist

77:10

>> forget what changes what's one thing

77:12

about software engineering that you bet

77:13

will be the same in 5 years

77:15

>> I think there will be a just has a big

77:17

big demand. I hope a bigger demand for

77:20

professionals who care about the craft

77:23

and who are true professionals and in

77:24

the sense true professionals that you

77:27

you know where the industry is at. You

77:29

know what the tools are. You've used

77:30

them. You use most of them. You know

77:32

what their trade-offs are. You have no

77:35

ego and and and you just choose the

77:37

right one for the for the right job. And

77:39

right now today this this will involve

77:41

like okay what kind of tool do I use to

77:42

write code with? How do I test it? How

77:45

do I deploy it? How do I verify the

77:47

correctness of the system? And as a

77:48

professional, you care about the things

77:50

that the average person would not. Like

77:52

if if I'm a building architect, I'm I'm

77:54

not one, but I I would imagine that when

77:56

I look at a building, I see all the

77:58

things that as a pedestrian, I don't

78:01

really care about. I'm like, "Oh, it's

78:02

beautiful glass windows." And you're and

78:04

the the architect is probably thinking,

78:05

"How it holds up? What kind of

78:07

characteristics? What about earthquakes?

78:08

What about this? What about that?" And I

78:10

think that that having us software

78:13

professionals who can look at that with

78:15

software work with it and change it be

78:18

unafraid of of changing it with high

78:20

confidence because we have the tool set

78:23

the tools you know sometimes again with

78:25

buildings you sometimes you put a

78:26

scaffolding to make some changes

78:27

sometimes you don't need to you just

78:29

like do a quick job. I think that will

78:31

be a lot more in demand and I I hope

78:33

that we'll have more people who care

78:35

about this and and AI is not going to

78:37

scare them away or or maybe AI just

78:39

scares away the people who never really

78:40

cared about the software. They just

78:41

always cared about, you know, like

78:43

making a quick buck and like just it but

78:46

it was never about the industry.

78:48

>> Yeah. So the these are all the

78:49

questions. Uh thanks Gerge for the very

78:52

interesting conversations. Really

78:53

appreciate it.

78:54

>> Thank you. It's a bit weird to sit there

78:56

because usually that's my line that you

78:57

just said, but Giggs, this was awesome.

78:59

Thanks so much.

79:00

>> Thank you.

79:00

>> And thanks to everyone, of course, who

79:01

submitted questions. Well, this was a

79:03

different format. And finally, it was

79:05

nice to not be the one asking the

79:06

questions for once. Leave a comment to

79:08

let me know how you like this one.

79:10

Thanks and see you in the next one where

79:11

we're going to return to usual setup.

Interactive Summary

The podcast features an AMA session with Gergely Orosz, founder of The Pragmatic Engineer, where he answers questions from the audience, moderated by Vladimir Gignak. Gergely discusses his transition from an IC role at Uber to tech content creation, driven by a desire for more autonomy and the unexpected success of his newsletter. He shares insights into how AI is reshaping software development, hiring practices, and the career landscape for engineers. The conversation covers the differing AI adoption strategies of big tech giants versus smaller, product-focused companies, the evolving role of engineering managers, and the increasing importance of practical AI experience for career relevance. Gergely also touches upon his personal experiences with AI in his workflow, his entrepreneurial journey, and the challenges of investigative journalism.

Suggested questions

6 ready-made prompts