HomeVideos

The Pragmatic Engineer AMA

Now Playing

The Pragmatic Engineer AMA

Transcript

2417 segments

0:00

What made you switch from a full IC role

0:02

like at Uber to focus on tech content?

0:04

>> My plan was leave Uber, finish writing

0:07

the software engineers guide book in 6

0:08

months and afterwards start a startup,

0:11

join a startup. I was a little bit tired

0:12

of being a middle manager. They tell you

0:14

congratulations, you become a manager.

0:16

They should have said you became a

0:17

middle manager.

0:17

>> Have you seen how AI is impacting what

0:19

employers look for in candidates?

0:21

>> Hiring will honestly just be more

0:23

friction. It'll feel more unfair because

0:25

there will be no clear rules we have

0:27

about used to and it'll be messy.

0:29

>> What's one thing about software

0:31

engineering that will be the same in 5

0:33

years?

0:33

>> There will be just as a big demand for

0:35

[music] professionals who care about the

0:37

craft. You have no ego and you just

0:39

choose the right one for the right job.

0:41

>> Have you ever gotten in trouble over an

0:43

article? Has everyone tried to sue you?

0:45

>> Yes, once. Two articles actually.

0:52

Today's episode is a different one. It's

0:53

an AMA where I answer questions that you

0:55

submitted. Asking the questions is

0:57

Giggs. [music] That is Voldemir Gignak

0:59

C2 at Wartsmith. Wordsmith is a legal AI

1:01

startup where I'm an investor and know

1:03

the team well. And Giggs was just in

1:04

town to help out with this AMA. We've

1:06

grouped the questions as observations

1:08

across the industry, opinions on AI,

1:10

opinions on hiring, questions about

1:12

myself, advice [music] on specific

1:13

situations, and the pragmatic engineer

1:15

as a business. Thanks to antithesis for

1:17

being our presenting sponsor. With

1:18

antithesis, you can verify your systems

1:20

correctness without human review or

1:22

traditional interrogation tests and

1:23

avoid bugs or outages. With this, let's

1:26

jump in.

1:26

>> Hey Ger, welcome to this reversed

1:28

podcast. AMA,

1:30

>> it's really nice to be a guest on my own

1:32

podcast. This this is really cool and

1:34

and thanks for for coming here for for

1:37

some background. We know each other from

1:39

Wartsmith which is one of the very few

1:41

startups I still invest in because I

1:43

stopped investing but about two years

1:45

ago I invested with with a friend Ross

1:47

who I I worked together. It's really

1:49

nice to have you here.

1:50

>> Yeah and you know I'm very appreciate

1:52

you putting trust in us in investing and

1:54

let's get started. So first question

1:56

what made you switch from a full IC role

1:58

like at Uber to focus on sharing

2:01

reporting tech content? Yeah. So at Uber

2:04

I started as an IC and I was an IC for

2:07

about 10 years before Uber. I started as

2:09

a senior engineer. I I became an

2:10

engineering manager pretty quickly. It

2:13

wasn't an IC role but I guess a manager

2:15

role but the it doesn't change the story

2:17

too much. I was hitting about four years

2:19

at Uber and and two things happened at

2:21

the same time. One is Uber in 2020 had

2:23

layoffs because COVID hit Uber's

2:25

business really bad. I had access to our

2:27

internal dashboard where we saw revenue

2:29

for rides and it was just going down

2:31

very close to zero and I was actually

2:34

sharing it to my team because I I

2:35

figured transparency is is a good thing.

2:38

I'm not sure that was the smartest thing

2:40

but I probably still do it again. I was

2:41

people like this is not this is not

2:42

looking good and we were all

2:44

collectively freaking out a little bit

2:46

and layoffs came very predictably. It

2:49

was a 20% layoffs about a quarter of my

2:51

team was unfortunately gone and the

2:53

remainder of my team our mission no

2:55

longer made sense in this new world

2:57

where we were building stuff some

2:59

something for drivers when we thought

3:01

there would not be as many drivers or we

3:03

had to compete with them but because of

3:04

co drivers actually were flocking to the

3:06

platform and and so I I got a new team

3:09

to to work with but it felt to me for

3:12

the first time in 4 years that they were

3:13

going really well and I I just felt

3:16

demotivated. I I knew that the business

3:18

would be doing poorly and I also asked

3:21

myself like why you know what I wanted

3:23

to do after Uber and before right before

3:25

I joined Uber I got this offer which was

3:27

an amazing compensation package which a

3:30

bunch of stock and I told myself well

3:32

stock I mean who knows if Uber will go

3:34

public or not but I said if Uber does go

3:36

public and this this money turns into

3:39

stock I I had about I got about $500,000

3:42

worth of stock as a grant option. And

3:44

I'm like if if I have like 500k in my

3:46

bank account, well I can take a risk and

3:48

I for the next thing I can actually do a

3:50

startup. So I remembered this and Uber

3:53

had gone public and that 500k stock

3:55

turned into 400k because uh of um the

3:58

stock price was a bit lower and then you

4:00

have to pay taxes on it. So it it was it

4:02

was less but I still had a lump sum

4:04

sitting in my savings account and I was

4:05

like huh I don't have to work actually

4:07

for like a I could not work for like two

4:09

three years easily. So I like, well,

4:11

maybe I should take a risk. And my plan

4:13

was leave Uber, finish writing the

4:16

software engineers guide book, which is

4:18

something I started writing at Uber,

4:20

just finish it in six months, and

4:22

afterwards do what you've done, which is

4:25

start a startup, join a startup cuz I

4:28

was a little bit tired of being a middle

4:29

manager. They tell you you're a manager,

4:32

you know, congratulations, you became a

4:33

manager. They should have said you

4:34

became a middle manager because now your

4:36

job is to keep your team happy, to keep

4:38

management happy. and especially I was

4:40

in a different region. I was in Europe

4:42

so this was easy but but when layoffs

4:44

came it was a lot of politics a lot of

4:47

explaining regulations that I it wasn't

4:49

what I wanted to do also keep your peers

4:51

happy in terms of your manager peers it

4:53

was pretty tiring and I I was like I I

4:56

want to be in charge next time cuz I I

4:58

have a lot of ideas but I I felt I was

5:00

like fighting the machine if you will in

5:02

some sense. So that was my plan. I it

5:04

involved nothing with writing except

5:06

just finish this book. I have a legacy.

5:08

I can give this book to people. I can be

5:10

proud of it. But then what happened is

5:12

similar to software engineering when you

5:13

start a project in software engineer

5:14

you've never ever done before. You know

5:16

you're a junior engineer. You're doing

5:17

your first migration. You think it'll

5:19

take two days and then two months later

5:21

you're still stuck there. And it was the

5:23

same thing with writing this book. I've

5:25

never written a book. I know I knew it's

5:26

a big project but I was like yeah six

5:28

months should be enough. Six months

5:29

later I'm still I'm like treading water.

5:32

I wrote three other short books. So uh

5:36

but my main book was not progressing.

5:38

And I asked myself like okay like I gave

5:40

myself about six to eight months to like

5:43

all right get this book out and then

5:44

just go and have a real job. In my my

5:46

mind a real job was either just start a

5:48

startup be a founder or go back to being

5:51

an engineering manager or staff engineer

5:52

or a CTO some a smaller place. And I was

5:55

like okay well I should be honest with

5:56

myself like what am I doing right now

5:58

and what what will I be doing? And I was

6:00

like either I start and I raise funds to

6:03

start a startup. And my idea of startup

6:05

was just Uber and site had a lot of

6:07

platform engineering teams copy one of

6:09

the things that they were doing. My idea

6:11

was actually we had an internal RFC

6:12

system request for comments where we

6:15

actually had a system that put these

6:16

Google docs together and we we graded

6:18

and all that and it was pretty cool

6:20

system. I thought maybe I could

6:21

productionize that. A lot of Uber

6:22

startups actually came from people

6:24

looking at internal platform stuff and

6:26

taking it and either making it open

6:27

source. temporal is is is exuber

6:30

chronosphere exuber observability system

6:33

and many others. So actually it's not

6:35

all all that radical but then I was like

6:38

well if I if I did that I just have to

6:40

fully focus on that and on the side I

6:42

was doing writing I was I was writing a

6:44

few books actually I was blogging I was

6:45

doing YouTube videos out of fun and I

6:47

was like well I need to stop that if I

6:49

do that because if I raise money I owe

6:50

that to my investors I will hire people

6:52

and for about 5 to 10 years I'm going to

6:54

be happy to be just focus 100% on that.

6:56

I talked with my brother. He was on his

6:58

second startup and he said like look if

6:59

you start a startup do it because you

7:01

are ready to spend 10 years of your life

7:03

on it. Like you need to believe that

7:06

right now because if you don't he's like

7:07

it's not going to work cuz startups are

7:09

just really hard. It's not a popular

7:11

thing to say. And I I wasn't sure I was

7:13

right to spend 10 years on like an RFC

7:15

system. I wasn't that excited about it.

7:17

And then I asked myself like okay like

7:20

what is this drive? Like why do I really

7:21

want to do this startup or a startup?

7:24

And I was trying to be honest. I had two

7:26

two answers. One was the money in in the

7:30

sense of like this was 2021. It seemed

7:32

everywhere I looked ex Uber startups

7:34

they were valued a billion. They were

7:37

unicorns in like a matter of like you

7:39

know a year or two. It it seemed too

7:40

easy and I was reasonable. I was like

7:42

that will probably not happen to me. But

7:44

what might happen is I might be able to

7:47

build a unicorn in like let's say 10

7:49

years time. And by that time I will

7:51

still you if I'm a sle founder I might

7:54

have five or 10% stake because I'll

7:56

count with a lot of high dilution which

7:58

is $50 million and let's say we have an

8:00

exit and I leave and then I pay taxes

8:02

and I still have 25 million which is

8:04

like exactly 24 more than I would need

8:07

you know outside of buying house and

8:09

then I have this you know fu money what

8:11

would I do? The answer was like well I'd

8:13

probably like share what I know. I'd

8:14

probably like you know write a book. I'd

8:15

probably like you know do some YouTube

8:17

videos. I was like huh interesting. like

8:19

I could do that right now. And the other

8:22

reason I wanted to do the startup was

8:24

the small teams. I always loved working

8:26

both at Uber and at my previous

8:28

companies at Skyscanner where I met

8:29

Ross, co-founder of of Wartsmith. We

8:32

were a small team, us against the world.

8:33

And I love that feeling like being

8:35

either an engineer on that team or the

8:37

manager of that team. I didn't enjoy

8:38

being a manager of managers, but I no

8:40

longer had connection. And that was the

8:42

other reason. And actually that that was

8:45

I guess the more legit reason. But in

8:48

the end, I I didn't have this like

8:49

exciting idea and I actually I was like

8:51

if this startup was successful, I would

8:53

just be writing probably. So I was like,

8:54

let me try that. I saw Substack was

8:56

taking off. Lenny Rashiski shared that

8:58

uh he had 2,000 page subscribers for

9:00

product management newsletter. I thought

9:02

if Lenny has 2,000 page subscriber for

9:03

product management, there's 10 times as

9:05

many software engineers as product

9:06

managers in every single team and

9:08

they're not as likely to to buy. But

9:10

there was no paid newsletters for

9:11

software engineers. So I was like, let

9:12

me try it out. I gave myself six months

9:15

uh and I figured it it might not work

9:17

and then it just worked. It took off.

9:18

>> Yeah, makes sense. Um next question. Uh

9:21

have you seen engineering teams uh at

9:24

big tech that adopted AI native SDLC and

9:27

how do they collaborate across

9:28

engineering product and design?

9:30

>> Yeah. So AI native SDLC software

9:33

development life cycle e even the whole

9:36

uh you know like SDLC is an interesting

9:38

one before we go get into AI because

9:39

like what what is SDLC? It used to be

9:43

you plan, you code, you deploy, you you

9:46

monitor and some people used to call

9:49

this waterfall and then there was agile

9:51

where you just like iterate a lot

9:53

faster. And interesting thing like

9:56

outside of big tech or outside of these

9:58

large tech companies, if you go to a

10:00

large company that is not like a big

10:02

tech, not not one of the the Googles or

10:03

metas, they often have like pretty rigid

10:06

processes around scrum specifically.

10:08

They say we're very agile. We have scrum

10:10

or they have the safe system, the scaled

10:13

agile framework, which has a bunch of

10:15

meetings and and like a really rigid way

10:17

to be agile. And of course there there's

10:19

a bunch of like money and consulting and

10:21

all that, but they they think they're

10:22

very agile and then they're very

10:24

surprised to see how most of teams

10:27

inside of the likes of Uber or Meta or

10:29

or or even Google work, which is like,

10:31

oh, we kind of have this like, you know,

10:33

problem. We we actually plan, we sit

10:35

together, we kind of do like I don't

10:36

know a few days of planning and then we

10:38

code it and then we deploy it and then

10:40

we get some feedback and we might

10:42

iterate and they're like well that's

10:43

waterfall we're so much more agile and

10:45

actually like the whole thing about

10:47

waterfall and and and agile is it

10:49

doesn't matter anymore. Waterfall used

10:51

to be a thing I talked with Ken Beck

10:52

when it it literally used to be like a

10:54

year or two of planning and like having

10:56

like this much documentation and we

10:59

don't do that anymore. So the software

11:01

development life cycle is is an

11:02

interesting one and almost every modern

11:06

company up up to AI used to have RFC's

11:08

or or or RF RFDs or or design docs where

11:12

people would write down because they

11:13

realize that you should if you plan

11:14

things ahead and then you build you'll

11:17

have better results like plan thing in

11:18

terms of thinking through. Now, the

11:20

whole AI native uh SDLC, the closest

11:24

I've seen to a company who is big and

11:26

successful and making a lot of money and

11:28

and employing, you know, like hundreds

11:30

or thousands of engineers is Entropic.

11:34

They don't employ thousands of

11:35

engineers. They employ probably hundreds

11:37

of engineers right now. But they're a

11:38

very interesting place. They're not a

11:40

product company decisively. They're a

11:42

research lab and they just do everything

11:46

super fluidly like on on you can see it

11:48

in cloud code and I've talked with Boris

11:49

Churnney about this. They don't do

11:51

design docs. They they just do

11:52

prototypes all the time. They kind of

11:54

show it to to themselves. But I I wonder

11:57

if it's really replic replicable and I

11:59

also wonder when it will break down in

12:02

the sense that cloud code is a great

12:03

product. It's it's now the leading

12:05

coding harness. So like they did an

12:06

amazing job and and just with prototypes

12:08

and iteration and using AI and and

12:11

getting feedback and fixing it and

12:12

responding on social media they respond

12:14

to bugs bugs they fix it immediately but

12:16

there's a question to me like sometimes

12:18

like how much do they plan do they have

12:19

a strategy like with pricing they keep

12:21

changing the tiers back and forth and

12:23

tropic is the closest I can think of but

12:25

I I did not see any company that managed

12:27

to really retrofit anything what I'm

12:30

seeing almost every company do they are

12:32

building AI infra systems so for example

12:34

they will build according agent that

12:36

talks with all their internal services

12:37

that's plugged into Google is doing

12:39

this. Uh RAMP is doing this. Uber is

12:42

doing it. So I think what's happening is

12:45

they're betting building a lot better

12:46

tooling to make this easier. And I think

12:48

that's where we'll see and and I I still

12:51

have one last question which is if you

12:53

have a business that is working, it's

12:55

making money. It it has a rhythm. You

12:56

have customers who are used to certain

12:58

things. How much do you want to change

13:01

inside everything versus just changing

13:02

it slowly to make sure for example in

13:04

case of Uber people expect that when you

13:07

press the button the car arrives that

13:09

the drivers are there's there's

13:10

processes behind this which are non

13:12

non-software like you need to do

13:14

outreach campaigns for the drivers you

13:16

need to let them know weeks in advance

13:17

when there will be a big event so that

13:19

they can prepare for it like the pace of

13:21

the business has not changed because of

13:23

AI even though AI speeds up development

13:26

and and and finally like when when you

13:28

just go too fast, you might forget the

13:30

basics, which I'm I'm seeing a lot.

13:32

Spotify is a good example where I've

13:34

talked with their CTO on their team and

13:36

they say they're they do AI very

13:37

responsibly, which which is great to

13:39

hear. But then again, as a as a customer

13:41

and a user, I'm so frustrated cuz they

13:43

seem to be down so much. Like I I

13:45

couldn't publish an episode two or 3

13:46

weeks ago cuz they were down and they

13:48

don't have a status page and I don't

13:49

know if it's AI or not, right? It might

13:51

not be. But then the other they like the

13:54

whole site just went down and I'm like

13:56

if you're using AI you're sure not using

13:57

it for to make better reliability.

13:59

>> Have you seen how AI is impacting what

14:01

employers look for in candidates?

14:04

>> Yeah. [laughter] Well it's it's

14:06

impacting it because it it feels to me

14:09

that they just don't really know what to

14:11

look for. I mean I'm going to ask you

14:12

for this one. I'm going to turn it

14:13

because you you guys are are hiring. How

14:15

how did it change how you're hiring for

14:17

software engineering? And then I'll

14:18

answer.

14:19

>> Yeah. So in our case, we definitely

14:22

structure the interview quite

14:23

differently. So the main thing that

14:25

we're looking for now is uh the ability

14:28

to reason through what AI is doing and

14:32

correct it and do the appropriate

14:34

research. So actually it's interesting

14:36

like our interview process we give away

14:38

a homework which is you know pretty

14:40

classic but we expect that this homework

14:42

will be done with AI but then we

14:44

basically have a very long discussion

14:46

around this homework and we are checking

14:48

okay you picked this algorithm was it AI

14:51

picking it for you or did you actually

14:52

do research and you figured out what is

14:54

appropriate or here is a design decision

14:57

that you made how did you make this

14:59

decision again like is it automatic

15:01

decision by AI or you understand it

15:03

deeply and you can course correct And

15:05

then we are looking so we are peing into

15:07

different parts of the code and we are

15:09

seeing how candidate can react on the

15:11

spot whether they can spot an issue

15:13

whether they can come up quickly with a

15:15

solution to the issue. So basically the

15:17

ability to reason through and of

15:20

research and not just apply all the

15:23

solutions that AI generates

15:25

automatically. So, so this makes a lot

15:26

of sense and this is I've seen a lot of

15:28

similar things with startups doing it

15:30

and when we think of how hiring is

15:32

changing with AI before AI there were

15:33

two worlds in hiring. There was the

15:35

Google interview process which is the

15:37

lead code interview process and this is

15:39

because Google decided early on that

15:40

they they want to hire for raw

15:42

intelligence. They had puzzles initially

15:44

like you know like how many golf balls

15:45

fit in New York or something like that

15:47

but they realized that doesn't really

15:48

scale that well and they found coding

15:50

interviews algorithmical coding

15:52

interviews to to work really well

15:54

because it's selected for a few things.

15:55

It's selected for people who have

15:57

computer science basics which Google

15:59

needed specifically uh going to

16:01

universities where they teach uh

16:03

computational complexity and and some of

16:04

those things. It also selected to, you

16:07

know, like apply under pressure, explain

16:08

your thinking, and it's very scalable,

16:10

meaning you can train um, you know, like

16:13

a thousand interviewers and and give

16:14

them like a a pool of 200 questions, and

16:17

it doesn't matter if a few questions

16:18

leak, uh, the bar will be the same. And

16:21

it works great for Google. It it it

16:23

really does. Oh, and a bonus is that

16:25

people once they know that this is

16:27

expected of them, you need to prepare.

16:28

And if you're unwilling to prepare for

16:30

this, you're not going to be a good fit

16:32

at a place like Google where sometimes

16:33

you need to do stupid stuff. There's

16:34

performance reviews, we need to do this

16:35

thing. There's a new project coming up

16:37

which makes no sense, but we need to do

16:38

it. But we need to do it. And you know,

16:40

like corporate needs people who put up

16:43

with BS processes every now and then

16:45

without too much complaint. So it kind

16:47

of selects for that. So kind of

16:48

wonderful. And this is why most of big

16:50

tech has just adopted that. And Google

16:52

knows that you're not going to do that

16:54

work. You're not going to use those

16:55

those algorithms. But again, it works

16:57

good enough for them because they hire

16:59

people who are adaptable. You learn

17:00

stuff and and you pick up new things

17:02

anyway. And then startups, you just hire

17:04

for practicality. So this is where trial

17:06

weeks have been popular where a lot of

17:08

startups used to hire by just giving you

17:11

real work. Uh for example, take-home

17:13

fixed a real bug in in a a few hours or

17:16

a few days and they could actually see

17:18

like oh you're actually doing the work

17:20

and startups who are doing open source

17:22

often would just hire the contributors

17:23

to the repository. What AI has changed

17:26

is first of all the algorithmic will

17:28

interview it. It it just whizzes through

17:30

it. So remotely doing it no longer makes

17:32

sense. And with the take-home where you

17:34

used to give someone a difficult

17:36

take-home, you can do it in a in a AI

17:38

will complete it pretty well. So you

17:39

don't really get that signal. So my my

17:41

bet is that what will happen is these

17:44

worlds will stay except the imperson

17:47

part is well decision will be made.

17:48

You'll have a filtering like have a

17:50

take-home task that you can do with AI

17:51

and you can cheat if you will. But when

17:55

you will talk with them on and Google,

17:57

they will still have you come into the

17:58

office and you'll have to do those

17:59

whiteboard interviews and if you didn't

18:01

prepare like no AI is not going to save

18:02

you because you don't have access to it

18:04

and startups will probably want you to

18:06

what you did is explain what you did and

18:09

a small percentage of of startups who

18:11

can do they will just have the trial

18:12

weeks what ones at linear does come work

18:15

with us for a week like you need to

18:17

collaborate you can use AI of course you

18:18

can but it's it's not the the main thing

18:20

of it so I I think hiring will be

18:22

honestly just more there will be more As

18:24

a candidate, it'll be more friction.

18:25

You'll need to invest more time. It'll

18:28

feel more unfair because there will be

18:30

no no clear rules that we have been

18:33

gotten used to and it'll be messy. It'll

18:35

be also more subjective. Just a reality.

18:38

>> Yeah, work together by the way is

18:40

amazing way to hire. We did that at the

18:42

earlier stages. It's just a little bit

18:44

hard to scale, but it's interesting that

18:45

Linear managed to scale it. That's

18:47

>> well and by scaling you you mean that

18:49

yes, you know, it's it's hard to do it.

18:51

So most candidates will say yes because

18:52

you need to take time off. The only

18:54

reason linear can do it is they have

18:55

they are very very well known in the

18:57

industry and even like a lot of people

19:00

say that I'm sorry so I I cannot do it.

19:02

I'd love to work there but I just don't

19:03

have the time and so they lose a bunch

19:05

of bunch of those folks.

19:06

>> What kind of engineers are thriving and

19:08

excelling right now? We hear about

19:10

layoffs and slowdowns but surely some

19:12

are doing better than other.

19:14

>> Yeah. So we do hide layoffs, but I I I

19:16

talk with engineers who are very much in

19:19

demand just as so or maybe more so than

19:21

before. And what what these these people

19:23

have is they either work at startups or

19:25

well-known tech companies. They are

19:27

interested in the business. They're

19:28

so-called product minded. You know, they

19:30

don't stop at borders. And by this time

19:32

whenever when AI came around, they they

19:34

just got into it. They somehow whiz weas

19:37

their way either at their company uh

19:39

saying, "Okay, I'm going to work on this

19:41

this AI project building something on

19:43

top of AI." often AI infra like I I will

19:45

help build build this part and now they

19:48

actually considered experts in in in in

19:51

this and most companies that are hiring

19:54

and trying to hire positions. So ones

19:56

that are hard to fill is I'd like an

19:57

engineer who has a few years of

19:59

experience. They've actually built

20:00

something with AI like they're they're

20:02

not an absolute noob to this. They they

20:04

they will help me able to decide what

20:06

architecture should we use. Should we

20:07

use rack? Should we use fine-tuning?

20:09

Should we use an offtheshelf model?

20:10

Should we use our own model? Should we

20:12

write an on-prem? Should we do it

20:13

off-rem? What about the inference costs?

20:15

What about like should we use Grock?

20:17

Should we use Cerrus? So whatever it you

20:20

know like 5 years ago this was you hired

20:22

an engineer who knew about cloud and

20:24

could help you figure out at a startup.

20:26

Now you're hiring someone who knows

20:28

about inference and and some of these

20:29

things and so engineers who have been

20:31

doing this are in very high demand. The

20:34

only problem they have is sometimes if

20:35

they work at the likes of Google Meta or

20:37

or or a wellunded startup these other

20:40

companies are are surprised at how high

20:41

of a compensation ask they have. But

20:44

these people are very in high in demand.

20:46

The people who are having trouble is

20:48

either at their current work they just

20:50

have no exposure to use any AI so they

20:53

don't have this this experience with ba

20:55

building AI infra you know they still

20:57

build software and they use cloud code

20:58

and codec but everyone does that they

21:00

feel a bit stuck on on how to go about

21:02

this and they don't have good pedigree

21:03

meaning they don't work at a company

21:05

that is assumed to be a modern company

21:07

and those people are finding it hard to

21:09

make the jumps and now they're thinking

21:10

should I just do some side projects and

21:12

my my answer will be like well at the

21:14

very least if you want to make that jump

21:16

between the tiers of companies and in my

21:18

mind there's I have the tri model of

21:21

course but also I have this model of

21:22

like the company where you have like

21:23

consulting companies where you're just

21:26

like an Accenture or Capgeemini or one

21:28

of these where you're given the client

21:29

projects they're really struggling right

21:31

now you have the product companies where

21:33

you work and you build products and

21:35

within the product companies you have

21:36

the venture funded uh product companies

21:38

where you actually have a bunch of money

21:40

to to build quickly scale compensation

21:43

won't be higher you're now competing and

21:45

hiring from the likes of big tech and

21:47

then at the very top you have right now

21:49

it's the AI labs the entropics the open

21:51

AI whatever Google used to be in 2004

21:53

and meta in 2010 that is right and Uber

21:56

and for a short time in in 2015 or so

21:59

now that's that's entropic and and open

22:01

AI and it's hard to jump between these

22:03

tiers so for example the pe a lot of

22:05

people are like oh I'd love to work at

22:06

entropic well I mean dream big but the

22:09

reality is that I know so many people

22:11

working at Google and meta and and

22:13

Facebook they want to get into those

22:15

places but these places are extremely

22:17

selective now.

22:18

>> So entry- level web product engineers is

22:21

saturated. Uh but what's the hiring

22:23

landscape for juniors in low-level

22:25

system hardware software integration

22:27

embedded or defense stack looks like? Uh

22:30

same surplus or genuine shortage of

22:32

system level thinking.

22:34

>> I'm less familiar with with with lower

22:37

level systems programming. I I would

22:39

just assume that it's not as saturated.

22:42

uh when I talked with the pragmatic

22:44

summit in February, I talked with an

22:45

engineer who was working on low-level

22:46

systems, mostly C++, some assembly and

22:49

we talked about who's using AI uh cloud

22:51

code, codecs, cursor, etc. And he was

22:54

the only one in the group. There was

22:55

about eight of us talking. Everyone's

22:56

like, "Yeah, using it almost 100% of my

22:59

code is generated by back then it was

23:01

Opus 4.5 or 4.6 or or I think it was

23:04

Codex 5.4." and he was dealing with

23:07

saying like we're using it but uh maybe

23:10

like 30% of my code cuz it's just very

23:12

low level. Uh these areas have always

23:15

been to me a different world than the

23:17

general big tech like big tech hires

23:19

these people. They feel a little bit

23:21

closer to electrical engineering,

23:22

hardware engineering. Now that area in

23:24

general I observe there's just a big

23:25

demand. There's a lot more startups.

23:27

There's a lot more money in hardware

23:28

tech. So hopefully it will be good. And

23:32

I also believe that knowing the basics

23:34

like knowing if you can code in C++ and

23:37

assembly like I think that's really

23:39

useful knowledge and and you can build

23:40

on top of that because most people who

23:43

know a high level language TypeScript

23:45

whatever like mo most of them will not

23:47

know how to go down to C++ if you know

23:50

C++ and you can build high performance

23:52

low latency systems you can learn easily

23:55

the the rest of a stack and if you're in

23:57

this situation I would just look for

23:59

those specific specific offerings. is in

24:01

junior positions. Uh either you have

24:03

pedigree uh which makes it easier which

24:05

means you're in a good school or you had

24:06

an internship at a good place or if

24:08

you're in school try to get that

24:09

pedigree try to get into an internship

24:12

program or build some impressive

24:13

projects either on the side or

24:15

contribute to open source which is a

24:17

still a pretty good way to stand out

24:19

especially with AI contributions being

24:20

rejected. You will have to work hard uh

24:23

if you want to get to prestigious place

24:25

and accept a stepping stone as well.

24:27

Like right now I think getting as a

24:28

junior a job is better than getting no

24:30

job. And once you have a job, try to

24:32

excel. Even if it's a if it's a shitty

24:34

job, try to be the the best there.

24:36

You'll you'll build up a good network

24:37

and at some point hopefully you'll

24:39

you'll have a stepping stone, a new

24:41

opportunity to come in to go to the next

24:42

level.

24:43

>> A few questions about big tech. Uh so

24:45

when a company like Meta lays off 10%

24:48

after a record year and then reassigns

24:50

another 10 10% without consent, how does

24:53

leadership fail to anticipate the

24:55

obvious heat to culture and morale when

24:57

everyone inside and outside can see it?

25:00

>> Yeah, this this is the question, right?

25:01

The interesting thing I talk with meta

25:03

inside of like some directors and and

25:05

even above and they see it. [laughter]

25:08

So so this is not a question of like

25:10

does leadership not see it. This is a

25:12

question of does the founder

25:14

specifically Mark Zuckerberg not see it

25:16

and why does he not see it or if he sees

25:18

it why does he not care and we're now

25:20

going to territory of like assuming what

25:22

a specific person thinks in the case of

25:24

Meta like Meta is the only one who's

25:26

done this no other company that has a

25:27

career CEO I'm looking at Uber I'm

25:30

looking at Microsoft I'm looking at

25:31

Google they have not done this because

25:33

they probably know what would happen and

25:35

they don't want they they don't want a

25:36

part of their business to go down for no

25:38

reason in terms of outages losing some

25:40

of their best people because what's

25:42

happening right now with meta is some of

25:43

the best engineers who up to a few

25:45

months ago thought you know I like meta

25:48

always treated me well we're investing

25:50

in AI we might or might not be winning

25:52

but it's it's it's doing good stock is

25:54

doing good I have a good work life

25:56

balance been here for 10 years now some

25:58

of them have been reassigned to do this

26:01

work that they don't want to do like

26:02

this data labeling you can make it

26:04

interesting and I talk with people who

26:06

are in this organization this a AI ADO

26:09

organization advanc AI that's as AI and

26:12

ADO is is a data organization but they

26:15

jo they joined and they're making the

26:16

most of it and they're engineers with

26:18

less experience but these people realize

26:20

like well I mean leadership specifically

26:22

co no longer cares about engineering as

26:24

a whole so we can only speculate clearly

26:28

it feels like Meta has had in the past

26:31

some existential times one of them was

26:35

when plus launched somewhere in in the

26:37

2010s and it's well documented there's a

26:40

book about a chaos uh I'm not sure if

26:41

Chaos Monkeys covers it, but but it has

26:43

been really well documented where

26:46

Meta went full on on wartime mode. It

26:48

was like look, Google is coming after

26:49

us. They they want to kill us and

26:51

everyone worked really hard because

26:52

everyone understood that the the fate of

26:54

the company was on the line. And my

26:56

sense is that Mark Tuckber probably

26:57

thinks that this is the case right now

26:59

for some reason that is not really

27:00

articulated and others don't necessarily

27:02

understand and he probably has his

27:04

reasons. I don't know why not he's not

27:06

telling people because this is Meta is

27:08

operating in wartime mode except

27:09

everyone's like where's the enemy like

27:12

revenue is is is record high. They're

27:14

doing amazingly well in in the ads

27:16

business. Their products are growing and

27:18

for some reason it seems existential to

27:20

Mark Zuckerberg to to own AI. But again

27:23

this this is where when you look at the

27:24

patterns like the metaverse also looked

27:26

existential to some extent and now AI is

27:29

looking existential. I think people are

27:30

starting to ask a question like okay can

27:32

you just pick a lane and in all fairness

27:34

it it might be hard for for meta or more

27:36

tucker because meta still does not own

27:38

any platform anywhere they they are an

27:40

application layer still and I think he

27:42

really wants to break out of that and

27:43

and I think it's just being a bit

27:45

reactive potentially this is all

27:47

speculation so I think the easiest thing

27:49

would be just ask him if you can answer

27:52

>> among uh big tech companies specifically

27:54

Google Amazon Meta Microsoft and Apple

27:57

how do they feel they're uh doing on AI

28:00

adoption in engineering who is

28:01

accelerating who isn't and who is

28:03

managing transition well

28:05

>> I think Google is trying the the most uh

28:08

they they have the one where they they

28:10

give a free reign to like everyone to

28:11

build AI tools is a bit chaotic but

28:13

people are building a lot of things

28:14

internally and they are the only big lab

28:16

who actually have an AI model with with

28:18

Gemini and they have a Gemini

28:20

organization and there's always talks

28:21

about how they're doing compared to open

28:23

AI and traffic but they're the only ones

28:24

who have any sort of competition in fact

28:26

Gemini is the only product which is

28:28

actually eating to Chad GP's market

28:30

share. My editor the other day was

28:31

telling me I don't use Chad GPT for my

28:33

queries. I use Gemini because I really

28:34

like Gemini and I think he also said

28:36

that it's free. So, okay, I guess there

28:38

you go. So, in in in this way, they're

28:41

actually, I think, way ahead of of uh

28:44

the others. Meta seems to be bogged down

28:47

by building and training their own AI

28:49

and morale is just going down because

28:50

people don't really see the the point.

28:53

Microsoft is in this weird place where

28:55

like it's it's still very political as

28:58

far far as I understand there's the

28:59

organizations there's the co-pilot for

29:01

there's the core AI organization GitHub

29:03

is under core AI now so is AI their

29:07

mandate or is source control they seem

29:09

to forgetting about that and their

29:10

reliability does not sell Azure is

29:12

fighting with everyone for capacity they

29:14

don't have enough Microsoft is focus

29:16

more focused on politics than AI in my

29:18

assessment Apple uh I talk with people

29:21

at Apple but like Apple is very

29:22

secretive And like Amazon is secretive

29:24

cuz their engine culture is is pretty

29:25

good. So I'm surprised they're so

29:26

secretive, but Apple is secretive

29:27

because their engine culture is absolute

29:29

trash from from all I gather is duct

29:32

tapes everywhere. I I'm not sure much is

29:35

happening at Apple, but because Apple is

29:37

not doing too much, I personally hope

29:38

that they will actually see local AI

29:41

locally running on your hardware because

29:42

they have a very strong hardware thing.

29:44

So one thing I think Apple is doing good

29:46

is they haven't forgotten about their

29:47

core business, which is making devices

29:49

and a software that's decent. It's not

29:51

great, but it's decent enough that

29:53

people don't leave. And maybe that will

29:55

actually be a winning strategy. Amazon,

29:57

they also, they're an interesting one.

29:59

So, Amazon is the example to me on how

30:01

difficult it is to retrofit innovation

30:04

compared to Google. They're trying so

30:05

hard to like have AI everywhere

30:07

internally. They built Kira, their

30:09

internal tool, and they have their own

30:12

models, but they're all subpar. It's

30:14

it's all people are dragging their feet.

30:16

They rather use clot code. And and

30:17

Amazon is full of smart people. So to

30:20

me, Amazon a good example of just how

30:21

Amazon, Microsoft, how difficult it is

30:23

to like bring AI to a large

30:25

organization. Companies that I think are

30:27

doing a lot better than all of these

30:30

companies are I guess the little tech,

30:32

not the big tech, but the publicly

30:33

traded companies who are smaller. Uber,

30:35

ramp, even intercom, block

30:40

say for the layout, but they're the ones

30:42

they're building AI in front because

30:43

they don't have an identity crisis. All

30:45

of these Amazon, Microsoft, Meta,

30:47

Google, they're like, "Look, we need to

30:50

own the whole stack. We need to build

30:51

the AI model. We need to build the

30:53

application layer." And then, you know,

30:55

we need to become a platform. And and

30:57

Uber and Ram is like, "No, like we we

31:00

know our place. We want to use these the

31:02

very best possible way. We will take

31:04

clock codeex. We don't care. We don't

31:05

want to build a one of those. We will

31:07

integrate it as much as we can inside of

31:09

us. We will not have a foundational

31:11

model. we will like buy or or use the

31:14

best one and so they're just focusing on

31:15

optimizing it for their business. So I

31:17

think they're the ones who are kind of

31:18

the most ahead in terms of lar companies

31:20

right now.

31:21

>> Entropic and specifically cloud code are

31:24

shipping at extraordinary rate uh using

31:26

agents for implementation, tests,

31:28

reviews, incident response and many

31:30

other things. Is this how AI native

31:33

development will look like or is it very

31:35

extreme environment and others would be

31:37

wrong to copy that directly?

31:39

>> I think it's just very hard to copy on

31:41

traffic. So we cannot deny that entropic

31:43

is the best example for AI native

31:45

development at scale together with

31:46

potentially the codeex team. And when I

31:48

say entropic I actually mostly mean cla

31:52

code and and also their model but it's

31:54

all interwinded because in AI lab their

31:56

product is don't forget entropic's

31:58

product is claude. It's not cla code.

32:00

Cloud code is is a revenue generator

32:02

until claude is so good. their product

32:04

is the model that they they get a new

32:06

version every few months and they do a

32:09

bunch of work with with with training,

32:11

pre-training, post-training and then the

32:13

the tooling around it and everything is

32:16

it's it's like a beehive all around this

32:18

one thing. So the only way you could

32:20

copy it is you become an AI lab and the

32:22

product is just a byproduct which right

32:24

now is doing great even though Entropic

32:27

for example don't even have an

32:28

enterprise sales team that a lot of

32:30

other ventures would have. Maybe they

32:31

have but it's it's it must be pretty

32:33

small right now. I always feel that

32:35

they're a bit of a anomaly. Where I'm

32:37

interested and I I'm not seeing all that

32:39

much yet is is startups on how startups

32:41

are completely changing how they work.

32:44

And I suspect the reason I'm not seeing

32:45

it is when I talk with AI native

32:48

startups who are like okay you know

32:50

we're founders we will use AI for

32:51

everything and you start a company you

32:54

realize the first hurdle is like how do

32:56

you get traction and at wormmith like

32:58

you guys luckily have have gotten

33:00

traction you kind of pass that point but

33:02

a lot of founders it doesn't matter how

33:03

how AI native you are if if you don't

33:05

have customers if you don't have a

33:06

market segment if you don't have any of

33:08

this and I suspect that I wonder if

33:11

that's going to be more important that

33:12

like get traction doesn't matter how and

33:14

once you have traction it's a little bit

33:16

like even preAI you could assemble an

33:19

amazing engineering team and build a

33:21

first version of a product or you could

33:23

just like have like a really bad

33:25

engineer but have a really good idea and

33:27

launch that product and it takes off.

33:28

Uber was a good example where when it

33:30

when it took off Travis Ken just hired

33:32

some contractors made an ugly app but

33:34

but it it did something that was that

33:36

people wanted. Oh and here it was at the

33:38

right place in San Francisco. So I I

33:40

wonder if like AI native is overrated

33:42

and and like once you have a business

33:44

model, of course you can optimize it,

33:46

but will AI native make all the

33:48

difference? I'm not sure. And another

33:49

good example is Coinbase. You know,

33:50

they're really trying to be AI native,

33:52

do all those things, but they're in the

33:53

end they're a crypto company. If the

33:54

crypto market goes up, they will do

33:56

great. And now they did layoffs because

33:58

crypto market just went down. So like

33:59

you can be as AI native as you want and

34:01

maybe you'll be able to do the same with

34:03

like fewer people. But I'm I'm not as

34:05

sold on this.

34:06

>> Yeah. To me it feels like artificial

34:08

artificially trying to become a native

34:10

is a bad strategy right like just saying

34:12

entropic is doing that so we'll copy it

34:14

and try to implement what I think works

34:16

really well is when you're seeing the

34:18

problem and you understand that oh

34:20

actually this problem can be solved

34:22

really well with AI for example you know

34:23

incident response right so why don't we

34:26

try AI to do a first pass understanding

34:28

what's happening right like it seems

34:30

like an obvious idea and like if we have

34:32

problems with incidents and debugging

34:34

time is taking a we can try and if it

34:37

sticks then good but some other process

34:39

might not work in the company. So it

34:41

depends if there is a problem and it

34:42

feels like it can be solved with AI then

34:45

it's like a good idea to adopt the

34:47

practice.

34:47

>> I I I wonder if instead of AI native

34:49

which is just think about like companies

34:51

where like AI is a natural tool that you

34:53

reach for like you for any anything you

34:55

try it out and it might or might not

34:56

work but you're not precious about it.

34:57

You use it if it makes sense and you you

34:59

throw it away if it doesn't or you'll

35:01

revisit it later.

35:02

>> Yeah. And just you have another tool

35:03

that can help you. Next one. Uh, can you

35:06

share something about today's presenting

35:08

sponsor? Was like, is this really is a

35:10

question that people are asking?

35:11

>> No, this was actually not submitted by

35:13

by anyone, but I still want to talk

35:15

about it.

35:16

>> Now, I admit this was the one question I

35:18

sneaked in because I really wanted to

35:20

share something visually interesting

35:22

about our presenting sponsor, Anticys.

35:24

It's how different their UI is. Let me

35:26

show you with three examples. We already

35:28

know that Anticys verifies your systems

35:29

correctness by running your whole system

35:31

in hostile simulation and finding bugs.

35:33

Here's the UI for casualty analysis. You

35:36

can open a report for a bug and see the

35:38

probability of a bug occurring

35:39

throughout the timeline of the

35:40

simulation. In this case, we can see

35:43

that at virtual time 25, something

35:45

happened that makes this bug close to

35:47

100% to occur. So, we can jump into this

35:50

point in the virtual timeline simulation

35:52

to read the logs. This kind of bug

35:54

probably visualization is one that I've

35:56

just not seen before. There's also this

35:58

neat log explorer. You can filter on

36:00

error messages and then visualize how

36:02

common or uncommon the error is over

36:03

time. For example, here we're looking

36:05

for failing linearization failures, the

36:08

purple line, and you can understand how

36:10

rare or common a specific failure was.

36:13

Again, I've yet to see this kind of

36:15

error visualization, and I really like

36:16

the innovation on the UI here. And

36:19

finally, the multiverse debugger. You

36:21

can go back in time and replay a debug

36:24

timeline. And you can inject bash

36:26

commands at any time without affecting

36:27

the playback of the bug. How cool is

36:29

that? For example, here we're listing

36:31

files in the current directory, but as

36:33

you can imagine, you can debug the whole

36:35

environment much easier. I really like

36:36

how the team atysis are pushing what's

36:38

possible with both debugging and

36:40

verifying software. Head to

36:42

anticysis.com/pragmatic

36:44

to learn more. Is ignoring code quality

36:46

for speed with AI worse it longterm?

36:49

Some engineers still review the plan. on

36:51

architecture and code. Others rely on

36:53

SDDD plus harness uh and disregard the

36:56

code plus are shortterm but is AI good

36:59

enough to make up for worse code.

37:02

This is a big question isn't it like and

37:04

I I wonder if there there's like any

37:06

answer like I I I feel as engineers I

37:08

think we we know what want what answer

37:10

we want. We we we want the answer to be

37:13

yes, quality is important. Yes, care and

37:15

craftsmanship is important. And this

37:17

hasn't changed. Like even before AI,

37:19

like we we wanted this to be true. But

37:23

when I got inside of Uber, I I learned

37:26

about some horrible hack that hacks that

37:27

Uber did that was look really painful.

37:29

For example, the old Uber app before

37:32

2016, before we had the rewrite, you

37:34

would open the Uber app and and you

37:36

would see the the ETA of of the the

37:38

cars. you sell the products and you

37:40

could like pull the slider and then it

37:42

would show like how many minutes the

37:43

next category would be. Like for

37:44

example, Uber black is like 2 minutes,

37:47

Uber van is like 6 minutes and and you

37:49

pull it and you saw some other

37:51

information on the screen and what what

37:52

what happened is that app was pulling

37:55

the server every 5 seconds to give me

37:57

all the information. It was a package

37:59

and so every 5 seconds you would get an

38:01

increasingly large data package but by

38:03

that time it was a few hundred kilobytes

38:05

I believe that was coming back. And the

38:07

reason that they did this is is the and

38:08

this is just terrible like strategy.

38:10

It's it's it's inaccurate. It's slow. Uh

38:13

it it's it's really wasteful on

38:15

resources. It it's it's also just stupid

38:17

honestly. And this was in 2016. But by

38:19

that time we should have just pushed

38:21

this information. But the reason this

38:24

happened is the back end team was small

38:26

and the the front end the mobile and the

38:28

web teams were larger and they were

38:29

getting frustrated that whenever they

38:31

wanted to change on the back end to get

38:32

some information back it would take you

38:34

know like days, weeks, months and so

38:36

they asked the back end team like hey

38:38

can we do something about it and they're

38:39

like well there's this really hacky

38:41

solution where we just send this like

38:42

big blob together and you can go in the

38:44

back and you can add whatever you want

38:45

into this blob and they're like perfect

38:47

and it actually unblocked Uber for a

38:49

long time to like grow independently but

38:51

it was a terrible architecture. ure and

38:53

so this is an example where like this is

38:55

clearly tech depth but techdep can speed

38:57

you up and I wonder if with AI this is

39:02

also true that should we not look at

39:04

tech depth in the stages of a product or

39:06

a company early stage you're looking for

39:07

an idea just like go with techdup we

39:09

don't know if it'll work you'll probably

39:10

toss it out there's companies at this

39:12

stage where we just try out prototypes

39:14

and it doesn't matter if it's beautiful

39:15

or not once you found product market fit

39:18

there's this Kenbeck has the the three

39:20

X's the uh I explore, expand, extend.

39:25

And there's other other ways to to say

39:27

this, but in in the expand phase, you

39:29

found product market fit. You want to

39:31

scale up. You want to quickly reach a

39:33

bunch more users. And you're kind of

39:34

okay with hacks at this point to grow

39:36

faster. And and the last phase is is

39:38

when you're mature, you want to make

39:40

things good. And what I've seen at the

39:42

likes of Uber again pre AAI is when you

39:45

find product market fit, you have a

39:46

bunch of customers, you have a bunch of

39:47

demand, you will now have enough revenue

39:49

and money that you can hire people who

39:51

can help you fix these hacks. So I

39:54

wonder if it's the same with AI. Maybe

39:55

we're overthinking that if you're in the

39:56

early stages, you're just doing a

39:58

prototype, just go all in. Don't worry

39:59

about the code quality, which might hurt

40:01

you. If you're at a stage where you're

40:03

now scaling up, I mean, pay more

40:04

attention. And if you're a stage where

40:06

it's a mature product, it's actually

40:07

making money. We don't want to mess it

40:08

up. You know, I'm looking at Instagram's

40:10

product for example, which is a mature

40:11

one, but Meta still messed it up. That

40:14

is probably where you want to be very

40:15

careful and and pay attention,

40:17

understand it. Oh, and final thing is AI

40:19

doesn't only let us build faster. It

40:21

allow us to refactor faster. So, we have

40:23

no excuse not to do that every now and

40:25

then.

40:26

>> Yeah, I completely agree. I think it's

40:27

basically a false dichotomy that it can

40:29

be only speed or quality. Like it's more

40:31

about segmenting in time or in codebase,

40:34

right? So infrastructure maybe more

40:36

attention to quality product maybe more

40:38

attention to speed. There haven't been

40:40

repeated shifts in AI tooling and best

40:42

practices. I makes it easier to find

40:44

exploits and create them. An AI jungle.

40:47

What would it take for the industry to

40:49

seriously create standards rather than

40:50

hoping they emerge?

40:52

>> Yeah, first AI is so new it keeps

40:54

changing. Like I think like any

40:57

standards would would make no sense and

40:59

I think standards just naturally emerge.

41:01

Like I I I haven't seen any patterns to

41:03

it. MCP entropic when they're still a

41:06

small lab. They're not a leading lab.

41:07

They're very small. They created this

41:09

thing called MCP and everyone thought

41:10

it's kind of it makes sense and it comes

41:12

from a non-threatening place. It's a

41:13

small lab which we don't really know.

41:15

They're kind of cool but they're not

41:17

Google was bigger, open was bigger and

41:19

then like all these large companies

41:20

adopted it cuz there was a lot of

41:22

politics in it. So I think it's

41:23

accidental. Entropic today if they try

41:25

to do an MCP people will be like no like

41:27

they are we don't want to be locked in.

41:29

So I think they'll just emerge. I'm

41:31

sorry like I don't have a I I don't see

41:33

anything like planned happening here.

41:35

>> Companies like Entropic have engineering

41:37

managers coding a lot and at Meta and I

41:40

presume at Uber as well uh the

41:41

philosophy was actually the other way

41:43

around that EM should mostly focus on

41:44

people. What's the right approach for

41:46

engineering managers in AI era?

41:48

>> I mean this is a philosophical question

41:50

and like people have strong opinions

41:51

about that. I for example like we we we

41:54

know like from the when at at Twitter

41:56

when El Mus took over Twitter and and

41:58

then renamed it to X he fired a bunch of

42:00

people and he mandated that engine

42:02

managers should code while having 20

42:04

plus reports which which sounded like

42:06

pretty insane to do both. I'm not sure

42:07

there's a right or wrong model. I' I've

42:09

seen all sorts of models work out there

42:11

there's pros to both. There's like when

42:12

an engine manager does not code they

42:14

will care far more about people. They

42:16

will pay more attention to what is

42:17

frustrating people at the personal

42:19

level, at the organization level, and

42:21

they will try to fix those systems and

42:23

they'll try to take really good care of

42:24

people. Injury managers who code, they

42:27

will be more in the details. They will

42:28

be able to to give more technical

42:30

guidance. They will have better

42:31

technical discussions and they will care

42:33

a lot less about this first category of

42:34

things. Uh, and they also probably will

42:36

not have bandwidth to like make systems

42:38

level changes or go to like meetings to

42:40

to for example like you know like work

42:43

with HR to like actually like change

42:45

some policy that makes no sense and like

42:46

upsets a few people or work with a bunch

42:48

of other other teams to like have this

42:50

new system instead of everyone just

42:51

duplicating the work. So right now the

42:53

industry is definitely going very strong

42:55

in a direction that managers should be

42:57

technical. Let's forget about this

42:59

people management stuff. So I think

43:00

people need to unfortunately expect less

43:03

guidance and support from managers.

43:05

Managers who love doing this part and

43:07

are very good at the people part will

43:09

feel probably underappreciated for a

43:11

while. And I think there's a pendulum. I

43:13

think it'll swing back and I think I

43:15

think we've been at the side where we

43:16

have been very focused on on people and

43:18

has been very rewarded as a manager and

43:20

it was great to be an engineer at

43:21

companies like this. It's now going back

43:23

where it will be less so and I I wonder

43:25

if it'll come back again. at some large

43:26

companies that you reported on not using

43:29

AI aggressively is a career risk. How

43:32

should leaders prevent adoption from

43:33

becoming a theater? Uh talking

43:35

leaderboards, mandatory usage, code

43:37

volume targets rather than real

43:39

outcomes.

43:41

So I I wonder if this is like almost

43:43

over because there was a part where I

43:45

talked with CTOs and engineering leaders

43:46

at all sorts of companies and they were

43:48

really frustrated saying, "Oh, my

43:49

engineers are not using AI." But this

43:50

was before Opus 4.5. This was before uh

43:54

well mostly before open 4.5 and GPT 5.4

43:57

and before cloud code was used by by

44:00

many people. This was at the age of

44:02

autocomplete with like you know GPT 4.0

44:06

or or even worse models and like our

44:08

engineers aren't using it or or when

44:10

cursor was al was just the the tab you

44:12

know they have the golden tab key. I

44:14

think this is almost like a non-issue

44:15

like every everyone in most places I

44:17

know uses it and also that's when token

44:19

leaderboards made a lot of sense.

44:20

Shopify the token leader boards in that

44:22

era. No one knows about this about them,

44:24

but they they did it back then and now

44:25

they kind of deprecated it. So I think

44:28

it's kind of moot point especially with

44:29

these strong models. I assume everyone

44:31

will use it and I think it's almost like

44:33

meaningless to look at it a bit like

44:34

lines of code made no real sense to look

44:37

at it for most engineers.

44:39

>> What evidence would persuade you that

44:41

organization achieved an actual AI

44:43

productivity gain rather than just more

44:45

code, more PRs or more humans to review?

44:48

>> It's a good one. right before I entered

44:50

just like taking a step back like when I

44:51

worked at Uber it was the first company

44:54

where I joined where it kind of like

44:56

people told me like don't worry about

44:57

the revenue we just care about growth

44:59

like as long as we grow we're good like

45:01

we just raise more money and then we

45:02

hire more people and then we grow faster

45:04

and we raise more money and we hire more

45:05

people and even I remember my my manager

45:08

was telling me that headcount when I

45:09

became manager I was like how does

45:10

headcount allocation work is like you

45:12

know do you need to make business plan

45:13

or something it's like oh no no no like

45:15

it's it's kind of a black box here like

45:17

it's it's this weird thing where you get

45:18

a headcount allocation and if you fill

45:21

it quickly you get some more and I was

45:23

like how does that work and turns out

45:25

that because like in Amsterdam at the

45:27

time we could hire quickly the

45:29

headcounts were reset at the end of the

45:30

year and if you didn't use it they they

45:32

reallocated within the or it was a

45:33

really weird time and it felt off to me.

45:36

I'm like surely like if I hire a person

45:38

for and it cost they cost X like they

45:40

should generate at least as much value

45:43

right but they're like no not right now

45:45

like we don't live in an age like that

45:46

like oh this is like different I always

45:48

felt it wrong and and so there were

45:50

opportunities where I could have worked

45:51

on a team or led a team which was a

45:53

purely platform team with no direct

45:56

business value and it was kind of I was

45:58

unsure like it was a cool technology

46:00

there was a team who was building uh

46:02

something similar to React Native uh

46:04

just internally because React Native did

46:06

not fit our needs and I was like I'm not

46:08

sure I see the business use case. So I

46:10

always stayed on teams where I was very

46:12

comfortable that we are actually making

46:13

money. Like I knew how I was making

46:15

money. And I always had this in my mind

46:17

that if someone asked like what would

46:20

you do if you hired two more people I

46:22

would have an answer here's how much

46:23

more revenue you would generate. And if

46:24

someone asked what would happen if I

46:25

took away two of your people or half

46:27

your team or your whole team I'd be like

46:29

no problem. Here is the business impact.

46:31

Here's how much revenue we would make.

46:33

And so when it comes to AI productivity

46:36

can we really distinguish from business

46:38

productivity? I mean, there's only two

46:40

ways that a business revenue-wise can

46:42

make a difference. And this is just a

46:43

very capitalist way of thinking about

46:45

things, of course. But one is either you

46:46

make incremental revenue, meaning money

46:48

that you would have not made before. If

46:49

you would have made that money before,

46:51

it doesn't matter. Like if you're a

46:52

crypto exchange and oh, we're making

46:54

more money because there's more crypto

46:55

volume. Well, that's not AI, is it? It's

46:57

the market. But if we launch this new

46:59

product and it's now making money that

47:00

we didn't do and AI is helping with

47:02

that, that's I guess value for AI or

47:05

cost savings. And I wonder if AI's

47:08

biggest use case is just cost savings

47:10

which is kind of depressing to me. But

47:12

the AI native companies that are making

47:14

money uh I do see the ones which are

47:16

selling an AI product. You know the AI

47:17

labs are obvious ones. There are

47:18

startups let's say AI incident review

47:20

who are making money because of that

47:22

product. So I think that's a use case.

47:24

But otherwise it's it's pretty iffy

47:26

pretty finicky. And I I still have this

47:28

this private thought of like will AI be

47:31

a bit more like cloud in the sense that

47:33

cloud is everywhere now and including in

47:35

banks just said we will never go on

47:36

cloud and now they're in AWS but like as

47:38

a customer no one cares if you have

47:40

cloud or not. It used to be as a cost

47:42

saver more a more flexible way to to

47:44

control cost and I think AI it maybe

47:46

it's a more flexible way to control your

47:48

own cost or or like what people do work.

47:51

It's a weird thing, but to me it feels

47:53

closer to cloud than like technology

47:55

like mobile which created a whole new

47:56

market of everything.

47:57

>> What is a popular current belief about

47:59

AI and engineering that you think is

48:01

incorrect?

48:02

>> I think it's incorrect to think that it

48:04

just makes things easier. if you're

48:06

using AI and your life is getting a lot

48:08

easier, like you're are you trying hard

48:09

enough or are you like delegating to

48:11

stuff? And because to me like I I I use

48:14

some of it for for my business and it

48:16

actually like makes me think just as

48:19

hard if if not harder work is harder. So

48:21

I I think like believing that AI makes

48:23

work easier, our our jobs easier, it's

48:27

just it's just wrong.

48:28

>> How important are degree and university

48:31

prestige in hiring today? Is computer

48:34

science becoming a prestige field like

48:36

law or architecture leading to fewer

48:39

self-taught professionals?

48:40

>> Unfortunately, I believe it is. And and

48:42

this is less to do with the with the

48:44

degree and what they're teaching, but

48:45

more about the market. There was a time

48:48

around like 2015 to 2020 where you you

48:50

could get hired at a company for a

48:52

well-paying job by doing a boot camp,

48:54

which is like three months to 6 months,

48:56

sometimes 12 months versus a four year

48:58

or or five year degree in computer

49:01

science. And the reason was there was

49:02

just a huge shortage like the all all of

49:04

the people graduating from from

49:06

university were were swapped up. That

49:08

has ended. Majority of companies do not

49:10

hire from boot camps. Very very few in

49:12

pockets maybe in the UK or elsewhere do

49:14

apprenticeships but they're very small.

49:16

And the top universities are still

49:19

getting those graduates are getting

49:21

hunted down at the likes of of MIT,

49:24

Caltech,

49:26

Harvard, many others, Waterlue in

49:28

Canada, Imperial College in in the UK

49:31

and so on. But they're not getting as

49:33

many competing offers as as before and

49:35

and even at the mid-level of schools,

49:37

it's it's just harder. So when it was

49:39

hard to hire someone with a computer

49:41

science degree, people went for like

49:42

lower selftaught and and those things.

49:44

But now they they do it less. I even had

49:47

someone tell me who is selftaught,

49:49

worked in the industry for 5 years, lost

49:51

their job about two I think a year and a

49:53

half ago that for a year she couldn't

49:55

find a position even though she was

49:57

doing like SR work and infrastructure

49:59

work. And I think in the end she said

50:00

that she's either considering changing

50:02

fields or or just doing her own thing.

50:04

And that's the other thing that I think

50:05

it's easier than ever to do your own

50:07

thing, but companies I think will be

50:09

more picky. And the value of the degree,

50:12

it's a bit underrated if you're in

50:14

living in your current country and you

50:15

don't plan to leave, like it it might

50:16

matter a bit less. But first of all,

50:18

large employers often like have this

50:20

requirement just for filtering. Saying

50:22

we need a degree, it just filters out a

50:23

bunch of non-qualified people. Saying we

50:25

need a computer science degree just

50:26

filters out the art majors and and they

50:28

don't have to look through as many

50:30

resumes because they already have too

50:31

much even if they have this one thing.

50:33

But a degree is very important for

50:35

visas. If you're for example in in a

50:37

country and you'd like to move to

50:39

another country, typically more towards

50:41

the west and they like without a degree

50:43

it will be very difficult with the

50:44

immigration system. So like that's

50:45

something that's worth keeping in mind.

50:47

That thing can pay dividends even

50:49

decades later when you're not thinking

50:51

too much about it.

50:52

>> So a few questions about yourself now.

50:53

Do you still spend time programming

50:55

yourself or testing large language

50:57

models? And if so, what percentage of

50:59

the time? I spend most of my time

51:01

researching and and writing, but

51:03

increasingly now for my business, the

51:04

primatic engineer, I have a backend that

51:07

manages group subscriptions, some

51:08

customer support functionality that I'm

51:10

I'm building. I'm building it myself.

51:12

And now uh I might have like some folks

51:15

help me on my team as well. But when I

51:18

could get a SAS now, I'm like I don't

51:19

want to get a sauce. I I just want to

51:20

build it myself. So it's it's simpler

51:22

stuff. Honestly, it's like crud database

51:24

that it runs on on infrastructure like

51:27

render. I I use the tools. I I I use uh

51:30

Codeex. I I really like Codex and and

51:32

GPD 5.5. I also use uh clot code as

51:35

well. I I play with cursor. I sometimes

51:37

try factory. So I I try to rotate these

51:39

tools and it just makes it so much

51:40

easier for me to get back into it, but I

51:42

don't spend most of my time on it.

51:44

>> And in your own workflow as a creator,

51:47

writing, podcasting, researching, have

51:49

you seen productivity gains from AI?

51:51

>> So this is the interesting thing where I

51:52

I think I should have. So I don't use

51:54

any AI for my own writing. Like I

51:57

I I did a few of these experiments more

51:59

for curiosity saying, "Hey, here's

52:02

here's some notes. Generate an article

52:04

in the voice tone of the pragmatic

52:05

engineer. First of all, it isn't

52:07

addresses job on it. I don't think it

52:09

sounds like me. Second of all, like it

52:12

it just has those I don't know, it just

52:14

feels artificial like like the links.

52:15

And then most importantly, I really

52:17

really enjoy like like I love writing. I

52:20

don't like it's not the the thing of

52:21

writing, it's the thinking. Like when I

52:23

write I I keep thinking and a lot of

52:25

times on social media when I will post

52:27

something and and it gets a bunch of

52:29

likes or views. It's often I'm just

52:31

writing and I have this idea when I'm

52:34

like revisiting the you know this topic

52:36

for the third time and I'm like that's

52:37

an interesting idea. So I just post that

52:39

idea out there and I just go back to to

52:41

writing and then later I see like you

52:43

know people respond to it because I

52:44

guess what people see is is just an

52:46

original idea that comes like most of my

52:49

social media is my byproduct of writing

52:51

and researching like most people don't

52:53

know this like there there are so many

52:55

people who are optimizing social media

52:56

for likes or or things or or all of this

52:58

thing but for myself and a bunch of

53:01

people that I I know and and respect it

53:03

it's kind of like their side thing. One

53:06

good example I I read someone on on on

53:08

Hacker News wrote about this that their

53:10

favorite YouTube creators in

53:11

photography. This person was a hobby

53:13

photographist. Their favorite

53:14

photography creators are not

53:16

professional YouTube creators about

53:17

photography. They're photographers who

53:20

have a business and they actually like

53:21

do shots and then they have a YouTube

53:23

channel where they share every now and

53:24

then. It's infrequent. It's not there.

53:26

And I also think of myself as my my main

53:28

thing is I I research what's happening

53:30

in a tech industry. I talk with

53:32

engineers. I try to keep an ear on on

53:34

the ground as much as I can because I

53:35

talk with and I do this by just being in

53:37

touch with a bunch of software

53:39

engineering folks I know some friends

53:41

and when I see interesting things I dig

53:43

into it. You know that's for example how

53:44

I noticed that something was really off

53:46

at Meta. I I've only ever sensed things

53:48

being like slightly off at Meta for so a

53:50

long time but now I've I I have 10 or 15

53:52

people who I know there and I for years

53:55

and now like most of them were like

53:57

sounding the alarm bell. I'm like that's

53:58

new. I haven't heard that before. And

54:00

you know, turns out I I was right about

54:02

how just how bad things have gotten

54:04

there. But in in in my workflow, uh I I

54:07

use it for research when I'm like here's

54:09

a topic like all right, I'm going to

54:11

research RAMs engineering culture. All

54:12

right, deep research on all the

54:14

platforms like give me all the stuff.

54:16

And I would have thought that this would

54:18

have like freed up time and I guess it

54:20

frees up some of that time, but I I

54:21

would have never spent that much time

54:22

researching. So I don't feel that I'm

54:24

working less interesting enough. And

54:26

what capability do you worry I might

54:28

weaken in your personally? For example,

54:30

coding fluency or technical recall or

54:33

writing from blank page.

54:34

>> I I don't think like the the writing

54:36

will will suffer cuz I I just don't use

54:38

it there. I don't even have spell checks

54:40

on like I just don't like it or I know I

54:42

turn Grammarly off off as well cuz I I

54:44

hate when it like wants to reorganize

54:46

it. I think it's whenever you over rely

54:48

on something it it it could make it less

54:50

efficient. Like for example, one thing I

54:51

now overrely on is like just deep

54:53

research. like I I want to find all the

54:55

things on the web. So, my ability to

54:57

like find things on the web might be

54:59

worse, but I'm not too worried about

55:00

that cuz first of all, it was it was

55:02

just grudg. Second of all, I don't

55:04

really trust the internet that much.

55:06

Like in deep research, I still check

55:08

where it gets references from. When it's

55:09

too much Reddit, I'm like, [laughter]

55:12

I'm not sure this is going to be 100%

55:14

checked out. But with coding, u I I now

55:17

just prompt and and write the code. and

55:19

my ability to to write code by hand will

55:22

probably be degrading, but I don't

55:25

personally mind that part all that much.

55:27

So, I think it goes back to like look

55:29

like whenever using AI for a bunch of so

55:31

just know that that skill will go down

55:32

and are you okay with that? And I'm kind

55:34

of okay with it.

55:35

>> Has AI ever tempted you to go back to

55:37

building software?

55:39

>> It's now so much easier to build

55:41

software. like it probably would would

55:44

have tempted me, but right now I just

55:45

love what I do and I I actually love the

55:48

human connection of actually talking to

55:49

people and getting getting a window into

55:51

what other people are doing. But it is

55:53

making me build more software and being

55:54

more ambitious. So there's this project

55:56

that I've been putting off for a while,

55:57

which is a self-service signup flow for

56:00

for companies for the pragmatic

56:02

engineer. So like the whole company

56:03

domain and I'm actually just building it

56:05

because it's so much easier to get

56:06

started with. It's it's less

56:07

intimidating. Vladimir is QA engineer in

56:09

banking early sorties and he's worried

56:12

about staying relevant. So he's tempted

56:14

to quit for full CS education. Uh but

56:17

it's quite scary to give up good

56:19

paycheck. Uh feel stretched. How should

56:23

he think about f future proofing his

56:25

options? What I see in terms of future

56:27

proofing is the single best ways to

56:29

future proof it is work at a company

56:31

which is doing stuff that is very

56:33

relevant. You know this is building

56:34

products, building modern products,

56:36

building products that incorporate some

56:38

level of of AI where it's okay to

56:40

experiment. a banking where it's a rigid

56:43

place it might be the opposite but my

56:44

first advice would be inside a company

56:46

can you start a project uh where you are

56:50

just doing some experience with AI this

56:51

is why Google is is such a great place

56:53

right now I I I know it might not be too

56:55

popular to say but they encourage doing

56:58

this like oh you're you're on your team

56:59

you're building a product cool and you

57:01

have a you have a suggestion to like

57:02

build this new experiment with AI yeah

57:05

go ahead and do it and I have a feeling

57:07

that a lot of companies will be

57:08

receptive to this cuz right now there's

57:10

a bit of like every leader thinks like

57:12

we should use AI more and if someone

57:13

comes and says like I have an idea and

57:15

I'll do it on on part-time it's a

57:16

win-win worst case is you know you

57:18

learned about rag or you learned how to

57:20

implement this thing it can be an

57:22

internal tool and that's why there's an

57:24

explosion even at larger companies like

57:25

Uber with internal AI tools just just

57:28

start doing that I think that's the best

57:29

way to stay relevant because if you take

57:32

a a computer science degree or or do it

57:34

full-time it's it will still be it could

57:37

be behind the industry right now also

57:39

like you can do a degree part-time, but

57:41

because it's such a big technology

57:43

shift, like the best way is to be

57:44

hands-on. So, my my advice would be try

57:45

to do that as part of your job, that's

57:47

the easiest. Everything else is harder.

57:49

Leaving for a new place, interviewing

57:50

for a new place, all harder. Of course,

57:52

you can try to do side projects, but I

57:54

find that unless it's something that

57:55

truly motivates you, like unless you

57:57

have this thing that you really want to

57:58

build, like this health app that you

57:59

really want and it doesn't exist, then

58:01

do it. But other than that, it it could

58:03

be easier to do it at work. My two

58:04

cents. How can you surround yourself

58:06

with highly motivated top-notch

58:08

programmers when your classmates aren't

58:09

that at that level and it feels like too

58:11

much to catch up to?

58:13

>> I mean, if if if your your classmates

58:15

are not that motivated and you are, try

58:17

to find a different group of friends and

58:19

well, it depends on where if it's high

58:20

school, then you're stuck with them. Uh,

58:23

which is find even when I was at high

58:24

school, there was only two of us who

58:26

were coding and luckily there was

58:28

another person. Maybe we can find

58:29

someone from a different class, maybe on

58:31

an online community. I I've heard some

58:34

Alis real on my podcast when she was in

58:37

high school she joined online

58:39

communities and started to build uh she

58:41

actually started to contribute to some

58:42

software there. So like that's one one

58:44

way to find if this would be at work try

58:47

to either change teams if you can

58:49

internally to to move there or outside

58:52

of your project like take projects where

58:55

you can work with other people like like

58:56

seek out and and and try to follow those

58:58

people or get towards them because a lot

59:00

of people will be motiv and and also

59:03

this is the thing where when you're in

59:04

that situation you can change companies

59:05

it makes a difference when I worked at

59:07

uh in banking one of my first jobs my

59:10

colleagues were super nice they were

59:11

such nice people but they were not in

59:13

love with technology. None of them were.

59:15

And then when I moved to Skype, everyone

59:17

was and it was just such a big

59:18

difference.

59:19

>> So Akos is saying that his son is

59:20

heading for an IT focused high school

59:22

dreaming of becoming a game developer.

59:25

What does a pass and the job market

59:27

looks like in 5 years from now? And what

59:29

should he do to prepare himself?

59:32

>> Everyone's asking this question, right?

59:33

If if only we knew. I mean, I I

59:35

personally believe that I try to draw

59:37

parallels from other industries because

59:39

we we don't know what's going to happen

59:40

exactly with AI. you know this tool that

59:42

we know that coding is so much easier.

59:44

It will probably make some of the other

59:45

parts of the jobs easier. But I like to

59:47

think of of a parallel for example

59:49

construction where like like if if you

59:52

wanted to build a house today or at

59:54

least okay renovate your house

59:55

significantly. You could walk into the

59:57

the DIY store or you can go online and

59:59

you can order a bunch of equipment in

60:01

including professional equipment. You

60:02

can get the same equipment as

60:03

professionals. On YouTube you have

60:05

professionals making videos of how to

60:07

build a wall, renovate a wall, tear down

60:09

a wall, do that. You could do all of

60:11

that. You have you have the information

60:13

and you have the the tools and you have

60:15

the materials. You can buy the top-notch

60:17

materials. It just takes a bit of work.

60:19

So why do people in construction have a

60:22

job? Well, I guess most people don't

60:24

want to do all that and they'd rather

60:25

hire a professional. So I think what

60:27

will happen in the tech industry is

60:29

exactly this where and of course more

60:31

people are fewer people are are calling

60:32

out electrician to like change a light

60:34

bulb or or or even some of the more

60:36

advanced work you a lot of people are

60:38

using YouTube and DIY shops are probably

60:40

getting way more business but I think

60:42

there will be professionals so if you

60:43

want to be a professional in a field

60:46

there will be a path to that and to to

60:48

get into that it will will go to

60:49

university's education I'm fairly

60:52

certain that the game that will be

60:54

released in 10 years which Aquas's will

60:56

hopefully be working on. It will be

60:58

built by a studio that's either a

61:00

startup or AAA studio and if it's a AAA

61:03

studio they will hire graduates from

61:04

some of the top universities from people

61:06

who have been building games on the side

61:08

and for Acro Stan specifically uh I have

61:11

a episode with Jonas Tyroller who uh

61:15

builds games and one of his games got a

61:16

million sales with two of them building

61:18

it. I would suggest that to watch that

61:20

episode, but also Jonas, he shared a

61:23

video of all the games he built over

61:25

like 10 years or or 15 or 20 years and

61:28

he has been building games on the side.

61:30

So if if his son wants to become just

61:32

encourage him to start building games on

61:34

the side right now

61:35

>> in this hard market, what do you

61:36

recommend for engineers in the EU? Uh

61:39

keep aiming for tier one companies or

61:41

stick with tier two job.

61:42

>> Yeah. So so this is the in the try model

61:45

structure. I I I have a tier one. I I I

61:48

put it as as the the local companies,

61:50

like the local supermarkets, the ones

61:52

that are really competing for local

61:53

talent. Tier two is regional and tier

61:55

three is as is global. That's the big

61:56

tech. And like in in this job market,

62:00

well, first of all, like when the job

62:02

market is is really like volatile and

62:04

uncertain, like staying put can be a

62:06

good strategy. At the same point, like I

62:08

would not stop looking for opportunities

62:10

because on one end, like the job market

62:13

feels a bit different than in 2023. 2023

62:15

was a brutal market. It was layoffs

62:17

everywhere and no one was hiring. Right

62:19

now there are some layoffs but so many

62:21

companies are hiring. So now could be a

62:23

great opportunity to jump a tier up to a

62:25

startup to to to some to to building

62:27

products to having more autonomy to

62:29

using more of these AI tools. And if you

62:31

stick at a company that is just really

62:33

moving slowly, you might not have that

62:35

opportunity. I I talked about the

62:36

engineers who are really in demand. They

62:38

have a few years of hands-on experience

62:40

with these tools. They will be in demand

62:42

in a few years time as well. And if you

62:44

will still have zero years of that,

62:45

well, you're kind of sitting in one

62:46

place. So, I I would be opportunistic in

62:49

looking out, maybe looking at at job job

62:52

openings, talking with your network, not

62:54

ignoring fully recruiters, seeing what's

62:56

out there. Look, if you get a job offer,

62:58

you can always say no. If you have no

63:00

job offers, I mean, you're you're going

63:02

to stay at your current place probably

63:03

anyway.

63:04

>> How can engineers and students use AI to

63:06

learn and explore new technologies and

63:08

concept better? I

63:09

>> I think you can use deep research a lot

63:11

better. You can ask it to explain stuff,

63:13

but the way I see it like it it AI only

63:16

ever helped me learn about stuff when I

63:18

wanted to learn about something. So,

63:19

start with what you want to learn. It's

63:21

a tool. It'll help you, but I wouldn't

63:22

also fully like throw away things like

63:24

like like books, other resources like

63:26

like like maybe like videos, uh,

63:28

tutorials and also just building your

63:30

own thing like that. That's what I mean

63:31

like biggest miscon.

63:34

It's not going to make it easier to to

63:35

learn especially when you're not

63:36

motivated. So like decide what you want

63:38

to learn and yeah it can help you but

63:40

like just just learn it in that case

63:42

like just have no you have one fewer

63:44

excuse when you want to do it and if you

63:45

don't want to do it just just don't do

63:47

it.

63:47

>> So not IRS is asking a question so I

63:50

guess it's very safe to share all the

63:52

information. How much do you earn from

63:54

this and why start this instead of the

63:57

tech job? the the last time I shared

63:59

specific numbers was I think I think in

64:02

the first year of the publication where

64:03

I shared that I had like 2,700 paying

64:06

customers and it it's gone a lot beyond

64:07

that. It's now more than 10,000 paying

64:09

customers of the the newsletter. I also

64:12

now have some sponsors in the podcast.

64:13

And the reason I I don't like to talk

64:16

about the specific money, you know,

64:18

there there's people like here's exactly

64:20

how much I make is every time I do that,

64:23

I get so many questions coming in from

64:25

people like, "Oh, I also want to make

64:27

this much. Can you advise me? Can you

64:28

have a call with me? Can you coach me?

64:30

Can you mentor me? I want to quit my

64:31

job. I want to do this thing. And first

64:34

of all, I'm very grateful that it's

64:35

amazing business, but it's just not what

64:37

I'm good at. Like, I don't want to give

64:38

financial advice to people. And I didn't

64:41

even think this was possible, but to

64:42

actually not like be that like vague.

64:45

When I left Uber, my composition was

64:49

going down a little bit because of the

64:51

the four-year vesting. But in my best

64:53

year at Uber in in the Netherlands, I

64:56

made I I think it was like something

64:58

like €288,000.

65:01

Back then it was like 320 $330,000 or

65:04

something like that. And and 120 of that

65:07

was base salary. I think it was like a

65:10

26 or 27k bonus or maybe 30k bonus. It

65:13

was a big cash bonus and the rest was in

65:15

equity. And like when I started this, I

65:20

I didn't think it would go too far. I I

65:23

thought I'd give it a shot. But mo mo

65:24

most of why I didn't think it would go

65:26

go so far, just being realistic. Like

65:28

Lenny shared his his numbers of 2,000

65:29

page subscribers and you do the math as

65:31

$300,000 roughly, give or take. And and

65:34

he was going up. And I thought, well, I

65:36

mean, maybe I could I get there? Maybe

65:38

yes, maybe no. But we we'll see when we

65:40

get there. But I in the first week of

65:43

starting publication, I I had 100 paying

65:45

customers, which is like that was

65:47

$10,000. So that's paid up front, which

65:49

is okay. That's very nice. In 6 weeks, I

65:52

got to,000 paying subscribers. It was

65:54

still $100 before I raised and I started

65:56

to raise the prices back then, but it

65:58

was like around $100,000. And then I

66:00

kept going up and I started to be on a

66:03

higher annual run rate in about like I

66:05

think four or five months than my old

66:07

Uber best total compensation. and it was

66:09

still going up and I was like, "Okay,

66:12

what's going on?" So, I I just kind of

66:14

stopped looking at or or thinking too

66:16

much about the money or or these things.

66:17

I started to focus on just writing that

66:19

one really good article. I did this for

66:21

a year and a half uh two years actually.

66:24

And then I looked up and I was like,

66:25

well, I actually really love doing this.

66:27

It actually I didn't know that you could

66:30

you could make more than working at a

66:33

big tech by doing this thing your own

66:35

business. And this is also something

66:36

that you can realize if you're like with

66:38

your own business, you have the

66:39

potential to make more. And also, you

66:41

know, one of the reasons you probably

66:42

left Meta as well where you were

66:43

probably very highly paid is you have

66:45

the opportunity with a startup with your

66:48

own business. I I'm very lucky that this

66:50

has happened. But but also one thing

66:52

like I love my days. Uh I find it very

66:55

very exciting every day what what I'm

66:57

doing and that that is what keeps me

66:59

doing this. And I I honestly I just love

67:00

being in charge. like like right now I'm

67:03

sitting here because I'd like to sit

67:04

here and I'm having a a great time with

67:06

you, but if I didn't want to, I didn't

67:08

have to do this. And I I'm do I do well

67:10

when I create my own structure, but it

67:12

really helped me. I don't think I could

67:14

have done any of this without going

67:16

through that like 15-ish years as being

67:18

a developer, like just doing the I

67:20

always tried to do the best work that I

67:22

could. I had a lot of structure. I I I

67:24

have a lot of I made a lot of

67:25

connections who actually helped so much

67:26

with this business. Like a lot of times

67:28

my my guests are people that I know or I

67:30

reach out to them for to advice. So uh

67:33

luckily I I feel almost like like wow

67:35

like this was this possible and I didn't

67:37

think this was possible but now I'm just

67:39

kind of rolling with it and I'm like

67:40

yeah it's it's great. I love it. I enjoy

67:41

it. I'm also not too attached to it in

67:43

the sense that like look if business

67:45

wouldn't do that well or people for some

67:47

reason you know they they stop being

67:48

interested. It's like well I I can live

67:51

with it as long as I help some people I

67:53

give value to some people. And also,

67:55

this is an interesting thing, like I

67:57

could make more revenue by like juicing

68:00

it more. Like I could put more things

68:01

behind payw wall. I've gotten feedback

68:03

from people saying, "Why did why did you

68:05

put so much of this outside of the payw

68:06

wall?" And whenever I think something is

68:08

important and more people should get

68:09

access to it, I try to not put it behind

68:11

the payw wall even if it hurts the

68:12

business because again it's it's kind of

68:15

nice to be able to do that.

68:16

>> What's next, Gary? Uh any expansion

68:19

plans for the programmatic engineer?

68:21

>> Yes. So the interesting thing is if this

68:22

was a VC funded company and I took VC

68:24

funding, I would have to expand. Uh but

68:26

I don't uh the only plan I I have is I

68:29

would like to make the pragmatic summit

68:31

more regular. There was one in in in

68:33

February in San Francisco. Uh there will

68:36

be one in in the beginning of the year

68:38

also in San Francisco and I'd like to

68:41

get to a point where I can have one in

68:42

Europe as well. Uh and I'd like to be

68:45

able to do this on a more regular basis.

68:46

So ideally my dream but uh like this is

68:50

more down to logistics and and energy

68:52

and some of those things is is to have

68:54

one in the US or pragmatic summit and

68:56

one in in Europe in London or or or

68:58

somewhere else. And getting to that

68:59

point I will be very happy and also I'm

69:02

growing my team very slowly. Uh we now

69:03

have a small team. Uh so I'm I'm just

69:06

figuring out ways that uh I I can have

69:09

folks involved and help with with even

69:11

more ambitious research. I'd love to do

69:12

even going deeper. I have so many ideas

69:15

of of of companies to research,

69:17

industries to research, sometimes some

69:18

boring industries. Like at some point,

69:20

I'd love to go into a utilities company

69:22

and like go through like how they build

69:24

software. It's it sounds pretty boring,

69:25

but it's pretty darn important.

69:27

>> Have you ever gotten in trouble over an

69:29

article? Has everyone tried to sue you?

69:32

>> Uh yes, once. Two articles actually. Uh

69:36

one I never published uh because I

69:38

decided not to publish. Uh I this was at

69:41

the beginning beginning of the

69:42

publication. For some reason, I really

69:44

got upset at at Neoang Bunk in the

69:46

Netherlands uh because I read about

69:47

their hiring practices. They do

69:48

intelligence test, raw chart test before

69:51

uh doing a technical interview. And I

69:53

thought that's kind of messed up. And uh

69:56

I tweeted about this and a bunch of

69:57

people who were unhappy at the company

69:59

wrote to me like, "Oh, here's some juicy

70:00

stories about how terrible this company

70:02

is and here's all the things that they

70:04

do and here's I have and they had

70:06

evidence and and all that." And it it

70:08

was like some of it was like, "Whoa,

70:09

wow. This is like crazy." And so I

70:11

started to write an article about that.

70:12

This was in the first year of the

70:14

pramatic injury. This was December. So I

70:15

started in August and this was in

70:16

December. And I had an article ready

70:18

that was pretty pretty damning. It

70:20

probably probably read like a hit piece.

70:22

Like I didn't have any agenda, but it

70:23

was just like negative negative negative

70:25

and this and can you imagine this and

70:27

that. I was about to publish it. I even

70:29

sent it over to the company uh to Bunk

70:31

and saying could do because I my editor

70:34

uh was like you should probably send

70:35

this over to them like but then I slept

70:37

on it and I was thinking what what am I

70:39

going to achieve with this like at the

70:41

company inside a bunk I'm not helping

70:43

anyone because they'll be defensive and

70:44

it's it's actually a business it employs

70:46

people and it's growing and it's playing

70:47

more and more people and then uh I also

70:50

got a message from someone who who said

70:52

that they had a bad experience there but

70:54

it was also very helpful because this

70:56

person came from I think Egypt and no

70:59

company would hire him in a visa on the

71:01

Netherlands, but Bunk did and they were

71:04

pushing him really hard and some things

71:06

felt unfair, but it was a stepping stone

71:08

and that person now works at Facebook

71:09

and said it could have never happened

71:11

without Bunk and they took a chance on

71:12

me. And I was thinking like, well, I'm

71:15

not going to help the company. The

71:17

article has zero positives. It just says

71:20

don't do this, don't do that. And and

71:22

also despite this, they actually have a

71:23

business. And I was like, I'm probably

71:25

missing something here. And I decided to

71:27

not publish it because I decided that's

71:28

when I decided I I want to publish

71:29

things where I actually like share

71:31

things that work like and I wasn't

71:34

sharing any of the things that made Bunk

71:35

work. And actually they're now even more

71:37

successful companies. So they well and I

71:39

think this is the thing like every every

71:40

company has it ups and downs. So that

71:41

was a thing that I did not publish and I

71:42

didn't get in trouble for that. A bunch

71:44

of journalists reach out to me later to

71:46

like get all the juicy details because

71:47

they wanted to read but I I just deleted

71:48

the whole thing. The thing that I almost

71:51

got in trouble for I was really stressed

71:53

about is the deep dive on Poland.

71:55

Poland, the events company, who really

71:58

pissed me off because uh I I was just

72:00

covering layoffs across the industry. I

72:02

mentioned Poland was one of the many who

72:04

did layoffs and I knew people there who

72:06

left Twitter and and Deliveroo and some

72:09

good companies to work at Poland because

72:10

it was a good good company, good salary,

72:12

flexible perks and I just briefly

72:15

mentioned them in my article saying uh

72:17

like updated layoffs, it was poorly

72:18

handled. On an all hands someone brought

72:21

up saying the pragmatic I was the only

72:23

one who mentioned it. the pragmatic

72:24

engineer mentioned that we did layoffs

72:25

and it was poorly handled. what do you

72:26

think of it as a co and the co said like

72:28

ah this is this is not like it's like a

72:30

BBC or panorama it's like some some

72:32

small publication they have an agenda

72:33

against us don't worry about it it's

72:35

incorrect anyway and I was like and and

72:37

they shared this back with me and I was

72:38

like what and so uh the company did not

72:41

pay employees they lied about them they

72:44

canceled health insurance it was like

72:46

lots of lies and and unpaid salaries and

72:48

I just decided like this this thing was

72:50

me like the guy said I'm I'm not a

72:52

panorama so I did a proper investigative

72:54

article where I collected a lot of stuff

72:56

on how it went wrong, including a double

72:57

charging of a payment that was a a

73:00

deliberate double charge. This guy's at

73:02

an outage. There's now reporting out

73:03

about it from the BBC. I might or might

73:06

have not helped uh with some of that

73:09

reporting for the BBC, not for my I I

73:11

couldn't put it in my article because

73:12

when I sent it over to Poland, they said

73:13

that this is lielist, this is lielist,

73:15

this is lielist, meaning they could sue

73:17

me. And I had to think about like, do I

73:19

really want to do that? So I so I

73:21

actually self-censored and I put so much

73:23

effort into the article, so much stress

73:25

and I I realized that investigative

73:27

journalism is just not for me and it's a

73:29

it's a good read. The BBC later made it

73:31

made a a documentary. Uh I also helped

73:34

them with that but I realized this this

73:36

this world is not for me.

73:38

>> Other than the book and newsletter, uh

73:40

what's something surprising you have

73:42

found through your writing?

73:43

>> I usually just find find ideas as as as

73:45

they go because they fester. I I I I

73:47

also have a long list of of things that

73:49

I I collect. Like I'm not sure if I have

73:51

any specific things. Trends some

73:53

sometimes pop out

73:56

a bit more as as I'm seeing multiple

73:59

people talk about them at the same time.

74:00

For example, there there was this this

74:03

and sometimes it just reinforces the

74:05

things that I I'm kind of thinking could

74:07

happen. In January when I started using

74:10

o over the Christmas break clock a lot

74:13

more and I was really impressed with it

74:14

and I was like, "Wow, this is really but

74:16

is it just me? And I started to read

74:17

around and I did some research and I saw

74:19

a lot of people saying the same thing

74:20

and that actually encouraged me to like

74:22

write the article saying like I think

74:23

coding by hand is over. And this was

74:25

very early on and I actually got some

74:27

flack from it from some people like how

74:29

can you say this? You're an AI shill.

74:30

But I was like like actually like I felt

74:33

this is where it's going based on my

74:35

experience and then I got a bunch of

74:36

evidence and I talked with a few more

74:38

people. So it either reinforces some

74:40

opinions I have or it it also gives me

74:42

new ideas. Do you plan a new edition of

74:44

the guide book updated for AI era and

74:47

what would you change to better reflect

74:49

the LLM era?

74:50

>> Right now this book stayed surprisingly

74:52

durable for AI because it it doesn't it

74:55

didn't contain too much about coding to

74:56

start with. Uh but the non-technical

74:58

parts things like understand the

75:00

business think about software

75:01

architecture those are more relevant but

75:03

at the lower levels at some point I'll

75:06

probably be updated but I I think I want

75:07

to like wait until we figure out like

75:09

how like what are practices that

75:11

actually work like when we'll have like

75:12

so-called best practices for certain

75:14

companies. I I think it'll take a while

75:16

but I'll probably revisit it at that

75:18

point. Yeah.

75:19

>> What's your favorite technical book?

75:20

>> So uh I'll give you two. It's one is the

75:22

philosophy of software design. I I I I

75:25

just love uh this book. I I it's it's

75:28

still to this day the only book that

75:30

actually compares

75:32

architecture approaches between like

75:34

groups of students and and what we can

75:36

learn from that. I wonder with AI if we

75:38

could now replicate this like have

75:40

agents like build different software,

75:41

but it it still wouldn't be the same.

75:43

But it's it's just a really nicely

75:44

written book. I I I really like the idea

75:45

of of modules, shallow modules, deep

75:47

modules and and so on. And then uh I

75:51

also enjoyed Kent Beck's Tidy First

75:53

book. book. It's a really thin book, but

75:55

I just like how crisp every single idea

75:58

is. Even though like that book might be

76:00

a bit less relevant when you're writing

76:01

a bit less code, but I just like the the

76:03

thinking that's behind it.

76:04

>> Besides Craft, what are some of your

76:06

favorite software tech products?

76:08

>> I really like Granola uh for for

76:11

meetings. It it it not only takes notes,

76:14

it fills out your notes and it's just

76:15

like such a delightful example of what

76:17

like an AI added product could be. like

76:20

I'm happy to pay for that cuz I get more

76:22

value and it's it's easier note

76:25

takingaking less issues with it not

76:27

having to think about that. I wish

76:30

actually that I could see like more

76:32

products are that that are are like that

76:34

and and I also I still really enjoy

76:37

Perplexity's search functionality

76:39

especially the deep research every uh

76:42

product has ruled out deep research but

76:44

Perplexi is still the one that seems to

76:46

be the fastest. it like it's I I wish it

76:49

was what Google would do for for for

76:51

search and again it's something that I I

76:54

pay for and I have like no affiliation

76:56

for it and this is specifically a search

76:57

I don't like their new push for like

76:59

computer or any of that stuff but like

77:02

again like from the beginning like I

77:03

feel there's some some things where like

77:04

AI can really add just a new experience

77:08

I'm like oh I didn't know this could

77:09

exist

77:10

>> forget what changes what's one thing

77:12

about software engineering that you bet

77:13

will be the same in 5 years

77:15

>> I think there will be a just has a big

77:17

big demand. I hope a bigger demand for

77:20

professionals who care about the craft

77:23

and who are true professionals and in

77:24

the sense true professionals that you

77:27

you know where the industry is at. You

77:29

know what the tools are. You've used

77:30

them. You use most of them. You know

77:32

what their trade-offs are. You have no

77:35

ego and and and you just choose the

77:37

right one for the for the right job. And

77:39

right now today this this will involve

77:41

like okay what kind of tool do I use to

77:42

write code with? How do I test it? How

77:45

do I deploy it? How do I verify the

77:47

correctness of the system? And as a

77:48

professional, you care about the things

77:50

that the average person would not. Like

77:52

if if I'm a building architect, I'm I'm

77:54

not one, but I I would imagine that when

77:56

I look at a building, I see all the

77:58

things that as a pedestrian, I don't

78:01

really care about. I'm like, "Oh, it's

78:02

beautiful glass windows." And you're and

78:04

the the architect is probably thinking,

78:05

"How it holds up? What kind of

78:07

characteristics? What about earthquakes?

78:08

What about this? What about that?" And I

78:10

think that that having us software

78:13

professionals who can look at that with

78:15

software work with it and change it be

78:18

unafraid of of changing it with high

78:20

confidence because we have the tool set

78:23

the tools you know sometimes again with

78:25

buildings you sometimes you put a

78:26

scaffolding to make some changes

78:27

sometimes you don't need to you just

78:29

like do a quick job. I think that will

78:31

be a lot more in demand and I I hope

78:33

that we'll have more people who care

78:35

about this and and AI is not going to

78:37

scare them away or or maybe AI just

78:39

scares away the people who never really

78:40

cared about the software. They just

78:41

always cared about, you know, like

78:43

making a quick buck and like just it but

78:46

it was never about the industry.

78:48

>> Yeah. So the these are all the

78:49

questions. Uh thanks Gerge for the very

78:52

interesting conversations. Really

78:53

appreciate it.

78:54

>> Thank you. It's a bit weird to sit there

78:56

because usually that's my line that you

78:57

just said, but Giggs, this was awesome.

78:59

Thanks so much.

79:00

>> Thank you.

79:00

>> And thanks to everyone, of course, who

79:01

submitted questions. Well, this was a

79:03

different format. And finally, it was

79:05

nice to not be the one asking the

79:06

questions for once. Leave a comment to

79:08

let me know how you like this one.

79:10

Thanks and see you in the next one where

79:11

we're going to return to usual setup.

Interactive Summary

Loading summary...