HomeVideos

Ask Me Anything - L7 Senior Staff Software Engineer at Meta

Now Playing

Ask Me Anything - L7 Senior Staff Software Engineer at Meta

Transcript

975 segments

0:00

So I just had an AMA and I had a lot of replies over 300 or so

0:04

replies and I went through and. I do duped all of them and I just

0:08

created kind of like the top questions, like the themes,

0:11

the common things that people ask me. And I thought I would

0:14

just like organize it and just answer it here so that you don't

0:17

have to go through and look at all of the AMA to just like get the

0:20

nuggets of the entire thing. So yeah, I had a blast doing this.

0:23

I'll do it again. So let's do it again. So let's get right into it. Right.

0:26

Future suite jobs. This was like a common theme. I got multiple

0:29

questions about it, but Kartoa asks, Hey John, appreciate you

0:34

doing this. Where do you see the future of SWE?

0:36

For context, I'm currently a SWE 2 at Fang Adjacent Company.

0:41

I also got an offer for dental school and I'm strongly thinking of

0:45

pivoting due to the uncertainty of

0:48

our future job market.

0:50

Now, Kartoa,

0:51

you're putting me in a very difficult position

0:55

because honestly, no one knows the future. The future.

0:57

You know, obviously there's definitely like safety in doing a job

1:02

like dentistry and, you know, anything physical, at least for

1:06

a while. But maybe because I'm an optimist, I actually kind of

1:09

believe in like Jevons paradox,

1:11

where as all these coding agents and coding tools, as they go

1:15

down in price and the usage of it goes up, I think even more

1:20

and more code is going to be landed. And then that just means

1:23

that even more engineers are going to be are gonna be needed

1:26

to review the code, land the code, maintain the code. Now I do

1:29

know that like junior engineers are having a hard time entering

1:33

the field. So that problem needs to be solved. But I think

1:36

like fundamentally,

1:38

I think we're gonna be all right for a while. At least from

1:41

kind of what I've seen, like the latest models outputs,

1:44

they're good. But at the same time,

1:46

it just like kind of sucks at the same time sometimes. It's just

1:49

like LLMs are like geniuses and they just kind of also fall flat on

1:53

their face

1:54

for even the smallest things. But yeah, so I still think this is a

1:57

great job.

1:59

I honestly though, if you're just starting out, it's hard for me to

2:02

recommend 100%

2:03

because the entry to get into it is pretty hard. But if you're

2:07

already in it, I think you should just stick around

2:10

and make sure you're like learning and pushing and like

2:13

adopting these tools. But yeah, thanks for your question.

2:15

All right, the next question is around agentic coding workflows.

2:18

Essentially like what my

2:20

coding workflow is.

2:21

So missionary,

2:23

given the rate of change in AI, what is the right percent of time

2:27

spent on workflow,

2:29

harness, tooling, DevX optimizations? How has it changed

2:33

since 2022? What is the best way to test new workflows?

2:37

By just using doing real work

2:40

or is there a certain flavor

2:42

of tasks slash projects that's best? Okay, that was a very hard

2:46

sentence to read. So the right amount of time, I think it depends

2:50

on people,

2:52

But there is a balancing act, I think, between just like

2:56

always jumping on new things versus

2:58

just sticking to what works. So what I like to do is I like to get

3:03

like a really nice workflow going. Right now, I use Codex and

3:07

especially Codex app for a lot of my work, but I still use Cloud

3:10

Code mainly for Fable access if I need something like very

3:14

like in-depth to do. In depth to do but at a high level i'm kind of

3:17

sticking with what i know and i really know how to like navigate

3:20

and i'm essentially a professional at but every time there when

3:24

there's a new model that releases and some major events like

3:28

grokbot is an example it just came out and it's like kind of

3:31

changing some of the paradigms you know it's like open cloud

3:34

but it's supposed to be more polished and fully managed so

3:38

things like that i will give it a shot and i'll like test it out.

3:41

Because it's a paradigm changing like kind of event.

3:44

But besides that, I think it really depends on you

3:48

and your like

3:49

desire to be on the latest and greatest.

3:52

But yeah. And then the second one, I think doing just work

3:56

is okay. It will get you so far. But the thing is, if you just rely

4:01

on doing

4:02

work to learn these things, there is a limitation of what you

4:06

will learn. What I like to do is I just like read the docs. I'll go and

4:10

just like read all of open AI or clock codes, like entire docs.

4:14

And then I'll just like try

4:16

these things that they're saying out, like try all the hotkeys,

4:19

try all these things. So whenever something new comes out,

4:21

I have phases

4:23

of exploration. Like, oh, I think there's a big Delta. Like I'm

4:26

going to give cursor a try again, since I'm going to try Grokbot,

4:29

I'm going to play around with it. And. I already look at it and it

4:32

looks very similar to Codex app. I actually actively spend time

4:36

learning the tools deeply because I think that's the best way

4:40

to take advantage of it. And you'll be surprised how much of

4:43

your work will change based on some hidden feature that you

4:46

may never run into if you were just working. All right.

4:49

Question number three, reviewing AI code. Can you explain in

4:53

detail your diff

4:55

view workflows? How do you review code after it's generated?

4:59

Do you open an IDE or just ask another agent? And this was

5:04

from Pablo. Oh, I actually got a ton of this questions. And, uh,

5:08

if you want kind of like a written down version, I actually made a

5:10

post about it recently, but to reiterate that a little bit,

5:14

essentially code review is the one topic that I keep changing

5:18

my mind on. And it's

5:20

like a gradient.

5:21

Um,

5:22

it's like a sliding window on what diffs or PRS that I review.

5:28

Now I kind of look at code review as like, I imagine like a tree,

5:32

like I think of like

5:33

a tree when I'm looking at the code. So I'll look at the code and

5:38

I'll quickly see what files are being changed and like what kind

5:41

of code is being changed. And then because at least I have a

5:45

pretty good understanding of the code bases I work on,

5:47

I immediately know whether that code is touching everything.

5:52

If it's an infrared code, if it's touching like hotspots in the code

5:55

base that I know,

5:56

then I consider that as like a trunk change, something that is

6:01

highly interdependent. And if it breaks, it's going to cause a

6:04

big issue.

6:06

Then I'll increase my own effort level and also my agent's effort

6:10

levels on reviewing that diff.

6:12

But even when I'm reviewing that diff, I really think about the

6:15

gating and the safety

6:17

aspects first. And then I'll look at the quality and the cleanness

6:21

and those kinds of things. But it's really around safety. Like I'm

6:24

highly anchoring on safety when I'm doing code reviews.

6:27

And then there's the other like

6:29

types of code, which is like leaf node codes.

6:32

So something maybe you created a new compose component

6:35

or react component. You haven't integrated it like landing that

6:38

code only changes the bite size of the code. I guess in

6:41

JavaScript land, it wouldn't even get sent down.

6:44

But anyways, that I don't look too carefully because the safety

6:48

of that code is like very safe. It's like not being used anywhere.

6:52

Right. So. I'll definitely just kind of let it go. I'll, I'll review it,

6:56

but I'm not like reviewing it like before. So that's like kind of this

7:01

high level, like philosophical thing. It's really around safety.

7:05

And then like, how can I get the diffs to be safely reviewed?

7:09

So all of the old practices still remain of making atomic diffs,

7:13

like very small diffs, single purpose. So that is easily revertable

7:18

and also like easily testable. And then the other big thing is

7:21

getting the agents to really give proof and confidence levels on

7:24

their validation. So whether that's screenshots, videos,

7:28

or runtime data, maybe they do A-B testing on some like,

7:32

I don't know, some like runtime logs, and then they tell you, oh,

7:35

the runtime state is like this. So it's actually good.

7:38

Unit tests, all of these things that's around safety,

7:41

I overemphasize in my code writing. And I'm optimizing for like

7:44

landing code at big tech. So it's really about

7:48

trying to land it safely as possible. Because at the end of

7:51

the day, any code that you

7:53

write with AI, you still need to back it up. You can't go to like a

7:56

sub review and say, hey, the AI wrote it, it's not my fault.

8:00

You know, at the end of the day, you have to stand by

8:02

what you put out.

8:04

So I anchor really heavily on safety and then really tune my

8:09

effort based on how safe I think that piece of code is. I hope

8:12

that's helpful. I wrote a little bit more detail on the post. So feel

8:16

free to read. All right.

8:17

So the next question is around architecture

8:20

without experience. This type of question I actually got a few

8:23

times about people asking about, how to learn things when

8:26

they don't have experience. I think it's actually really cool

8:29

because it just shows that there's a lot of vibe coders or people

8:32

who are just interested in this kind of things who never

8:35

would have

8:36

really been interested in learning how to code. I think not,

8:40

I don't know, Joshua, but I think there's this whole set of

8:43

subcategory of people that just are

8:46

getting into coding because AI is making it easier and

8:50

more accessible. And I think that's really

8:52

cool. So hi, John, thanks for doing this AMA.

8:55

Coding becoming more common, how do you make sure that

8:59

AI is making good architectural and coding decisions?

9:02

Especially if I don't have

9:04

much experience. It's one event, so I'm missing some of

9:07

your posts, I think. But

9:09

the high level gist is that

9:12

honestly, it's very hard if you don't know something you

9:15

don't know. You could essentially use the AI to do

9:18

adversarial reviews.

9:19

So there's a lot of skills around like grilling your architecture

9:23

and all this kind of stuff. But at a high level, you should always

9:27

anchor on trying to get as much understanding. If the AI is

9:30

doing something and telling you some plan, if you don't

9:33

understand it,

9:34

I think if the goal is for you to get better, I think you should

9:38

slow down. You should pause and try to understand

9:41

what the AI is doing. Like every word, every term. Like recently,

9:46

I started learning about like model scaling, and I'm not a

9:49

machine learning engineer. Or like an AI researcher. But I saw

9:52

Ryan Peterman's podcast on some, I forgot his name, but he

9:55

was from like Google, DeepMind. And he recommended this

9:59

series on Jack's ML. And essentially, it's like how to think

10:04

about model scaling. And I've been kind of consuming

10:07

that material. But it's been very slow. It's like, I'll read

10:11

one paragraph, and I don't understand it. And.

10:14

I essentially have,

10:16

you know, Codex or CloudCo, both are fine, like the

10:18

Chrome extension. And

10:20

it's looking at my browser. So I'll just

10:22

say, hey, what is this? What is that? And it literally takes me

10:25

hours to get through like one page.

10:29

But after I do it, I have a much deeper understanding than if I

10:32

just had breezed through it, right? So in my opinion, I think if

10:36

you don't know good architecture, or good coding patterns,

10:39

or things like that, you know, study the fundamentals,

10:42

like question and ask and use AI to teach you how to be a

10:46

better engineer. But yeah, that's what I

10:49

think. It will slow you down. Like if the goal is to build products

10:52

and like just really stuff and like have impact in the world.

10:56

This may not be like

10:57

the best advice. But if the goal is to learn and get better,

11:00

then yeah, use AI to learn and get better. All right,

11:03

question number five is update on the coding walkthrough.

11:07

So let me read Alan's post. Can you make a V2 for this video?

11:11

And he linked one of my. YouTube videos.

11:13

With the latest CloudCo video

11:15

and

11:15

all the things you've learned since the last video, Nothing beats

11:19

a screen share and actual code, which is totally true. So I had

11:22

this video, it went kind of viral on YouTube. I think it was like

11:26

sitting at almost 500, like half a mil views. And it was my first

11:30

like major breakout video. And this was right around the time,

11:33

like, I don't know, when Opus was going viral too,

11:35

like November or like early

11:38

December or something like that.

11:40

But it's a really thorough video. And I still think a lot of the

11:44

things I covered in that video still stands. I think the way I

11:48

covered it, and it's not just about like showing things

11:51

about Clock. Code, but I cover some bits of agentic

11:53

engineering and things like that. But I should make another

11:56

video. The thing is, I did make another version, but I happened

12:00

to just like use that material to teach with ByteByteGo. But I

12:04

should probably make another version because even

12:06

since then, since I've been teaching, I've created a whole new

12:10

stack using Codex app more.

12:12

And then goals is a thing. Graph engineering is a thing.

12:16

And there's like graph

12:18

bot is like another thing that I'm like, got to look into. So there's

12:21

like new things. But I think agentic engineering and the various

12:25

pieces of it, like context engineering, compound engineering,

12:28

harnesses, agentic tooling, agentic validation, all of these kind

12:32

of core

12:33

fundamentals of agentic engineering, I think is here to stay.

12:37

They're evolving within its own thing, like their own lanes,

12:41

but they're all

12:42

like core, I think, to agentic engineering. So long answer short,

12:47

it's in the works. But these kind of videos literally take months

12:52

of research of just being in my workflow for

12:56

day in and day out. And so it takes a long time. Yeah, so I'll get

13:00

to it as soon as I can. All right, the next question is around

13:03

manual coding.

13:04

How much code do you write by hand? And

13:07

the simple answer is none. I don't manually write

13:11

any code by hand. And, you know, I think this is

13:14

pretty common. I think the only people who are actually still

13:17

writing code by hand

13:19

is people who want to because they want to feel something

13:22

different. There's a lot of there's a group of people who

13:26

genuinely just love to code like manually. And I was that I

13:29

actually don't have a CS degree. I have a non

13:32

traditional background. And I found coding

13:35

as a hobby.

13:36

And it took me like five years of just doing it on the side building

13:40

random apps with my friends until I decided to become an

13:43

engineer and then like did a boot camp and all that kind of stuff.

13:46

So when I stopped coding by hand, there was a period of time

13:49

where I really mourned it. And I was like, man, this feels kind

13:53

of bad. And, and during that time, there was a lot of babysitting

13:57

auto mode wasn't even out yet.

13:59

Right. So

14:00

it was a lot of just like constantly juggling so many

14:03

different threads, and they would stop very quickly. Like these

14:07

days is a lot different, right? You're like, writing long goals that

14:10

do bigger tasks. So you have more

14:13

kind of

14:14

ease of mind, at least in the brain, like context switching.

14:17

But yeah, so manual coding, I think is going away as sad as

14:21

that is. But yeah, it's just kind of the cost of this whole,

14:25

like change and revolution and anyone telling you that, hey,

14:28

manual coding is not going away is, you know, it's more like

14:32

they want it not to go away, I think.

14:35

And maybe for their very specific code is like very specialized,

14:40

and they don't feel like AI can do it. And I think there's some

14:44

merit to that, right? Like AI is not going to write perfect code the

14:47

way you want it exactly.

14:49

But, you know,

14:51

it will get the job done with the right context and the

14:54

right validation, in my opinion. And this is kind of where,

14:57

where the whole like coding is solved meme comes from,

15:01

like people go, oh, you can't even like update the codex app

15:04

without having you to like install an update or something.

15:07

And then they'll put like coding is solved. I think that's just

15:10

like disingenuous, honestly, because like with enough context

15:14

and with enough validation, I think,

15:16

like, the coding part is solved. The AI will do the coding for you.

15:21

But that doesn't mean there's all this like other true engineering

15:24

work that is just

15:25

like done. But yeah,

15:26

that's kind of my high level tech on the manual coding. All right.

15:30

So the next question theme was around

15:32

competitive advantage. So my hash, Vivi says,

15:36

if AI makes everyone capable of building, what becomes the

15:40

real competitive advantage? I think there's a lot to this here.

15:45

The first thing is around domain knowledge and like

15:47

domain specialty. I think like social media is like a really hard

15:52

thing to compete on is because

15:55

the true power of social media is really the graph,

15:58

the graph relationships. That's a mode that's very hard to beat,

16:03

even if you have AI. And also for all of the major big

16:06

tech companies, I think data is a big one. Like Tesla,

16:10

for example, it's hard to beat them on self-driving

16:13

because they have so many miles. And so the only way like

16:17

other companies can beat them is through different ways,

16:19

like adding LIDAR, for example. That's how like Google is

16:22

getting around it, right? With Waymo. But Waymo also has a lot

16:25

of miles, right? So I think there's still a ton of ways for you

16:29

to compete. Now, if this question is really like on individuality,

16:33

like how do I make like a successful app or whatever?

16:36

How do I like start a startup? I think this is a question that

16:39

always comes up. But if you just look at the data of all

16:42

these companies, there's been more newly minted

16:45

unicorns in the past like few years because of AI. And I actually

16:49

think there's a delta in the skill

16:51

gap of like AI usage. And I noticed that because I teach

16:54

AI coding, I just like see the knowledge gap between

16:58

various people. And like most of the students that I've taught

17:01

like the stuff to like,

17:03

like their mind is blown, right? And the thing is,

17:07

when I talk to like average non like Silicon.

17:10

Valley, like tech bros, people who are not in this little bubble of

17:14

like always talking about rock and image generation and LLMs

17:19

and open source and, you know, like model costs and all like

17:23

there's normal people are not like that. Most people don't give a

17:27

shit about any of that.

17:28

And when I talk to them, most of them are just still on ChatGPT

17:32

or Gemini. And they don't even know that like

17:35

Codex exists and Codex can do all these things. And some of

17:38

these people are like young. They're not like my mom. My mom

17:41

uses like Gemini and ChatGPT and she's like, oh, it's so great.

17:45

But like average people don't need these other things, right?

17:49

So,

17:50

but yeah, so in my opinion,

17:52

there's multiple ways to answer this question, but in terms of

17:55

like competitive advantage, I think you'd be surprised how

17:58

few people

18:00

know these AI coding tools deeply. So if you're learned that,

18:03

if you're on board with that, then you're going to have an

18:05

advantage here. All right, the next question is staying sharp

18:09

with AI. All right, this guy has a bad username, but he had a

18:12

good question. So how do you stop writing code manually and

18:15

not lose your coding sharpness? So this is very related to not

18:18

coding manually question. Personally, for me,

18:21

I'm constantly learning. Whenever I don't know

18:23

a piece of architecture within the code base, or if I run into

18:27

some kind of new patterns that I haven't seen in the code base,

18:30

while I'm reviewing the diff, I'm always asking questions and

18:33

digging into it. And for me, I actually spend a ton of time

18:38

on my own digging into other new technologies. Like I think I

18:41

mentioned that I'm going through the Jaxx ML like scaling

18:45

model scaling

18:46

course on my own because. I'm just interested. The big

18:49

advantage for me is I create content. I create content around

18:52

this topic because it's actually my hobby for some reason.

18:56

But yeah, I really love learning about all this stuff,

18:59

making content about this stuff. So for me, it's kind of like a

19:02

flywheel because, oh, I want to make some content about

19:05

some AI thing

19:07

that I'm interested in. If I want to teach, I need to understand

19:10

this stuff, right? If you want to test your knowledge, you teach,

19:14

because once you start trying to teach it and like verbalize what

19:17

you think, you know, then you'll see the gaps in

19:19

your knowledge. So

19:21

I like to try to teach. That's kind of the reason why I actually

19:24

started YouTube eight years ago, because I just wanted to like

19:27

talk about this stuff. And doing YouTube is like a really good

19:30

reason to just really get into it. So I always try to teach what

19:33

I learn.

19:34

And

19:35

because of that, I post and I get excited about it because we

19:39

were talking about it and it's fun. And then it actually changes

19:42

the way I work sometimes.

19:44

I just see a lot of benefit of continually continually learning and

19:48

trying to teach what I

19:50

learned and that's how I stay sharp so I recommend it for you if

19:53

you're interested in teaching but if you don't then you just have

19:57

to be good with having deep focus time and learning just

20:00

constantly learning all right next one is around becoming

20:03

job ready

20:04

so

20:05

Vashnavi

20:06

Patil hi John I'm not in the job market yet all right

20:10

someone young

20:11

as someone getting into software slash cs what skills or ai

20:15

related things would you recommend focusing on now to be

20:19

truly job ready

20:21

keeping it at a high level what matters the most versus what's

20:25

just noise

20:26

so at a high level i think learning

20:29

one of the like agentic coding tools whether that's like codex

20:34

clock code open code i guess cursor whatever it is learn it

20:38

really well like understand how the memory works understand

20:42

what's a skill what's an mcp

20:45

what's agents agent teams what's the difference between sub

20:48

agents versus agent teams in claude's case what's ultra code

20:52

in clock case when should you use that how good are the

20:55

different models

20:56

like do you have a good enough sense of using all these

21:00

different models that if i gave you the output of like something

21:04

from chat gpt models versus like clod do you think you could

21:07

like see the difference just by the feel of the model can you feel

21:11

the model because you kind of can if you use these models a

21:14

lot you just know that's like from opus or that's from soul you

21:19

know you kind of can get a sense of it so yeah just get really

21:22

good at all of these agentic coding tools and learn agentic

21:25

engineering there's so much to it so much to learn i i think

21:29

maybe not yet but all of these things that I'm talking about,

21:32

I think the industry is going to move towards trying to filter out

21:37

candidates that does

21:38

know these stuff or does not know it. Like it's, I think the

21:42

interview process will change at some point where these are

21:45

going to be tested. So I think that

21:47

is probably one of the most important. And then the other

21:50

big thing, in my opinion, is still learning foundational,

21:53

like fundamentals of like data structures and algorithms,

21:56

design patterns, you know,

21:58

clean code, Bob,

22:00

Uncle Bob, you know, watch his stuff, right? So

22:04

all of these things, I think the core foundation is really

22:06

important because agent decoding is essentially

22:09

an abstraction. It's a layer above, right? And abstractions are

22:12

inherently leaky. What that means is every now and then some

22:15

abstraction layer will

22:17

like mess up, like something will not happen, even though it

22:21

should theoretically happen. And that

22:23

happens all the time with AI, where you're. You're like, oh,

22:26

I think it should be working, but the agent is saying this. I don't

22:29

know if it's actually right or not. And there's all these things.

22:32

But if you don't have a foundational layer, when things get hard

22:35

and when things get stuck and the agent has a hard time,

22:39

you won't be able to steer it.

22:41

So having a really good foundational skills in engineering will

22:45

help you peel the abstraction layers when you need so you

22:48

could dig in and really debug and have confidence in your

22:52

product and your coding. So,

22:54

yeah, those are the two main things I would say. But yeah,

22:56

I hope you do well when you finish your classes. All right.

22:59

Choosing coding agents. Question number 10 through 12.

23:03

So welcome. How do you feel about Codex versus

23:05

Cloud Code?

23:06

Are you using both in any way or just Cloud Code?

23:09

So I use both

23:11

Cloud Code and Codex app.

23:13

My class is actually primarily based on clock code, but I'm,

23:17

you know, working on a version for Codex,

23:19

especially Codex app. So this question is actually more than

23:22

just clock code versus Codex, in my opinion, because

23:26

the apps itself,

23:28

they have, there is a Delta between the apps and there's a CLI

23:31

version in itself.

23:33

And recently I've been converted to essentially not use the CLI.

23:38

I've almost completely went to the app. If you asked me like two

23:41

months ago,

23:42

I thought it was like, there's no way I'm giving up the CLI.

23:44

It's just so powerful. There's so many things that you can do

23:47

with it.

23:48

But there's just like a few features on the app side

23:53

that has convinced me that the long-term priority

23:57

and all the feature sets are going to go to the app,

23:59

in my opinion. Because number one, I think all of the major labs

24:02

are targeting mass market,

24:05

right? That is their strategy. And that's kind of the ultimate goal.

24:08

I think Anthropic is like targeting enterprise, but at the end of

24:11

the day, they want to get like the entire pie of enterprise, right?

24:15

But for OpenAI, they're definitely looking at mass audience and

24:18

the enterprise.

24:20

So they're gonna keep pushing the app

24:22

because it has rich rendering, it's not a 2E, so you can actually

24:26

do a lot of very interesting things, like a full-fledged app, right?

24:30

You're not limited by the 2E's limitation. Yeah, so rich rendering

24:34

is a very

24:36

good example, but there's so many little things, right? You can

24:39

control the entire

24:40

Codex app with your voice, using the live ChatGPT voice,

24:45

you can queue prompts. I know you could queue prompts in

24:47

other places,

24:49

but you could just like drag things around, like queue 10

24:52

prompts and then drag them, edit them. There's just like a lot of

24:55

little things. And over time, I think it's just gonna get better

24:58

and better.

24:59

And yeah, I think it's gonna be hard

25:01

for just a 2E experience to

25:03

win out in the end. So that's why I switched.

25:06

That's one of the main reasons. In terms of like model quality,

25:10

I think price is becoming a factor for me, even for me,

25:14

because Fable's usage and rate limits run up so fast.

25:18

It's because this is a very expensive model.

25:20

So they limit it.

25:22

The thing is like GPT-SOL has been great for me. And because

25:25

of the price and like rate limits, I actually switched a little bit to

25:29

using Codex

25:30

and Codex app and stuff like that. And then I found like the

25:33

output very comparable to Fable.

25:35

And I actually think it yaps less.

25:38

It has like a dog in it. Like it just keeps going. Like really goes

25:43

until it gets the answer. That's how my friend Peter puts it.

25:47

It has a dog in it. When I just tested both of them out, I just

25:50

prefer the OpenAI models right now.

25:53

This may change next model release, who knows? But that's

25:56

like kind of the thing with these models. But I will say it'd be

25:59

very hard for me to give up the Codex app because I also use it

26:02

with my phone and I remote control all of my threads

26:06

and my laptop at home or whatever is just like open. It's just on

26:10

all the time.

26:11

And I just control it. I control it wherever I am. So those kinds

26:14

of things, all the schedules and things that I've created on it.

26:17

And like, yeah, it's just hard to give that harness up, I think.

26:21

But yeah, so that's kind of where I am right now, but it

26:24

may change. All right,

26:25

agent permissions. And so Daniel asks,

26:28

curious how you think about permissions in agent decoding.

26:31

At work, I stick to coding agents in the terminal. Personally,

26:34

I run multi-agent Hermes

26:35

and tight roles.

26:37

So one failure doesn't spread. So I think permissions wise,

26:41

the whole agent decoding is going towards longer runs using

26:45

goals and less permissions and then having like

26:48

agentic safeguards

26:50

or like an agentic garden that protects your code base

26:54

and all the work that you're doing. I think this is a long-term

26:57

right approach in my opinion. And then the models should just

27:00

get better and better

27:02

at doing things that most people don't want.

27:04

Like dropping a DB without, you know, approval or messing up

27:08

your OS and things like that. So, but yeah, I think less

27:10

permissions is fine. As long as the output is what you want at

27:13

the quality that you want and you have enough

27:16

agentic safeguards. All right, the next question is

27:18

fundamentals and AI. For students building

27:21

AI systems,

27:22

how would you balance learning fundamentals

27:24

with agent decoding and rapid

27:26

prototyping? For students, I think you should just focus

27:29

on learning,

27:31

learning fundamentals. Like why do you need the prototypes?

27:34

Like if you're not going to do anything with the prototypes,

27:36

what's the purpose of prototyping? The main reason why we

27:39

prototype for like at work is because we want to get a feel for a

27:44

product that we want to build so we can show leads or like play

27:47

with it ourself,

27:48

right? So there's this like reason for the prototyping. But when

27:52

I'm prototyping, I'm rarely looking at the code. I'm just like

27:56

getting it. I'm mainly focusing on how, like what the field is.

28:00

You know, that's for like client code, like product code. But if it's

28:03

like infra code, my prototype for infrastructure code is really on

28:07

exploring different paths.

28:09

So I'll have multiple agents prototyping different ideas I have

28:14

on how I think the architecture should work.

28:17

And then I'll get it to a certain point and I will play around with it

28:21

and feel the API

28:23

and see kind of the niceties and like things that I might've

28:26

missed if I, you know, miss an abstraction layer or something,

28:30

or if I didn't have certain APIs here, or if I expose

28:33

this in the wrong place, like those things, it's hard to imagine

28:37

just on like a UML diagram, but it's easy to see when you're like

28:42

trying to add new things to some existing infrastructure,

28:45

you know? So like there's,

28:47

depending on what you're doing, prototypes are really good,

28:49

but they're not really for learning. It's really to answer a

28:52

specific question

28:54

about UX or, you know, some

28:57

feel. You're trying to get a feel for something.

28:59

But if you're in school,

29:01

then you should just focus on fundamentals,

29:03

in my opinion. All right. The next question is around

29:05

AI engineering

29:06

specialties. Saravana Kumar asks, AI landscape seems to be

29:11

very broad these days. From serving models efficiently,

29:14

training models,

29:16

RL training, AI infra, security,

29:19

custom engines, and memory,

29:21

where should one focus today? I mean, this is a very

29:24

personal question, I think. Like, I think any one of these are

29:28

great. You could get a really good job doing any one of these,

29:31

I think. So

29:33

it depends, right? It depends on where you are in your journey.

29:38

Of like employment.

29:40

Like for me to like switch into

29:43

any one of these things would require at least like two years of

29:47

really dedicated effort to be like back to kind of the novice,

29:52

like kind of like mid-level of probably one of like

29:55

training models.

29:56

I'm just learning about it because I'm curious. But if I

29:59

wanted to really be like an AI researcher that trains models,

30:03

or even maybe I do

30:05

engineering where I, you know, optimize kernels for

30:08

model runs, man, I have to spend like two, like a year to two just

30:12

to catch

30:13

up on the latest like frontier, like what the frontier

30:16

knows already.

30:18

And then from there to

30:20

contribute my own

30:22

thing, my new ideas and write papers, it's going to be another

30:25

few years, in my opinion. So like it'll be at least like four years

30:28

before I'm like baseline par. And that doesn't mean that I'm

30:32

going to be even the world class, right? I feel world class at

30:35

what I do right now but it's going to take a long time for me to

30:38

get there

30:39

to do this in some other domain

30:42

right but to answer your question about one of these things

30:46

honestly i think you should pick what you think is interesting try

30:50

a little bit of it talk to a bunch of people who is doing that and

30:55

then you know just try

30:56

like the very basic things like the training models example like if

31:00

you can get through Jack's ML like model training and you're

31:03

able to train your own like little model

31:06

using a GPU or even a MacBook

31:08

with like a high RAM, like you could

31:11

see how you feel, see how you like that, see how that feels.

31:14

I think that's probably the best way

31:16

because chasing a job just for money has never really worked.

31:19

In my opinion, you always quit because it's too hard to

31:22

get through. Any one of these things require a lot of effort.

31:25

All right. The next question is next AI leap. So what do I think

31:29

the next AI leap is? So

31:31

Paul Sufka,

31:32

MD,

31:33

doctor, doctor. Hello. Hi, what are you looking forward to or

31:36

hoping for in AI

31:38

in the next six to 12 months? What will be the next leap?

31:42

Honestly, there's hints of it, but I think I really want to do

31:45

everything mobile. So the voice control is really good with like

31:49

ChatGPT's voice, but I just need better like visuals,

31:53

like feedback mobily. And I think glasses may be a good

31:56

form factor. And, you know, meta displays, really great. So I

31:59

might get pick up a pair of those. Shout out to meta. But yeah,

32:02

I just want like really good interface just mobily so I could like

32:05

code on the go or like juggle my agents on the go. That to me is

32:09

like the most interesting because one thing about this

32:12

profession is that. I have to sit and be in front of a computer for

32:15

a really long time. And if I could

32:18

figure out a way to not do that, I think it would really change

32:21

my life. It would really change like the quality of my life. Oh,

32:24

and another thing that I would be really interested in

32:26

is

32:27

video. Input as like a raw input. So right now,

32:31

most video inputs, if you add video, what happens behind the

32:35

scenes is they take the video, they use like FFM peg

32:38

or whatever, and then they'll get all the frame data and try to like

32:42

piece together what the video is through frame data. Now, I use

32:46

this workflow when I'm debugging animations or trying to build

32:50

some animations that my designer made or whatever.

32:53

And it's OK, but it's really slow and it doesn't work all the time.

32:57

Yeah, it's just not. Great. So it would be great if we get video

33:00

multimodal like support like natively. That would be

33:03

really interesting. But yeah, it's a video multimodal input. I think

33:06

those two are probably very interesting for me personally.

33:10

All right. So the next one is around portable agents. Makan

33:14

asks,

33:15

as

33:15

agent coding evolves, do you think the agent will eventually

33:19

become portable

33:20

across models and coding harnesses with things like identity

33:24

payment permissions

33:25

and memory

33:26

following the agent rather than being? Owned by Claude Code,

33:30

Codex, Cursor and et cetera. So this is a really

33:33

interesting question. And I think this is kind of hinting at some

33:36

of the

33:37

world that will eventually live in, which is like agents that

33:40

operate for people will have their own entity. I actually do think

33:44

that's going to happen. And I think

33:46

Stripe is seeing that. That's why they purchased like

33:49

open router. I think I think they're they're just trying to get ahead

33:53

of that and they'll probably create something like that,

33:55

in my opinion. And it's going to happen very quickly where

33:58

agent traffic is going to be more than human traffic in, in,

34:02

in the internet, obviously. So the concept of agent as an entity

34:06

that operates on your behalf, that has its own credit

34:09

card information,

34:11

Gmail credit score, maybe,

34:13

I don't know. It's like all these kinds of things. I think it's going

34:16

to be a thing. And I think as personal agents like

34:19

gain popularity,

34:20

I don't know if Grogbot or whatever is going to be a thing,

34:22

but yeah, as all these things gain popularity, the, the necessity

34:25

for the agents to have their own entity,

34:28

I think is going to be

34:30

a thing. I don't know if like the whole memory and all this kind of

34:34

stuff is going to get ported around with this, but I'm talking

34:37

more about what it required to be an entity. I think that concept

34:41

will be created and ported around. I actually think Stripe is

34:44

going to be the one that creates it, but we'll see. All right.

34:46

So the next data is confidential data.

34:50

Welcome John. We'd love to hear your take on uploading

34:52

confidential documents.

34:54

To AI even when data control is off? You know, I get this

34:57

question actually quite often, especially people who are in

35:02

these fields like HIPAA compliant

35:05

or EU, like people who do a lot of work with the. EU, they just

35:09

have this like

35:10

higher sensitivity towards data. And

35:13

my answer to this has always been figure out a

35:16

way to like host your own like servers and host your

35:19

own models, whether that is doing a small build out. And the

35:22

thing is like local models are so good with open rates. If your

35:26

company has a budget to buy a few like really good like H100s

35:30

or whatever,

35:31

and then have that set up and just have one person that's like

35:34

dedicated to just managing that system. Yeah, just use open

35:37

source to like use these models. You know, maybe you just use

35:40

open code and you could get so much done, I think, just using

35:44

these like open tools and open weight models. So that's kind of

35:47

my answer to that. If not, then you're always going to be just

35:50

kind of

35:51

like have to use

35:53

some enterprise like box version of Anthropix systems or

35:57

open AI. I think they have an enterprise solution, but I

36:00

don't know. All right. Open models and security.

36:02

Question number 17. Pragnya and Ramath. Thoughts on open

36:05

source models being used for cybersecurity warfare when they

36:09

are as good as closed source ones in a few years. So I think it's

36:13

already happening. Like this, this, this is already happening.

36:16

I think Hugging Face had to use an open source model

36:20

because the

36:21

closed source models were like rejecting the

36:24

like cybersecurity

36:26

like prompts because it detected cybersecurity. So they had to

36:29

use like an open source to get around

36:32

like that

36:33

post training, that post training kind of like

36:36

safety concerns. So I think it's already happening

36:39

the other way. Right. This is saying like, what do you think

36:42

about cybersecurity warfare happening? Honestly, that's a

36:45

scary question. And I think it's a legitimate thing to be

36:49

scared about. And a lot of people joke about, you know,

36:52

Anthropix or open AI or any of them AI labs like saying that,

36:57

we want to slow down. Like we're very concerned. Like people

37:01

joke about it because they only see, I don't know. I think like a

37:04

lot of people just see that and they think, oh, they're high.

37:07

They're just like trying to hype their models up or things

37:10

like that. But I don't know. I think it is pretty scary.

37:13

Like cybersecurity itself is pretty scary because these models

37:17

are pretty powerful and there's just a lot of like zero day

37:21

security holes. So yeah, I don't know. Like I try to not to be

37:24

so pessimistic

37:26

and that like these companies have so many ulterior motives,

37:29

but I think they're just calling a spade a spade sometimes that,

37:32

you know, there is serious cybersecurity

37:35

like concerns with models and open source models and all this

37:39

kind of stuff, because, you know, let's be real. These, the open

37:42

source companies, like especially the ones in China are not

37:45

going to care

37:46

that much

37:47

about like security. You know, I'm not, I'm not trying to get

37:50

political here, but yeah, that's just the reality. All right. The next

37:53

question is getting into meta or I guess any big tech. Hi,

37:56

what advice would you give your past self to make it easier to

38:00

look for a job at a company like meta? So I actually made a

38:04

bunch of videos on this topic. So feel free to look at that on my

38:07

YouTube channel. But the main advice that I have is there's like

38:12

a few things like I wish I had good grades and went to a

38:15

good school, then it would have been a lot easier.

38:19

But the other path is first, you actually do need to just know

38:24

the fundamentals, like data structures and algorithms to even

38:27

pass these interviews.

38:28

But even to get an interview, you need to have been working for

38:31

a few years. If you don't have the pedigree of like a really Ivy

38:35

league school, then you need to figure out a way to get

38:38

into like, like I went to capital one, like I worked at a bank for a

38:41

few years, like four years or something. And around year three,

38:44

that's when

38:45

meta and Netflix and all these other companies started

38:48

knocking on my doors and I got interviews. Like before then I

38:51

would send a bunch of resumes. I never got the interview.

38:53

But after around year three, that's when everyone wanted

38:57

to talk. So I think you just need to have those things. And then

39:00

once you get the opportunity, you just have to nail

39:03

the interviews. I think it's actually not as hard to get into a

39:07

company like meta or one of the big techs, in my opinion,

39:10

because it's like interviews in a sense is a solved problem,

39:14

but it's hard to commit to

39:17

studying for it enough

39:19

that you can pass it. You know, I think neat code is really great if

39:22

you want to like really dive in and learn like the code, but yeah,

39:26

neat code is great. If you just know like 80% of neat code and

39:31

then you could get into Fang

39:33

or, or mango, whatever you call it. In my opinion, if like, you got

39:37

to just get so good at those kinds of things where you see,

39:41

you read a problem. And as you're reading, you already have

39:44

a sense

39:45

and feel what kind of data structure algorithm problem is it?

39:49

Is it a sliding? Window problem is it a tree problem is it a link list

39:53

problem is it a graph problem I don't know there is a subset of

39:57

these things and you can start pattern recognizing

39:59

so for me personally. I tried twice the first time I got my ass

40:03

kicked I failed every single interviews I did I did basically

40:07

everywhere and I got I just like failed that taught me what I was

40:11

missing that taught me the gaps and then the next time I

40:13

studied literally for a month and a half four hours a day I was on

40:17

during that time and then I got two offers like a meta and Netflix

40:21

and I took the meta offer that's a whole nother story because

40:24

it's like anyways

40:26

and then the last thing I think I mentioned this. I think this is a

40:29

new thing but learn AI coding

40:32

I think agentic engineering is

40:34

the future and a lot of these companies are going to test for it

40:37

and then another like side tip that's like not necessary is to

40:40

build in public

40:41

like try to build and put yourself out there make connections

40:44

you know doing social media like doing like content creation.

40:47

I meet so many cool people and it's, it's one of the

40:50

best ways to network. It just opens doors that you'd never

40:53

thought was possible.

40:55

And then social media is one of the places where it's an even

40:59

playing field. Like you could be 10 years younger than me

41:02

or

41:03

10 years older than me. Doesn't

41:05

matter if you just make good content and you put a lot of value,

41:08

people will notice, and then they'll reach out to you and then do

41:11

stuff with you. Maybe give you a job. I don't know. All right.

41:14

Next question, getting some career questions now, which is

41:18

growing to staff.

41:19

So hi, premium goblin. It's weird saying this because this is like

41:24

a random name I came up with

41:26

for my experiments that I was running on X and threads and

41:30

other social media platforms. But what is necessary to become

41:34

a senior staff software engineer? And could you give tips on

41:37

becoming an excellent suite? So like, this is a, I don't know,

41:40

there's

41:41

so much, I actually have a lot of insights into this topic,

41:46

mainly because to

41:48

do really well at a company like meta, you not only need to be

41:52

text technically excellent, because that's just the bar.

41:55

Like everyone's just very

41:57

smart. And then they have a very high technical bar. That's just

42:00

like the minimum,

42:01

but you also have to have pretty high EQ. Like people will need

42:05

to like you,

42:07

people need to like working with you. Right. And you need to

42:09

be pretty easy to work with, but not also not a pushover at the

42:12

same time. So there's like all these like various factors.

42:15

But from going from E3 or L3, like junior level to senior, you just

42:22

have to do

42:23

your job really well. You know, E3 is just coding

42:27

really well, just landing a lot of stuff. E4 is like taking a project,

42:31

like by yourself all the way to the end with minimal,

42:34

like handholding. E5 that's the baseline but you're now like

42:38

mentoring other mid-level engineers and you're slowly creating

42:41

some scope for yourself

42:43

and you're taking on even more complicated projects but from

42:47

senior to staff it's essentially a different job like from a technical

42:50

perspective a senior engineer and a staff i think there is not a

42:54

huge amount of delta to be honest and even for like senior staff

42:58

but obviously there is a delta but like the the true delta between

43:02

like senior roles and like staff plus roles is around behavior.

43:07

Actually, there's a lot of behavior things that make you really

43:10

stand out. And it's like, it's a totally different job. Like my bar for

43:13

staff is you have so much ideas and so many things that you

43:17

want to do, and you're good at executing on all of those ideas,

43:21

but you have so much that you have to and want to do that you

43:24

just need people to help you. And that's inherently

43:27

scope creation, right? So that's why a lot of tech leads is the

43:31

archetype for sixes because they help create scope. And then

43:35

they essentially have impact that scales beyond

43:38

just themselves.

43:39

And seven plus is that, but at org level scale, not just

43:42

your team. So you're like multiple teams and cross org. And it's

43:46

really around influence.

43:47

So it's really hard to get into in just this like small like video,

43:52

but it's essentially, you got to know that staff plus

43:55

is like a different job.

43:57

It's a different role. All right, so

43:59

we're at question number two. 20, and this is agents outside

44:03

of coding. What's been your favorite way to apply agents

44:06

outside of coding?

44:07

So I actually use agents for all of my stuff, like whether it's

44:12

helping out with taxes, you know, the typical ChatGPT

44:15

use cases,

44:17

but I also run my entire content pipeline through Codex. Yeah,

44:21

I think at one point for my personal stuff, I was using Codex

44:25

more for content pipelines

44:27

than like coding itself because I didn't have like a side,

44:30

like coding project to do.

44:32

But yeah, that has been my favorite. All right,

44:34

product decisions

44:35

and AI. Mahesh, provide insights on product design,

44:40

no responsibilities and meta and paradigm shifts towards

44:42

human AI interactions and collaborations.

44:45

What work are they doing now? And what skills do their

44:48

roles require?

44:50

So not just product design,

44:52

but product management,

44:54

data science, data engineer, like all of these were, a lot of these

44:57

roles are kind of blending a little bit. Obviously,

45:00

people have specialties, but like our designer is amazing.

45:03

They're basically a designer and an engineer.

45:06

She essentially codes and makes a bunch of like UI changes.

45:10

And like, she doesn't ask us to, you know, fix this pixel or

45:14

that pixel. She just like does it.

45:16

And it's been really nice. It's really great. And they're closer to

45:20

the code and they're like, it's like they get more empathy to

45:23

what we do. I have always like gave my own opinions about

45:27

designs and stuff, but I'm not like doing the designs yet. Right.

45:30

But in terms of like data science, I'm doing my own queries now

45:34

I'm doing my own analysis. I mean, I've always done that,

45:36

but it's a lot easier with. AI to run a queries and get like impact

45:41

sizing and things like that. So roles are definitely blending.

45:44

Yeah. It's, it's, it's very interesting, not just us, but I don't think

45:47

the entire industry has figured it out yet. That's why everyone's

45:50

being just labeled as member of technical staff, like the labs.

45:54

But yeah, it's a very interesting like state we're in right now.

45:57

All right. Lessons

45:59

from meta products. Nice to see another new L7

46:03

suite on here. What have you found as the most interesting

46:06

projects of the ones you worked on and why?

46:09

Interested to hear both from a technical perspective and

46:11

organizational one. So obviously working on reels was like a

46:15

dream come true at the time. I was like a E4, right. When I got to

46:20

join reels and essentially I got to like senior during that time,

46:24

my tenure at

46:25

reels, but I was there when we launched it. So I got to join the

46:29

team that created it. I always get to say that even though I

46:31

joined at the very tail end of it, but yeah, that product was

46:34

really interesting. It was, I like, it was very technical and hard

46:37

for me because I switched from full stack web to mobile during

46:41

that time because I really wanted to work on reels and it's a

46:44

really interesting product.

46:45

And a lot of people don't know that reels is actually

46:48

a music based app and everything's indexed around music.

46:52

So that's a really interesting project. I also got to work on

46:54

meta AI, like the original, like connect launch of meta AI

46:58

on messenger. I know like meta AI is not like the most widely

47:02

used right now, but I, this was during. Lama three days where it

47:06

was very popular and like a lot of people were using it,

47:09

but yeah, it was, I think that was really interesting because

47:13

none of us, the entire industry hasn't really figured out what AI,

47:17

like interacting with AI look like. So all of these new UX patterns

47:21

and like client

47:22

had to be like, just kind of imagined. And I really enjoy that

47:27

like experience. All right. So the last question is growing

47:30

content reach. Draco asks, Hey, yeah. And welcome. What are

47:33

some of your best tips for content creations in the agentic era?

47:37

I've recently just started sharing content and so far limited to

47:41

my blog and LinkedIn. How do you approach the reach of

47:46

your content? So

47:48

a few things I have content pipelines with my agents. And the

47:51

other big thing is I use. LinkedIn, which is my friend,

47:54

Kevin's a startup. And what I do is essentially post to one place

47:59

and it fairies all of my content. And it has been really helpful

48:02

helping me go viral in like places that I'd even know I was

48:04

going viral. But as a content creator, like the best advice I can

48:08

give to you is don't rely on just one platform and just make sure

48:12

you post, but make sure you reuse a lot of the content that you

48:16

have repurposed them because people hang out in

48:20

different places.

48:21

They don't always cross paths and some people only stay on X

48:24

some people only stay on threads. Some people only consume

48:27

on YouTube. So just be everywhere every creator is doing this,

48:32

you know. But they just have a team do it. I'm just by myself.

48:35

So I leverage ferryman so shoutouts to my

48:38

friend Kevin for making that but yeah, that's basically it. Alright,

48:41

so that's all the questions on the AMA that I thought I kind of

48:45

like dedupe as much as I can. I'm sure I missed a few but feel

48:49

free to add more questions here and I'll try. To get back to you

48:52

as quickly as possible. But yeah, I really love doing AMAs.

48:55

I feel like it's just like a fun way to interact with the community

49:00

of like people that have the same hobbies that I do. Like same

49:04

interests and I could talk about AI and like software and career

49:07

stuff all day. I don't know why I'm weird, but this is what I enjoy

49:11

talking about. And I don't get to do that all the time because my

49:14

wife doesn't want to talk about that kind of stuff. She just wants

49:17

to talk about Korean mom dramas.

49:19

But yeah, thanks for. Watching this little series of videos or this

49:24

little video. I hope to make more of these kind of videos and

49:27

thanks for supporting me in this journey. All right

Interactive Summary

The video features the creator answering questions from an 'Ask Me Anything' (AMA) session regarding software engineering, AI, and career growth. He discusses the future of software engineering roles in the age of AI, shares his current agentic coding workflows, and emphasizes the importance of safety and foundational knowledge. He also touches upon his transition to becoming a staff-level engineer and offers insights into content creation and staying competitive as a developer.

Suggested questions

5 ready-made prompts