HomeVideos

Lessons from building Vercel v0 and the d0 agent - The Pragmatic Summit

Now Playing

Lessons from building Vercel v0 and the d0 agent - The Pragmatic Summit

Transcript

836 segments

0:04

Malta, thanks for having the

0:06

conversation with us today.

0:09

Um,

0:11

this time it feels different when it

0:13

comes to coding agents. I think there

0:16

have been times in the past where, you

0:19

know, it it felt like it was uh a little

0:22

revolutionary, but I think this time

0:24

we're all trying to figure out how we

0:26

are supposed to build while the ground

0:28

underneath us is shifting. And so super

0:33

happy to be speaking with you today. I

0:37

think that with your products uh DZ your

0:40

internal data agent and then Verscell V0

0:43

as well your public facing thing um

0:47

you've

0:49

you've been able to roll with the

0:52

punches and and be able to build and and

0:55

create products as the world has changed

0:57

around us. Let's start with DZ your

1:00

internal uh data agent. What was your

1:03

first approach there and why did it turn

1:05

out to be so flawed?

1:08

>> Yeah, to give folks a little bit of

1:10

context like the thing that makes

1:12

Versell strong is that we always build

1:14

things with our own technology and like

1:16

one of our thesis is that like building

1:19

agents actually extremely easy and you

1:21

don't need to buy them. You can just

1:22

build them yourself. And so we build one

1:23

ourselves and so the the agent that we

1:26

call DZero internally is a is a text of

1:28

SQL engine. So you you give it any

1:32

question in Slack and it will reply with

1:34

the answer and it has access to our

1:36

entire snowflake kind of subject to the

1:38

to the access rules of the of the user.

1:41

Right? And so um I I'll share one query

1:44

which I think is the funniest one. It's

1:45

a salesperson. You'll hate it all. Um so

1:48

this early this year they um this person

1:50

asked the following question. uh which

1:53

S&P 500 CTOs and VPs of engineering have

1:56

private Versel accounts and have

1:58

deployed over Christmas.

2:03

So presumably they got like an email or

2:05

a call. I don't know. But like I think

2:06

like that's like if like actually

2:08

finding that from I mean obviously you

2:10

have to do a little bit of research. You

2:11

have to go to LinkedIn etc. The agent

2:12

does as well but then eventually you

2:13

kind of figure out the right snowflake

2:15

query. It's it's very very difficult

2:17

right? Um, and so the the initial

2:20

version of this agent was kind of this

2:21

kind of traditional infrastructure where

2:23

you have, you know, the agent is a tools

2:26

in a loop type of thing. Has all kinds

2:28

of different tools to do all kinds of

2:29

different things. Um, and it wasn't like

2:33

it was working badly, but it was, you

2:36

know, maybe not as magical. And then we

2:38

deleted everything and switched to like

2:43

an agent that looks very similar to a

2:44

coding agent. Now it's it's it's still

2:46

kind of custom coded like it doesn't use

2:48

for example cloud code as a harness uh

2:51

because again building such a harness is

2:52

actually really easy and you can just do

2:54

it. Um but otherwise it kind of looks

2:56

the same way. So the the the general

2:58

architecture is that we did the work of

3:02

going through our entire snowflake and

3:04

for every single column

3:07

in pros explaining the business value,

3:10

right? And that gets exported to a YAML

3:13

file. And the the agent

3:16

essentially gets told, you know, you got

3:19

post-trained on using GP on tail and and

3:22

all these things, right, that you need

3:23

for coding and go to go to town on these

3:26

YAML files to figure out the business

3:28

semantics of everything. And then you

3:30

make a SQL query. Um, for that it has a

3:32

completely different custom tool and

3:35

that's it. So there's just two tools.

3:36

There's the bash tool and there's the

3:38

SQL execute SQL tool. and and that's the

3:40

entire agent. So, it has like 50 lines

3:43

of code. Um and and it's completely

3:46

transformational for the business.

3:48

>> What led you to understand that you

3:50

needed to throw everything away? Cuz I

3:52

feel like you go and you build all of

3:54

this this code and it's it's just so

3:57

hard to light it on fire and then start

3:59

from from scratch again.

4:02

>> Yeah. I think like I think in the in the

4:04

world of agents, you have to be humble

4:07

in the sense of like we're just

4:10

discovering how to build them. And so

4:12

just because something was best practice

4:14

like in the summer of 2025 means quite

4:17

little today and like that's different

4:19

from like I don't know if you've built a

4:21

website you know it's been 30 years and

4:23

we kind of know how to do it but on you

4:26

know agents are in their maybe third

4:28

year for real if at all right um and so

4:31

you have to be willing to entertain the

4:33

notion that yeah maybe there's actually

4:35

now a better way to do it and like it's

4:38

kind of proportional to the models

4:39

getting more intelligent so you And it's

4:41

more viable now to have agents that are

4:43

essentially it's fully relying on the

4:46

emergent behavior and and respectively

4:49

um are more simple because you don't

4:51

have to prompt them so much. You don't

4:52

have to hard code so many rules.

4:54

>> Uh on the Verscell blog you had a uh a

4:58

post it was titled I think all you need

5:01

is the file system in bash. Is that is

5:03

something like that? And so you just

5:05

took a complete step backwards and and

5:08

described what the the data was in in

5:12

plain English and sort of like you just

5:15

step back and let it cook and and move

5:18

to a much more declarative model with

5:20

everything,

5:21

>> right? Yeah. The intuition is that you

5:22

kind of you have to think about like

5:26

what was the model trained on like what

5:28

what what is it optimized on? And for

5:30

now there's lots of coding tasks, right?

5:32

And it'll change in the future. And so

5:34

if you can make things look like like

5:37

they're a coding task even though

5:39

they're not um then you can uh you have

5:42

you get disproportional good results.

5:45

>> How many CEOs and CTOs in the the

5:48

Fortune 500 are using Versell on their

5:50

personal accounts?

5:51

>> I I don't have the precise number. It

5:52

was pretty substantial.

5:53

>> Okay.

5:54

>> Yeah.

5:55

>> Dozens of them.

5:57

Well, I just it is it's quite amazing

6:00

now to see all of these CEOs and CTO's

6:02

come out of the woodwork and start

6:04

coding and and doing all these agents.

6:06

Are are you one of those CTOs that are

6:08

close to the ground and and shipping

6:10

stuff?

6:11

>> I was already before, but I'm I'm deep

6:15

in 12 hours a day coding. And by coding,

6:18

I mean like I I can do meetings, right?

6:20

cuz I can, you know, just kind of every

6:22

so often uh optimize the I go in, check

6:25

the prompts, deliver a code review.

6:27

Yeah, I'm super back. Uh I I've been for

6:30

for the longest time kind of oscillating

6:32

between coding a lot and and not coding

6:34

so much and I'm I'm back on um like

6:37

24/7.

6:38

>> What's what's your drug of choice? Your

6:40

agent of choice.

6:42

>> So for I mean for Versell, we try for

6:45

folks to get a broad experience across

6:47

the company. We want to feel what our

6:49

users feel. So we want to we don't we

6:50

don't mandate anything. Um my current

6:53

stack but it's subject to change is uh

6:56

clot with 4.6 fast and then I'm using uh

6:59

codeex 5.3 for code reviews.

7:02

>> Yeah. Yeah. It's uh it's quite amazing.

7:06

It's just this like dopamine hit where

7:08

you're you're uh you're hitting the the

7:10

slot machine hoping that you get

7:12

something awesome out of it.

7:13

>> Right. Like that. By the way, I had u

7:15

there was an article in Wall Street

7:17

Journey journal of me basically saying

7:19

that and so that was my first ever quote

7:21

in a major newspaper. Here you go.

7:22

>> Oh okay.

7:23

>> Oh wow. We both came to that.

7:25

>> So voted to be addicted. But yeah I'm I

7:30

I maybe I'm not addicted but I do love

7:32

it. It's such a good experience.

7:34

>> Well let's shift to Verscell Vzero uh

7:37

which I think you launched back in 2023.

7:40

Is that correct? Yeah. So the original

7:43

pitch was um anybody should be able to

7:46

make an application even non-engineers

7:48

and you could do some prototyping and

7:51

stuff like that which was I think pretty

7:52

revolutionary at the time. What did you

7:55

think Vzero was going to be and how

7:58

quickly did it start diverging from the

8:01

plan?

8:03

>> Yeah, I think initially we we thought we

8:05

were building a tool for front-end

8:06

engineers uh because that's what we're

8:09

doing in general, right? And so like we

8:11

we thinking we were making a tool for

8:12

ourselves and

8:15

we then realized we actually built a

8:17

tool for backend engineers because it

8:20

was empowering them but it also sucked

8:22

um in the sense that it didn't work all

8:24

the time. And you know this is 2023 GPD

8:26

3.5 GPD4 days and so it didn't work all

8:30

the time but the back end engineers they

8:31

were good enough to fix it in the cases

8:33

where it didn't work but you couldn't

8:34

have given it to a non-engineer at the

8:36

time right because it was just not um

8:38

reliable enough and and so that was the

8:41

that was the kind of the main part of

8:42

market fit for a while and then uh we

8:46

but again in the AI space you have to be

8:48

humble right like you have to be willing

8:49

to entertain that the world is changing

8:51

around you so sometimes people call it a

8:53

pivot but it's It's not really the right

8:54

word because usually that's used for the

8:56

cases where you realize that you kind of

8:58

made a mistake on your internal data and

9:00

you have to do something else. Whereas

9:03

let's say anthropic ships sonnet 3.5 and

9:06

suddenly essentially the same prompt can

9:09

be used to build full stack apps which

9:11

previously just wasn't possible. You

9:13

cannot now keep your product the same

9:14

because the world is different, right?

9:16

Um and so that that was like a major

9:18

milestone where like we we realized okay

9:20

we have to um and I mean obviously this

9:23

amazing right like we can we can now h

9:25

uh adopt our product to be able to build

9:28

like end to-end applications and also

9:30

with a success rate that kind of

9:31

approach is the the case where um where

9:34

a non-engineer can be successful.

9:37

So you told me there were about five oh

9:40

moments when it came to vzero um over

9:44

the years where the models took a really

9:47

big step forward or you know usage

9:50

patterns shifted and you needed to

9:53

rethink things. Can you take us through

9:55

one of one or two of those moments and

9:57

and how you were sort of thinking about

10:00

things? Yeah, I mean definitely the

10:02

first one was um like in the summer of

10:04

2023 when um to take us all back, right?

10:08

The CHBT had launched and LMS were still

10:11

kind of new and and and broad adoption

10:14

and

10:16

these things were making text and so I

10:18

think us and everyone was thinking like

10:20

we got to like it must be possible to

10:22

make web pages with these things and

10:24

back in the day when you tried you would

10:27

realize that it wouldn't do a good job.

10:29

uh like it would kind of do it but like

10:32

it wouldn't look good. It would kind of

10:33

be be um be subpar. Not something you

10:35

would package as a product. And I still

10:38

remember to this day sitting at the like

10:40

we had like someone actually who who is

10:42

from China and lives in Berlin, but he

10:44

was in our office in San Francisco and

10:46

he was hacking away and then at some

10:48

point he was like raising his hand like

10:49

guys I've I found something. And so he

10:53

had just changed the prompt to say use

10:55

Tailwind.

10:58

And this was such a like serendipity

11:00

moment because Tailwind at the time

11:02

which is it's like a way to write CSS um

11:04

at the time it was old enough that it

11:06

was in the CHBT 3.5 um training kickoff.

11:09

Um but at the I mean at that time it

11:12

wasn't super popular yet but it was

11:13

enough training data and so the model is

11:17

so much better at doing inline reasoning

11:19

rather than saying we have to write a

11:20

CSS file then later write CS HTML. the

11:22

models at the time were too dumb to do

11:23

that. So they so they couldn't, right?

11:25

But if you if you told them basically

11:27

just put everything in the same place,

11:28

then they did a real job. And so that's

11:30

kind of how we figure out how to build a

11:32

product that actually was viable back in

11:33

the day, right? Um so that that was the

11:36

kind of the first milestone to actually

11:37

make it work. Um eventually like I mean

11:41

I already mentioned that we like the

11:42

second really big pivot was was that um

11:45

I think the the the final step you know

11:48

obviously there was like this whole

11:50

ecosystem now of of products kind of in

11:52

this space and and some of them went

11:55

very much like into the consumer space

11:58

um and and we definitely discovered okay

12:01

there's this like enterprise use case so

12:03

like when for vzero the the users we're

12:05

aiming for I would call tech adjacent

12:08

right so it's the it's the PM, it's the

12:10

designer, it's the the product owner,

12:13

the the business person who's kind of

12:15

interested. It's like um that found the

12:17

law of product market fit. Um and then

12:19

the final use case, and I'd love to talk

12:21

a little bit more about that, but like

12:22

that is essentially um I'm a I'm a

12:26

business person at a company. I'm going

12:27

to make an internal app for myself,

12:29

right? um kind of the new like crazy

12:33

onslaught of of shadow IT um is

12:37

definitely something that that we're

12:38

very interested in both from a from a

12:40

from the VCR point of view but also from

12:41

the Versel deployment point of view.

12:44

How do you think about

12:46

um how do you think about the fact that

12:49

the models are so fully capable right

12:52

now and like where does Verscell sit in

12:57

uh as a product, you know, as these

12:59

models get better and better?

13:03

>> Yeah. So, we're we're a multi-product

13:05

company, but like so our core business

13:07

for folks who don't know is you throw

13:09

over the fence and we're going to

13:10

run it for you. Um, and the the beauty

13:14

of that is that there's no more being

13:16

made right now. Sorry for cursing on TV,

13:19

but here we go. Um, so like like like

13:23

every like we love it if you use cloud

13:24

code, if you use cursor, you know, like

13:27

if at some point you're going to have to

13:29

have a place to run it and and um you

13:31

know, we can connect Versell to your git

13:34

repository and every time you push um

13:36

we'll make you uh a new version of it

13:38

and have it in production. So, so that's

13:40

kind of like that's how I see my primary

13:42

position in that marketplace, right? And

13:44

then, you know, with VZero, for example,

13:46

obviously you're also playing kind of on

13:47

the creation side, but I certainly spend

13:49

most of my time actually on the the

13:51

question of how do I run these apps that

13:54

are made in a different way in

13:56

production in a way that's um like

13:58

that's appropriate for this new type of

14:00

application.

14:03

So on a scale of 1 to 10, as the CTO of

14:07

a tech company in 2026, how worried are

14:10

you that the stuff that you've built

14:12

will become obsolete as these models get

14:15

better and better?

14:20

There's things I'm worried about. Um,

14:23

but I don't really see like uh like

14:28

again like you know since we're in the

14:30

business of operating software um I

14:33

don't see a major disruption there. Like

14:36

you could argue, you know, the agents

14:38

are also great at writing Terraform,

14:41

like you know, they can just make the

14:42

infrastructure for you, but like that's

14:44

actually not how that works, right? like

14:47

the the the whole idea of of of any form

14:51

of professional DevOps is that I have

14:53

like somewhat an idea of what's going on

14:57

and and so I can't like you can't really

15:00

vibe code that like you you so you there

15:04

has to be there always has to be some

15:06

form of platformization of how I run

15:08

something

15:09

>> and um and so that like you know

15:12

essentially we're playing in that in

15:14

that space relatively successfully. So

15:16

for that from that point of view I'm

15:17

actually not particularly worried. Well,

15:20

do you think that the lack of

15:21

observability is a temporary limitation

15:24

or a fundamental limitation of

15:26

long-running agents?

15:30

>> Like uh you know I think that the the

15:34

there's there's a whole you know there's

15:38

a whole revolution ahead of us of of

15:40

agents participating further in in kind

15:43

of the DevOps space and and and and

15:45

running your application. um we started

15:47

calling it kind of self-driving

15:49

um like infrastructure where like where

15:52

the you know where you have essentially

15:55

something that in an agentic way kind of

15:57

understands what's going on. Um but yeah

15:59

I think that still kind of like relies

16:01

on the fact that there is a certain

16:04

uniformity how how things are running

16:06

versus essentially you know let letting

16:08

the AI kind of loose.

16:11

If you were to start the Vzero team

16:15

today from zero, how would you do it

16:18

differently than when you started it in

16:19

23?

16:23

>> Oh, that's a really good question. I I

16:25

think the the obviously now we under

16:27

like if you already know what what the

16:29

product market fit is, you can jump over

16:31

all these steps, right? Um I think the

16:34

the big difference is that today you

16:38

actually don't need a team. Like so if

16:40

you start why would you have a team?

16:42

Teams just I don't know make things go

16:44

slower, right? Like you can you can

16:46

always go to the step where like where

16:51

you where you have enough that you can

16:55

make a judgment call as to what whether

16:57

that's worth investing with a single

16:59

person. And maybe there's two of them.

17:01

Maybe there's three of them, right? But

17:02

it's not like seven people, right? And

17:04

so I would I would tell someone, "Go

17:08

figure out what the product is and give

17:11

me a demo and if the demo is good, I'm

17:14

going to give you a team."

17:16

>> So you would just have one dude like

17:18

just go and do it after you found the

17:20

market fit

17:20

>> or Gallop. But yeah.

17:21

>> Yeah. Yeah. Yeah. That's amazing. Um so

17:26

how are you thinking about your dev

17:29

teams within Versel then? Are they much

17:32

more about like one person and and one

17:34

sphere of ownership and then they go and

17:36

they do everything or are you trying to

17:39

retrofit maybe like a broader team

17:41

dynamic?

17:47

I don't I definitely don't think we have

17:49

like in a major way kind of changed how

17:50

how how we operate. Um, I think it was

17:53

always a good idea to have individuals

17:55

to be able to ship something end to end

17:57

and and to not really always rely on the

18:00

entire operation to make progress. And I

18:03

think that's kind of like many of these

18:06

many of these things, you know, continue

18:08

to be true, but they're they're probably

18:10

more painful now if you if uh if you if

18:14

you you know increase the speed of the

18:15

inner loop through a coding, but your

18:17

outer loop of shipping is uh is

18:20

different. Um I give you one example

18:22

which I think is relevant for this

18:23

group. Um so I I was at Google before

18:26

for 12 years. I led like part of the

18:28

search team. Um you can imagine

18:31

essentially being a very slow oper

18:32

operation, right? Uh my job was

18:34

essentially to approve things via email

18:36

and go to meetings. Um and so I didn't

18:39

want to build the organization. And so

18:42

the the the pattern that we use at

18:45

Verscell is what in the nerdiest way you

18:48

could describe as optimistic locking. So

18:51

there are no approvals.

18:54

Um anyone can ship anything

18:58

but

18:59

they have to tell the organization that

19:01

they're going to do it and the

19:03

organization can veto things. And so

19:06

vetos actually kind of sounds scary and

19:08

weird but it's really empowering, right?

19:10

Right? Like if the legal team, they says

19:13

like like most of the time they say,

19:14

"Yeah, I mean this sounds totally

19:16

reasonable. I don't need to spend any

19:17

time on it." Right? But sometimes

19:18

they'll say, "Oh my god, you cannot ship

19:20

this to like children in North Korea."

19:22

Um like there there's a there's a like,

19:24

you know, sometimes that's true, right?

19:26

But uh um but if you have a process

19:30

where legal has to say yes,

19:33

uh then you have to wait for them and

19:35

like there's this round trips and

19:37

they're on vacation and like whatever,

19:39

right? It's it's it's complicated if you

19:41

say well no you can always say this is

19:43

not okay but you have to you know do you

19:46

have to now be an active actor in this

19:48

process you kind of it's both empowering

19:51

for the for those teams but also puts

19:53

the the responsibility

19:56

>> well that's interesting and so

20:01

like you guys are like ultimately you're

20:03

an infrastructure and devops corporation

20:06

how do you see the role of like reli

20:08

iability and maybe moving a little bit

20:10

slowly and and more conservatively for

20:13

the uptime of all of your customers

20:16

versus like wanting to move really

20:17

quickly in this age of agentic coding.

20:21

>> Yeah, I think the the it's it's just not

20:24

right to take those things to be in

20:27

opposition.

20:28

But like essentially everything like

20:31

everything we do in our business um and

20:33

we we have this like kind of maybe

20:37

great situation where like it's our

20:40

business to make our customers move fast

20:42

and we're taking advantage of it

20:43

ourselves, right? We're own first

20:44

customers. And so everything I do is I

20:48

think about how can I make my teams move

20:50

faster? Um how can I, you know, improve

20:53

the speed of the inner loops? How can I

20:54

improve the speed of the of the outer

20:56

loops of shipping? And so like if I uh

21:02

like that doesn't mean I never make a

21:04

trade-off, right? Like for example, we

21:06

only ship our um like serving systems

21:09

once a day, right? Um whereas we ship

21:12

our control plane every time time

21:14

someone pushes to to main. And so would

21:18

I love to be able to, you know, make a

21:20

new feature in our um consumer serving

21:23

stack on a like 15 times a day? Yes. But

21:26

you know we did make some trade-offs

21:28

there. So obviously there's you make

21:29

some decisions but it doesn't mean that

21:31

in in like that you cannot move fast and

21:36

uh you know not break things right like

21:37

there is it's possible.

21:39

>> Well you know um I did a deep dive into

21:42

Cloudflare's outage and it turns out

21:44

that it was some bad data in the control

21:48

plane twice. Um and uh the whole reason

21:54

they had the dynamic configuration was

21:56

that they could move really quickly and

21:57

make changes and customers would see

21:59

that reflected really quickly. But you

22:02

know this globalized like key value pair

22:04

store that is storing these

22:06

configurations has the potential to take

22:08

out 20% of the internet. And so do you

22:10

make a distinction between the ops and

22:13

the devops part side of the corporation

22:16

and then the the software and the

22:17

engineering and the architecture? Are

22:18

those the same thing? No, it's a really

22:20

good question. I think the like also

22:22

from my experience at Google like every

22:24

time Google goes down which you know at

22:27

at a at a large scale only happens maybe

22:29

like every five years, right? Every

22:31

single time there's it's one of two

22:33

things. It's either like a bad config

22:36

change or it is like something around

22:40

the like like secrets management service

22:43

that everything depends on, right? or

22:45

it's a config change of the secrets

22:46

management service which I think was the

22:48

last big one. Right. Right. So it's it's

22:51

always going to be that. Um and so I

22:54

mean in Verscell's architecture

22:57

we uh so we operate 20 regions 20 core

23:03

regions and so on the serving stack

23:06

again we we have deliberately decided

23:09

that we want these regions to be

23:11

autonomous and we don't have a mechanism

23:13

to change them all at once and so we uh

23:18

we thankfully cannot do these type of

23:21

confict changes that break everything at

23:23

once and so we we change them in waves

23:25

and so yeah there's another like kind of

23:27

deliberate decision to say okay we um if

23:30

I want to move fast I want to be able to

23:33

get get relatively quick feedback on my

23:36

config changes right let's say feature

23:38

flex for example and so but for that

23:40

like to get that feedback you actually

23:42

don't have to ship it globally right

23:44

it's completely sufficient to say um you

23:47

know maybe I only put it into one region

23:49

and see what happens Um and then

23:51

obviously when that region goes down we

23:53

can easily just take it out of the

23:54

rotation. And so like you can I think

23:57

every time you you do something it's

23:59

obviously important to think about like

24:01

what is the what's the risk profile and

24:04

can I find a way to make essentially

24:07

progress at the same velocity but

24:09

without taking down the risk of for

24:11

example global outages of 20% of the

24:13

internet.

24:15

>> Are you one of these shops that give

24:17

unlimited tokens to your devs?

24:20

Absolutely. We even put it into our uh

24:22

job description on

24:25

I I could not see why I could possibly

24:28

not want that. I mean, obviously people,

24:31

you know, there's always going to be

24:32

people who abuse some policy, but like I

24:35

mean, how much could it be?

24:38

>> I don't know. You're the CTO. Don't you

24:40

know about your cost?

24:40

>> No, we had a guys like basically people

24:42

like mostly it's it's bucks, right? Like

24:44

I had a engineer who was 10x the second

24:47

one was like first of all I was

24:48

impressed. Um, second of all, we found

24:51

out that his um custommade coding

24:55

harness uh had like was changing the

24:59

prefix of the prompt so that it wasn't

25:00

hitting the caching um system

25:03

>> and so which is drastically more

25:05

expensive, right? Um so obviously it

25:08

happens but yeah I think it's worth

25:09

having an eye on it but otherwise um I

25:12

think the the more the marrier.

25:16

Are your code changes uh going into

25:18

production? The CEO's code changes, are

25:21

they going into production?

25:23

>> Uh

25:24

so my CEO I think still deploys an app

25:28

to Versell every day. Um but he very

25:33

very rarely does production code

25:35

changes. And I do

25:38

I mean regular about you know maybe two

25:41

three times a week.

25:42

>> Okay.

25:43

>> Nothing nothing super big. Um, I think

25:45

it's a really common profile people in

25:47

the room will have where you say, "I do

25:50

things, but not the ones that actually

25:52

are important."

25:54

>> What do you think the future of your

25:57

tech organization is going to look like

26:00

as these agentic tools just get more and

26:03

more powerful?

26:07

I think what's already happening is that

26:10

there is like the job is just looks much

26:14

more like management than it looks like

26:16

I see work

26:18

and that I think does kind of change a

26:23

lot about the profile of the of the

26:25

people and so we what we see is that um

26:28

the the most senior IC's are in a way

26:32

the one that benefit the post because

26:35

they're they kind of already did a very

26:37

similar job, but now they have just more

26:40

minions. Um, and then and then the other

26:44

folks who benefit the most are the the

26:46

most junior engineers. Um, because they

26:51

for the same reason that they're better

26:52

at making Tik Tok videos than me, right?

26:55

Like they're growing up with that stuff.

26:57

Um, I think what what's most interesting

27:00

is kind of what happens in the in the

27:02

middle. um like where people have to

27:07

still learn to be in this in a way new

27:09

role and also

27:13

have a kind of a um you know or need to

27:18

be just willing to engage with the

27:19

technology.

27:20

>> So are you one of these companies that's

27:22

really leaning heavily into interns and

27:25

junior engineers?

27:27

Yeah, we I mean I I I'm

27:30

year over year very very impressed with

27:33

the internship program. Um and yeah, we

27:35

also have um like a pretty very very

27:38

decent cohort of junior engineers.

27:43

>> So in terms of your organization,

27:46

what does it look like in a year? What

27:48

does it look like in two years?

27:52

>> Obviously, I don't know. Um my my CEO

27:55

and I have this quasi joke that we So

28:01

right now we're like 750 people and we

28:04

just quote unquote decided that we cap

28:07

employee count at 1,024.

28:10

>> Nice round number.

28:12

>> Um

28:13

which which is notably below our hiring

28:17

plans for this year. Um so we'll we'll

28:19

see what actually happens. Um but so I I

28:22

I I could see right that there's

28:24

essentially this asmtote right where

28:26

like you know you you grow the company

28:29

but at some like the the growth kind of

28:31

even let's hopefully our growth as a as

28:33

on the revenue side kind of keeps

28:35

growing up but that maybe you you

28:38

actually don't need more people. Uh I is

28:43

it realistic?

28:46

uh like I it's like we we I mean we so

28:50

we see agentic transformation obviously

28:53

on the coding side everyone here does um

28:55

we

28:57

automated for example our uh sales leads

28:59

qualification with an agent that we also

29:02

open sourced um we automated 87% by now

29:07

of our support intake um and that you

29:11

know that's actually good example for

29:13

did we let support agent go no A I mean

29:16

first of all the company's growing fast

29:18

enough that you know that would never be

29:20

necessary and B they have a much better

29:22

job now because they only have to solve

29:24

the hard problems which I think as a

29:27

support engine you enjoy more but the um

29:30

so I think there are some factors that

29:32

kind of are you know at least reducing

29:34

growth and so I do I do think there is

29:37

going to be a transformation on that on

29:38

that line

29:40

otherwise my like the real journey that

29:45

I we're all on is that we're figuring

29:48

out how elastic the software market is,

29:51

right? because we are making it cheaper

29:53

to make software and the like what's

29:57

definitely true and I think we're very

29:59

much seeing this also in our own numbers

30:01

is that leads to more software and and

30:05

so you

30:07

like the question is like you know

30:08

obviously that's going to balance out at

30:10

some point on some equilibrium and it's

30:12

completely unclear to me right now if

30:14

that equilibrium has more software

30:16

engineers than today or fewer but it's

30:20

very possible that it's power. Um, and

30:23

it's also very possible it's fewer,

30:24

right? like but but it's I I I I I

30:26

couldn't tell how because the

30:29

like the maintenance burden that is

30:33

associated with all that free free

30:35

software is very substantial and but

30:38

also like you know as long as it gains

30:40

the productivity wins it's not worth

30:42

investing in it having people who manage

30:44

it and so forth like

30:46

>> yeah I can see how you're positioned to

30:50

support all of this new software that's

30:52

going to be created So I'm pretty

30:54

bullish on that. But yeah, I just think

30:56

the the big question about whether we're

30:58

software light or software heavy in this

31:01

new world where software is free. I

31:03

think of it sometimes like like YouTube,

31:07

right? So you know before it was very

31:09

very expensive to create a you know TV

31:11

show or a movie and now anybody can do

31:14

it. And so turns out we were actually

31:17

video light in 20 2005 or 2006 when when

31:21

YouTube came out. And I do think, you

31:24

know, nobody knows the future, but um if

31:27

we are software light, it's going to be

31:30

pretty great.

31:31

>> That's I love that analogy, right?

31:33

That's exactly my point, right? There's

31:34

going to be more software. And you know,

31:38

there's now like the number of people

31:40

that are engaged in professional video

31:42

production is drastically higher than it

31:44

was 20 years ago. Um and again like

31:48

they're they're um that doesn't mean

31:52

there's no changes, right? I think when

31:55

uh like to quote kind of Ben Thompson

31:57

who I think is making this really good

31:59

analogy that the transformation is

32:01

probably closer to the one in the 60s

32:04

when the main frames were introduced and

32:06

the buildings full of quote unquote

32:08

computers

32:09

>> um you know no longer had a job. Then it

32:11

is like the transformation of the

32:13

introduction of the internet. Um but and

32:17

so that if you look back at the

32:19

transformation in the 60s um that was

32:23

very painful for some folks, right? But

32:25

like but overall from a from a societal

32:30

perspective obviously everyone's

32:32

drastically richer now. Um so in the

32:35

long term it goes well and so I think we

32:37

you know there there's a possibility of

32:39

of a transformation that's very similar.

32:42

Last question for me. What's your

32:46

prediction about the future? That's uh

32:49

that's a hot take that you haven't

32:50

shared with anybody else yet.

32:53

>> That's difficult because I tweet

32:55

everything out immediately.

32:56

>> Oh, okay. Oh, your spiciest tweet then.

32:59

Uh

33:02

I think what I like in my in recent

33:06

world like I think like definitely um

33:10

it's

33:11

certainly the the point is that software

33:14

you know you already mentioned it's free

33:15

I mentioned it's free I think we all

33:17

realize it's free like giving getting a

33:18

free puppy right like it has to be it

33:22

has to be maintained and so I think I

33:24

mean I'm I'm very excited about the

33:28

uh the role of

33:31

agents in software maintenance and

33:33

exploring that. Um and we touched on

33:37

like how does stuff happen in

33:39

production? Uh can I can I automatically

33:42

maintain something? Um and yeah and I I

33:45

want to I mean but otherwise I'm I'm

33:47

just in the same position as everyone

33:48

like I I now get an engineer saying I

33:51

build a new file system and they

33:54

wouldn't have done that before, right?

33:55

like it would have been just too much

33:56

work or like it would have been on the

33:57

plan that took them six months. Um, but

33:59

yeah, I don't I know it's not a spicy

34:00

take, but I really I really want to

34:02

figure out like what do I do with that

34:03

file system? Like can I ship it now? Um,

34:07

or or am I now in a like or or is it

34:11

actually not real?

Interactive Summary

The video discusses the evolving landscape of coding agents and application development. It covers Vercel's internal data agent (DZero) and its public-facing product (Vercel Zero). Initially, DZero was a text-to-SQL engine that proved to be complex. Vercel then transitioned to a simpler, more declarative model based on YAML files and LLMs, which significantly improved its effectiveness. The discussion highlights the need for humility and adaptability in the rapidly changing AI field, emphasizing that current best practices can quickly become outdated. Vercel Zero, initially intended for front-end engineers, found its niche with back-end engineers and has since evolved to support full-stack app development, driven by advancements in LLM capabilities. The conversation also touches upon Vercel's operational philosophy, focusing on empowering individual engineers, optimistic locking for shipping code, and a deliberate approach to managing infrastructure to ensure reliability. The future of tech organizations is seen as increasingly management-oriented, with AI agents augmenting both senior and junior engineers. Vercel is exploring the role of agents in software maintenance and the concept of 'self-driving infrastructure,' while acknowledging the potential for increased software creation leading to new opportunities and challenges in the market.

Suggested questions

10 ready-made prompts