HomeVideos

Background Agents Summit Wrap: What To Build Next

Now Playing

Background Agents Summit Wrap: What To Build Next

Transcript

532 segments

0:02

Hey.

0:05

Welcome back in here.

0:08

Another awesome talk.

0:10

>> Yeah, that was awesome.

0:12

>> I mean, it's really cool to see just

0:13

kind of how everyone's approaches

0:16

differ. Like everyone's not so your

0:18

approaches differ, but like their

0:20

opinions on where things are really at

0:22

and how to uh

0:25

implement

0:26

always seems to be like a little bit

0:27

different.

0:29

>> Yeah, yeah. I mean, generally we had two

0:32

incredible days. We had 14 sessions. We

0:35

had Uber here, Stripe, Cloudflare, just

0:37

saw Monzo, Harvie, AWS folks, Genentech.

0:41

So,

0:42

a crazy lineup. And I'm also very

0:44

appreciative that after 3 hours so many

0:46

of you are still sticking around. So,

0:48

thanks for tuning in from all those

0:50

different platforms. Um

0:52

And a quick note again. So, we will

0:54

follow up with the recordings. If you

0:56

joined via like Extra so, make sure to

0:58

go to background-agents.com/summit.

1:01

Um register with your email so that we

1:03

can actually share the recordings with

1:05

you. We will also share this as a

1:06

Spotify playlist so that you can listen

1:08

to it on the go cuz YouTube requires you

1:11

to be premium if you don't watch it. Um

1:13

and we'll probably also distill this

1:15

into a notebook LM um podcast all those

1:18

14 talks into one

1:20

um synthesized message basically.

1:23

So, um let's close the loop. Actually,

1:27

nice really nice framing to that. Um so,

1:29

we opened the summit with three pillars.

1:31

Um infrastructure was one, security was

1:34

the other, and then leadership and like

1:35

how to roll this out um the last one. Uh

1:38

and we also spoke about the shifts in

1:40

the SDLC and the how the role of the

1:42

human changes in the in the keynote. So,

1:45

let's actually close the loop, uh talk

1:47

about what we learned, synthesize some

1:49

of the learnings, and um

1:51

how and who demonstrated what in

1:53

practice. So, let's kick it off. Well,

1:55

curious what you what you think.

1:57

>> Yeah, so I thought it was really

1:59

interesting to hear how environment,

2:02

governance, and security kind of all

2:04

coalesce, right? Um

2:07

I mean, across talks from yesterday and

2:09

today, like dev boxes being so

2:12

important,

2:14

um

2:15

and the security that dev boxes kind of

2:18

gives you so long as they're within your

2:20

own cloud,

2:21

uh really seemed so important.

2:25

Um

2:25

and going from that to

2:29

implementing something similar within

2:31

AWS and you utilizing all these crazy

2:35

divergent AWS tools to build something

2:37

similar.

2:38

Um

2:40

basically, it's it's

2:42

it's really interesting to see how

2:45

the architecture that is the

2:47

architecture that's emerging

2:49

is

2:50

relatively consistent, but the

2:53

insights and the tweaks along the way

2:56

are all so so different. Um

3:00

Do you want to add a little more color

3:01

to that, Phil?

3:02

>> I think you're spot-on. I I would

3:04

totally agree with that.

3:06

And it's funny that like

3:08

the two pillars that we had in the

3:10

beginning, I think we said that, you

3:11

know, the environment is the foundation

3:13

and um security is also the foundation,

3:16

but the environment is really like um

3:18

it's like the foundation to both, right?

3:20

It's like it's also your governance. So,

3:22

um it's the architectural foundation,

3:24

but it's also the foundation of the of

3:25

the governance. So, it's almost like two

3:26

in one. If you have the environment

3:28

figured out, you also have like made

3:30

strides on the security

3:32

um bit with a which I found interesting.

3:34

So, um

3:36

let's let's talk about security and pick

3:38

that up um really quickly. So,

3:40

um you yesterday, if you tuned in, and

3:43

if you haven't, we spoke about um how to

3:46

actually avoid that agents are reasoning

3:49

around around the guardrails, basically

3:51

nice prompts that you put in to to ask

3:54

them not to execute certain things. And

3:56

um we had Stephen and Nuno from the open

3:58

source side talking about kernel level

4:00

enforcement. We had Leo Lorenzo and

4:02

Chris from Ona talking about VDO, the

4:04

data wall, and and how to actually um

4:06

protect at runtime at the kernel level

4:08

for for for that. And what I just found

4:12

nice at from the Monzo talk with Suhaib

4:14

Ellis

4:16

I I wrote I wrote this down cuz I found

4:17

it nice. Like he had a quote that said,

4:19

"There's nothing in regulation that

4:20

stops you from adopting an AI." And it's

4:22

exactly it's exactly the right mindset,

4:24

right? Like if you have those

4:25

foundations in place, if you can be sure

4:27

that you like limit your blast radius,

4:29

then there's like nothing stopping you.

4:30

And I think

4:31

especially we work a lot with the

4:33

regulated industries and oftentimes what

4:35

we hear is they they really believe they

4:37

can't use AI securely, and it's just not

4:40

true. Like of course you have to like

4:41

think a little bit different, and like

4:42

you have to do some of the protections

4:44

in place, but as you said, like if you

4:46

have the environment figured out, if you

4:48

have the governance of that in place,

4:50

then um you are actually very very well

4:52

set up.

4:53

>> Yeah.

4:54

>> And I also wouldn't

4:55

Yeah, go go ahead.

4:56

>> he said something too that I thought was

4:58

interesting in that last one, where he

4:59

said like people will always find a way,

5:02

you know?

5:03

Um

5:03

>> Yeah, yeah, yeah. Exactly.

5:05

>> Positive enforcement is so much better

5:07

than negative reinforcement sometimes.

5:09

>> E- exactly. I think shadow IT has never

5:12

been um higher than it is right now. So

5:14

even as a company, if you're like

5:17

I don't want AI cuz it's like it's bad,

5:19

it's too dangerous, whatever, your

5:20

engineers are one CLI command away from

5:23

from using those agents, and they will,

5:25

right? Um it's also what made cloud code

5:27

etc. like boom so much cuz it was like

5:29

uh such a bottoms-up bottoms-up motion.

5:32

So many of these companies are now in

5:34

the

5:34

um actually figuring out like how to

5:36

govern the the use of all those

5:38

different local agents. So

5:40

Yeah, really really interesting.

5:43

All right, let's move on. What's the

5:44

what's the next takeaway? I I that one.

5:47

>> Yeah, so the the third pillar when we

5:50

were kind of going into this, the there

5:52

were the three pillars, right?

5:53

Infrastructure, uh governance, and

5:55

leadership. So, leadership is where we

5:58

were trying to focus most of the talks

6:00

today, and I think a lot of really

6:02

interesting stuff

6:04

kind of came up. Um so, what really

6:07

stood out to you from some of these

6:09

talks around how people are uh how

6:13

people are rolling things out today, how

6:16

they're thinking about um enablement

6:19

beyond trust give everyone access to

6:21

background agents as a tool.

6:24

>> Um

6:25

yeah, I think there were a couple. So,

6:27

the

6:30

what we heard is that you you have to

6:31

you have to win everybody's trust. Like,

6:33

you have to start small. Like, none of

6:34

them came in with like, "By the way,

6:36

here's a big change. Tomorrow, your

6:38

whole workflow has is is is changing,

6:40

and like, please follow these steps."

6:42

Um I think the developers have been

6:44

following certain practices, obviously,

6:46

for for a long, long time. And um what

6:49

all these talks had in common is that

6:50

they're like really starting incremental

6:52

and small. And there were a couple of

6:54

talks that um um that talked about this.

6:56

I think Nico at Uber was was pretty

6:59

outspoken about this, where he said

7:00

like, I think he he was literally the

7:02

guy who said like, "Go where the pain

7:04

lives," right? And then it's like, I

7:05

think that's the that's the best proxy

7:07

you can you can do. Like, if you uh

7:09

identify the toil from developers and

7:11

can take that away, like, you earned the

7:13

trust. And then you go from there, and

7:15

then you go a little bit further. Um I

7:17

think Rajesh at Cloudflare is the same,

7:19

right? He talked about the PR reviews

7:20

that um created a lot of, you know, slop

7:23

and like slapped a bunch of comments on

7:24

the PRs. It didn't really help guiding

7:26

humans' attentions.

7:28

Um and then they changed uh to um to

7:31

their Codex approach. So, like, a

7:33

machine-readable, more deterministic

7:35

standard um that they would incorporate

7:37

into the agents' workflow when reviewing

7:39

the PRs. And like, suddenly, the um the

7:42

developers had trust into that standard

7:44

cuz they were used to it from the human

7:45

review, then they trusted their agent,

7:47

and then obviously that kind of resolved

7:49

the the the bottleneck. And

7:51

um the last one that comes to mind is is

7:53

Quake at Genentech where he literally

7:55

said, you know, they started with ops,

7:57

then they kind of graduated their agents

7:59

to also work on dev, um but then they

8:01

let the agent work on their on its

8:03

self-evolution, and kind of each of

8:06

these stages built the trust for the

8:07

next stage, and really gave them an

8:09

unlock. And now I think he he said

8:10

something like they have four a team of

8:11

four engineers, um and they have shipped

8:14

like 190 tickets or so in the last

8:15

sprint. So,

8:16

uh yeah. I think that's that's the the

8:19

gist of it is like start small, one

8:21

problem at a time, and then like, you

8:23

know, build your kind of factory up. Uh

8:25

as a whole thing.

8:26

>> really interesting to kind of take um

8:28

a You kind of have to take

8:30

simultaneously a prod like a platform

8:33

approach to solving this problem, but

8:35

also a product approach.

8:38

Right? Hearing the stories from like

8:39

Florence and Harvey about how they AB

8:41

tested the way that people interact with

8:44

the agent through things like Slack

8:46

summaries, and then how those Slack

8:48

summaries were presented to users versus

8:51

how they were presented to agents, and

8:53

the importance of like removing slop

8:56

from the potential outputs to improve

8:59

the trust,

9:00

um while also improving transparency.

9:02

There's so many things to consider in

9:04

the design aspects of a successful

9:07

platform here that you need to take a

9:10

product approach in building it. I

9:12

thought that was really really

9:13

interesting.

9:14

>> Great.

9:16

All right, what else do we got?

9:18

>> Yeah, I think at this point we've gone

9:21

through obviously 14 talks, and there

9:24

seems to be like one big theme that

9:27

feels like it's emerging.

9:29

And a lot of this is just best

9:31

practices, right? I mean, 20 years of

9:34

best practices in engineering and

9:36

platform engineering in agile

9:38

development, all of this just became

9:41

table stakes.

9:43

Right? If you want to start building the

9:44

future with background agents and

9:47

software factories, it's not nice to

9:49

have clear standards and the measurement

9:52

and service catalogs and IDPs, you have

9:56

to have them. It's a It is a requirement

9:59

moving forward in order for these agents

10:01

to behave

10:02

uh super well. I think someone uh I'm

10:05

blinking on who it was uh on day one. I

10:09

wish I had I wish I had the name in

10:10

front of me, but somebody mentioned um

10:14

like

10:15

I think it I think it was Patrick at

10:16

Tessell mentioned that every AI engineer

10:20

or every AI agent is effectively an

10:22

engineer that you're onboarding on day

10:24

one. And they're only as smart as the

10:27

things that you give them access to

10:28

instantly. Right? So,

10:31

it's more than just self-service. It's

10:34

more than just documentation and

10:36

onboarding. It's like you want to extend

10:40

the brain's capabilities effectively.

10:43

Um and that that's kind of the thing

10:45

that really was screaming screaming to

10:47

me throughout this entire summit.

10:50

>> Yeah. No, I I totally agree. And

10:54

um I get I think what all what what all

10:57

the others also had in common is that we

10:59

spoke about this a bit just now, but

11:01

like none of them started with this like

11:02

grandiose plan.

11:04

Um they earned the trust from there and

11:06

like going back to to to the

11:08

foundations, I think

11:10

um

11:11

it's really easy to get started with

11:13

that if you have the environment as a

11:15

foundation and if you um have the

11:17

governance around this cuz then

11:18

experimenting experimenting is actually

11:20

quite cheap, right? The blast radius is

11:22

like kind of limited. Uh you can run

11:24

things in parallel. Obviously, you can

11:25

run things in the background cuz they're

11:27

running in the cloud and don't have your

11:28

laptop

11:29

um to be open. And um you can experiment

11:32

with workflows one one workflow at a

11:34

time. Like can you can you know

11:36

continuously remove yourself as as the

11:38

bottleneck. I'm picking this up because

11:40

in the keynote we spoke about the

11:42

uncertainty increasing

11:44

cuz it can be daunting to like

11:47

and read like the end state of what the

11:49

the companies have been presenting here

11:50

like Stripe and Ramp etc. Like this is

11:52

the machine that we have and then you

11:54

look at this and you're like I'm

11:55

still stuck with cloud code in the CLI.

11:57

Like how do I get there? Oh my god like

11:59

they built so much for such a large

12:00

company I can never get there.

12:03

And I hope that these talks and like the

12:05

the journey that they all so kind of

12:07

also vulnerably shared is

12:09

made it much more approachable to to

12:11

everyone here and makes this again more

12:13

look like a journey rather than this

12:14

like grand grandiose blueprint that you

12:17

that you have to figure out.

12:19

So

12:22

the fastest way if you want to get

12:24

started if you're interested in that is

12:25

actually to abstract a lot of this away.

12:28

The thing you can abstract away is the

12:30

infrastructure piece and the architect

12:32

architecture around it. If you're really

12:34

interested in building all those

12:36

different layers that go into that that

12:37

some of those companies have spoken

12:39

about, you can check out

12:40

backgroundagents.com/landscape

12:42

where we collated 11 layers of the stack

12:45

with 95 tools that can be helpful to

12:47

building this.

12:48

Not many companies have the capacity to

12:50

to do it or

12:53

actually want to do it cuz it diverts

12:54

resources, right? So if you want to get

12:57

started right away with this

12:58

foundational piece in place, then

13:00

shameless plug this is exactly what Mona

13:03

has built for. It's got the obviously

13:05

the sandboxes context and security piece

13:08

and the adoption playbooks and

13:11

it really allows you to have background

13:13

agents execute end-to-end

13:15

on reproducible dev environments that is

13:17

that are connected to to to your whole

13:20

tool chain.

13:21

And

13:22

it also has these automations that we've

13:24

heard a couple of times today that for

13:27

example, Zach at the software factory

13:28

referred to. So, these are agent fleets

13:31

that are, um, running on your code base

13:33

or across thousands of repositories on

13:36

different triggers, like, uh, schedules

13:38

or web hooks.

13:39

And, um, all of that with the governance

13:42

and the guarantees that you need. So, if

13:44

you want, it runs in your VPC with audit

13:46

trails, scope credentials, and the

13:49

kernel level enforcement that we spoke

13:50

about in the in the talk with Chris Liu

13:52

and

13:53

Lorenzo.

13:55

So, if you want to get started, um, very

13:58

quickly with this,

13:59

um,

14:00

lock yourself out. We have a free tier.

14:03

Uh, go sign up and check it out. If you

14:04

if you require a little bit more

14:05

enterprise solution with running this in

14:07

your in your own VPC, please, um, don't

14:10

be a stranger and feel free to, um,

14:12

reach out to us. And again, if you want

14:14

to build the whole thing yourself, go to

14:15

the landscape page on the background

14:17

agent summit page.

14:19

Yeah.

14:20

Great. Will, anything to add on your end

14:23

here?

14:24

>> Um, no, I just wanted to kind of dive

14:26

into a bit of a thank you. Uh,

14:29

first things first, thank you to all of

14:31

our speakers. 14 incredible talks.

14:34

Um, every single person really put their

14:37

their heart and soul and all their all

14:39

their brain power into these

14:41

presentations for you guys. Um, we will

14:43

be following up with, uh,

14:46

we'll be following up with, uh, unlisted

14:48

YouTube playlists for all of you guys

14:50

have access to these recording uh, the

14:53

recordings of these talks if you ever

14:55

want to go back and reference them. As

14:56

Philip mentioned as well, we'll be

14:58

sending out a, uh, notebook LM, uh,

15:00

notebook LM podcast, um, and some other

15:04

useful tools if you want to go in digest

15:06

the content of these talks a little more

15:09

on your own terms and your own

15:10

timelines. Um, but seriously, we cannot

15:13

thank these people enough. Uh, it's the

15:14

research they've been doing that's made

15:16

any of this possible. It's the way

15:18

they've been implementing these these

15:20

pieces of technology in their companies

15:22

that made of possible and um, we're just

15:25

overjoyed with the quality of these

15:28

talks.

15:29

>> Yeah.

15:31

>> And on the flip side of that, I wanted

15:32

to also thank you send out a thank you

15:34

to everyone behind the scenes at Ona who

15:36

helped make this happen. So, Lou, if you

15:39

don't know who Lou is, go follow him on

15:41

Twitter at Lou JB. I'll send out his

15:44

handle.

15:45

He's kind of the He's the architect

15:47

behind the background agents landscape

15:49

and the micro site. He's also the person

15:52

that you saw running a lot of these

15:53

interviews.

15:54

He's extremely bright and understands

15:57

this space very very well. If you have

15:59

any thoughts, considerations, any

16:01

questions, just tag him on Twitter and

16:03

he will respond or X the everything app.

16:07

Likewise, Matt, huge thank you. He is

16:10

the

16:11

He is our head of engineering here at

16:12

Ona and he ran a bunch of the interviews

16:15

as well. You definitely saw his face in

16:17

the most recent the Monzo video as well.

16:20

And then a shout-out to the team that

16:21

made this webinar possibility. Ben,

16:24

Janine, and Sidhan for

16:26

making the website live and being behind

16:29

the scenes with pulling together all the

16:30

videos, editing, and graphics, and

16:33

everything. There has been so many

16:35

moving pieces to make this all happen.

16:36

So, just an enormous thank you.

16:40

>> Last one.

16:41

Thank you to you, Will, for for being on

16:43

with me here and like hosting through

16:45

all of this. Really appreciate it. And

16:47

lastly, thank you to the audience for

16:49

sticking around. It's now approaching 3

16:50

and 1/2 hours. We still have over 400

16:53

people watching live. Yesterday we were

16:55

even higher than that. So, really really

16:57

appreciate the engagement that we had in

16:59

the chat. Again, we will also follow up

17:00

with some of the answers from the

17:03

from the speakers that we weren't

17:04

answering live here. And

17:07

I think one one quick note, we will also

17:09

send around a survey. You will find this

17:11

also on the live embed page that you're

17:13

probably on right now. We would really

17:15

appreciate it if you give some feedback

17:17

on what um the quality of the talks

17:20

were, what we can do better, and if

17:21

you're also interested in um doing

17:23

something like that in person, live.

17:26

Not virtually.

17:29

>> Yeah.

17:30

Absolutely. Uh stay up-to-date with us.

17:33

Follow us on the Background Agents

17:34

microsite. Make sure to sign up for the

17:37

newsletter. Um cannot shout that out

17:39

enough. We put a lot of effort and a lot

17:40

of research into these. Um we will be

17:44

updating the website, we'll be updating

17:46

the landscape, and we'll be we'll be

17:48

sending out continuous, you know, actual

17:50

thoughtful emails. No uh no marketing

17:53

spam. Do not worry about that. So,

17:56

um I guess the final call to action is

17:58

we've we've learned about the

18:00

primitives, we've learned about how to

18:01

build this all out, learned about the

18:03

architecture, and the rollout and the

18:04

enablement best practices. So, with all

18:07

of that in place,

18:08

take this take this foundation and go

18:11

build it.

18:13

>> Let's talk about that.

18:15

Yes. And then, talk about us about this

18:17

in the next next virtual summit that

18:19

we're doing, or a live summit, who

18:20

knows.

18:21

>> Yeah.

18:22

>> Cool. All right.

18:23

It's a wrap. Thanks, everyone.

18:27

Take care.

Interactive Summary

The video summarizes a two-day virtual summit dedicated to infrastructure, security, and leadership in the adoption of background agents and AI in software engineering. Hosts Philip and Will discuss key insights from 14 industry sessions, emphasizing that building robust AI agent workflows is a journey rather than a single step. The consensus among speakers is that success comes from starting with clear infrastructure foundations, implementing incremental changes to build trust, and focusing on developer enablement. The hosts also highlight that existing engineering best practices are essential requirements for effective agent integration and provide resources for those looking to implement these solutions.

Suggested questions

4 ready-made prompts