HomeVideos

Agent Canvas Is Production Ready: Run & Automate AI Coding Agents

Now Playing

Agent Canvas Is Production Ready: Run & Automate AI Coding Agents

Transcript

294 segments

0:00

We have now launched Agent Canvas as a

0:03

production ready product. And we are

0:05

excited to talk more about that. We have

0:07

Devin here who will lead on.

0:11

>> Yeah, I think I've talked about this the

0:12

past two

0:14

community meetings at various stages of

0:16

like it's in progress. Here's what it is

0:18

and then it's in progress. It's in beta

0:20

and now it is fully launched and out

0:22

there.

0:23

Can you go to the next slide, Jamie?

0:25

Awesome. So if you haven't seen it

0:26

already, hopefully you have and got a

0:27

chance to use it. Agent Canvas is our

0:29

new hotness, right? So this is a new

0:30

face of Open Hands. It's local first

0:32

visual workspace run and automate AI

0:34

coding agents. That's sort of the

0:36

elevator pitch, right? It's your sort of

0:37

front end to do all the things with a

0:40

flexible system to sort of build your

0:42

own,

0:43

you know, best practice tool. So just

0:45

some of the highlights. This is

0:45

certainly not everything, but it's sort

0:47

of I went through like our announcement

0:49

post and things like that and tried to

0:51

distill it into a few bullet points

0:52

here. So parallel agents, the idea is

0:53

that very easily you can run multiple

0:55

agents across multiple backends and, you

0:57

know, do it all at once. We support get

0:59

work trees. So when you create a new

1:01

conversation,

1:02

um,

1:03

you can have the option of using a work

1:04

tree so that stuff happens there kind of

1:06

in a silo and it doesn't affect your,

1:08

you know, live branch.

1:09

Um, and then we also have automations

1:11

built in. So we're really excited about

1:12

everything that you can do having a

1:15

really full featured automation system

1:17

and an automation server built in to,

1:19

you know, the same place where you would

1:20

work and talk with your LLMs. So you can

1:22

plug into all your MCPs and use the same

1:23

secrets and things like that and it can

1:24

do all kinds of really cool stuff there.

1:26

So,

1:27

you know, by default you can do like

1:28

just, you know, cron at different times.

1:30

You can do polling so that you have an

1:31

automation kicking off like every minute

1:32

to check something. That lets you build

1:34

like Slack bots and PR reviews and

1:36

things. I've been a big fan of using

1:37

this on my own Slack instance to have a

1:40

Slack bot that I can talk with and run

1:42

and do things.

1:44

And then, you know, of course, one of

1:45

the really cool things is you can bring

1:46

your own agents, not only work with

1:48

whatever LLM you want to via API, but

1:51

the agent team did a really, really good

1:52

job of adding support for ACP so that

1:54

you can actually use Claude, Codex,

1:57

Gemini,

1:58

uh anything you really want inside

2:00

instead of just open hands as the full

2:01

agent. So, um I just talked with a user

2:04

this morning who needed that, didn't

2:06

even know that he needed it, uh but when

2:07

he first started he was like, "Oh, I can

2:08

just set this up." and didn't even know

2:10

what ACP was before and was able to sort

2:12

of like put together so he could use

2:13

what he wanted to across like I think

2:14

four or five different virtual machines

2:16

with different, you know, setups in each

2:18

one. So, very very very flexible. And

2:20

then of course like local first but not

2:22

local only. Um sorry, Jamie's last

2:23

bullet point. Um

2:25

again, that was sort of like I did

2:27

some user interviews earlier this year.

2:29

Leonardo was one of the folks that I

2:30

talked with as well.

2:31

Just asking, you know, what are you

2:32

doing these days with agents? What do

2:34

you need? What, you know, and one of

2:35

those those key things was like, "I need

2:37

a local, you know, GUI that's even

2:40

better than what we have, but I also

2:41

need it to be not just local but, you

2:43

know, able to work on cloud environments

2:45

and in virtual machines and so I can

2:46

sort of like do that work on the go from

2:48

a device." So, that was sort of like one

2:50

of the

2:51

cornerstones

2:52

that we started with and also delivered.

2:54

So, you can you can do that now. You can

2:55

connect to Open Hands Cloud, run it on

2:57

your laptop, set up a computer at home.

3:00

You can have a really expensive What is

3:02

it? Nvidia Spark. So, you have like a

3:04

local LLM and you can have your own

3:07

siloed local experience. I mean, there's

3:09

a lot of flexibility.

3:12

Awesome. Okay, now next slide. Great. Um

3:13

so, with that I wanted to just sort of

3:15

like talk about

3:16

where we are now, what what's sort of

3:18

focus and then where we hope to go. This

3:20

is not just like me, you know, laying

3:22

this out there. This is sort of coming

3:23

from community conversations and

3:25

different inputs. So, the focus right

3:27

now that I've sort of put forth is

3:29

because the agent team is still working

3:30

on some of the ACP stuff. There's a

3:31

handful of tickets, so we're doing some

3:33

polish there. And there's also agent

3:35

profiles that just got merged into the

3:36

SDK. And Simon has been working on

3:39

getting that also into Agent Canvas. So,

3:41

some really exciting stuff there. Um

3:44

hopefully we'll see that sort of ship

3:46

next week and that's kind of like the

3:48

first release that will come afterwards.

3:50

There'll probably be a handful of other

3:52

items uh, in that release, but that's

3:54

sort of like the the anchor for the next

3:56

release is what I've been sort of like

3:58

calling it, like maybe like one anchor

3:59

per release, so that you have a nice

4:01

marketable moment.

4:03

And then coming up after that, so like

4:05

what's up next? Um,

4:07

something that I I've I've heard is

4:09

automations are pretty good, but they

4:10

could be better and we've gotten some

4:11

feedback on what that might mean. So,

4:13

sort of the free bullet points here are

4:15

make it easier to set up and run, um,

4:17

potentially adding like a UI to make it

4:19

like easier to fine-tune without having

4:20

to talk to an agent. There's a lot of

4:22

flexibility when you can just say, "Hey,

4:24

agent, create this automation that does

4:26

this thing, check this repo at this

4:28

time, or hook up with this MCP, whatever

4:30

you want." But, um, there's some

4:32

hesitation about being able to see

4:34

exactly what's going to get set up and

4:35

stuff. So, UI is one thing that we're

4:36

exploring. Um, and then just making them

4:38

more observable end-to-end, so um,

4:40

looking at adding like a dashboard view,

4:42

so you can see like all of your

4:42

automations, what their process is, like

4:44

where they are, how often they run, if

4:46

they've run into any um, errors, and

4:48

like if they've created artifacts.

4:49

Um, and then just a general like a

4:51

deeper SDLC integration, so you can

4:52

actually use this as part of, you know,

4:55

whatever that looks like for you, you

4:56

know, whether it's taking like um,

4:57

tickets and then turning that into

4:59

issues or just doing some research or PR

5:00

reviews, just kind of generally making

5:02

that easier.

5:03

So, that's sort of the the next bundle.

5:04

There's not a clear epic or um, a

5:07

singular

5:09

a breakdown of what this is going to be.

5:10

So, if you have feedback here, I would I

5:11

would love to hear it. If there's a PR

5:13

that you've already gotten in,

5:14

um,

5:16

that's like out there that just hasn't

5:17

been reviewed or something that's

5:18

dealing with this, that'd be great.

5:19

And then of course that the most

5:20

important one here, um,

5:22

in planning what comes after that, I

5:24

think that this call and this community

5:26

is where we're going to have the the

5:28

biggest guiding light, right? Like so,

5:29

this is all just like a starting point,

5:31

um,

5:31

and your your feedback and contributions

5:33

are really going to help shape like what

5:34

comes after this. Uh, so just a couple

5:37

of highlights here. Um, Christopher P,

5:38

he's given a ton of feedback on like the

5:40

importance of sandboxing and being able

5:41

to use like the the current app server

5:43

that um, OpenHands has. Uh, so he's done

5:45

some work there and I know he he just

5:46

posted 15 minutes ago um in the the

5:48

project um Asian Canvas Slack that um

5:50

he's got a PR coming to use the current

5:53

um app server as a back end. So, just an

5:56

example of something like, "Hey, this is

5:57

something he really wants to see and

5:58

he's going to make it happen, you know,

6:00

advocating for it." Um

6:01

we had a another user, Shane War 1982.

6:04

He posted a vision of like a boss

6:06

orchestrator. Um we haven't gone further

6:08

than that. There's no other PRs, but

6:09

it's sort of like he was like, "Hey,

6:11

this is my vision of what I want. Like,

6:12

I want a boss that I can talk to that

6:14

then spin out all these conversations

6:15

across my multiple back ends."

6:17

I don't know what that could look like,

6:18

but I'd love to hear more about it and

6:20

um if it's something that others, you

6:21

know, resonate with,

6:22

you know, we can make it happen.

6:24

Um and then Engel has done uh a really

6:26

great draft PR on like um

6:28

like add-ons for tool visualizations. Um

6:31

Vasco did some work that could um make

6:35

that I think possible and then Engel

6:37

looked at it and said, "Yeah, I think

6:38

this could work." I've got a shaping

6:39

ticket out there for like a whole

6:40

add-ons or plug-in like extension system

6:42

for Asian Canvas that I'd love to see

6:43

happen. Um so, he just did some initial

6:45

work like, "Hey, here's what it could

6:46

look like and here's how it could work."

6:48

So. I've talked a bunch. Any any

6:49

questions on this? Anybody wants to, you

6:51

know,

6:52

jump in?

6:59

>> So, I have questions if no one else has

7:01

questions. Um you mentioned if there's a

7:04

PR that needs to be reviewed or like

7:06

want more attention. I shared your

7:08

GitHub handle and also the Slack.

7:11

But, I guess my other question is

7:14

what specifically do you think is the

7:16

best place for contributors to help us

7:19

with Asian Canvas? Like, where's the

7:20

best place for them to get plugged in,

7:23

especially if they're newer and a little

7:24

bit overwhelmed because of all the

7:26

options?

7:27

>> That's a good question. I mean, I have I

7:29

have my opinion about that. I would say

7:31

Slack's a great starting point cuz you

7:32

can jump in and say, "I'd love to get

7:34

started." And then generally, I think

7:35

folks get pointed to GitHub like, "Hey,

7:37

dive in, look at it."

7:38

Probably the best is if you care about

7:39

something, then

7:41

try to get involved there. Uh if you

7:43

know, you see a problem that you want to

7:44

fix where you want to add something,

7:46

that's a good one. I know that you did a

7:48

bunch of work to make like great first

7:49

issues. If you just want to look at

7:50

anything to get involved in, but I'm

7:52

curious to hear if anybody else has um

7:54

ideas on like what what's worked for

7:55

them or you know what they think could

7:57

be the best you know path forward to be

7:59

more involved.

8:08

>> All right, I think that's

8:10

>> Yeah, if you have any ideas feel free to

8:12

drop them in the chat. We're going to

8:13

keep going. I did share a shortened link

8:16

and this is how you can easily find good

8:20

first issues. I would say something that

8:23

comes up in conversation on Slack is

8:25

that the best way to find things to work

8:27

on is to start using Agent Canvas. As

8:29

you use Agent Canvas for like your

8:31

workflow, you'll either see that there's

8:34

a small UX bug that you can create an

8:36

issue and maybe even fix or you could

8:39

say, "Hey, I really wish that we had

8:40

this feature. Let me create an issue.

8:42

Let me talk about it in Slack." So I

8:43

think that's just another way to also

8:45

get started.

Interactive Summary

The video marks the official production launch of 'Agent Canvas,' a new visual workspace within OpenHands designed to run and automate AI coding agents. Key features include parallel agent support, integration with Git worktrees, a built-in automation server for tasks like Slack bots and PR reviews, and high flexibility for bringing custom agents via MCP. The development team is shifting focus toward polish, agent profiles, and enhancing the automation system with better UI and observability. Community contribution is actively encouraged through feedback, GitHub pull requests, and by users engaging with the tool to identify potential improvements.

Suggested questions

3 ready-made prompts