HomeVideos

Claude Computer Use Just Dropped, Here's How to Hack It

Now Playing

Claude Computer Use Just Dropped, Here's How to Hack It

Transcript

554 segments

0:00

So, Anthropic just released computer

0:01

use, which is basically where you give

0:02

Claude access to your browser and your

0:04

keyboard, and a lot of people out there

0:06

are using this for silly toy demos like

0:08

how to organize your file workspace or

0:10

whatever the heck. In this video, I want

0:11

to show you eight ways you can actually

0:13

apply computer usage to real

0:14

economically valuable tasks like for

0:16

instance reaching out to tens of

0:17

thousands of people automatically in a

0:19

highly personalized way using my

0:20

browser. So, I'm going to start with a

0:21

brief demo and then I'm going to show

0:23

you guys how you guys can set this up on

0:24

your end. We're also going to be

0:25

bypassing Anthropic's built-in read

0:27

block, which basically is where they

0:29

don't allow you to use your browser for

0:31

incoming rights. I'll show you guys how

0:33

to do that and then I'll also show you

0:34

guys how to set it up in case you guys

0:35

want to know. Okay, first and foremost,

0:36

what's going on here? I'm on LinkedIn

0:38

and what I'm doing is I'm sending

0:40

connection requests, which are the way

0:42

that you sort of do outreach on

0:44

LinkedIn. And one thing to note is that

0:47

LinkedIn inherently blocks the vast

0:49

majority of browser automation because

0:51

it's obviously in their interest to

0:52

maintain a highly human sort of

0:54

environment, right? Most social media

0:56

platforms will do this. Instagram does

0:58

this, uh you know, X is going to do

1:00

this, um Facebook and and so on and so

1:02

forth. And so, any sort of like

1:05

automation of this task is pretty

1:07

difficult to do in practice and you'll

1:09

receive some sort of other major

1:10

platform block or you know, you're just

1:12

going to run into some form of issue.

1:14

Computer use basically negates that for

1:16

you entirely. If you feed in the right

1:18

prompt and then you use the right

1:19

browser analog, you can have whatever

1:21

automation you want done basically

1:23

constantly for you in the background and

1:25

I foresee a future where we all have 100

1:28

Mac Minis the heck is the the trending

1:30

item pretty soon where stuff like this

1:32

is occurring on autopilot all the time.

1:34

How do you actually do this? Well, I'm

1:35

just going to open up my thread here and

1:37

you'll see that what I've done is I've

1:38

said, "I want you to use computer use to

1:40

control my computer and send connection

1:42

requests to people on this page with the

1:44

Min browser, which is full read write

1:46

access." That's important because

1:49

Anthropic automatically blocks the usage

1:51

of Chrome, Safari, Firefox, and most

1:53

other major browser tools for this. Then

1:55

I say customize each connection request

1:57

so it doesn't suck. Use a connect

1:58

request like, "Hey first name, saw

2:00

casual version of company name and I

2:01

think we'd vibe quite a bit given our

2:02

interests." So, when I have computer use

2:04

on as you guys can see, the browser

2:06

looks a little bit different, right? We

2:07

have sort of that like yellow outline.

2:09

And it's actually like controlling my

2:11

mouse. What it's doing is a variant of

2:13

what it's already capable of doing with

2:14

like Chrome DevTools MCP or whatever

2:16

where it takes a screenshot and then you

2:18

know, it like kind of controls it. But

2:19

you can see that at any point in time I

2:20

can just jump in and make minor

2:22

adjustments and so on and so forth. And

2:24

you know, as long as I'm not doing that

2:25

while it's doing something super

2:26

valuable or important, it sort of

2:27

figures it out on its own. So, that's

2:29

use case number one and I just showed

2:30

you guys it on LinkedIn, but I want to

2:32

show you guys just how many other

2:33

platforms you can do this on as well.

2:35

Obviously, a big one here is Instagram.

2:37

I know sending Instagram DMs

2:38

automatically is obviously very high in

2:40

demand and you know, a lot of people

2:41

want to want to do that. But the same

2:43

thing applies to any other platform. So,

2:45

you could do this on x.com

2:47

despite the fact that I don't think

2:48

Facebook is a great place for this

2:49

stuff. You can also automate Facebook

2:51

entirely. Then obviously, you could do

2:52

this on other platforms like I don't

2:54

know, TikTok and you know, short form

2:56

and and so on and so forth. The way that

2:58

you do this to make a long story short

2:59

is one, you install a browser that not a

3:02

lot of people have heard about, a

3:03

browser that is not on the block list.

3:05

Anthropic's current block list I think

3:07

is

3:08

Chrome is Chrome. I think it's also

3:11

Safari and then they also do obviously

3:14

Edge and Firefox. Min is a simple, free,

3:18

and straightforward browser that I'm not

3:19

affiliated with at all. It was just the

3:20

first one that I tried that wasn't part

3:22

of this block list. And what I'm doing

3:23

is I have Min set up here. I then logged

3:26

into my LinkedIn account and then I just

3:27

give it a list of all of the different,

3:29

you know, leads I want to actually, you

3:30

know, send requests to. And in my case,

3:32

I did this pretty straightforwardly. I

3:34

just pumped in the term AI automation

3:35

into my LinkedIn, sorted by people, and

3:37

then I just have it going. Now, I should

3:39

note that, you know, most of these

3:40

platforms have outreach limits so you

3:41

can't actually send like five

3:42

quadrillion pieces of outreach

3:44

automatically. You'd need either

3:45

multiple accounts to do this or I don't

3:47

know, some other sort of like black hat

3:48

method and I don't recommend doing that.

3:50

You know, I don't recommend overly

3:51

gaming these social media platforms

3:52

because there's obviously downsides and

3:54

you know, a fair amount of risks.

3:56

But you can apply the exact same

3:57

approach to whatever the heck you want.

3:58

After that, you just feed the list and

4:00

then perhaps most importantly, you have

4:01

some form of weak in the cold outreach

4:03

business call an icebreaker, which is

4:05

some sort of like kind of quasi

4:07

customized template that allows AI the

4:09

ability to fill in variables

4:10

dynamically. And so, in my case, what I

4:12

did if I go back to Co-Work is I said,

4:14

"Use a connect request like, 'Hey first

4:16

name, saw casual version of company name

4:18

and I think we'd vibe quite a bit given

4:20

our interests.'" You can insert or

4:22

replace whatever variables you want

4:23

here. It'll work pretty reasonably so

4:25

long as Claude obviously has access to

4:27

information about that. My next major

4:28

use case is going to be scraping social

4:30

media for posts and then saving that to

4:32

a local file, which I can then feed into

4:34

I don't know, Claude code or some other

4:35

future thing in order to like generate

4:37

content on my end. Now, the issue with

4:39

doing a lot of this stuff organically is

4:41

obviously one, it takes a fair amount of

4:42

time, but then two, there's no like

4:44

API-based way to plug this into a

4:46

workflow. You either have to have like a

4:47

virtual assistant or somebody do it or

4:49

you have to do some sort of hacky

4:50

workaround. What I'm doing with Claude

4:52

computer use is I'm giving it a really

4:53

simple and straightforward query just

4:55

saying scrape my LinkedIn feed for 10

4:56

posts about AI and then save the

4:58

trending ones to a file for me with

4:59

computer use. Uh and it's just going

5:01

through right now basically taking

5:02

screenshots and then also saving the

5:03

text to a file. Um after I'm done with

5:05

that, I could use the file for whatever

5:06

I want. So, some really cool use cases

5:08

for this. Obviously, there's like

5:09

trending news scraper style systems,

5:11

which is personally what I'm using this

5:12

for. Uh but there are a variety of other

5:14

ones as well. You could try like a

5:15

parasite-based system, which goes

5:16

through somebody's social media

5:17

platforms. Again, you know, on platforms

5:20

that do not explicitly allow or

5:21

explicitly prevent any sort of browser

5:23

automation and then get the text. You

5:25

could feed that text into AI to have it

5:27

like rewritten. You could um save photos

5:30

and stuff like that by right-clicking

5:31

the pictures saying, you know, save as

5:33

and so on and so forth and then

5:34

eventually just have like a big file set

5:35

up that you can, you know, then plug

5:37

into your own content calendar. Once

5:38

you're done, you then get a list of

5:40

trending AI posts and then you can do

5:41

whatever the heck you want with these

5:42

posts. In my case, maybe I'm going to

5:44

use these trending posts to create some

5:46

parasite content or whatever and then

5:47

use that to rank on LinkedIn. My next

5:48

use case is going to be giving it a list

5:50

of forms. So, in my case, I'm just going

5:51

to use dentist, but you guys can do

5:53

whatever the heck you want. Contact

5:54

forms for agencies, I don't know, big

5:56

people to get in touch with, whatever.

5:57

And then just have it actually reach out

5:59

to them by filling out those forms. And

6:01

this is valuable because a big chunk of

6:02

the internet right now is like

6:04

gate-walled by contact forms and so on

6:06

and so forth. You can't find people's

6:07

emails, but you can get a contact form.

6:09

And so, you can use or have computer use

6:12

um actually control your browser, click

6:14

buttons and so on and so forth one,

6:16

mitigate the appearance of CAPTCHAs and

6:17

other things while also two, um filling

6:19

it out in like a human natural way with,

6:21

you know, your browser and stuff. So, in

6:23

this case, I said with computer use,

6:24

fill these forms out. Loose info, gave

6:26

it my name and so on and so forth. You

6:28

know, initially it tried using Chrome.

6:30

The reason why is because it always

6:31

tries just using the specific um thing

6:33

that it's connected to. What I'm going

6:35

to do now is I'm actually just going to

6:36

go into the Min browser again. It's

6:38

going to open up some new tabs I imagine

6:40

using the URLs that I gave and again,

6:42

it's literally using my my keyboard,

6:44

which is why it's so cool.

6:46

And then it's going to try and uh you

6:47

know, fill out their forms and stuff.

6:48

So, here's a simple walk-in dental

6:50

clinic, you know, it's like a new

6:51

patient form and it's just going to go

6:52

top to bottom and click on everything.

6:54

It started by closing the chat widget

6:56

and now it's going to start with the

6:57

what looks like first name, last name,

6:59

and then work through each field. I

7:01

should note that, you know, a couple of

7:02

these input fields are pretty dynamic,

7:04

right? One of these is like a birth year

7:06

or birth date picker. It's not very

7:08

straightforward. And what it's done is

7:10

it's just like clicked on four things in

7:11

like 2 seconds for me and it's just

7:13

working its way top to bottom. And when

7:14

all said and done, it then fills out the

7:16

form and then submits it. The next one's

7:17

going to be managing ad platforms

7:19

without API access. So, think of things

7:21

like Google Ads or Meta Ads or TikTok

7:24

Ads. Like these platforms all lock down

7:26

their ads stuff really, really strongly

7:28

and then they also just make it a pain

7:29

in the ass if you do have any sort of

7:30

API access. Um the reason why is

7:33

obviously they just don't want like a

7:33

fleet of agents that control everything

7:35

completely automatically. But what's

7:37

walled is with computer use, you can do

7:39

that. And you can make a fair amount of

7:40

money in the interim by automating all

7:41

of that stuff before, you know, they

7:43

catch up. So, this is one of the

7:44

companies that I run and we do ads for a

7:46

fair number of dentists across the

7:47

Canada area. We typically generate ROASs

7:50

anywhere between 8 to 10x, so very

7:52

strong stuff. And let's just say I want

7:53

to automate the process of I don't know,

7:55

like turning off ads that aren't very

7:57

good. So, in my case, maybe I want to

7:58

click through all new patient video ads

8:00

in the current ads manager page and then

8:02

find the cost per lead. I want the

8:03

inside view so I actually want to like

8:05

inside

8:06

not just on this little dashboard and

8:07

then I just want to turn off the lowest

8:08

performers. Obviously, I could

8:10

standardize this in like a bajillion

8:11

different ways. Hopefully, that's clear.

8:13

I don't just have to do it like super

8:15

loosely like find the best ads. I could

8:17

have strict SOPs where it's like find

8:19

the top three performing ads, find the

8:20

lowest five performing ads, and so on

8:22

and so forth. But just like I use my own

8:24

computer and my mouse to do this, I

8:25

could do this with computer use

8:27

controlling everything. This reminds me

8:28

of like those Tesla self-driving ads,

8:30

but like my hands up here. So, I don't

8:32

know. It's finding the new leads ad. You

8:34

know, it's saying that there's no budget

8:35

and then maybe it's turning it on or

8:36

it's turning it off. Hopefully, you guys

8:38

get the point. You can automate the

8:39

large majority of more or less any

8:41

valuable knowledge work like this. I

8:43

think honestly, the thing that I'm

8:44

coming to realize is the more important

8:46

thing than actually just like having a

8:48

list of things to automate

8:50

is just knowing what to automate and

8:51

then having a pre-existing like SOP for

8:54

that. Um so, believe it or not like the

8:56

big businesses are going to have the

8:57

most success with this stuff. Not

8:59

necessarily, you know, the the small

9:01

ones. But anyway, here's it going

9:02

through clicking on my ad sets and and

9:04

stuff like that finding the highest

9:05

performers and then enabling them or

9:07

disabling them. Another cool use case is

9:08

uploading and then managing things for

9:10

YouTube. Very similar idea so I'm not

9:12

going to show it here, but what you can

9:14

do is in my case, you know, I record a

9:15

lot of videos via OBS. That's what you

9:16

guys are watching right now. Um

9:18

previously, in order for me to automate

9:20

the process of uploading them to

9:21

YouTube, I had to use the YouTube API or

9:23

I had to use some sort of third-party

9:25

service that connected with YouTube like

9:26

Go Fonic. And the issue behind uploading

9:27

things automatically to social media

9:29

platforms via API

9:30

is like the the current consensus is

9:32

they will block you or significantly

9:34

restrict your reach if you do it

9:35

automatically. Again, cuz they don't

9:36

want automatically generated content.

9:38

They want like real user-generated

9:39

content, people that actually click

9:40

buttons. Well, now you can just have

9:42

computer use do it for you. You can

9:43

automate the process and you can also

9:44

get all of the upside of like having

9:45

organic reach and brand. The next use

9:47

case is going to be pretty

9:48

straightforward. I'm just going to have

9:50

it compile a bunch of invoices to me um

9:51

locally on my computer. Obviously, I

9:53

could do this manually and there are

9:55

probably some API-based ways I could do

9:56

this as well, But uh this uses the exact

9:58

same interface that I do. Very similar

10:00

to like a humanoid robot. Why do we make

10:02

humanoid robots nowadays? It's because

10:04

despite the fact that other types of

10:05

robots are probably better, our natural

10:07

environment is geared towards like

10:08

humanoids, right? So, humanoid robots

10:11

obviously, despite not being perfect at

10:13

any one thing, can do everything, which

10:15

is valuable. In my case, I just have it

10:16

grabbing the first Appify billing

10:18

invoice because uh I pay them for the

10:20

automation of a few other things that I

10:21

do. And then it's just going to save

10:22

that to an invoices folder. $49 US, good

10:25

lord. What's funny is I think I was

10:26

right across the street from their

10:27

office when I was in Prague. That's

10:29

wild. I didn't realize they were

10:30

headquartered down there.

10:31

Anyway, it's uh scrolling down now. Then

10:33

uh sorry, I didn't want to show you guys

10:34

my address or anything, but it went

10:35

through, it downloaded it, and now um

10:37

you know, it's in my downloads folder

10:38

right over here. You can also have it

10:39

automate some desktop apps as well. Now,

10:41

this is sort of like the more boring use

10:42

cases that most of the people have shown

10:43

on YouTube videos, but still pretty

10:45

interesting. You can have it automate

10:46

like Premiere Pro, for instance, to

10:48

identify um low waveform points on a

10:50

graph and then actually cut right at

10:51

like the lowest point. You could have it

10:53

do a combination of like terminal-based

10:55

commands, and then I'm just like I'm a

10:57

video editor cuz I do a lot of video

10:58

editing right now. GUI-based commands to

11:00

both shorten it, uh you know, have

11:01

Premiere Pro generate captions for you,

11:03

slap the captions on the video

11:04

automatically, and then do a couple of

11:05

other things. Uh you know, really the

11:07

sky is the limit there, and

11:08

unfortunately, there's just so many

11:09

different products that we could use

11:10

there. I don't feel like I'd do a

11:11

substantive positive service by demoing

11:14

just a couple of mine. Okay, and then

11:15

finally, uh QA testing. Because we are

11:17

using our mouse and our keyboard here,

11:20

uh we are going to be interacting with

11:21

the screen with Plaud in a very similar

11:22

way to in which a human would really

11:24

realistically interact with the screen.

11:26

A lot of the ways that people have been

11:27

doing of some sort of um QA testing so

11:29

far has been using like Chrome DevTools

11:31

MCP or browser automation. And that's

11:33

okay because, you know, it still like

11:35

does things on the computer, but it

11:36

doesn't do so in a way that a human

11:37

being might. For instance, it like

11:39

doesn't click specific parts of the

11:40

page, right? What it'll do is it'll like

11:42

run JavaScript that simulates a click

11:44

event. So, what I've done here is I've

11:45

said, "Hey, I want you to QA test on

11:47

nicksri.com. Go through my entire

11:49

sign-up flow. Try to break it.

11:50

Screenshot every step." The goal is some

11:52

form of real user simulation. I just

11:54

want you to actually like do it the way

11:55

that I would do it. And you can see that

11:57

it's uh it's going to try and break it

11:58

in like a million different ways. And

12:00

the reason why this is valuable is

12:01

because sometimes there are like buttons

12:02

on a page or features in an app that

12:04

aren't immediately accessible to

12:05

something like a browser automation

12:07

version. Personally, I think this is

12:08

what like a lot of big teams have

12:09

probably been doing for at least a

12:10

little while.

12:11

Uh I would almost guarantee you the

12:12

Anthropic team in particular has

12:13

probably been using it to like stress

12:15

test their products. But it's going to

12:16

start clicking various buttons. It's

12:18

going to try all the different

12:19

validation approaches and so on and so

12:20

forth. And this isn't a product, it's

12:21

just my own personal website. But

12:23

hopefully you guys can see how you'd be

12:24

able to scale up an approach like this

12:25

uh

12:26

substantive as you want. All right. So,

12:27

how do you actually get this set up?

12:28

It's actually really straightforward.

12:30

First of all, this is in research

12:31

preview mode, so some of the features

12:32

that I just showed to you may be

12:34

invalidated if you're watching this

12:35

video like two or three months from now.

12:37

>> [gasps]

12:37

>> Um but realistically, all you really

12:38

need to do is just like download and

12:40

then install the Claude Code desktop

12:43

app. So, you can do that by just going

12:44

to Claude desktop app. Okay, give that

12:47

button a quick click. You'll go to the

12:48

downloads page, and then we have a

12:50

couple of different options here

12:51

depending on if you guys are on like

12:52

macOS or Windows. Now, in my case, I'm

12:54

on macOS, so I'm just going to click

12:55

download on Claude desktop. That's going

12:57

to open up this page. In the top

12:58

right-hand corner, you can see it. I've

12:59

done this a couple of times cuz I wanted

13:00

to reinstall it. Then um all you do is

13:03

you drag the Claude app over to

13:05

applications. I'm not going to do that

13:06

cuz it's going to reinstall it for me,

13:07

and you know, I already have it

13:08

installed. And then just type Claude to

13:10

actually open up the app. Once you're

13:11

done with that, you'll have access to

13:12

three different tabs: chat, co-work, and

13:14

code. Um right now, it's available for

13:16

co-work and code, not inherently chat.

13:19

But in order to do this, just go to

13:20

co-work, and then now you can basically

13:22

say, "Hey, do X, Y, and Z." It may not

13:24

be enabled for you guys right off the

13:26

bat. If that's the case, head over to

13:27

settings first, and then underneath

13:29

general, scroll all the way down to

13:30

where it says browser use and computer

13:31

use. Enable browser use cuz that'll

13:33

allow it to use the crop the Claude

13:35

Chrome extension, which allows it to do

13:37

some browser stuff. And then also enable

13:39

computer use, which allows it to take

13:40

screenshots and control your keyboard

13:41

and mouse in apps that you allow. Then

13:43

you can do any of the demos, you know,

13:44

that I say, and you know, just in order

13:46

to maximize the probability that it

13:48

actually uses the computer use feature,

13:49

I have so far just been appending or

13:51

prepending my request with the term

13:52

computer use. Otherwise, sometimes it'll

13:54

just try doing API stuff. The reason why

13:56

is probably cuz it's very

13:57

token-intensive, and I'm I'm sure

13:58

they'll figure out ways to make it less

13:59

token-intensive over time, but right

14:01

now, this is the simplest manner. Okay,

14:02

and then the last thing is you need some

14:04

sort of browser app that does both read

14:07

and write access. Uh the one that I'm

14:08

using right now is called

14:09

minbrowser.org.

14:10

If this does, for whatever reason, get

14:12

patched or whatever, uh you can also

14:14

just look up other browsers that are

14:15

safe, hopefully open source, that'd be

14:17

ideal. Um the way I get that is I just

14:19

went on a Claude Code, and I said like,

14:21

"Find me 20 different browsers." And uh

14:23

you know, one of those ended up working.

14:25

Okay, so that said, hopefully you guys

14:26

appreciated this look in how to actually

14:28

make money with Claude computer use.

14:29

It's not just fancy toy demos here, but

14:31

you know, if you apply it to a couple of

14:32

interesting workarounds, you can make

14:34

some cool things happen, and you can

14:35

also take advantage of browser

14:36

fingerprinting and stuff like that.

14:37

Aside from that, if you guys enjoyed

14:38

this video, please subscribe to the

14:39

channel. Some like 70% of people aren't,

14:41

and I'm trying to grow as quickly as I

14:42

can right now, so you'd be doing me a

14:43

big solid. Um check out my 4-hour Claude

14:45

Code course for more on how to use

14:46

Claude for economically valuable ends,

14:49

and I will catch all y'all in the next

14:50

video. See you.

Interactive Summary

This video explores practical, economically valuable applications of Anthropic's new 'computer use' feature, which allows AI to control your computer's browser, mouse, and keyboard. The creator demonstrates eight use cases, including automated LinkedIn lead outreach, scraping data from platforms without APIs, filling out web forms, managing ad platforms, and performing manual QA testing. The video also covers how to set up the feature using the Claude desktop app and a compatible browser, while providing tips to bypass common automation blocks implemented by major social media platforms.

Suggested questions

3 ready-made prompts