HomeVideos

Do not talk to Claude's new voice mode

Now Playing

Do not talk to Claude's new voice mode

Transcript

224 segments

0:00

Well, folks, it's official. Anthropic

0:02

now lets you choose from one of five AI

0:05

companions. For instance, you could

0:07

choose airy.

0:08

>> We can chat while you are on a walk.

0:10

>> Glassy.

0:11

>> You can ask me about what's on your

0:12

schedule.

0:13

>> Or my personal favorite, sultry French

0:16

Canadian, rounded.

0:17

>> Best places for voice mode.

0:19

>> There's also mellow.

0:20

>> Worst places for voice mode

0:22

>> and buttery

0:23

>> in voice mode. We'll just talk. Now, the

0:24

reason why I wanted to make this video

0:26

is not because I thought that it was

0:28

worth me dropping several minutes of

0:30

your time on an announcement that could

0:32

have been a tweet. It's because I wanted

0:34

to talk a little bit about a potential

0:36

future, you know, maybe 2 or 3 years

0:39

that we should all have at the back of

0:40

our minds. We're not very far away from

0:43

having wireless headphones that have

0:45

over 24 hours of charge, such that you

0:48

can take them before you leave in the

0:50

morning, put them in, and then wear them

0:52

with some sort of pass through mode

0:53

across the entire day, such that every

0:56

one of your interactions is both

0:57

filtered and mediated by an AI assistant

1:00

like this. Anytime you are not in a

1:03

conversation and have some downtime, you

1:05

talk to something like this. Maybe on

1:07

the way home or on the train, you start

1:09

a personal conversation with a model

1:10

like this. These models will know more

1:13

about you than your closest family

1:15

member. They'll know more about you and

1:16

know how to please you more than your

1:19

closest lover. These will have

1:21

unprecedented access to your tastes,

1:24

your your hobbies, the things that you

1:25

care about, the things that you you

1:27

fear, the things that you don't want to

1:29

see, and more. And all of this will be

1:32

just turned directly into your own

1:34

little personalized AI assistant that

1:36

you will likely have access to on your

1:38

phone. Now, if that doesn't scare the

1:41

hell out of you, one, I think it should,

1:43

but two, you've probably just watched a

1:45

lot of sci-fi. Um, that certainly scares

1:47

the hell out of me. Throughout human

1:48

history, we've always given up some of

1:50

our privacy and some of our control for

1:52

safety and security, typically provided

1:54

to us by the state. And there were

1:56

already rumblings of this with, you

1:58

know, Google over the course of the last

1:59

10 or 15 years, later social media

2:01

platforms like Facebook and and Meta and

2:03

Instagram and so on and so forth

2:05

listening to us and watching everything

2:07

we type into the the the the phone to

2:09

service ads and the like. But this is

2:11

something really different. This is

2:12

something that you're not just going to

2:13

depend on for, you know, economically

2:16

valuable ends. No, this is no longer

2:17

just a software development agent. This

2:20

thing is going to be your preferred

2:21

conversation partner basically

2:22

everywhere. I don't really like that. I

2:24

think that a lot of what makes somebody

2:27

valuable and unique and differentiated

2:29

is actually the time that they spend

2:30

alone. It's the time that you spend not

2:32

in conversation or in the wider fabric

2:34

of civilization, not listening to

2:37

podcasts or listening to music or really

2:39

what differentiates you and turns you

2:40

into your own unique individual is time

2:42

that you spend not under the influence

2:43

of other minds. And you know, the fine

2:45

thing is so far it's been other human

2:47

minds, but with models like this, we're

2:49

very quickly going to arrive at a future

2:51

where you are constantly being

2:52

influenced by non-human minds as well.

2:54

You know, I'd say there are a couple of

2:55

risks with that. Obviously, there's the

2:57

unprecedented security and access risk.

2:59

These things will know everything about

3:00

everybody. Have total control over

3:02

virtually every economic transaction,

3:04

every text that you send, every call you

3:06

make, every conversation. Uh that is

3:09

essentially going to be mediated through

3:10

this big cla or whatever the the future

3:13

model landscape will look like. But

3:14

also, I think we run the risk of just

3:16

losing our sense of individuality. And

3:18

you know, I think you could get really

3:19

political here with the differences

3:21

between collectivist ideologies and then

3:23

individualistic ideologies. But at its

3:25

core, I think the reason why all of

3:27

humanity is so beautiful is because we

3:29

are so different. I think it's because

3:30

we have our own minds. We are our own

3:33

little nodes in a graph. Sure. But every

3:36

node offers something different,

3:37

potentially unique perspective. When

3:39

we're all plugged up to some big hive

3:41

mind here that's just feeding us,

3:43

hijacking our limbic system and telling

3:45

us more or less everything we want to

3:46

hear, where then goes the spirit of

3:49

human advancement and discovery? Where

3:51

goes our individuality as mentioned?

3:53

Where goes the thing that makes me me

3:54

and you, you? Or do those boundaries

3:56

just dissolve entirely and we become

3:58

some big planetarysized brain again

4:01

mediated and modulated by an

4:02

intelligence that we created that we've

4:04

grown but maybe that we don't fully

4:05

understand? This contains in part my

4:08

brain. This contains everything I've

4:10

done over the last few months. This

4:12

contains all of the queries that I've

4:14

plugged in. I use it as a search engine.

4:15

I use it as like like an idea partner. I

4:17

use it to generate images. I use it for

4:19

more or less everything now. And the

4:21

second that it starts vering on, you

4:23

know, our personal lives and our own

4:25

sense of of relationship fulfillment,

4:26

identity and stuff like that, I think

4:28

you're going to see a really big change

4:29

in just the fabric of society socially

4:31

as a whole. And so too, like the early

4:33

days of, you know, like Facebook and and

4:35

Instagram, so too will the early days of

4:37

this technology just lead to

4:39

unprecedented intrusion into your life.

4:42

Unprecedented amount of data collection.

4:44

I'm sure at some point in the future,

4:46

some regulatory board or body will

4:48

approve, you know, a more granular and

4:50

maybe safer and more secure way of

4:52

proceeding, one where you don't actually

4:54

just like bend over and give Big Daddy

4:56

Claude access to everything in your

4:57

whole life. But certainly for the next

4:59

few years, I I don't consider that

5:01

likely. And so what I'm trying to say is

5:03

at least in the near term, I would not,

5:06

you know, talk to these things. I would

5:08

not actually have conversations with

5:09

these things. The unfortunate thing is

5:11

the human brain tends to

5:12

anthropomorphize things. You just put a

5:14

little face on something. You give

5:15

something a voice and you'll start

5:16

thinking this is a person. And when you

5:18

start thinking something as a person,

5:19

you'll start giving it person-like

5:21

qualities. Start uh occupying a space in

5:24

your mind that is reserved for people

5:25

and so on and so forth. I mean, this

5:27

thing, as lovely and cute as it is, this

5:29

is just a collection of pixels that

5:31

somebody or maybe another Claude has

5:33

programmed in order to wink kind of

5:35

cutely every time I click the button. Is

5:36

that really a future that you want? I

5:37

mean, I would have considered myself

5:38

like an accelerationist prior to this. I

5:41

would have considered myself somebody

5:42

that just wants to jump to the deep end

5:44

of technology, you know, neurolink my

5:46

brain up, bro. Like, chop my arm off and

5:48

give me a big cyborg hand instead. uh

5:51

that can I don't know transform into an

5:54

ice pick to grip things better when

5:56

needed. But now that I'm kind of

5:57

thinking about what it means to lose

5:58

your sense of self, uh part of me is

6:01

reticent and I don't really know if

6:02

that's good. I think we've seen a lot of

6:05

like AI almost psychosis over the course

6:07

of the last year and I don't think that

6:09

all of that is good or productive. And I

6:12

wonder, you know, if we have models like

6:14

this that know every little intricate

6:16

thing about us, if the degree of AI

6:18

psychosis will not just grow crazier and

6:20

crazier and crazier until everybody's

6:22

living again in their own little bubble,

6:24

but it's their own safety bubble where

6:27

they think that they're having their own

6:28

unique set of experiences when in

6:30

reality we're all sort of connected in

6:31

this wider uh way. This logically should

6:34

not occupy the same space in my brain as

6:36

a person. Yet, as a human being with my

6:38

own set of biases, I have no choice but

6:40

to look at that and go like, "Huh,

6:41

that's kind of cute. It's kind of

6:42

interactive, like a hand or something."

6:44

Um, that's the real danger here. And

6:46

that's sort of the reason why I wanted

6:47

to make this video, just so that we're

6:49

all a little more aware of the obvious

6:50

trajectory in which this technology is

6:52

taking us all. Um, we can't pump the

6:54

brakes, I don't think, meaningfully or

6:56

reasonably. I'm pretty sure we're on

6:58

this train all the way to the end, but

7:00

hopefully we can at least know a little

7:01

bit more about where we're

Interactive Summary

The video discusses the implications of new AI voice companions from Anthropic. The speaker warns that these increasingly personalized AI tools, which can mediate daily interactions through persistent wearable technology, pose significant risks to human individuality, privacy, and our ability to spend time away from external influences. He expresses concern that these systems will exploit the human tendency to anthropomorphize machines, potentially leading to social and psychological challenges as we increasingly rely on AI for fulfillment and identity.

Suggested questions

3 ready-made prompts