HomeVideos

Opus 5 is driving people nuts. Anthropic gave the fix

Now Playing

Opus 5 is driving people nuts. Anthropic gave the fix

Transcript

385 segments

0:00

There's a widespread problem plaguing

0:01

Claude users recently, specifically on

0:04

Opus 5, because its replies [music] tend

0:06

to be confusingly long, packed with all

0:08

too possible nonsense, and it's becoming

0:10

more and more jargon dense. The good

0:13

news is that Anthropic already shared a

0:14

fix for this. It's super easy, and the

0:16

principle behind it makes your setup

0:18

faster and cheaper, and it lets you

0:19

finally understand what the heck your

0:21

agents are actually saying. And by the

0:23

end, I'll hand you a resource that

0:24

solves all of this automatically just by

0:26

sending it to Claude. Let's dive into

0:28

it. So, if you've been using Opus 5

0:29

heavily the past few days, you may have

0:31

noticed two specific problems with it.

0:33

The first one's the jargon problem,

0:35

which is its tendency to use technical

0:36

terms or acronyms much more versus

0:38

earlier models, which makes it much

0:40

harder to understand and work with. Just

0:42

to give you one simple example, and this

0:44

is probably not the worst of it. If you

0:45

ask a simple question to Opus 5 like

0:47

this, where I said our CRM dashboard

0:49

says open rate is 32%, and I said from a

0:51

conversation with a peer, we discussed

0:53

how open rates are basically fake now.

0:55

So, I ask it what does that mean, and

0:57

should I care? And it did give us a

0:59

proper explanation here, but it seems to

1:00

always default to being more

1:02

comprehensive and more technical than

1:04

most people would probably want it to.

1:06

And you can see its tendency to assume

1:07

that you know every single jargon in the

1:09

field as well. Like for example, here

1:10

it's saying every Apple Mail recipient

1:12

with MPP on registers as an open. And it

1:15

also tends to use a lot of technical

1:17

jargon like send time optimization, geo

1:19

data, or device data derived from opens,

1:22

MPP masks IP, and reports a generic

1:24

device. So, all of this is corrupted.

1:26

So, you can see what I mean, right? And

1:27

like I said, that example was probably

1:29

not the worst of it, because I first

1:30

became aware that this is sort of a

1:32

widespread problem when I saw this tweet

1:34

by Peter Levels, who's pretty popular in

1:36

the in the hacking space, where he

1:38

shared this snippet of an article that

1:40

made the rounds around X recently. And I

1:42

can probably show the actual article

1:43

just to give credit where it's due. So,

1:45

this was written by Niklas Kron, if I'm

1:47

ever pronouncing it correctly. And I

1:49

think he summarized the problem really

1:50

well here, where he's saying that

1:52

reading AI output today is extra effort.

1:55

You can pretty much do it, but it is

1:57

extra effort. It's verbose, it

1:59

frequently contains all too plausible

2:01

nonsense, and is increasingly jargon

2:03

dense. And then he says that he recently

2:05

got this sentence from Claude that even

2:07

I don't know what this means really. And

2:09

then the second, but related problem is

2:11

the wall of text issue. So if we go back

2:14

to our example here, you probably

2:15

experienced the same thing where you ask

2:17

it a simple question and then it goes

2:19

into a full-blown essay and gives you a

2:21

wall of text as an answer. And for most

2:23

cases, there's multiple issues with

2:25

that, right? Because it wastes your time

2:27

because you need to understand and read

2:28

through this whole thing in order to get

2:30

to the point. And secondly, there is

2:32

also a corresponding cost for tokens

2:34

because the longer it's output to you,

2:36

the more tokens that Claude is

2:38

consuming. And so if you have this same

2:40

problem with Opus 5 as well, which a lot

2:42

of people seem to be using as their

2:44

default, then you're in the right place

2:45

because today I'll be showing you the

2:47

two solutions for those two unique

2:49

problems. And by the way, if you want to

2:50

learn how to build and sell AI systems

2:52

that businesses actually pay for, then

2:54

that's pretty much all we do over at the

2:56

Robonuggets community where not only do

2:58

you get access to the Claude Living

2:59

Masterclass, which we update every week

3:01

and takes you from zero to mastery with

3:03

the latest on AI, but you also get

3:05

access to our Agents as a Service

3:06

course, which walks you through how to

3:08

actually get paid for all these AI

3:10

skills that you are learning. You also

3:11

get to be part of a genuinely great

3:13

community of AI builders. In fact, you

3:15

can see just some of the recent wins our

3:17

members are getting from the program

3:18

right here. So if you want to start

3:20

earning from AI, then check that just in

3:21

the pinned comment below. Now back to

3:23

the video. So let's start with the

3:24

jargon problem. And the good news about

3:26

this is that Anthropic's team actually

3:27

talked about how to fix this one issue.

3:29

And that fix is courtesy of Lidia, who

3:31

is a member of technical staff at

3:33

Anthropic. And essentially, it all has

3:34

to do with this configuration in Claude

3:36

Code that's called the output style. And

3:38

the output style is simply just that. It

3:40

is the style by which Claude Code

3:42

provides its output to you or how it

3:44

talks to you. And I'll just show you

3:45

where to find it, at least in the

3:47

terminal view, but I'll show how to do

3:48

it in the desktop app as well if in case

3:50

you're more comfortable there. But here

3:52

in the terminal, if you have Claude

3:53

Claude open, you can slash config, which

3:55

brings up all your settings. And if you

3:57

find output style here, and if I click

3:59

on enter, what you would most likely

4:01

find is that your Claude is set to the

4:03

default output style, which is that

4:04

verbose jargony output that Opus 5

4:07

usually defaults to. You have other

4:09

options here like proactive,

4:10

explanatory, and learning that Claude

4:12

Claude ships with by default. But you

4:14

can see that I have a fifth one here

4:15

that I added as a custom called ELI5.

4:18

And this ELI5 is the fix that Lydia was

4:21

talking about here. And in case you're

4:23

curious, ELI5 simply stands for explain

4:25

like I'm 5. It is a popular subreddit.

4:28

And so the reason why that acronym works

4:30

for a lot of models, including Opus 5,

4:33

is because they've been trained with the

4:34

entirety of the internet, including that

4:36

subreddit. And if you're curious, this

4:38

is what that subreddit is. And there's

4:39

like thousands of posts in here asking

4:41

questions in the ELI5 format. And you

4:44

can be sure that these models have

4:45

scraped this whole thing in order to

4:47

understand how people respond to these

4:48

questions. But the core principle of it

4:51

is if you want things to be simple to

4:52

understand, then this ELI5 is one way to

4:55

do it. Now, obviously, you don't have to

4:57

adopt the exact verbiage that Lydia has

5:00

here. For example, one thing that I

5:02

added in my output style personally is

5:04

this tip from Andrew that I found where

5:07

he asked Claude to only report to him in

5:09

this ASD STE 100 simplified technical

5:12

English. So what is that? Well, in a

5:14

nutshell, that's essentially a

5:15

controlled language standard that uses a

5:18

more restricted dictionary. So a list of

5:20

words that are much easier to

5:22

understand. So it avoids jargon, it

5:24

avoids a lot of those technical

5:26

vagueness. And at least from what I

5:27

found personally, and for a lot of

5:29

people it seems, that standard seems to

5:32

help a lot in terms of just making

5:33

talking to your agents much easier and

5:35

much more seamless. So how do you now

5:37

apply this fix and actually change your

5:39

output style so you can test it out?

5:40

Well, what you can do is to just copy

5:42

this prompt or take a screenshot of it

5:43

and send it to your Claude Claude. And

5:45

what you're saying here is simply to set

5:47

your output style to the one below,

5:48

which is this whole snippet from Lidia

5:51

with that addition of the ASDSE100.

5:54

And then the important part here is

5:55

direction to save it in your output

5:57

styles folder, which obviously depending

5:59

on your workspace, that location of that

6:01

folder may be different. But the good

6:02

news is Claude Code can probably find

6:04

that for you. At least for me, this is

6:06

where it put that markdown file. And

6:08

within this markdown file is just this

6:11

piece of text. And then the second thing

6:12

that this prompt will do is to just set

6:14

this output style for ELI5 in the

6:16

appropriate settings files. And you can

6:18

see for me, because I already have it

6:20

set, that is what Claude also told me,

6:22

where it created that style file for me

6:23

that ELI5.md. And it also updated the

6:26

relevant settings. And the best way for

6:28

you to check is to just open up a new

6:29

session and ask what output style it's

6:32

using now just to confirm. And if you

6:33

need to make any changes to it, then you

6:35

can just tell that to Claude and it will

6:37

update this output style for you. Now,

6:39

you may be asking why it's important to

6:41

put these rules in the output style

6:43

instead of something like the Claude.

6:45

md. And the truth of the matter is that

6:46

you can actually put these rules into

6:48

Claude.md, but it just isn't as

6:50

effective. And if you're curious, it has

6:52

to do with two things. One is the

6:54

strength of the placement with regard to

6:56

the output style, because if you notice,

6:57

what we changed earlier is the actual

6:59

settings for Claude Code. So, it's

7:01

written into the core system prompt of

7:03

your Claude Code instance. And then more

7:05

importantly, at least I would think, is

7:06

that under the hood what Claude Code

7:08

actually does is it auto injects these

7:10

sort of nudges, these reminders like

7:12

stick to your output style even midway

7:14

through out your session. So, if you

7:16

were to show that visually, your

7:18

Claude.md that does get preloaded into

7:20

every session that you start, but only

7:22

at the top, right? But the great thing

7:24

about putting this rule into your output

7:25

style is that it becomes part of the

7:27

core system prompt, number one, and

7:29

number two, throughout your session,

7:31

Claude Code actually gets reminded about

7:33

this rule so that it follows it more

7:35

consistently and religiously. And just

7:37

to give an example of that same question

7:39

that we asked it, if you read through

7:40

this, it's much more legible now, at

7:42

least in my view. It leads with the key

7:44

answer, where it's saying that that open

7:46

rate is not all real people. And then it

7:48

tells the clear story here of why that

7:50

is, and then ends with this conclusion

7:52

that anyone can understand. Now, that

7:54

fixes the jargon problem. Now, let's go

7:55

to the second issue, which is this wall

7:57

of text that you usually get from Opus

7:59

5. And for a lot [snorts] of use cases,

8:01

especially knowledge work or production

8:03

code, the tricky part about this problem

8:05

is that you do sometimes need long

8:08

pieces of text in order to get a lot of

8:10

the detail that you need. And so this is

8:12

why I generally I won't advise people to

8:14

put the wall of text fix right in the

8:16

output style. And so what I would

8:18

generally recommend is to just use a

8:20

skill when you need that wall of text to

8:22

be shorter. And in our community, I

8:24

always advise people to make their own

8:25

skills because each of our work is

8:27

different. But let me give you some

8:29

ideas, and I'll also share how I do it

8:30

personally. One really interesting skill

8:32

that I found is this one called {slash}

8:35

bro. And it's probably one of the

8:36

shortest, but really useful skill that

8:38

you can add to your arsenal because it

8:41

is only one line. So its sole purpose,

8:43

whenever you invoke it, is for your

8:45

agent to restate the last message in

8:47

plain human language with zero jargon.

8:49

And so if we go back to this wall of

8:50

text, and you can see here I just used

8:52

that skill, {slash} bro. When it rewrote

8:54

their response, it's saying here, "Okay,

8:55

so basically that 32% never meant 32 out

8:58

of 100 people actually read this. And

9:00

here's how it actually works." So I'm

9:01

not going to read the whole response

9:03

here, but you can see just how much more

9:04

understandable and better it is versus

9:06

what we started, right? Another example

9:08

of a skill that I found is this one from

9:10

Matt Pocock. It's called wait, what? So

9:12

again, it's a very short skill. It says,

9:13

"I don't understand where you've got to

9:15

here. Repitch that and give a little bit

9:17

of context." And this is what I'm saying

9:18

where you need to create your own skills

9:20

because you can see from Matt's

9:21

workspace here, he probably has this

9:23

context.md that he uses a lot. You may

9:25

not have that. So what you can do is to

9:27

take a screenshot of this or copy this

9:29

skill and just ask Claude to personalize

9:31

it for your own setup. Now, what I tend

9:33

to do personally, in conjunction with

9:35

{slash} bro, since you can see sometimes

9:37

Opus 5 still defaults to a wall of text

9:39

if it doesn't know how long you want the

9:41

response to be. Is I use this skill of

9:43

mine called /quick, where I just declare

9:45

a number, in this case three, and it

9:47

gives me just three points in sequence

9:50

of what it thinks is the most important

9:51

takeaway from that whole essay that it

9:54

wrote. And just to show you what that

9:55

skill looks like, I think it's this one.

9:58

Yeah, so you can see this is the /quick

10:00

skill. And you can see just in its

10:02

current state, it just has rules on when

10:04

to use it when I don't declare a number,

10:06

when I declare a number. And apparently

10:08

there's now, how many? Two modes here

10:11

that probably naturally arose since I

10:13

use this skill a lot, and I also ask

10:16

Claude to tweak it depending on our

10:18

conversation. But that is one idea by

10:20

which you can cut that wall of text into

10:22

more bite-size chunks. But like I

10:24

mentioned, it's probably better for you

10:26

to just get these ideas for skills and

10:29

create them yourself as well, depending

10:31

on your type of work. Now, what I talked

10:32

about just now are pretty simple fixes,

10:35

but if you take a step back, there's

10:36

actually a larger takeaway to this whole

10:38

thing. Because interestingly, and if you

10:40

remember, Opus 5 is actually the best in

10:43

terms of a lot of benchmarks that we see

10:45

online, including this one from

10:47

artificialanalysis.ai,

10:49

where it is leading at the moment. And

10:51

so, the first key takeaway here is that

10:52

even though benchmarks show the raw

10:54

intelligence of these models, user

10:56

experience can sometimes differ. So,

10:58

it's sort of like if you bought a

10:59

computer with the highest specs

11:00

available, but then you actually find

11:02

that you prefer your older computer just

11:04

because of maybe some unique features

11:06

that that old model have. So, it's quite

11:07

similar to AI models also is what I'm

11:09

finding. And so, what you should realize

11:11

here is that let's say a year or two

11:13

down the line where you have Opus 7 or

11:15

Opus 10 already, if those future more

11:17

powerful models have the same issue as

11:20

well, the good news about it is that

11:22

these AI models are very malleable, and

11:24

you can just tweak your AgentiC

11:25

Operating System, or essentially the way

11:27

that you talk to these agents, through

11:29

these same solutions that we talked

11:31

about, and that will just provide a much

11:33

better experience for you when you work

11:35

with agentic AI. And so just remember

11:37

that you can always direct these models

11:39

with your preferred output style as well

11:41

as these skills, which are essentially

11:43

shortcuts. And just to make it easy,

11:44

everything that I talked about in this

11:46

lesson in this video, I just put it all

11:48

in this eight-page PDF, which you can

11:51

probably just send to your cloud code

11:52

and just pick out the prompts and the

11:54

styles and the skills that you would

11:56

need and just tweak them to whatever

11:58

your workspace needs. So you can just

12:00

find this whole thing down in the

12:01

description. I hope that was helpful and

12:03

as always appreciate you for making it

12:04

until the end because that helps me a

12:06

lot and I'll see you next time. Thanks.

12:08

>> [music]

Interactive Summary

This video addresses common issues with Claude Opus 5, specifically its tendency to provide overly long, jargon-heavy, and confusing responses. The presenter offers practical solutions to refine these outputs by adjusting the model's 'output style' configuration and creating custom 'skills' (shortcut commands). By implementing these settings, users can make their AI agents more efficient, cheaper to run, and easier to understand. The video also emphasizes that while powerful AI models like Opus 5 exist, user experience depends heavily on how these agents are configured through custom system prompts and interaction styles.

Suggested questions

3 ready-made prompts