HomeVideos

Meta's Claude Code clone is INSANELY cheap

Now Playing

Meta's Claude Code clone is INSANELY cheap

Transcript

1236 segments

0:00

I have something I'm a bit ashamed to

0:01

admit. I'm a pretty big fan of Meta. Not

0:03

of things like Facebook, like no, gross.

0:06

Not my thing at all. But when it comes

0:07

to their actual software contributions

0:09

and things they do for the ecosystem, I

0:11

found them to be pretty solid, if not

0:13

great. Projects like React and React

0:15

Native were essential to the growth of

0:16

the web and to an extent mobile as well,

0:18

and are genuinely incredible things that

0:21

they've put out there for free for

0:22

people to use however they want. Their

0:24

contributions to the AR and VR ecosystem

0:26

were all things that I enjoyed heavily

0:27

at the time because I'm a big VR nerd.

0:30

And when they started getting into AI,

0:31

they did that similarly well with their

0:33

focus on openweight models with the

0:35

llama line. To this day, llama is still

0:38

used almost like a generic term for

0:39

openweight models. And it's crazy how

0:42

far the llama models went, but it's even

0:44

crazier how far the entire industry has

0:46

moved ahead of meta. They've been trying

0:48

to correct course for a while with this

0:50

hidden quietly worked on line of models

0:52

called Muse. And historically, they've

0:54

not been accessible beyond their little

0:56

web interface to try it out. But

0:58

apparently, they've been trying to make

0:59

it ready for code. Not just the model,

1:01

but the tools around it as well. And now

1:03

they're finally ready to release.

1:05

Zuckerberg just announced on Twitter, by

1:07

the way, that Muse Code is out in beta

1:10

today. This is their clone of Claude

1:12

Code and it's powered by Muse Spark 1.2,

1:14

which is their new coding focused model.

1:16

It's been a while since I've seen a lab

1:17

publish benchmark numbers where they're

1:19

not in first place in anything, but that

1:21

doesn't mean it's a bad model. As you

1:23

guys probably saw in my video about Gro

1:25

4.5, there is still a lot of value in

1:28

wellpriced, fast, useful models. And

1:30

with Meta's focus on using every model

1:32

for everything lately and collecting all

1:34

the data they get as a result, it's

1:36

actually going to be pretty interesting

1:37

to see how well this performs. So, I'm

1:40

going to go through this with y'all

1:42

together. I'm going to try it live. I'm

1:43

going to read through what they have to

1:44

say. I'm going to see what others are

1:46

doing with it, get a feel for the price

1:47

and the weird quirks as well. And I just

1:50

had to sign into my terminal with

1:51

Facebook. So, I'm feeling a little

1:53

gross. This is going to be a journey and

1:55

I hope you enjoy it with me. But first,

1:57

a quick break for today's sponsor.

1:59

There's a lot of code review bots around

2:01

nowadays and they're pretty good at

2:02

reading the code, but I've noticed that

2:04

running cloud code and codecs on my

2:05

machine tends to be better simply

2:07

because the models can actually run

2:08

things and verify the changes. Wouldn't

2:10

it be great if those review bots had the

2:12

ability to actually verify changes on a

2:14

real computer? Reptile thought so, and

2:16

that's why they introduced T-Rex. It's a

2:18

new sandbox that can actually run your

2:20

code and verify the changes rather than

2:22

just reading the syntax and hoping it's

2:23

good. If you've ever added an element to

2:25

your UI and had it overlap something

2:27

that was obvious when you ran it that

2:28

the code review bots missed, that's what

2:30

this is for. Because the models can

2:32

actually click through and test things,

2:33

and it can even respond with screenshots

2:35

of the things it finds along the way.

2:37

Their website lists a bunch of realworld

2:38

open source projects that have had bugs

2:40

prevented through T-Rex. Even companies

2:42

like Work OS are finding real bugs. For

2:45

example, this code that seems like a

2:46

totally safe filter, but has a really

2:48

rough edge case that you'll only find

2:49

when you run it on real data. If you've

2:51

debug in the last 3 months, you owe it

2:52

to your team to check out

2:53

soyv.link/gretile.

2:55

So, let's start with what Zuckerberg had

2:57

to say about their most recent release.

2:59

Releasing Muse Code in beta today. It's

3:01

a terminal coding agent that takes on

3:03

complex software engineering tasks

3:04

across large repos, lining changes,

3:06

writing code, validating the results.

3:08

It's powered by Muse Spark 1.2, which is

3:10

a coding focused model update. This is

3:12

going to be an interesting one because a

3:14

lot of the other legacy companies like

3:16

uh I don't know Microsoft and Google

3:18

don't necessarily have the best stack

3:21

internally, whereas Facebook has done

3:23

some incredible things with their

3:24

internal tech. They didn't use git

3:26

because it was too slow for the scale

3:28

they were moving at. So they built their

3:30

own custom everything on top of

3:32

Mercurial and it's really powerful to

3:34

the point where people have been trying

3:35

to copy their workflows with things like

3:37

stacked PRs and stacked diffs. I know a

3:40

lot of people who used to work at Meta

3:41

and left and just missed all of that

3:43

tooling that made it so much easier to

3:45

work in these gigantic projects that are

3:47

met scale. Other companies like Google

3:49

also have gigantic monor repos, but they

3:52

are less focused on fixing them. In

3:54

fact, they've went as far as laying off

3:55

the teams that built the tooling to make

3:57

them usable. Meta's always done the

3:59

opposite where they'll rewrite a

4:00

language if they have to, like they

4:02

rewrote PHP and hack in order to try and

4:04

make their code bases work better. Since

4:06

Meta's code bases are so huge, it's

4:08

often easier to rewrite the language

4:10

that's underneath them than it is to

4:12

rewrite the codebase itself on a better

4:14

language. And that type of thinking is,

4:16

at least it was unique to Meta for a

4:18

long time. And I think it kind of

4:20

positions them well to dive into this

4:22

world of using models and tools to work

4:24

with your code bases at that scale. And

4:27

that's why they've been using models

4:28

like Fable and Opus so heavily recently.

4:30

So, it's interesting to see what they're

4:32

cooking here. They shared some benches

4:34

here. And the first notable thing is

4:35

that they're not putting Fable or Soul

4:37

in these lists. They're only putting

4:39

Opus and 56 Terra in, which is a choice.

4:43

In Terminal Bench 2.1, they slightly

4:45

beat out Terra and are slightly behind

4:46

Opus 5. There also a big jump from US

4:48

Spark 1.1 to 1.2. 1.1 was barely

4:51

available to the public. 1.2 2 is now

4:53

actually out and the pricing is really

4:55

interesting which we'll show in a little

4:56

bit. Deep SWE which is one of the

4:58

benchmarks I prefer. It did pretty well

5:01

here getting a slightly higher score

5:02

than Grock 4.5 which is nuts because I

5:05

actually found Grock 45 to be a very

5:06

pleasant to use model but it's still

5:08

lagging behind Terra and Opus which

5:10

means it's far behind models like Soul

5:12

and Fable. And then Meta's internal

5:13

coding bench, it came in second place in

5:16

with Muse Spark being much closer in

5:17

third. And if this model is as far off

5:20

as other benches showed, I think their

5:22

internal bench might not be the best.

5:24

They also in their internal bench have

5:25

Terra in Gemini 36 Flash suspiciously

5:28

close. So, we shall see as we go. Oh

5:30

god, they're already getting community

5:31

noted. Community note: Meta is still

5:33

dead last in AI with this release. Okay,

5:36

maybe not. Apple is, but they're behind

5:38

just as much as Google Gemini is. That's

5:40

not a thing you need to put in a

5:41

community note, nerds. Anyways,

5:43

according to Zuck, Muse Code runs

5:45

specialized background agents that stay

5:47

active your whole session. So, they

5:48

build up context over time instead of

5:50

starting from scratch on every task.

5:52

Interesting. When a job is big enough,

5:53

it fans out the separate sub agents

5:55

working in parallel in isolated work

5:57

trees. Your working copies never

5:58

touched. In testing, we had it build six

6:01

features for a game simultaneously with

6:03

no collisions. Huh, very interesting.

6:05

Again, big codebase stuff. We pointed

6:08

Muse Spark 1.2 at a kernel optimization

6:10

task and let it run. a thousand tool

6:11

calls over 24 hours on Nvidia Hopper. It

6:14

kept finding substantial improvements

6:16

well beyond the initial exploration

6:17

phase. This is also kind of funny to me

6:20

because Meta rented a bunch of TPUs from

6:22

Google. They're one of the few companies

6:24

to actually buy and rack hardware from

6:26

Google and then Google went and rented a

6:27

bunch of GPUs from Nvidia, all from XAI

6:30

and SpaceX. So Google is reselling their

6:33

shitty chips to Meta so they can use the

6:35

money to go buy better chips from Nvidia

6:37

through XAI. And now apparently

6:40

Zuckerberg is still stuck on Nvidia.

6:41

Auditable by design, every model call,

6:44

tool run, and edit has a local event log

6:46

before it executes. If it crashes mid

6:48

task, it picks up exactly where it left

6:50

off from that log. No lost work and no

6:52

reprompting. Pricing. It's easy and low

6:54

cost to get started. Install Muse Code

6:56

with one line and you can start on our

6:58

contributor tier. Contributor tier is an

6:59

interesting piece we'll talk about in a

7:01

second. Musepark 2 is our next step as

7:03

we push towards Front Tier with larger,

7:05

more capable models on the way. Install

7:06

it, use it, and tell us what you think.

7:08

Well, the first thing I think is that

7:10

when you Google search Muse Spark, you

7:11

get all of these old articles about 1.1.

7:14

This old developer page. Okay, this one

7:16

has 1.2 on it now, but it was actually

7:17

kind of hard and annoying to find this

7:19

initially. Here's the part I was looking

7:20

for, though. The price. $1.25 per mill

7:24

in, 15 cents for cashed 1 mil in, and

7:26

425 per mill out. Not great pricing

7:30

until you realize I was hiding something

7:32

from you. The contributor price tier.

7:34

This tier is 10 cents per mill in and 20

7:37

cents per mill out with 0.2 cents per

7:41

cached input token. That is a 10 to 20x

7:45

price gap. They're effectively giving

7:48

out the contributor version for free

7:50

because they need training data so

7:52

goddamn badly. Meta's released Muse

7:55

Spark 1.2. It's their third release in

7:57

four months and it scores a 54 on the

7:59

intelligence index, significantly

8:00

improving agentic knowledge war

8:02

capabilities over prior releases,

8:03

putting meta next to SpaceX in a tie for

8:06

third place amongst US labs. Crazy they

8:08

have to specify this now because the

8:10

Chinese labs have caught up so much,

8:11

especially with K3. Muse Spark 1.2 lands

8:14

at a 54, up three points from 1.1 and 11

8:16

points from Muse Spark 1.0 which came

8:18

out in April. That's a pretty big jump.

8:20

Like if we're just looking at the

8:21

trajectory of what meta right here,

8:24

that's a lot of improvement in not a

8:25

whole lot of time. It's effectively tied

8:27

with GBT 55 and Gro 4.5 narrowly behind

8:31

current frontier models like Opus 5,

8:32

Fable 5, and 56 Soul as well as Kimmy

8:35

K3. It's among the most costefficient

8:37

models at its intelligence level. It's

8:39

40 cents per intelligence index task at

8:41

Meta's unchanged $125 and $425 per

8:44

million token pricing. They don't

8:46

mention I I was right when I was reading

8:47

that earlier. They are not measuring the

8:50

prices based on the contributor tier.

8:52

They are measuring them based on the

8:54

normal pricing that they would charge

8:56

actually. So if we go back to the

8:58

pricing chart here, it's about a 10 to

9:02

20x difference in price, which means

9:04

Muspark 1.2 on the contributor tier is

9:08

actually the cheapest model currently

9:10

here because it would be 2 to 3 cents

9:12

per task, which is comparable to V4

9:14

flash as well as 56 Luna. Very

9:16

interesting. This model, especially if

9:19

you're down to like let Meta have your

9:21

data, could be a really good value for

9:23

the short term. Amnition's absention

9:25

rates have increased. The model score

9:26

rose from an 18 to a 22 and the

9:28

hallucination rate fell 10 points. The

9:30

attempt rates dropped from 82 to 67.

9:32

This is this bench is measuring how

9:34

likely is the model to lie when it

9:36

doesn't know something and it's much

9:37

less likely now even though for my

9:39

experience that is not the case.

9:41

Scientific reasoning results remain

9:42

largely unchanged. does much better at

9:44

GDP val, but I still don't love that

9:46

bench. Good analysis. We can work with

9:49

that. Muse is trained heavily on data

9:51

from people using models like anthropic

9:54

models internally, and all of the work

9:56

they do. I've heard numbers as high as

9:58

50% of staff at Meta have been moved

10:00

over to some type of data labeling or

10:02

like management tasks in order to help

10:04

them train smarter models. And one of

10:06

the results here is this wonderful tweet

10:08

from Luke. Muse Spark is trained on the

10:10

screen recordings of Meta employees,

10:11

which makes it best-in-class at applying

10:13

for jobs at Anthropic. Absolute banger.

10:16

I want to go through other numbers that

10:18

matter before showing off the code that

10:19

I can write with Muse. I already have it

10:21

working in the background and it's

10:22

surprisingly fast. We'll talk about that

10:24

in a sec, but first I want to look at

10:26

the numbers from artificial analysis. As

10:28

you can see here, Muse Spark 1.2 falls

10:30

right between Kimmy K3 and Gro 4.5. I

10:34

will say it's a little bit embarrassing

10:35

to release a closedweight model as a lab

10:38

that has billions of dollars like Meta

10:41

does and have it be behind an openweight

10:43

model that came out much before it. That

10:46

is a little embarrassing. But also, if

10:49

it's really fast and cheap and reliable,

10:51

these numbers don't mean everything cuz

10:53

I can tell you confidently that Opus 5,

10:55

despite being at the front of this list

10:57

and tricking me into thinking it was a

10:58

great model, ended up all being Copus

11:00

because I hate using Opus 5. Now, it

11:03

once I started merging the code it

11:04

wrote, I realized how bad it was cuz I

11:06

had to have Fable and 56 Soul come in

11:07

and clean up the mess. Not great. But

11:09

again, Kimmy K3 actually felt quite

11:12

usable, as did Grock 4.5. But Opus at

11:15

the front doesn't feel usable for real

11:16

code work at all. But what I really want

11:18

to see is output tokens. How did they do

11:21

here? Interesting. Okay, so Muse Sparks

11:26

runs did about 30k tokens per task

11:28

compared to about 36k for fable 5 and

11:32

compared to about 17k for 56 soul. So

11:36

it's not quite as inefficient as

11:38

anthropic models, but it is far from the

11:40

efficiency that we see from models like

11:42

the GPT line or Gro 4.5. Very

11:45

interesting. Definitely puts it in a

11:48

weird different spot. Like this model

11:50

isn't just another openweight model

11:51

tuned or something like this really is a

11:54

new model and it should feel quite

11:56

different especially when you look at

11:58

the speed that this model has too. I

12:00

don't think they have recent speed

12:01

numbers yet on artificial analysis but

12:04

they do have them on open router. Open

12:06

router is an easy way to use pretty much

12:08

every model and they track the

12:09

throughput and speeds that users are

12:11

actually seeing when they use the models

12:13

through open router and they're seeing

12:15

an average of 191 tokens per second

12:18

which is absolutely nuts. For reference

12:21

56 soul is only at about 30 tokens per

12:24

second. So that is a gigantic

12:26

improvement like 5x plus absolute best

12:29

case with soul is 134 TPS but

12:32

realistically speaking the p50s in the

12:35

40s to 50s on openai's official infra

12:38

and the 50s for Azure at best. To

12:40

compare Muse Spark gets 316 TPS at its

12:44

best and 162 at its P50. That is pretty

12:48

nuts and I feel the result coding with

12:50

it already. Man, that cerebrous

12:53

deployment of 56 soul can't come fast

12:54

enough. It was supposed to already be

12:56

out, so I'm not sure what happened

12:57

there. No one's given me any info,

12:59

sadly. Then we get to cost and Muse

13:01

Spark is performing absurdly well here

13:04

at 40 cents per task on average through

13:07

the artificial analysis intelligence

13:09

index. That's still more expensive than

13:11

V4 flash is, as well as 56 Luna on max,

13:15

but it's a lot cheaper than other

13:18

things. Even Mistro medium is more

13:20

expensive. And Kimmy K3 is more than

13:22

twice the cost for similar work. And I'm

13:25

assuming this is the normal cost too,

13:27

not that contributor tier, which is

13:28

effectively free. Think it's about time

13:30

we fire off some prompts. I just opened

13:32

Muse Code inside of the T3 codebase.

13:35

It's defaulting to one two contributor

13:37

on high. And since T3 code is fully open

13:39

source, I don't mind if they get my

13:40

data. They probably have it anyways. I

13:42

asked it to give me an overview of the

13:43

architecture of the codebase. And it had

13:45

this under 30 seconds. Not bad. Let's

13:49

see where this goes. If I ask it for

13:50

something a little harder where it has

13:51

to investigate more. I asked it if it

13:53

can find anything suspicious about the

13:54

event sourcing model. Things cause weird

13:56

behaviors on different platforms,

13:57

unnecessary bandwidth, usage and lag,

13:58

etc. Let's see what it does for that.

14:00

Another interesting thing I noticed when

14:02

I set this up is that it pulled all of

14:04

my skills and personal rules from claude

14:07

code. Normally things don't use the

14:09

cloud directory because it's clouds.

14:11

They use the shared aagents standard and

14:14

agentmd stuff like that. They seem to be

14:16

really focused on quad. And from

14:18

everything I know about how meta's been

14:19

working lately, they're definitely an

14:21

enthropic house. They use a lot of opus

14:23

and a lot of fable there. Yeah. 174 TPS.

14:27

Okay. Okay.

14:29

Now we're talking. For comparison, Grock

14:32

4.5, which is still quite fast, is at 50

14:35

to 52 TPS. And a model like 56 Soul is

14:39

30 to 50. It's crazy that Azure is

14:41

performing that much better than Open

14:43

Eyes official servers are right now. But

14:45

yeah, you're welcome. I had to fight

14:46

hard to get Azure to move. It had some

14:48

interesting findings here. I'm going to

14:49

tell it to summarize them. See our

14:51

findings in an easy to digest HTML file.

14:56

Let's see if it's able to find my HTML

14:58

plan skill and actually take all of this

15:00

work and synthesize it. Look at that.

15:02

Already found the skill. Now it is

15:03

thinking. Hopefully, it will synthesize

15:04

this properly and then put things up.

15:06

It's interesting to state how much data

15:09

this skill is. There's definitely some

15:11

slop in here. things like the way that

15:13

the full path for files is included in

15:15

the UI and stuff like this CLI is a bit

15:18

slopp here is the HTML it made for me to

15:21

summarize the findings that it had pure

15:22

decider plus single serialized worker is

15:24

correct cost surfaces at the wire full

15:27

snapshots on subscribe unbounded

15:28

payloads in a global sequence that

15:30

couples every thread so here's what

15:33

we'll do for a comparison I'm going to

15:35

do a cla run with fable we're going to

15:38

paste this I have a plan here you know

15:41

what I I want to try DeepSeek 4 model.

15:45

Deep seek v4 flash. Let's copy over the

15:51

same prompt then.

15:57

God, that is fast as too. For

15:58

reference, Muse 1.2 got me this feedback

16:01

and even had an HTML page generated all

16:03

in well under a minute. I've just been

16:05

trying to get similar feedback from

16:07

Fable and we're over four minutes in and

16:08

still don't have any useful anything

16:11

here. I also have Deepseek Flash running

16:13

in the background as well just as a

16:15

comparison because the new Flash release

16:16

was really solid too just to get a

16:18

comparison across things here. RG wasn't

16:20

finding them because I used - G quote

16:23

star.ts which doesn't work on Mac OS

16:25

with rip grip. This is the Deepseek one

16:27

running by the way. God, these are both

16:29

so slow and not getting me useful

16:30

feedback so far in comparison. It's been

16:32

very interesting. My plan is I'm going

16:34

to take the findings that Muse had and

16:37

throw them at these other two models

16:39

after and say, "How do these compare?"

16:41

So, my favorite ways to get a feel for

16:42

what model strengths and weaknesses are

16:43

is to have them all do the same task,

16:45

have them write up the results, and then

16:46

have them compare each other's results.

16:48

Deepseek Flash just finished its

16:50

analysis. I'll ask it write up your

16:52

findings in HTML. See if it can figure

16:55

out my HTML skill. Oh, um, use my HTML

16:59

skill. You can read it from my agents

17:03

orclaude.

17:05

It doesn't have skills built in by

17:07

default if I recall. Oh, it did. It

17:09

found it. Nice. After waiting way too

17:10

long for both Fable and Deepseek to do a

17:12

similar investigation, I asked them both

17:14

to review their findings and compare it

17:16

to what was found with Muse 1.2. And

17:19

here we see the way that Fable

17:20

categorizes the differences. And

17:22

remember, Fable, when doing a similar

17:24

task with Opus, thought that Opus had a

17:26

much better investigation overall. It

17:28

seems like that is not the case with the

17:29

Muse investigations. There are a few

17:31

places where it said that Muse did

17:33

better. For example, the coverage breath

17:35

it thinks Muse went a little further on,

17:37

but for the most part, it thinks it did

17:39

worse and that Fable's plan was much

17:41

more accurate and overall properly found

17:44

root causes. Meanwhile, Deepseek seems

17:47

to think that the Muse plan was

17:48

meaningfully better. Very interesting.

17:51

Yeah, it's a solid model for the price,

17:54

but I don't know if I would trust it for

17:56

really heavy endto-end work yet. But

17:58

we'll test it a little more. I had to

18:00

try one of my favorite tasks where I

18:02

take my crappy fish game and have it

18:03

remake it both in 2D and in 3D. And the

18:06

most impressive thing is how quickly it

18:08

did it. It made the 2D version in about

18:09

2 and 1/2 minutes and the 3D version in

18:11

under five. For reference, Opus 5 took

18:14

over an hour for both of these. It

18:17

doesn't move properly. Like I can't turn

18:20

Kind

18:24

of nuts that it made this whole thing

18:26

from scratch in four minutes, though.

18:28

Like, that part is impressive.

18:31

It's just that the rest is broken. Mouse

18:34

look does not work. And it made a 2D

18:37

version of Fishlop as well in 2 minutes

18:39

and 39 seconds. For reference, when I

18:43

put these same prompts to remake this

18:44

game into other models like Opus, it

18:47

took multiple hours to do. And this made

18:50

it in under five minutes for both the 2D

18:54

and 3D versions.

18:56

Is it perfect? No, far from it. But it

18:58

does have a couple nicities. Like it it

19:00

made solid animations using the sprites

19:02

that I had access to from the other

19:04

project. It did shadows and like

19:05

contrast well. Like it it has a weird

19:08

type of taste that I haven't seen models

19:10

have. It's obviously still jank as

19:12

in a lot of ways, but like the little

19:13

shadows are nice. The way things are

19:15

moving is nice. It feels fluid. It's

19:18

this model feels different. It doesn't

19:20

feel like it's just distilled on other

19:23

popular things. It does have a vibe to

19:25

the results. And I am definitely curious

19:28

what's going to happen when they make

19:29

bigger and smarter versions. It

19:31

allegedly just fixed the 3D mouse broken

19:34

stuff in a few seconds.

19:39

And it does appear that it has. I can

19:41

now look around as expected.

19:46

The fish are all swimming backwards

19:48

though. That's hilarious. Fish are

19:50

swimming backwards. I can't look up or

19:54

down. Only left and right. Can you use

19:58

computer use to test it yourself? Oh, if

20:02

I might codeex computer use skill. Oh

20:04

no, that is not the solution. As if it

20:06

can do it itself without codecs. Does it

20:09

have vision? Oh it does. That's

20:12

huge. Okay, now the up and down movement

20:15

of the mouse tilts this. That is broken

20:19

as And the fish are still moving

20:21

backwards. It promised me it fixed that.

20:25

Oh, wait. No, it didn't. Yes, please fix

20:28

and rebuild. Okay. Nope. Fish moved the

20:33

right way now, but I still can't look up

20:34

and down.

20:42

spaces both feed and go up. Yeah,

20:45

there's a lot of little things it got

20:47

wrong here. Like it

20:49

it doesn't understand

20:52

that things can collide with each other,

20:54

which is interesting. So, one of the

20:55

things they said the model was good at

20:56

was like breaking things up and letting

20:59

lots of stuff work at the same time.

21:01

But, it's it's getting work done and

21:03

it's doing it alarmingly fast. Like,

21:04

that's one of the nicest things here is

21:06

using it to like touch something up.

21:08

seems to be a useful method. Dra just

21:11

got me one of my favorite things to look

21:12

at when new models drop. The comparison

21:14

of how it handles design on his

21:16

witchai.dev site. Very nice for like

21:18

looking at the designs that different

21:20

models do and comparing them. And I'm

21:22

already seeing some interesting things

21:23

here. Like I love how it uses the scroll

21:26

areas where this like graphic on the

21:28

side scrolls with you until you hit a

21:30

certain point.

21:32

The sections are tasteful, too. I I

21:35

don't hate this. I'm tired of the pills

21:36

on everything. It feels a little

21:38

templaty, but not bad at all. And this

21:40

little tilted reminder recall thing here

21:42

is nice, too. This is all without the

21:44

design skill as well. If we switch to

21:46

the second one, we end up with one of

21:48

the cringy code style ones. It's laid

21:52

out well. Like, its page layouts are

21:54

solid so far, but I don't love the

21:57

design and the graph it made there. It

21:59

really likes doing these tilted things.

22:01

It has one here as well. I actually I

22:04

really like this one of them so far.

22:06

This design looks decent. And I like the

22:08

way it's using the like squirle here. I

22:12

don't like that it switches from squirle

22:13

to rounded there. This isn't bad though.

22:16

This again is reminiscent of Gemini to

22:19

an extent. Way too much text. Way too

22:21

much text, but otherwise not bad. These

22:24

brutalist ones are getting tiring. I say

22:27

after making lawn video, which is

22:29

absolutely of this style. But yeah, it's

22:33

not bad. Like nothing jumps out as like

22:35

that is horrible. I don't love having

22:37

the bar here when it's already a very

22:40

brutalist like lineheavy style and now

22:43

the classic like Tailwind template

22:45

homepage.

22:47

Oh, it does these little floaties. Well,

22:48

I I like how it uses those other models

22:50

get that stuff really wrong and I fought

22:52

it a ton on things like the T3 code

22:54

marketing site. That's like what's

22:55

interesting about this model just has a

22:57

bit of a different flavor. You know

22:58

what? Let's give it something harder.

23:01

Does it have work tree support first

23:02

off? It does. Huge. That means I could

23:06

play around with less risk a bit here.

23:08

Can I yolo mode from here? Nice. Oh,

23:10

that's a bit annoying cuz I had that in

23:12

a work tree. D-workree- yolo. Now we're

23:16

in a safe work tree where I can ask it

23:18

to do stupid things like let's try their

23:21

voice. Actually, I would like to

23:23

implement muse as a provider inside of

23:26

T3 code. I'm not sure what Muse code

23:29

supports in terms of integration

23:30

methods. I haven't played with it enough

23:33

or looked into the SDK. I don't even

23:35

know if it's open source. What I really

23:37

want is to integrate it through a layer

23:40

like ACP similar to how we have

23:42

integrated other providers in the past.

23:44

But if we need something more custom, I

23:46

am down. I would like you to start by

23:48

investigating everything you need here.

23:50

Both how we can implement within T3

23:52

code, but also what is offered by Muse

23:55

itself. You'll have to do some digging

23:57

to find source code where available,

24:00

docs, SDKs, and whatnot. Might be a bit

24:02

hard to find because this is all still

24:04

so new. Use a lot of sub aents to break

24:07

up the work as you go. I actually liked

24:09

that voice to text. It showed things as

24:11

I spoke, which a lot of other solutions

24:13

don't. They just show it when you're

24:14

done. So, let's send that over and see

24:16

how it goes. That's the first good

24:18

terminal voice to text I've seen in any

24:20

of these CLIs for being real. Look at

24:22

that. is already spawning sub aents and

24:24

we can look at them almost the exact

24:25

same way we can in claude. I I know I

24:28

click baited a bit saying this is a cla

24:29

code clone, but like this is such a

24:31

cloud code clone. It's cool that it spun

24:33

up all of these intelligently. Like it's

24:35

it's clear they are trying to make this

24:37

model good at this type of like broken

24:40

up heavy sub aent breakup work. I just

24:44

got hit with a rate limit.

24:46

Are you kidding? I put in a credit card

24:48

and everything. Are these sub agents

24:49

getting hit with them, too? They are.

24:51

Great. Why why would you make a sub aent

24:53

flow like this if your APIs can't even

24:55

handle it meta? Uh how much does it cost

24:58

so far is a good question. Interesting.

25:00

I actually checked out the dashboard

25:01

before. They have instructions on how to

25:03

set it up with other providers too like

25:04

open code, cloud code, codeex as well as

25:06

curl and python directly. Assuming the

25:08

Python is showing you how to like set it

25:10

up with code. I'm assuming this is like

25:12

an OpenAI compatible API. I want to see

25:15

how much I have spent. I don't know how

25:16

accurate or up to date this is, but

25:18

everything I've done so far apparently

25:20

is only about 13 cents, including both

25:23

of those game rewrites as well as the

25:24

codebase audit. So, yeah, absurdly

25:27

cheap. It's making progress here. Why is

25:30

it talking about anti-gravity?

25:32

I just asked why is so much of this

25:33

about anti-gravity? I didn't mention

25:35

anti-gravity at all. It did a deep dive

25:37

and it took under three minutes despite

25:38

the fact that it was hitting rate

25:39

limits, but like the results are

25:41

useless. Contributor has very low rate

25:44

limits. Okay, that's the problem. It's

25:45

cuz I'm on that contributor tier. Okay,

25:47

I shouldn't be so amused by this, but

25:49

this is actually objectively hilarious.

25:51

I

25:53

resplap

26:03

heavily in recent search results and I

26:05

ran the whole investigation on that

26:06

assumption without confirming. I don't

26:08

have a clear hit for Muse as a distinct

26:10

product. Web searches mostly return Muse

26:13

Spark, which is Meta's new coding model.

26:14

July 2026. An unreleased Muse Markdown

26:17

OS project. Something definitive for a

26:18

Muse CLI or SDK. Can you point to me to

26:21

what you mean by Muse? A URL, the

26:23

company behind it, or what the binary or

26:25

SDK is called would be enough. I'll give

26:28

you a hint. I'm in it right now. Let's

26:32

see if this can figure out what it is.

26:34

I'm way too amused. Yes, Muse is Muse

26:37

Code itself. The CLI you're in right

26:39

now. Powered by Muse Code 0.1.0. Powered

26:42

by Muse Spark. My first investigation

26:45

mapped it to anti-gravity by mistake.

26:47

Completely wrong target. So of course

26:49

the Muse code layer here does not have a

26:51

lot of the functionality that I would

26:53

want to integrate with it. Things like

26:55

it being open source. Things like it

26:58

having an SDK I can plug into ACP as a

27:00

way to communicate with it. It's missing

27:03

a lot of the stuff I need. I do have to

27:05

write up a plan on how we would

27:06

integrate Muse code. You know what? I'm

27:08

going to send the smarter model through

27:10

this with a smarter tool code. code.

27:13

I'll do it on this machine so that I

27:14

have the results here. I want to

27:17

integrate the new Muse code

27:21

from meta into T3 code as a new

27:26

provider. Not much documentation exists,

27:31

but I do have it installed right now.

27:34

Investigate and help me figure out how

27:38

we can integrate. So I have Fable both

27:41

investigating how it would do it and

27:43

separately in parallel I have it

27:45

reviewing the plan that was written by

27:47

Muse. O the page layout's super broken.

27:50

Bit annoying to make those types of

27:52

mistakes still. There's a lot of things

27:53

here that feel really last generation,

27:56

but a lot of things that feel next

27:57

generation, too, where it's like it

28:00

seems to know how to break things up

28:01

with sub agents really well, but it also

28:03

seems to struggle meaningfully with like

28:06

basic page layout stuff or staying on

28:08

task and not hallucinating its way down

28:11

an entirely incorrect path. Do we get uh

28:15

omniscience scores here yet? Um, oh,

28:19

apparently it does well on a

28:21

omniscience. That is weird to me cuz we

28:23

just watched it hallucinate

28:24

aggressively. Allegedly, it is about as

28:27

bad of hallucinations as 56 Soul is and

28:30

slightly better than Kimmy K3, but

28:32

considering how aggressively we just

28:34

watched it do that, that was rough. I

28:37

had Fable give feedback on Muse's plan

28:39

to integrate Muse and it said it's a

28:41

solid plan and gave a little bit of

28:42

feedback. So, I'm going to do what I

28:44

usually do in my real world day-to-day

28:46

work when doing things like this and I'm

28:48

going to take that response. I'm going

28:50

to paste it into the original chat with

28:52

the first model that made the plan and

28:54

see what it does. Oh, it updated the

28:56

plan alarmingly quickly as well. It's

28:59

It's very nice how fast this model is.

29:01

And since it's fast and token efficient,

29:03

it just feels great. Plan updated. Take

29:06

another look. It is nice having all of

29:09

these fast, cheap models getting smart

29:11

again. It's been a while cuz everybody's

29:13

been fighting so hard on the frontier

29:15

considering that OpenAI just lowered the

29:17

price of Luna by 80%. Which is a massive

29:21

drop on a model that was already really

29:22

cheap. $120 per mill out and 20 cents

29:26

per mill in is just unbelievable. It's

29:29

crazy that you can get a model with a

29:31

million context window with the

29:32

capabilities that Luna has for this

29:34

price. And I've been using it a lot more

29:35

for like random background tasks,

29:38

categorization, titles, and stuff like

29:39

that. We went from having almost no good

29:41

small models drop for months if not like

29:44

a year to having Luna come out and then

29:46

price drop massively by like 5x.

29:48

Deepseek V4 Flash just got a new

29:50

snapshot that I was testing earlier that

29:52

is really good, really fast, and really

29:53

cheap. And now we have this new Spark

29:55

1.2 model that's also seemingly really

29:58

good for the money, especially if you're

30:00

on that contributor tier where they are

30:01

reading all of the things that get sent.

30:03

After the one passive feedback from

30:05

Fable, apparently it thinks that the

30:08

plan Muse wrote is ready to go. That's

30:10

kind of nuts, man. I love T3

30:12

code. It's so nice being able to just

30:13

like hop between models, harnesses, and

30:16

computers. I'm now spinning up soul on

30:18

one of my Linux boxes to compare the

30:20

plans that Fable and Muse wrote

30:22

separately. See, we're up to 36 cents of

30:25

spend now that we've done all of the

30:26

planning. Oh, nope. 40 cents. Wow, I'm

30:29

going to go broke at this rate. For

30:30

reference, just my little tests with

30:32

Fable and Opus on this computer for

30:35

reading those plans and investigating

30:37

them is already $32 almost of spend in

30:40

Claude. So that is a 100x gap. And I've

30:44

done way less work with these models

30:46

than I have with the Muse one. That is

30:48

on the they have access to all my data

30:50

tier. But to be fair, Fable 5 also does

30:53

have them storing the data. They're not

30:55

training on it allegedly, but they are

30:57

storing it for safety reasons. Opus,

31:00

they don't do that with. And if you

31:02

spend the much higher 10 to 20 times

31:04

more on the standard tier for Spark 1.2,

31:07

then you will end up paying still not

31:09

anywhere near this much money. But if

31:11

it's 10 to 20 times more, which is

31:13

roughly what it is, that would be 4 to 8

31:17

at most for a bunch of work, that is

31:19

decent. Oh boy, it's spinning up those

31:21

sub agents now. Probably going to hit

31:24

rate limits again. Yeah, I'm hitting

31:25

rate limits again. I might have to

31:27

switch. I'll stop all of these.

31:31

We'll move off the contributor tier.

31:34

Let's see how it handles. Uh, continue.

31:36

It is nice only having one model and

31:38

just picking between the two versions

31:39

that have different pricing for the

31:40

exact same thing. But when one of them

31:42

hits rate limited that hard, it's a

31:44

little annoying. I just spend way too

31:45

much money in comparison. Even though

31:46

all the data I'm about to get here is

31:48

technically available for anyone to

31:49

train on because it's in my videos. The

31:51

review sub agents are finishing up their

31:53

work. I I switched to the higher price

31:55

tier and I'm still getting rate limited.

31:57

Are you kidding? Like I'm just doing the

32:00

sub agent stuff. They said that they

32:01

support well and I'm hitting rate limits

32:03

constantly. This is obnoxious. And it

32:05

sucks. It's like the harness actually

32:07

feels pretty good. It's like a minimal

32:09

polished up quad code. It is making my

32:11

laptop a little warmer than I would

32:12

like. But uh yeah, this is

32:16

I am annoyed by the rate limit thing

32:18

more than anything else here. The rest

32:19

is not the worst. Like rate limits on

32:22

subscription plans make some sense. rate

32:25

limits on paid per token tiers where I

32:29

am using it the way it's intended is

32:32

pretty rough. Oh, cool. Soul is now done

32:34

comparing things here. Yeah, this is

32:36

what I expected. It's a slaughterhouse.

32:39

It also decided to weight the different

32:41

categories more and less heavily

32:43

depending on how it felt about them. So,

32:46

it said for the current repository and

32:47

API fidelity that the plan from Muse is

32:50

4 out of 10. The plan from Fable is 7

32:52

out of 10. For the protocol research,

32:54

they tied roughly. For end-to-end and

32:56

multi-urface completeness, Muse was

32:58

nowhere near there. Fable was a lot

33:00

further along at 8 out of 10. Life cycle

33:02

permission safety recovery pretty close.

33:04

Delivery plan closeish with Fable Little

33:07

had at seven versus five. Simplicity and

33:09

maintainability both didn't score great.

33:11

But overall, Muse's plan got a 4.8 out

33:13

of 10 and Fables got a seven. Yeah,

33:16

considering the gap in cost, that is

33:19

reasonable. But considering the reality

33:20

that you have to merge the code when

33:22

it's done, this is much less reasonable.

33:24

Still a very interesting model, just not

33:27

necessarily

33:28

one I would trust for making big

33:31

sweeping changes to my code. Think now

33:33

is a good time to answer the important

33:34

question, why would someone use this

33:37

model? What makes Muse 1.2 useful enough

33:40

that someone should use it? Well, the

33:43

obvious reason, like the number one

33:44

thing that would make someone want to

33:45

use this model is that they work at

33:47

Meta, in which case they would probably

33:49

use this as their second or third most

33:51

used model compared to Opus and Fable

33:54

because I know they love those models

33:55

there. Main reason to use Muse is that

33:57

you work at Meta. But there are other

33:59

reasons that I'm seeing a bit of. The

34:01

biggest, of course, is that you like to

34:03

try new things, especially when those

34:06

things are cheap. Because this model is

34:09

cheap. Even if you're not willing to

34:11

share your data and you're using it on

34:13

the paid tier that's a little higher up,

34:15

it's still a very, very cheap model.

34:18

Although, now that I've switched out of

34:20

that way cheaper tier, I just went from

34:22

40 to $5.32 for the work I've done in

34:25

the past 10 minutes because it's going

34:26

so fast. But it did make its integration

34:30

for Muse inside of T3 code. So, I will

34:33

ask it to spin up dev server and share a

34:37

link. If it got this working properly

34:40

first try after a little bit of plan

34:42

review from Fable, then credit to them.

34:44

They made a model that's pretty good. If

34:46

this fails out right, then expected

34:49

models this cheap can't really do tasks

34:51

this exploratory and undefined because

34:54

again they didn't put out the SDK I need

34:57

to build this. So the model had to

34:58

integrate Muse into T3 code with hacks

35:01

more than anything. Moment of truth.

35:03

Let's see if we are in here. Muse

35:05

Spark12. What is this project? Not

35:08

looking good so far. [snorts] Didn't

35:10

even add it in the provider section in

35:12

settings. It just added it in the UI

35:15

here and it does not appear to work.

35:19

Ah, was a nice attempt. The

35:21

autogenerated title was from codeex

35:23

because that is the default. If you have

35:24

codecs, I just use 56 Luna on low for

35:26

it. So, the title gen was nothing to do

35:29

with Muse. It just appears to be broken.

35:31

Okay. So uh sadly what this means is you

35:34

cannot trust it for longer running

35:36

things for sure. I was hoping it would

35:38

be a little more capable at that but it

35:40

is not. So what other reasons would you

35:42

use this? You like really fast models

35:45

that are somewhat capable. Like this is

35:49

not anywhere near as good as a model

35:51

like 55. Even though the benches suggest

35:54

otherwise, it just doesn't get it as

35:57

well. And that's what makes this model

35:59

so strange to me is that it understands

36:01

breaking up work in sub agents and not

36:03

stepping on each other's toes when it

36:05

does that type of thing really well. But

36:06

it's nowhere near as good at actually

36:09

seeing complex work through. It's almost

36:11

like it it knows how to act like a

36:14

modern smart model, but it doesn't know

36:16

what the modern smart models know. I

36:18

like the comparisons people are making

36:20

with gro code fast because it does feel

36:22

similar there where it has a lot of the

36:25

the layers that make the models work

36:28

well, but it's not good enough to really

36:31

be trusted. And I'll be honest, it's

36:33

hard for me to justify using models like

36:35

this for a lot of my work just because I

36:38

would rather wait two to three times

36:40

longer and have something I can almost

36:41

certainly merge versus trying it five

36:44

times with a fast model and still have a

36:46

mess inside of it. Honestly, the most

36:48

impressive thing here is the CLI. It's a

36:51

lot more stable and less annoying than

36:53

Cloud Code. It's still not my favorite.

36:55

Like Pi still smokes it overall, but

36:57

it's solid for a thing that like they

36:59

threw together for this release. I am

37:01

tired of the labs making new CLIs and

37:04

things when they're already in last

37:05

place, forcing us to install yet another

37:07

thing, but they did provide integrations

37:08

for things like open code. So, that was

37:11

nice and right directionish. And it

37:13

still crushes everything Google is doing

37:15

by quite a bit. It is funny to see Meta

37:19

quickly leaprog Google but still be far

37:22

behind everyone else. It's almost like

37:24

these big companies are fighting to be

37:26

like fifth place and all the startups

37:29

that are really embracing the power of

37:30

these new models are excelling in

37:33

jumping far ahead. Obviously, Anthropic

37:35

and OpenAI are far ahead, but companies

37:37

like Moonshot with Kimmy, like Zai with

37:39

the GLM series and more are all far

37:42

ahead of this in my opinion. Hell, I

37:44

would still use Grock 4.5 above this. I

37:47

do have one last test I want to give it

37:49

though. I want you to audit all of the

37:51

poll requests I have open on T3 code.

37:54

Figure out which ones are mergeable,

37:56

which ones need more work, which ones

37:57

should be closed, which ones have been

37:59

trumped by other things merging, etc. I

38:02

want you to make a priority list for me

38:03

of what I should look at first and how

38:06

confident you are in me merging it.

38:08

Break up this work into lots of sub

38:11

aents in order to get through it faster.

38:13

Cool. We'll see how it does with that.

38:14

Bad gateway when trying to hit the

38:17

GitHub API through the CLI. That's fun.

38:20

Is GitHub down? No. Is this formatting

38:24

things wrong? Fun. It's doing some

38:25

sketchy to get in. Interesting. It

38:28

went through all my PRs in 4 minutes.

38:30

That's like genuinely impressive.

38:32

Especially cuz I spent the first two

38:33

minutes just trying to get into GitHub

38:34

and off it. If this review is of decent

38:37

quality, then this might be what I use

38:40

the model for. I might just use this as

38:41

my go-to. like go review all the PRs I

38:43

have open. Oh, that's a nice little

38:45

thing. When I have Codeex and Claude

38:47

make these PR audit pages, they often

38:49

don't link the actual PRs with these

38:53

like links here, and this did. That's

38:56

really nice. I have been annoyed at how

38:58

many models don't make these clickable

39:00

links. Even gave little confidence

39:02

scores. This is one of the better PR

39:04

review pages I've gotten. For reference,

39:06

here's one I made with a different

39:07

model, and I actually had to tell it,

39:08

"Please make sure these are links." I

39:11

genuinely prefer the layout of the

39:13

version that Muse did here by quite a

39:16

bit. I might even use this as like my

39:17

go-to template in the future. This is

39:19

super readable to me. I like the little

39:21

confidence scores. I like that it tells

39:23

you if it's clean or dirty merge, what

39:25

it thinks the status of things are. This

39:28

is good.

39:30

This might be one of the use cases I end

39:32

up using this for a bunch. So to go back

39:34

to use cases quick like fast models is

39:37

one. One of the big ones I've now

39:38

learned is for random code adjacent

39:43

analysis work. Obviously I wouldn't

39:45

trust this model to like actually go

39:47

merge PRs for me. But as a surface level

39:49

like go audit what's going on in this

39:51

repo for 20 or 30 cents. That was really

39:54

good especially with like no additional

39:55

effort to try and make it better. Like

39:58

that was great. I'm going to tell it to

40:00

go go to go further here. How about you

40:02

do a similar audit for all open PRs that

40:07

have had updates in the past five days?

40:10

If this audit costs less than like a

40:13

dollar, it was absolutely worth it. One

40:15

of the things that'll be hard for this

40:16

model with this though is that it's not

40:18

trained on GitHub because again, Meta

40:20

mostly uses their internal mercurial

40:22

stuff where all the other labs are heavy

40:24

on GitHub. So, they've trained the model

40:25

to be very good at GitHub. I'm about to

40:27

hit so many rate limits. It doesn't seem

40:30

to have parallel limits like all the

40:32

other harnesses do. It's more than happy

40:33

to run seven sub agents in the

40:35

background at once. And it gave each of

40:37

these a ton of PRs to look at. There's

40:40

$841 before I hit send on this. We have

40:44

spent another 5 cents since. It's going

40:46

to hit rate limits. We'll let that run

40:47

in the background. I'll come back to it

40:48

if it ends up with good results. But

40:50

back to why you would use it. I already

40:52

said you like to try new things, but I

40:54

really want to emphasize this point

40:55

because this model has a different

40:57

flavor. it like when we went through the

40:59

different designs it made, it did things

41:01

meaningfully differently. It still has

41:04

the like early Gemini 3 Pro era style

41:08

overall to it. Like a lot of these look

41:10

like what I saw out of Gemini 3 and 3.1

41:12

Pro, but it also just has little

41:15

nicities to it that give it a vibe

41:18

that's different. It's it's like a

41:21

little bit of seasoning that they added

41:22

that other stuff doesn't have. This

41:24

really is a model for enthusiasts right

41:26

now. Like you want to go play with it

41:27

because it's fun to play with new

41:28

things, not because this model is going

41:31

to magically save you a bunch of money

41:33

or become your go-to. Like no one should

41:35

use this model as their day-to-day

41:36

coding model. But what it is is

41:38

interesting. The things that Meta chose

41:39

to focus on, the things they didn't

41:41

focus on, and the capabilities that I'm

41:43

seeing here, it's fascinating,

41:45

genuinely, and I'm definitely going to

41:46

play with this model more. Probably

41:48

through a better harness, though,

41:49

because you can't really integrate this

41:51

one with anything. I don't know why they

41:53

closed source the Muse CLI here. Like

41:56

Muse code should just be open source.

41:58

Meta, you guys know better. You're an

42:00

open source company at heart. Just put

42:02

out the source. In under five minutes,

42:04

it was able to index and review 222 poll

42:09

requests. And this cost me a total of 10

42:13

cents on the contributor tier. That is

42:15

insane. Being able to go through that

42:18

much real work, like auditing 222 pull

42:22

requests in my codebase, organizing them

42:24

by how mergeable it thinks they are, so

42:26

I can quickly blast through this and

42:27

ship real code. That's insane. That's

42:31

actually valuable. And this is why it's

42:33

fun to experiment with the models. Like

42:34

try the different things you do and take

42:36

a look at how much it costs and how fast

42:38

it runs. Being able to hit a button and

42:40

spend 10 cents and in five minutes you

42:42

have a page like this for 200 plus poll

42:45

requests on your project. That's good.

42:47

That's useful. I'm impressed. I would

42:49

use this regularly and I might even set

42:51

something up to automatically do this

42:52

for me every day. That's cool as

42:55

Remember though that was on the

42:56

contributor tier. So if you're not

42:57

willing to share this data to Meta,

43:00

you're going to be spending 20ish times

43:02

more. But that goes from 10 cents to $2

43:06

for this type of work and this much

43:08

work. That's genuinely really

43:10

impressive. I I think you should play

43:12

with this model if you're interested in

43:13

this type of thing. Obviously, you

43:15

shouldn't trust it for everything. You

43:16

shouldn't just blindly go through and

43:18

merge stuff, but as a way to like pull

43:20

signals out of noise for really really

43:22

cheap. It's a fun way to experiment and

43:24

try things. stuff like generating

43:26

titles, categorizing PRs, generating

43:28

summaries for reports, digging through

43:31

logs to find useful stuff. Like this is

43:33

solid and doing similar work with Fable

43:35

cost tens if not hundreds of dollars and

43:38

this was literally 10 cents. So yeah,

43:40

not a bad model. I think it's going to

43:42

get a lot of because it has all the

43:43

weird quirks it has, but when you think

43:45

about it for the price, the speed, and

43:47

the capability, as well as it weird

43:49

things it seems to do not better, but

43:51

different from other stuff, it's fun. It

43:53

almost is like playing with one of those

43:55

like interesting toy programming

43:57

languages is how it feels to me. It's

43:59

it's different in a way that isn't

44:01

necessarily ready for real world work

44:03

all the time, but it's cool as and

44:05

very fun to play with. I definitely had

44:06

ups and downs with this exploration, but

44:08

overall I'm coming out somewhat

44:09

impressed. I don't think this model is

44:11

going to kill Opus or Fable anytime

44:13

soon, but it's a model that I could see

44:14

myself playing with for lots of weird

44:16

things, especially when you consider the

44:17

price. If I didn't have all of these

44:19

accounts across cloud code and codecs

44:21

that I just burn for all sorts of stuff,

44:23

I would probably be leaning on models

44:24

like this. And even though I have those

44:26

other things I can burn, I am still

44:28

going to be trying this to try and just

44:30

organize my work and life better because

44:31

it is so surprisingly cheap. I'm curious

44:33

how y'all feel though. Am I too Frontier

44:35

Pilled or is this model just not that

44:37

impressive? Let me know how y'all feel

44:38

and if you'll be using it. And until

44:40

next time, peace nerds.

Interactive Summary

The video explores Meta's new 'Muse Code' tool and its underlying 'Muse Spark 1.2' model. The creator examines its performance in software engineering tasks, specifically focusing on its agentic capabilities, speed, and cost-effectiveness. While highlighting significant limitations in reliability, complex task handling, and integration compared to frontier models like Claude's Opus or Fable, the creator finds it remarkably useful as a cheap, high-speed tool for tasks like repository audits and PR analysis, especially under the 'contributor' pricing tier.

Suggested questions

3 ready-made prompts