Vibe Coding With GLM 5.2
356 segments
In this video, I'm gonna be vibe coding with the newly released GLM
5.2, which released this morning from ZAI as a result of the US government
banning access to Fable 5 and Mythos 5
By this point, I'm sure that most of you know that Anthropic has suspended
access to Fable 5 and Mythos 5, and this does matter to the release of
GLM 5.2 because ZAI basically saw this as a marketing opportunity.
If you look at their post, they literally say the future of AI is open and it
belongs to the people, which is crazy.
They weren't planning on releasing this model, but they saw this
as an opportunity, and it's only available to GLM coding plan users.
So it's not available in their chatbot.
It's not available via API.
So for the purpose of this video, I have purchased a GLM
coding plan for $65 a month.
Note that GLM coding plans are now like 100% more expensive than they
were just a couple months ago.
Like literally the last time I bought one of these subscriptions, it was like $35.
So the price has gone up significantly because the price of
GLM models have also gone up a lot.
But I'm excited to test the new model
I currently have GLM 5.2 being run through BridgeBench.
That's what this open code instance is doing.
But I also wanna test GLM 5.2 on that horror house game
that we did with Fable 5.
If you guys remember from my previous video, I tested Fable 5 building out a
complete horror house game, and I think it would be very interesting to test
GLM 5.2 with the same exact prompt.
So I'm gonna drop this in the BridgeMind Discord community
if you guys wanna check out the prompt that is being used for this.
But I am gonna drop it in here just so that we can test out the
capabilities of GLM 5.2 on the same exact test that we gave to Fable 5
One thing I wanna mention real quick just so you guys can see it in real
time, is that the rate limiting on the GLM coding plan is absurd.
I literally deal with these rate limits every time that I use a ZAI
coding plan because they do not have the resources to be able to
serve the model from their server.
So if you guys look at this, literally I'm getting rate limited
here, I'm getting rate limited here.
And yes, I'm running a few subagents, but running five to nine subagents should
not cause me to get rate limited the way that I'm getting rate limited right now.
So if you're thinking about getting a GLM coding plan, just have that in mind that
running subagents and actually being able to work in a normal Vibe coding workflow
where you have multiple agents and tasks being worked on at the same time is
gonna be much harder for you than normal.
And it looks like those rate limits have just subsided now.
But still, that is not a great thing to have when you're
spending $65 a month on a plan
I'm also going to drop in a stealth game test.
So this is from a member of the Bridge Mine community.
You guys can look at the prompt here, but this is going to be a 3D
stealth action game in Three.js.
So I'm gonna submit that prompt here, and we'll see what happens there
GLM 5.2 does seem a lot faster than GLM 5.1.
If you guys look at this here, we're actually getting a
substantial amount of output in a relatively short amount of time.
It seems like those rate limits have now subsided.
We've got all of our tasks running here.
We've got our games being worked on here and here.
And the output, I'm actually pretty happy about it.
It's much better than the release of GLM 5.1.
If you guys remember that, I was getting five hundred and twenty-nine errors.
I was getting four zero one errors.
I was getting four hundred errors.
So it seems like ZAI has figured out how to serve the models a little bit better
I did just drop in another prompt that is going to create a Minecraft clone.
So this agent here is currently working on a Minecraft clone, and guys, you
can see it's been working only for a few minutes, and we are getting
quite a lot of output from GLM 5.2.
So we're gonna see what it does on Bridge Bench for the speed test,
but to me, it seems like it's definitely faster than GLM 5.1.
Another thing that I also wanna test this on is creating a Remotion video.
So let's drop in the Bridge Agent desktop app and then drop in the Remotion
directory, and then I'm just gonna give it a quick prompt here with Bridge Voice.
I want you to do a complete in-depth review of the Bridge Agent desktop
app and our Remotion directory, and then I want you to create a
new marketing video for the release of the Bridge Agent desktop app.
Note that this needs to be completely independent from other
Remotion videos that you see.
Do not reference any other Remotion videos.
I want you to create a Remotion video that is 30 seconds long and is
a digital twin of the actual Bridge Agent desktop app and is fast-paced
and easy to follow and uses actual demos of the Bridge Agent desktop app.
All right, guys, here is the moment of truth.
So we have the horror game completed.
We have the Shadow Protocol game completed.
We have our Minecraft game, which is about to be done.
We have our Remotion video, and Bridge Bench is on its last step.
So let's pull up Shadow Protocol here and just check out what we have.
So this says high-value target, so we're targeting Dr. Malachi Voss.
And okay, it looks like we're just gonna literally be in,
a building and be fighting.
Oof.
Okay.
All right, first issue that we're already seeing is that the
lighting, you guys can see that I can't actually see anything, okay?
So this is an attention to detail that we experience with a lot of
these Chinese models, where it is
it does not get the attention to detail that is needed, okay?
So what I'm gonna do is I'm just gonna stop this, okay?
So that was not good, okay?
And this is an attention to detail that some of these Chinese models really do
struggle with, is that with Fable 5, what we saw before it was banned, is
that pretty much anything that you gave it, it would be a perfect one shot.
perfect lighting, perfect game.
And GLM 5.2, not there
So let's click to enter, and right away, definitely not as good of
graphics as Fable 5, but if you do look around, it does look like this works.
Is there a Post-It note or something in here that we can use?
Let's read the note.
"Three locks, three keys somewhere in these rooms.
The lo- the front door is your only way out.
Keep the light on.
Do not let the silence fool you.
If it starts to hunt, run.
The door will open then." Okay, so let's pull up here, and let's
see if we can find these keys.
I'm just gonna try and speed run this.
Let's open this door.
So yeah, look at this key.
The animations and the UI and the graphics is nowhere near
Opus or Fable-level capabilities.
here is the second key, and let's just take a look at the note.
" Don't take them all at once.
It wakes when the third is moved.
I only needed one to see the door.
God, give me for the… forgive me for the rest." Okay, so apparently this thing is
going to wake up and chase us or something like that, or do a jump scare at, what,
I guess when we find the third key.
So let's try and see if we can find this third key.
Oh, whoa.
That, like, sent chills up my spine, that, sound effect.
That was cool.
Okay, so I just picked up the third key.
Is anything gonna happen now?
Let's see.
Looking around.
I don't see anything, guys.
There's just this creepy poster.
I don't know.
What do you guys think?
Drop a comment down below based off what you guys see.
So I have all three keys.
I don't see anything chasing me.
Is nothing gonna chase me?
It doesn't seem like anything's gonna chase me.
Just kinda run around and see if we can trigger anything, but it seems
like it's not actually working, guys.
So we're seeing the same issue.
Nothing is actually happening.
when we used this with Fable 5, as soon as we picked up that third
key… Oh, and look at this, guys.
I can't even get out.
Even though I have all three keys, I can't escape.
It says… Look at this.
"Objective: find three keys, escape through the front door." I
have all three keys, and I can't escape through the front door.
And guys, I'm gonna say it again, this is what we're seeing from the Chinese models
Let's check out this Remotion video that was created by GLM 5.2
for the Bridge Agent desktop app.
So first things first, this is not good.
right off the bat, not loving what I'm seeing.
It thinks, it searches, it ships.
It does have pretty much a digital twin of the UI.
here's the task board, but this is nothing that we haven't seen before
from other models, and that is… I like that a little bit right there,
but, like, really a purple gradient.
This is-- look at the text here, "Built by agents, built for builders.
Get agent free." I don't know.
I-- You guys can be the judge of that one.
I don't think that's good, but you guys can let me know what you think in the
comment section down below, but I'm gonna not give it a pass on that one.
Just again, lack of attention to detail
Here's the Minecraft game that we created.
So it's called Voxel Sandbox.
Let's click Play.
And guys, I can't even move.
I can't even move around to… I can't do anything.
Okay.
Okay.
All right.
So this doesn't work
This is one of the most frustrating parts about Chinese models, is that I don't
trust them in production code bases.
If you can't get a Minecraft game where I can at least navigate the map
and, like, walk around, then how am I supposed to trust you in a production
code base where actual customers and actual subscribers are on the line?
And for me, that's what earns you the Bridgemind stamp of approval,
is can I use you and trust you in my real vibe coding workflow?
And from what I've seen there, that doesn't look like I can trust GLM 5.2.
But let's look at BridgeBench.
We do have the results.
Here is the Flappy Bird game test.
So this is a game.
You guys can see the UI.
I don't know how I feel about the bird's beak, but that's a thing in itself, but
it is a functional Flappy Bird game.
It looks fine.
I'm not gonna play that too much.
Here is the infamous lava lamp.
So this is probably the fattest lava lamp.
I don't know if this is just a bar being balanced up on the top here, but
that's not gonna get a pass from me.
Here's the thunderstorm over the city.
Let's see the lightning effects.
That looks pretty good.
Thunderstorm over city is all right, and let's see another lightning
bolt just for reference sake.
Okay, that looks pretty good.
coral reef underwater, that looks pretty good there.
Everything looks good But remember, at the same time,
these are HTML file tests, okay?
This is completely different than oh, this is something I'm gonna use
in a real-world production workflow.
This is like just to give us a visual representation of 'Hey, how good is the
model?' This game here is pretty good.
I have to say, I like this.
GLM 5.1, I'm pretty sure that it does rank pretty high on like Design Arena,
and that little bug there where it doesn't destroy him if it gets behind him.
But that's fine.
that looks good.
But let's check out the leaderboards and see where GLM 5.2 is ranking.
So let's check out.
Whoa, look at this.
It ranks number six for hallucination.
Do you guys see this here?
So it ranks sixth for hallucination, so it looks pretty good on hallucination.
For refactoring, it ranks fourth, and that's the model's ability to be able
to rewrite code without breaking it.
BS, whoa!
We just got our first one hundred percent score on the BS bench.
It just got a hundred percent.
So this is the benchmark that basically it pu- it will push back against nonsensical
premises or confidently invent answers.
And look at this, GLM 5.2, we just got our first perfect score
on the BS benchmark from GLM 5.2.
Where was GLM 5.1 on this?
GLM 5.1 was way down here at twenty-six, so that is actually a huge
leap in terms of the BS benchmark.
And then, whoa, over here on reasoning too, it does very well on reasoning.
Number one in reasoning and even beat out Claude Fable Five.
So this is actually one of the hardest benchmarks on BridgeBench.
It's a thirty-task benchmark for grounded multi-reasoning over code, logs, config
specs, and conflicting artifacts.
This is the hardest one.
The scores on here are very close together, so the fact that it
scores one point three percent ahead of Claude Fable Five says a lot.
But the problem is, is that with the initial test that we just did, like
the Minecraft test and the horror game test, it just seemed to leave
out some very critical details.
And then look at this, guys.
This is what I noticed when it was running.
The speeds of GLM 5.2 are actually off the charts compared to GLM 5.1.
Look at this.
GLM 5.1 was all the way down here.
It was number twenty-one.
It ran at eighty-three point nine tokens per second, and all of a sudden,
with GLM 5.2, they've been able to speed up the model significantly.
It ran almost, yeah, over three times faster than GLM 5.1.
It runs at two hundred and ninety-six tokens per second.
So that actually does change things, okay?
And I'll tell you why.
It's performing very well in reasoning.
It's performing very well on hallucination.
It's performing very well on BS, and it's performing well on speed.
It's also performing well on debugging.
It scored an 86.6.
And then big thing here is also cost.
And, the cost, the cost is very low.
If we go to OpenRouter, we'll have to see what it does cost.
I wasn't-- 'cause I'm in the Jill coding plan, and the way I typically will do
this is through OpenRouter, so I didn't get a cost here for this cost benchmark.
But when you do look at it, guys, I'm assuming that this is gonna
be the same cost as Jill M 5.1.
We'll see, okay?
But it looks like it's gonna be the same cost as Jill M 5.1, and if it
is, this is gonna be something that you could potentially be using in
like Hermes agents because of the speed, because of the reasoning
capabilities, and because of the BS.
And that's one thing that I noticed.
It's hey, I typically will use GPT 5.5 in Hermes agents and Bridge agent
because it's just so intelligent, and I can use it with my existing Codex CLI.
But the thing is, is that this model is cheap enough, and it's fast
enough, and it's smart enough that this could potentially be a really
good model for Hermes agents, okay?
Check this out, guys.
While I was making this video, I reached 71% used on my five-hour quota
and 14% used on my weekly quota, and I only used 37 million tokens, which you
may say, "Oh, that's a ton," but it's actually not that much for the model.
It's a super cheap model, and if I kept going, I would've already
reached my five-hour quota.
If I was in a real vibe coding workflow, I would've obliterated this quota, okay?
Because I would've been running way more tasks.
In the grand scheme of things, I only ran this through… Hey, I ran it
through BridgeBench, yes, but I also ran it through one, two, three, four
tasks that weren't that difficult.
But at the same time, I also am using GLM 5.2, which is a super cheap
model, so why am I hitting usage limits on a model that is this cheap?
hey, if I'm using Opus 4.8 in Claude Code and I get usage limits after,
two hours or whatever using it.
Hey, I'm using Opus 4.8, rest in peace Fable 5, hopefully we get it back.
But the usage limits here are a little bit too much for me.
So with that being said, moment of truth here, I am not going to be putting
the Bridge Mine stamp of approval on this model for the following reasons.
First of all, you're not gonna get a ton of usage out of this.
I'm paying… What is it?
My plan is the $65 a month plan, and I'm using a model that is supposedly
supposed to be only, a dollar per million on the input, and I already
got 71% of the way through my five-hour limit and 14% of the way through my
weekly limit just from, a one-hour test.
That doesn't make any sense to me.
I'm not gonna be able to use that in my real vibe coding workflow.
Also, if you guys look back at the games that we created, the
Minecraft game I couldn't even move.
The horror game didn't actually function where it had, a monster that came after
you, or you could even, once you had the three keys, to be able to get out.
And then with this, whatever this was, it was like the first-person
shooter game, it was just completely dark, and it didn't look good.
And then with the Remotion video, it just had no, touch to it.
It had no creativity.
So I don't see anything about GLM 5.2 that's calling to me
Other than the fact that it is very fast, much faster than GLM 5.1, and
it does do well on BS benchmarks and reasoning benchmarks, which makes it
suitable for Hermes agents potentially.
But really the reason that I'm not gonna be using this in a vibe coding workflow
is attention to detail and reliability is more important now than ever.
And I think that we saw this with Fable 5.
With Fable 5, you would basically be able to give it a prompt, and it would
have so much attention to detail.
It would be able to one shot pretty much anything that you asked it.
And it's terrible because we basically got this incredible thing
that has now been taken away from us, and it is very frustrating.
Maybe you guys are getting that from this video.
But I, I'm not seeing that with GLM 5.2.
GLM 5.2, it's not meant to compete with Fable 5, but that's the core issue that
I have with Chinese models is that if you make something, if you make a horror game
and you make it so that one of the biggest pieces of functionality, the ability
for me to escape the house and for there to be any like ghost that is actually
going to appear, that's a huge piece of functionality that just is nonexistent.
It makes it so that I would have to prompt it maybe two, three, maybe
even four times to be able to get what I wanted out of the model.
Whereas with Frontier models, Opus 4.8 obviously is far more capable.
But hopefully we get Fable 5 back because with that model, you could
pretty much do anything with that model.
So we'll see what happens today and what Anthropic gives us today,
what updates they give to us.
But GLM 5.2, you guys aren't gonna be seeing me work on this
in my vibe coding workflow.
But definitely an interesting model and an interesting drop from ZAI just
as a competitor to say, "Hey, you're gonna block the American models? guess
what? The future of AI is open, and it belongs to the people." So shout out
to ZAI for open sourcing their models.
I think that is a phenomenal way of doing this and great work on your marketing,
but not so great on your model because I personally will not be using it.
So with that being said, if you guys haven't liked, subscribed,
or joined the BridgeMind Discord community, make sure you do so.
And with that being said, I will see you guys in the future.
Ask follow-up questions or revisit key timestamps.
The video provides a review and hands-on test of the newly released GLM 5.2 model from ZAI, which was launched as an open-source alternative following the suspension of access to Anthropic's Fable 5 and Mythos 5. The speaker tests the model on several code-generation projects, including a 3D stealth game, a horror house game, a Minecraft clone, and a Remotion video. Although GLM 5.2 demonstrates impressive performance on the BridgeBench benchmarks—specifically achieving a perfect score on the BS bench, top reasoning capabilities, and three times the speed of GLM 5.1—it struggles significantly with attention to detail and game mechanics in practice. Due to broken gameplay loops, strict rate limiting, and restrictive quota limits on the $65/month coding plan, the speaker ultimately decides not to endorse GLM 5.2 for real-world vibe coding workflows.
Videos recently processed by our community