HomeVideos

LM Studio Bionic: The New Agentic Harness for Open Weight Models #lmstudio #aitools #claudecode

Now Playing

LM Studio Bionic: The New Agentic Harness for Open Weight Models #lmstudio #aitools #claudecode

Transcript

104 segments

0:00

In this quick video, we're going to go

0:01

over LM Studio Bionic, which is

0:03

essentially a agentic harness for open

0:04

weights models. In my opinion, this is

0:06

more important than ever with everything

0:07

going on in AI. I do believe open source

0:09

and open weights is something that

0:10

everybody should become familiar with.

0:12

And today, it's not really about LLMs

0:13

anymore, it's about running LLMs within

0:15

agents. ChatGPT is now ChatGPT work and

0:18

Codex, Claude is now co-work and Claude

0:20

code, and that is essentially what LM

0:22

Studio is doing. But the promise of LM

0:24

Studio is you could run it with local

0:25

models where you're technically not

0:27

paying a third-party provider.

0:28

Everything is staying local on your

0:30

computer, it's private, and you have all

0:31

these models you can choose from that

0:32

are optimized to work on your computer.

0:34

Bionic is an AI agent for getting real

0:36

work done with open models, including

0:37

coding, research, and complex work with

0:39

documents and files. We commit to zero

0:41

data retention and never training on

0:43

your data. You could run it either

0:44

locally or use the largest frontier open

0:46

source models through LM Studio secure

0:48

cloud. So, essentially, this is a soft

0:50

launch for their own cloud model

0:52

services. Bionic works with powerful

0:54

open source models like GLM 5.2, Kimiko

0:57

2.7 code. I'm sure Kimiko 3 is going to

0:59

come soon. You can have it organize

1:01

local folders, edit files, summarize

1:03

materials, all running locally on your

1:05

computer with those open models. So, the

1:07

difference between this and previous LM

1:09

Studio is LM Studio was able to run LLMs

1:11

and use tools, but not make edits, not

1:13

really take big actions. But Bionic is

1:15

able to do that. You create multiple

1:17

projects. We'll create a new one now.

1:18

We'll call this for video, and you can

1:20

see down here it could either be code or

1:22

work. Now, by default, it starts in

1:24

work, and if you do that, it won't have

1:26

shell access. So, in my case, I like to

1:27

use code. Here we have my three models I

1:29

have installed at the moment. But this

1:30

release makes it kind of clear of what's

1:32

really going on in AI right now.

1:33

Frontier models are getting too

1:34

expensive, and people want to run and

1:36

probably will need to run open source in

1:38

the near future. Now, the biggest caveat

1:40

here is that open weights models that

1:41

you're running locally on your computer

1:42

will not compare with Claude code or

1:44

Codex or any of these frontier models.

1:46

They're running on huge infrastructure

1:48

that you just won't have on your

1:49

computer. That means you have to adjust

1:51

your approach. The approach in how much

1:52

context you want to use, the approach in

1:54

how much you're going to trust your

1:55

agent. Because even last week, there

1:57

were plenty of reports of GPT-5.6

1:59

deleting files off of people's computer.

2:02

My point is, these agents still make

2:03

mistakes. You have to understand this is

2:05

a smaller model. It has less

2:06

instructions, has less reasoning

2:08

capabilities, and it still has access to

2:10

your full file system. With that being

2:12

said, if we go into settings, one thing

2:13

that's missing is skills. And in coding

2:16

agents specifically, skills are so

2:17

important because they're reusable

2:19

prompts. The fact that skills are

2:20

missing here means that the CLI tools

2:22

I'm using are less powerful or less

2:24

capable because the Bionic Agent can't

2:27

read the skills that go with the CLI

2:28

tools. So, now I'm just going to have it

2:30

use Bright Data CLI to tell me about the

2:31

current situation with Gable 5. And And

2:33

if it's going to subscription plans. So,

2:35

I'm going to send it off. I also like,

2:37

by the way, how we could actually see

2:38

the thinking. The reasoning has been

2:40

hidden or truncated on Claude and also

2:42

on ChatGPT on Codex. And there we go.

2:44

Emerging reports suggest that it's being

2:46

reintegrated into subscription plans

2:48

with a usage cap. So, overall, I think

2:49

this is really cool. You have to manage

2:51

your expectations, manage how you expect

2:52

to work and get work done. It's all

2:54

possible. It's a workflow shift. And I

2:56

suggest at least playing with this

2:57

understanding, getting to know Open

2:59

Weights.

Interactive Summary

This video introduces LM Studio Bionic, an agentic harness designed to run open-weights models locally. It explains how Bionic allows users to perform complex tasks like coding, research, and file management on their own machines, ensuring privacy and avoiding third-party data retention. The narrator highlights that while these local agents offer greater control, they have different capabilities than frontier models and require users to adjust their expectations regarding performance and safety.

Suggested questions

3 ready-made prompts