HomeVideos

Why AI Agents Need More Than One Model

Now Playing

Why AI Agents Need More Than One Model

Transcript

52 segments

0:01

Intelligence [music] isn't

0:02

one-size-fits-all.

0:04

AI agents are built with many models,

0:07

each bringing different [music]

0:08

strengths to the work.

0:10

Some tasks call for deep reasoning.

0:13

Others demand speed, lower costs, domain

0:16

expertise, [music]

0:17

or stronger data control.

0:20

Frontier models provide state-of-the-art

0:22

reasoning for the hardest [music] tasks.

0:24

Open models can be fine-tuned on company

0:26

data to excel [music] at specialized

0:28

work.

0:29

They can also run on premises, helping

0:32

keep sensitive data secure while

0:34

reducing latency for high-volume tasks.

0:37

>> [music]

0:39

>> Glean uses the system of models approach

0:41

to help enterprises search and act on

0:43

their data.

0:45

Waldo, a specialized model post-trained

0:47

[music] on NVIDIA NeMo Triton 3 Nano,

0:49

gathers context across sources like

0:52

support tickets, Slack, [music] and

0:54

survey data.

0:55

With that context, it decides whether

0:57

the agent should respond directly

0:58

[music]

1:00

or hand off to a frontier reasoning

1:01

model for deeper analysis.

1:05

For simple questions, Waldo delivers all

1:07

the context to a model that returns the

1:09

answer in one shot.

1:11

The response is fast.

1:13

If the question is more complex, Waldo

1:15

sends the task to a frontier model that

1:18

reasons deeper. Because the [music]

1:20

frontier model receives the right

1:21

context upfront, it can produce

1:23

structured analysis with themes,

1:25

evidence, and segment breakdowns more

1:27

efficiently.

1:30

Routing lets Glean [music] search

1:32

enterprise context 10 times faster.

1:35

This translates to 50% lower latency and

1:38

25% [music] fewer tokens with no

1:40

reduction in answer quality.

1:45

In a system of models, frontier and open

1:47

models work together [music] to make

1:49

your agent smarter, faster, and more

1:52

efficient.

Interactive Summary

The video highlights the advantages of utilizing a multi-model approach for AI agents, explaining how combining specialized open models with frontier reasoning models optimizes performance. Using Glean as a case study, the video demonstrates how routing tasks based on complexity improves speed, reduces costs, and maintains high answer quality.

Suggested questions

2 ready-made prompts