HomeVideos

How Companies Are Building Their Own Intelligence | Sonya Huang, Sequoia Capital

Now Playing

How Companies Are Building Their Own Intelligence | Sonya Huang, Sequoia Capital

Transcript

522 segments

0:00

Okay, good morning everyone. Thank you

0:02

all so much for being here. We have

0:04

about 80 portfolio company founders and

0:06

AI leaders in the room to explore a very

0:09

timely topic, owning your intelligence

0:12

or sovereign AI. Uh today's event is

0:14

meant to be half a rallying call and

0:17

half technical how-to. And so we have

0:19

stacked the agenda with, I think, high

0:21

high substance technical talks and demos

0:24

so that we don't just talk the talk of

0:25

building your own AI, but actually learn

0:27

how to get there together. Uh so thank

0:29

you all for taking the time out of your

0:30

mornings to join us. I know your time is

0:32

incredibly precious, and let's dive

0:35

right in.

0:37

So let's start with the opportunity.

0:39

What is sovereign AI? Uh a sovereign is

0:42

an independent state that has total

0:43

self-governance. And sov- sovereign AI

0:46

refers to companies owning their own

0:48

intelligence without external

0:50

dependencies down to the weights.

0:52

An important nuance here is we are

0:54

definitely not telling our companies to

0:55

get off Opus or GPT. That is definitely

0:58

not the message.

0:59

Uh for coding agents, for desktop work,

1:02

uh for frontier level APIs,

1:05

the closed model APIs are wonderful.

1:07

But what we've observed is that more and

1:09

more of our companies are going down the

1:10

path of wanting to build their own AI

1:13

capabilities in parts of their products

1:15

and vertically integrating towards

1:16

owning more of this intelligence. And so

1:18

today's session is meant to equip

1:20

companies that are starting to go down

1:22

that journey.

1:24

We're obviously not alone in this idea.

1:26

In the last month,

1:28

uh the rhetoric around sovereign AI has

1:30

escalated sharply with folks like Alex

1:33

Karp and Satya speaking up in support of

1:35

companies owning their own intelligence.

1:37

Just last week, Jensen led the charge in

1:40

making sure that open weight models

1:41

remain available in the US. And it was

1:44

awesome to see the near unanimous wave

1:46

of support. I think the message is very

1:48

clear that companies want to own their

1:51

intelligence. They want to own, not

1:53

rent, their weights. And I think it's

1:54

simply because intelligence is too core,

1:57

too fundamental of a property to just

1:59

outsource.

2:02

We're glad that sovereign AI is in the

2:03

zeitgeist right now uh because we think

2:05

it's a good thing for the world. On one

2:07

hand, you have centralized intelligence

2:09

where a single all-powerful AI powers

2:12

more and more of the GD the world's GDP

2:14

as a black box sucking in all the data

2:16

exhaust, all the data flywheels from the

2:18

rest of the world.

2:20

On the other hand,

2:21

you have decentralized intelligence

2:23

where the whole world builds on top of a

2:25

solid core, but every individual person,

2:28

company builds their own intelligence on

2:30

top bespoke to their own data, their own

2:33

industries, their own personalization,

2:36

uh their own way of working, their own

2:37

taste.

2:38

And so the ecosystem flourishes and

2:40

individuality triumphs.

2:42

No single company swallows the rest. I

2:44

think this is a much more optimistic

2:46

view of the world.

2:49

And so we work with dozens of companies

2:51

that are going down the journey of

2:52

building their own AI.

2:54

Um here are the biggest reasons that

2:55

we've seen people move.

2:57

Reason number one is cost.

3:00

Uh especially for low, zero, negative

3:02

margin companies, sovereign AI isn't a

3:05

nice-to-have, it's a must-have.

3:07

Um ironically, the more successful your

3:09

AI product is, the higher your your AI

3:11

cogs tend to be. And so it's actually

3:14

the companies that have been most

3:15

advanced in the deployment of AI that

3:18

have been the first to go on this

3:19

journey of of owning their own models.

3:22

Reason number two is speed. And so in

3:25

certain domains, coding is one of them,

3:28

uh security is another one, a small

3:30

distilled custom model can beat a large

3:33

general one because speed is so

3:34

important.

3:36

Num- Reason number three

3:38

is performance. Um this is a relatively

3:40

newer one. I would say last year, most

3:42

companies were not choosing to own their

3:44

intelligence to generate better

3:45

performance.

3:46

Uh but we're now at the point where open

3:48

models can outperform closed ones on

3:50

your domain.

3:51

And we're going to spend a lot of

3:52

today's agenda talking about how to get

3:54

there. And then reason number four,

3:56

controlling your own destiny. Uh

3:58

Anthropic and OpenAI, I actually think

4:00

to their credit, they've been really

4:01

wonderful partners to a lot of the

4:03

ecosystem. But companies are

4:05

increasingly finding that they want

4:07

their own set of independent legs to

4:08

stand on as well.

4:11

Um does anybody here come from the

4:13

crypto days or remember the crypto days?

4:15

Okay.

4:16

Um do you guys remember this meme?

4:18

Okay.

4:19

Uh in the crypto of the days there was

4:21

this meme for the DeFi degens. Uh not

4:23

your keys, not your crypto. And so if

4:25

somebody was custodying your crypto for

4:27

you, it fundamentally wasn't yours.

4:30

I hereby present the AI version of this

4:32

meme. Not your weights, not your

4:34

product.

4:35

Um I think that for product to be truly

4:37

yours, I think it's reasonable to think

4:39

that you need to be able to control

4:40

control and custody your own weights.

4:45

Pat shows this slide at AI Ascent

4:47

talking about the race for the

4:48

application layer. Uh the He looks so

4:51

proud of yourself. Uh the punchline is

4:53

that both the AGI labs and the

4:54

application companies are racing to be

4:57

the user-facing products from different

4:59

ends. The foundation model labs from the

5:01

model side and the application companies

5:03

from the user back.

5:05

I think we're seeing a new dynamic

5:07

emerge now, which is actually that

5:09

battleground is increasingly becoming

5:11

not just the race for the application

5:13

layer, but the race for the intelligence

5:15

layer.

5:16

And so this this battleground is no

5:17

longer just about who gets to control

5:19

the product, the UI, the go-to-markets,

5:21

the wrapping. It's actually about who

5:23

can own the intelligence itself

5:26

and shape better intelligence in the

5:28

product. So the product is the

5:29

intelligence, and the newest

5:30

battleground is for not just the product

5:33

surface, but for the intelligence layer

5:35

itself.

5:37

And so the hottest new labs, in my

5:38

opinion, are actually uh the applied

5:41

research that we see coming out of

5:43

companies right now like Harvey,

5:45

like Factory,

5:48

Glean,

5:51

Open evidence,

5:53

Semgrep,

5:56

Ramp.

5:57

The list goes on and on, and I think the

5:59

research is spanning everything from

6:00

evals and benchmarks to harness

6:02

engineering to new algorithmic

6:04

techniques for fine-tuning and a lot,

6:06

lot more.

6:08

And we started this uh we started this

6:09

morning talking about centralized versus

6:12

decentralized intelligence. I think it's

6:14

really wonderful to see the amount of

6:15

innovation that is happening in these

6:18

democratized intelligence world. Like I

6:20

actually think the application companies

6:22

are the newest Neo labs.

6:25

Okay, so I assume that everyone here

6:27

today is pretty bought into this

6:28

journey. Let's assume that you want to

6:30

build your own lab, build your own

6:31

models. How do you go from zero to one

6:33

to 100?

6:34

We're going to do something a little bit

6:35

different today here. Um I'm going to

6:37

lay out an opinionated framework and

6:39

technical roadmap. And so take that with

6:41

a giant grain of salt. Uh every company

6:43

is different.

6:45

And and I'm not technical. And so take

6:46

this with a giant, giant grain of salt,

6:48

but I hope it provides a useful starting

6:50

point for how to think about building

6:52

your own intelligence.

6:55

Uh step one um to owning your

6:58

intelligence is strategy.

7:00

What parts of your AI do you want to

7:02

own? What parts do you want to rent?

7:05

Step two is team, figuring out how to

7:06

staff and organize people towards the

7:09

production of intelligence.

7:11

Step three is legibility. I really think

7:13

this gets glossed over

7:14

um and is incredibly important. So more

7:16

on this later.

7:17

And then finally step four, we're going

7:19

to talk about a technical roadmap. What

7:21

are the building blocks you need to

7:22

assemble in order to build your own

7:23

intelligence?

7:25

So let's dig in.

7:27

Um step one, defining which capabilities

7:29

you want to own versus rent. Sovereign

7:31

AI isn't binary. Uh you're not 0% or

7:34

100% sovereign.

7:36

Um an important part of the strategy is

7:38

to draw the lines for which intelligence

7:40

do you want to own and which you're

7:41

comfortable outsourcing.

7:42

And so here's a useful framework to

7:44

think about um what parts you want to

7:47

own versus rent. I think there are four

7:49

important factors that go into this. Uh

7:52

one is cost. Like how how important is

7:54

this cost line item zero overall COGS?

7:57

Uh two is speed and latency. Is it a P0

8:00

or not? Um factor three is performance.

8:03

And this is where it gets very

8:04

interesting. It used to be that you

8:06

would choose open weights when you

8:08

didn't care about performance. Now we're

8:10

getting to the point where in certain

8:11

domains you may be able to get better

8:13

performance by tuning models on your own

8:15

data.

8:16

And then finally, proprietary data. Are

8:19

you in a domain where the data you're

8:20

giving the model to improve it is super

8:22

proprietary super proprietary to your

8:24

business or less so?

8:27

Um so here are some examples of how

8:29

companies have decided to make this

8:30

trade-off. In coding, you have both

8:32

agents and you have auto complete. On

8:35

the agent side, this these are still

8:37

mostly rented today because you want

8:39

strong out-of-the-box performance and

8:42

latency isn't a P0.

8:44

Um on the other hand, for Tab auto

8:45

complete models in coding, you really

8:48

really care about speed and these uh

8:50

these API calls are so frequent that the

8:52

cost really rack up. And so most Tab

8:54

auto complete models now run on

8:57

sovereign intelligence.

8:58

I work at a cybersecurity company in

9:00

stealth. Alon, I think I saw you

9:02

earlier. Uh that owns its models

9:04

primarily for speed and performance um

9:06

and the ability to post-train the model

9:08

in very bespoke ways.

9:10

Um bio companies are moving that to

9:12

their own models because of the value of

9:14

proprietary data in that space. And so I

9:16

think this is just a useful framework to

9:18

think about which AI capabilities do I

9:21

want to own versus rent?

9:23

Step two, assemble a team.

9:25

I've shown two profiles of labs leaders

9:28

here just as examples.

9:29

Uh Nico comes more from the research

9:31

side of the house having done uh

9:33

research at Apple and then at Google

9:34

Brain.

9:35

Alex comes more from the engineering

9:37

side having held multiple engineering

9:39

roles at Microsoft and then Ramp. And I

9:41

I show this just to say there's multiple

9:43

paths to Nirvana and depending on the

9:45

flavor of research you're going to be

9:46

doing at your company, um whether it's

9:48

going to be more fundamental or applied,

9:50

there are different profiles uh that

9:52

work for a labs leader.

9:54

I also think it's important to think

9:55

about how to design your organization.

9:57

Um traditionally AI teams have

10:00

frequently been organized hub and spoke.

10:02

So you have a single platform team

10:04

supporting different uh different AI

10:06

product uh different application uh

10:09

product teams.

10:10

And what I've seen is that a lot of

10:11

companies are shoehorning this AI

10:13

platform team into doing the sovereign

10:16

AI stuff as well. Um I'd encourage folks

10:19

not to do this.

10:20

Uh

10:21

I'm for encourage people to start from

10:22

scratch here because this fundamentally

10:24

is not a platform services capability.

10:27

You want people that are able to think

10:30

on their feet, think on the frontier,

10:31

and produce frontier level research. And

10:33

it's such a different flavor of research

10:35

and you want them to be playing offense,

10:37

not just servicing teams.

10:39

And so we've seen uh small de novo teams

10:41

get very far here. Harvey, for example,

10:43

has published a ton of research. They

10:45

have just a team of seven. And so start

10:48

small, I'd say start from scratch, um

10:50

consider making it uh your own lab.

10:54

Step three, legibility. I think this is

10:56

totally underestimated in how important

10:58

it is because my guess is a lot of

11:00

people in this room are doing wonderful

11:02

research in-house internally and that

11:04

not all of it is very externally

11:06

legible.

11:07

And Winston Weinberg talked about how

11:09

the responsibility of a CEO is twofold.

11:12

One, drive substantive results, but two,

11:15

control the narrative, control

11:16

legibility around what you're building.

11:18

And I totally agree.

11:20

Um when it comes to owning your AI

11:22

stack, legibility really matters because

11:24

every single buyer right now is choosing

11:26

their AI champion. And so they're trying

11:29

to they're they're getting the same

11:30

pitch over and over again. They're

11:32

trying to discern which vendor is

11:34

sophisticated enough to take me to the

11:35

promised land. Um and you know, they

11:38

want to they want to choose people that

11:39

know what they're doing. Increasingly,

11:41

that means putting out your own

11:42

research. And so, being legible here

11:44

means doing excellent technical

11:46

marketing. Maybe having your own

11:48

separate branded labs or research group.

11:52

Publishing research with high taste. All

11:54

of this matters a lot. I think it goes

11:56

overlooked. And so, um for the all the

11:58

Sequoia companies in this room, I would

11:59

really really push on us to think about

12:01

this.

12:02

And then finally, step four, setting

12:04

your technical roadmap. Um at a high

12:06

level, the uh the rough journey that I

12:08

see companies take and every company

12:10

goes on a different journey, but first

12:11

you set your strategy.

12:13

Um second, defining evals. This is so

12:15

important. Um it is unglamorous work. It

12:18

is not fun work, but the more that you

12:20

do up front, the better positioned you

12:22

are for everything after. And so, I

12:23

think this is a really really crucial to

12:25

get right at the beginning.

12:26

Um next, we see companies starting to

12:28

play with model routers, with harnesses.

12:31

Um some companies find they can get good

12:33

performance with out-of-the-box models.

12:35

Um others are finding strong performance

12:37

gains from post-training, in some rarer

12:40

cases needing to move into mid-training,

12:41

pre-training. And then finally, setting

12:44

that machine up so that live customer

12:46

data is actually creating a feedback

12:48

loop where your model, your

12:50

intelligence, is improving with every

12:51

customer interaction. And so, this is

12:53

the rough journey that I see people go

12:55

on. Um again, every company is very very

12:58

different. And I'd encourage everyone in

13:00

the in the audience today is just

13:01

compare notes with with people around

13:03

you. Everyone is everyone's somewhere on

13:04

this journey.

13:07

The beauty of owning your stack is that

13:09

you can actually drive frontier-level

13:10

performance now. And so, this is

13:12

somewhat new. And in large part, this is

13:14

thanks to the newest open weight models,

13:17

uh especially Kimmy K3 and GLM 52 being

13:21

extremely good. Um because the weights

13:23

are available, they're actually much

13:25

more malleable than working with the

13:27

closed APIs. And so you start with a

13:30

baseline that's already

13:32

close to frontier, and then within with

13:34

a good enough technical roadmap, so with

13:36

strong post-training, prompt harness

13:39

engineering, online learning, you can

13:41

actually reach better than frontier

13:43

performance by owning your stack. And so

13:44

this is new for 2026. I think this is

13:46

very, very important. This is a big part

13:48

of why people are starting to think

13:49

about owning their intelligence.

13:52

Um I like diagrams, and so in an attempt

13:54

to orient us all, here is how I think

13:56

about the stack from an infrastructure

13:58

perspective. On the left-hand side, this

14:00

is production. This is your user-facing

14:02

intelligence. This is the stack that

14:05

drives um every every uh token that your

14:08

user ends up seeing. And fundamentally,

14:10

I think of the production stack as a

14:12

harness on top of a model.

14:14

Alongside that, you have a development

14:16

stack. These are the tools and vendors

14:18

that you use to get your intelligence

14:19

good.

14:20

In the closed model ecosystem, this

14:22

entire stack is very simple. You have

14:24

foundation models like Opus, GPT. Um and

14:27

you have the harnesses that come out of

14:28

the box with each. And you can get quite

14:30

far with the stack, including building

14:32

your own harnesses, prompts, feeding

14:34

contexts into the models, doing your own

14:36

evals. Um but you're not really having

14:38

to collect a ton of data. You're not

14:40

really having to train your own models.

14:42

And so it's much simpler stack. And so

14:44

I'd say this is a higher floor, but it's

14:46

a lower ceiling because you don't

14:47

actually have the ability to take your

14:49

own data, to take online production

14:51

data, and then improve your own

14:52

intelligence.

14:55

The minute that you start to think about

14:57

owning your own intelligence, it is like

14:59

opening a Pandora's Box because that

15:01

beautiful, clean API call is now um

15:04

having to train your own models.

15:06

And so instead of having a single model

15:08

API and some uh good performance out of

15:11

the box, you have to choose a

15:13

open-source base, do a lot of

15:15

post-training on top.

15:17

For your harness, you've got a choice of

15:18

several open harnesses, and then it's up

15:20

to you to configure the harness, the

15:22

logic, the tools, the context uh versus

15:25

taking an agent that just works out of

15:26

the box.

15:28

Um I just on the side here, context is

15:30

really, really important to driving

15:31

performance.

15:32

Um and there's several different flavors

15:34

of context that that that are driving

15:36

these these models. Um a vector database

15:39

like a Turbo puffer, an enterprise

15:41

knowledge graph like a Glean, um open

15:43

source connectors obviously via MCP, um

15:46

and then even novel approaches to

15:48

context. Uh Dan Biederman from N Gram is

15:51

here. Uh they're doing novel research

15:53

around encoding context in in the

15:55

weights themselves. Um so I'd encourage

15:57

anyone that wants to chat about memory

15:58

to go find Dan during one of the breaks.

16:01

Um and then alongside the production

16:03

stack, the development stack becomes way

16:05

more important when you own your own AI.

16:08

You have to carefully monitor evals to

16:10

know how your intelligence measures up

16:12

um and watch how the model performance

16:14

is drifting in production.

16:16

You need a lot of high-quality data

16:18

to post train the models for your

16:19

domain.

16:20

Sometimes this is expert trajectories.

16:23

Uh sometimes it's synthetic data.

16:25

Sometimes it's RL environments.

16:27

And then finally you need to think about

16:28

how to set up online learning for your

16:30

system so that your intelligence gets

16:31

better and better with every single user

16:33

interaction.

16:35

And so the way that we've set up today

16:36

is we've picked a series of technical

16:38

workshops to give you deep dives into

16:40

everything you need to build your own AI

16:42

other than pre-training your own models.

16:44

Uh Lynn from Fireworks is going to lead

16:46

a workshop on post training.

16:48

Harrison from LangChain is going to lead

16:50

a workshop on harnesses and evals.

16:53

Brendan from Mercor is going to lead a

16:55

workshop on RL environments, synthetic

16:57

data, and more. And then finally

16:59

Trajectory is going to lead a workshop

17:01

on online learning.

17:04

And then to bring it all together,

17:05

Harvey's going to lead a workshop on how

17:07

they approach building their entire AI

17:09

stack and strategy. And just yesterday

17:11

they announced Harvey research. You'll

17:13

see that um Um, uh, of their technical

17:16

partners are actually speaking today.

17:18

And so, we've really gone all out to get

17:20

the best possible lineup of speakers

17:21

today, both inside and outside the

17:23

portfolio.

17:25

>> [applause]

Interactive Summary

The video provides an overview of 'Sovereign AI,' defined as companies owning their own AI intelligence and models rather than relying solely on external API providers. The speaker outlines why companies are choosing this path—citing cost, speed, performance, and control as key drivers—and provides a four-step framework for building a proprietary AI stack: strategy, team assembly, legibility, and a technical roadmap involving evals, post-training, and feedback loops. The presentation emphasizes that while using closed models remains valuable for some tasks, building bespoke intelligence allows companies to achieve superior, domain-specific performance.

Suggested questions

3 ready-made prompts