HomeVideos

Work IQ Overview

Now Playing

Work IQ Overview

Transcript

510 segments

0:00

Hey everyone, in this video I want to

0:02

introduce what work IQ is

0:06

and why we would actually use it.

0:10

So if I think about what we're probably

0:12

most used to today.

0:16

What we really focus on a lot of the

0:19

times is the idea of our M365 solutions.

0:24

So if I consider hey great

0:27

M365

0:29

we used to thinking about exchange,

0:32

SharePoint, Teams

0:34

and all that data

0:36

is accessible through the Microsoft

0:39

graph. And also there's data with for

0:41

things like Entra, Intune and more which

0:44

we have long been able to interact with

0:47

programmatically.

0:49

So what we're looking at is the various

0:51

types of data like our email messages, I

0:55

can think about our documents in our

0:58

OneDrive, our SharePoint. We have our

1:01

spreadsheets of data, we have meeting

1:05

transcripts,

1:06

we have chats in Teams.

1:09

We have all these different types of

1:11

data. We also have data that's

1:12

integrated through various types of

1:16

connectors. That's supposed to be a

1:17

puzzle piece.

1:19

Um

1:20

but you have all those Copilot

1:21

connectors.

1:23

And also what it's going to do is

1:25

because of integration with things like

1:27

Entra, it understands certain business

1:30

relationships, hi who my manager is,

1:32

what is the org chart.

1:34

And then for all of this data we protect

1:36

it. There's permissioning, we apply

1:39

sensitivity labels, we have information

1:42

protection.

1:44

And then we had this availability and

1:48

widespread use of generative AI.

1:51

And what that meant is in addition just

1:54

interacting with the graph API to grab a

1:56

document and maybe do sort of keyword

1:59

searches on things. We have to use

2:01

natural language because in natural

2:03

language what is complicated, one word

2:06

can mean many things, many words can

2:08

mean the same thing.

2:10

And so traditional lexical searches when

2:13

you're just looking for that keyword, it

2:14

doesn't meet the need.

2:16

Instead we want to search based on the

2:18

meaning of what we're looking for and

2:21

the meaning of the data we had.

2:24

And so this is where

2:27

the semantic

2:30

index

2:33

came in.

2:34

So these are high-dimensional vectors

2:38

that represent the meaning of data. So

2:41

that's embedding it's called is created

2:44

for all of the different chunks of data

2:47

stored in a semantic index and then when

2:50

I'm looking for something it takes what

2:53

I'm looking for

2:55

and it converts that to an embedding

2:58

that high-dimensional vector and it

3:00

looks for data that really is the

3:03

closest neighbor to it so it has the

3:04

closest meaning.

3:06

And that's how we find data using

3:09

natural language that relates to what

3:11

we're looking for.

3:12

And that semantic index is widely used

3:15

today by M365 Copilot for finding the

3:19

relevant data to ground requests on. And

3:22

it's still checking for the permissions,

3:24

it's checking the sensitivity labels, it

3:26

enforces the same permissions and

3:29

labeling if it goes and creates things.

3:33

But just being able to find the closest

3:35

data

3:36

really isn't enough.

3:39

Because I want to understand how data

3:41

relates to other data, how people relate

3:43

to data, how people relate to other

3:45

people, the rhythm of business.

3:48

That's a completely different set of

3:49

requirements.

3:51

And if you think about all the things I

3:52

just said, it's what we have in our

3:54

brains.

3:55

We have that mapping of okay well these

3:58

this PowerPoint and this Word doc and

3:59

that spreadsheet I know it's about this

4:00

project which relates to that meeting. I

4:02

just had a chat with Bob about that. So

4:05

we have this rich graph of relationships

4:08

and understand the full context. So if I

4:11

want now agentic agents to be able to

4:15

maybe take over certain parts of tasks

4:19

or entire workstreams or help me

4:22

I need AI to be able to have that same

4:25

type of context. And that is work IQ.

4:28

That is the whole goal around it.

4:32

So

4:33

how does this come into play?

4:35

Well firstly when I think about the

4:37

vision for what is work IQ and a caveat,

4:41

not everything I talk about today at

4:43

time of recording is available but it's

4:45

on its way.

4:46

So when I think about the data that is

4:48

in scope of this, absolutely yes the

4:51

M365 data but I'm also going to think

4:54

about things like my Dynamics 365 data.

4:58

I'm going to think about Power Apps.

5:06

I'm going to think about Power BI.

5:11

And kind of those things will grow and

5:13

increase over time. Think of all the

5:15

Copilot connectors of which there are

5:16

hundreds. We have all of these different

5:19

things and ways to bring in data.

5:21

And I can really think of this whole set

5:24

here as our data layer.

5:32

while understanding, while respecting

5:35

all of the data permissions, those data

5:37

sensitivity labels.

5:39

And as I mentioned if I create a doc off

5:41

of data that has a certain sensitivity

5:43

label like highly confidential, the

5:45

output will respect and maintain that

5:47

labeling.

5:48

So this is our data layer, fantastic.

5:52

The next thing we now think about is

5:54

really where this this whole power and

5:56

what's new to what we're used to comes

5:58

in

6:00

is this idea of

6:02

context.

6:04

The inferred understanding which again

6:07

we do in our brains and now I want for

6:10

agents. Now a large part of this is

6:13

memory.

6:15

And this is going to span all of these

6:16

different areas. So we think about this

6:18

context.

6:22

And a huge part is memory.

6:27

And also activity. So the activities

6:32

that is performed. So when I think of

6:34

memory, that's going to persist across

6:37

conversations, across interactions to

6:40

enable

6:42

agents that are using work IQ to have

6:44

very rich context and be able to infer

6:47

information. So think about my chat

6:50

history. Think about the activities I

6:52

perform, what I do in Outlook, tasks I'm

6:55

doing, what happened in meetings, who I

6:58

work with and about what. That is the

7:00

full context. I talked to Jane about

7:03

Office of the CTO core business.

7:06

We are working on this PowerPoint about

7:09

the next field trip.

7:11

And what it's also going to start to

7:13

learn is what are the most talked about

7:15

items between certain parties.

7:17

Which ones have the highest priority?

7:20

What are most meetings about? Well that

7:23

must be a high priority project. So all

7:26

of these different signals get fed into

7:27

this idea of memory. And I can think

7:30

about that as an implicit memory that's

7:32

being built.

7:34

And then I think as time goes on

7:37

relevancy changes. So that memory will

7:40

move with you over time.

7:43

So it will start to say the most recent

7:46

things, well they will have more

7:48

relevance. So it still maintains older

7:51

memories

7:52

but in terms of what it's going to focus

7:54

on with relevance, it's going to be this

7:56

sliding window of the most relevance.

7:59

It's going to rewrite relevance

8:01

as time goes on. So the things I'm doing

8:03

this week

8:05

are likely

8:12

It's going to get even better about the

8:13

things I do over a month period for

8:15

example.

8:17

I can also do explicit memory.

8:21

So I can configure custom instructions

8:23

to tune how it responds. I can ask it to

8:26

remember certain types of things. So I

8:29

can actually say hey remember I like X.

8:32

We can see this. So if I jump over for a

8:34

second

8:36

to here I'm just looking at the work

8:38

Copilot chat experience.

8:40

If I go and look at my settings and look

8:42

at my personalization

8:44

we'll firstly notice

8:47

I can add custom instructions

8:50

for how I want it to respond, how I want

8:52

it to act.

8:54

But it's also got this idea of saved

8:57

memories. These are explicit things I

8:59

have called out

9:01

about how I want it to act.

9:03

So in my case I told it once to remember

9:06

I prefer brief factual responses, I

9:08

don't want a ton of emojis.

9:10

I can delete certain memories, I could

9:13

delete all of them.

9:14

Notice it's also here as thinking about

9:16

hey chat history. We're going to use

9:18

this about personalizing our responses

9:20

as well. So there's this whole concept

9:22

here of memory both explicit and

9:26

implicit.

9:28

And then it's going to use this as part

9:30

of its inferencing because it has a

9:31

real-time understanding of work, of

9:34

actions, of relationships. It's going to

9:36

learn who has specific skills based on

9:39

work patterns. What is the right next

9:42

action?

9:43

It can prompt me

9:45

based on the context it has gathered and

9:49

predict things like who are the people

9:51

I'm most likely going to want to work

9:52

with about something. What is most

9:54

likely file I'm going to want to use. So

9:57

if I jump back over here for a second,

10:00

I could say

10:03

um regarding

10:05

um Mars base, set up a meeting

10:09

with and I just do {slash}

10:13

and it's saying these three people.

10:17

Because these three people

10:20

are the people that have had meetings

10:22

and worked on documents about a Mars

10:25

base. So, it has worked out that

10:26

context.

10:28

I could also go and look at different

10:29

files. So, there's like oh villain

10:31

threat briefings and it's understanding

10:34

the context of exactly what I'm doing to

10:37

help me with the various tasks I want to

10:40

do.

10:41

And the big focus here is this is

10:44

primarily based around

10:46

personal memory.

10:48

There are contexts of maybe larger

10:49

organization, but for the most part this

10:51

is all about personal memory.

10:53

And then there's also this idea

10:56

of business

11:01

understanding.

11:07

And what this is doing is it's really

11:09

building a semantic index

11:12

and ontology

11:16

on top of my Dynamics data, my Power

11:19

Apps Dataverse data, either structured

11:21

data.

11:23

So, it's going to learn and understand

11:24

that structured data as well, which is

11:26

really important. So, I think about I

11:28

want to ask questions about my systems

11:30

of record, my Dynamics 365 sales, my

11:33

Dynamics 365 customer service. Hey, help

11:35

me evaluate issues related to I don't

11:38

know inventory, sales. That will all be

11:41

available as well. That's that complete

11:43

understanding of kind of how we work and

11:46

that state of the business.

11:49

And then what it adds

11:51

as the next layer

11:53

is I can think about this idea

11:57

of skills and tools.

12:00

So, we'll add in

12:02

skills

12:05

tools.

12:10

For example,

12:12

there's a whole layer of fine-tuned

12:15

models that power certain agentic sub

12:18

processes. Think about um there's a

12:21

process optimized for deep search

12:23

retrieval.

12:25

There's one for better fidelity creating

12:27

office documents, creating a meeting,

12:29

many more. They're basically there to

12:31

help the agentic processes have a super

12:33

high fidelity output.

12:36

So, the skills help describe what to do.

12:40

Now, I'm going to do a little

12:41

demonstration. I'm going to show this in

12:43

the chat experience, but I could do

12:45

exactly the same thing in Outlook, for

12:47

example.

12:49

So, I could say here just looking at the

12:51

chat

12:52

um recommend

12:55

how to resolve any conflicts in my

12:58

calendar tomorrow.

13:05

So, this is hooking into Work IQ. It's

13:06

looking into the skills

13:09

and it's understanding.

13:11

So, it's identified various conflicts

13:14

and it's got recommended resolution

13:16

plan. So, hey move or shorten the prep

13:18

time,

13:19

prioritize the kryptonite removal from

13:21

planet. It's a shorter window.

13:23

Maybe I could have partial attendance.

13:26

So, it it's giving me

13:29

options for how I can handle that

13:31

because it understands calendars. It

13:33

understands the options it could do.

13:36

And then hey, do I want to apply these

13:37

changes? It will actually go and make

13:39

those changes for me. That's really the

13:41

whole key point about these sets of

13:44

capabilities.

13:48

I could ask it to draft an executive

13:50

summary of a certain project, highlight

13:52

the purpose, the progress, the

13:53

implications.

13:55

I can in PowerPoint maybe ask it to

13:59

create a slide summary. In fact, let's

14:01

go and do that one. So, if I go over

14:03

here again, actually this time I'll go

14:04

into PowerPoint. Again, I could use the

14:06

local app,

14:08

but I've opened up

14:10

Copilot

14:11

in PowerPoint.

14:14

So, I might say create a single slide

14:17

summary

14:19

of my Word

14:21

document

14:23

related to a hero base on Mars.

14:32

So, now is it's working out

14:35

okay, how to find the right Word

14:36

document, i.e. the the full context and

14:39

inference. It's checking here and it's

14:41

put the most likely one at the top. So,

14:43

I'm just going to confirm that is the

14:45

right document.

14:49

Then it might give me some other options

14:50

maybe about style I want to do and other

14:52

stuff. And then it will go ahead and

14:55

create the content.

15:00

I'm just going to skip this. I don't

15:01

care about the format.

15:03

So, now it's going to review the Word

15:04

document.

15:05

It's going to inference based on what it

15:08

believes is the most important points

15:11

from it.

15:12

And then it can use its skills

15:15

to create that very high fidelity new

15:18

slide in this case and add it to my

15:21

deck.

15:29

Okay, so it's finished and well,

15:32

a nice one-slide summary

15:35

of the top five considerations for my

15:39

base on Mars for my superheroes. It

15:41

doesn't seem

15:43

um

15:44

totally convinced it's a good idea, but

15:46

hey, whatever.

15:49

I can ask it other things. Hey, I've got

15:51

to sync with some person, prep me using

15:54

our last two one-on-one meeting

15:55

transcripts, the latest version of this

15:57

product overview. Give me a crisp

15:59

agenda, three specific things I should

16:01

update them on and two tough questions I

16:03

should ask to ensure we stay on track.

16:05

So, it's all about really

16:07

massive amounts of context and

16:10

capabilities to hook into many different

16:13

things to help me have the best

16:14

experience. And then for tooling, I'm

16:17

hooking into MCP server tools, APIs,

16:19

plugins, agent flows, Power Automate.

16:23

So, tools do the work.

16:26

And I can bring my own tools. These are

16:27

going to evolve over time.

16:31

And then I think about this and I've

16:32

tried to sort of demonstrate this. All

16:34

of these

16:36

are then getting used by the various

16:39

experiences.

16:44

So, obviously we think about M365,

16:47

the Copilots there, Dynamics 365.

16:53

Your own agents though. So, the whole

16:55

point here is we have this idea of the

16:58

Work IQ API.

17:02

So, everything I'm doing here around

17:06

everything,

17:07

I can create my own agents.

17:09

Copilot Studio, Microsoft Foundry and I

17:11

can have GitHub Copilot helping me do it

17:13

but other platforms as well.

17:15

Now, I already did a separate video on

17:17

using Work IQ with GitHub Copilot CLI,

17:20

so you could check that out in detail,

17:23

but just to give you a super quick idea

17:26

of just directly hooking in via the Work

17:28

IQ API.

17:32

So, I'm going to fire up Copilot.

17:35

It's going to automatically load in the

17:38

Work IQ

17:39

plugin and skill because I've already

17:42

configured that for the environment. And

17:44

I'm just going to ask it to do

17:45

something.

17:46

So,

17:47

schedule a meeting with Clark

17:52

next Tuesday

17:54

to discuss Mars

17:57

base.

18:00

And it will work out that okay, I need

18:02

to use the Work IQ skill. You can see

18:05

it's doing that already because it's

18:07

about calendar appointments.

18:11

Then it's asking it hey, I want to

18:13

schedule a meeting with Clark. It's

18:15

worked out the date.

18:17

And then it's going to go ahead and

18:18

actually schedule that meeting with Work

18:20

IQ. So, this is just using the Work IQ

18:24

API from outside the standard kind of

18:28

M365 experiences or the chat.

18:34

And hey, I could then carry on.

18:36

Let me know if you need any adjustments

18:39

and it will go and do all of that.

18:41

So, that's just another example of how

18:43

we can

18:45

leverage it.

18:48

And then on top of this,

18:50

>> [laughter]

18:50

>> the whole big

18:52

set of capabilities is going to grow

18:54

over time,

18:55

but we have multiple models. So, all of

18:59

these different things it is

19:02

multimodal.

19:04

So, yes, we obviously think about the

19:06

Open AI models.

19:08

We think about the Anthropic

19:13

models. There's There's others as well.

19:16

And over time, hey,

19:19

the

19:21

the best models to use for a certain

19:22

type of hey, long reasoning cycle or

19:26

really quick interaction is going to

19:28

change. Today, the time of recording,

19:30

Copilot co-work is made possible by late

19:33

2025. There are now very complex

19:36

reasoning models that can reason for a

19:37

really long time, i.e. multiple days

19:39

before going off the rails, but they're

19:41

100% going to change over time and 100%

19:44

it's not just one right model.

19:47

Different models are good for different

19:48

sets of circumstances.

19:51

And really the the key point here is

19:54

that as I obviously I'm going to create

19:56

agents.

19:58

That's the whole goal of all of this.

20:01

We have agents

20:06

that are going to

20:07

work autonomously

20:09

or even provide assistance

20:12

without context

20:14

they're really limited to what they can

20:16

do. So Work IQ supplies that full

20:21

context of how we work, our data. When I

20:25

build in Copilot Studio, I just get all

20:26

this automatically.

20:28

And yes, this is part of the Microsoft

20:32

experiences, but now you can bring it to

20:34

your own agents.

20:37

So how I work is available to any of the

20:40

agentic capabilities you choose to do.

20:42

Now, as I mentioned again, not

20:44

everything is here at the time of

20:46

recording, but hey, it it's coming in

20:49

the next couple of months if it's not

20:50

there today.

20:51

So go ahead, go and play.

20:54

Uh go and light up your agents to

20:57

maximize what they can do

21:00

by using Work IQ for that full how we do

21:04

business, how we work, and then

21:06

obviously Foundry IQ

21:10

for that exposure and usage of

21:12

institutional knowledge, Fabric IQ, hey,

21:15

the state of your business. So all those

21:16

things together is that complete 360 of

21:20

how my organization functions. I hope

21:22

that was useful. Till next video, take

21:23

care.

Interactive Summary

Loading summary...