HomeVideos

Work IQ Overview

Now Playing

Work IQ Overview

Transcript

510 segments

0:00

Hey everyone, in this video I want to

0:02

introduce what work IQ is

0:06

and why we would actually use it.

0:10

So if I think about what we're probably

0:12

most used to today.

0:16

What we really focus on a lot of the

0:19

times is the idea of our M365 solutions.

0:24

So if I consider hey great

0:27

M365

0:29

we used to thinking about exchange,

0:32

SharePoint, Teams

0:34

and all that data

0:36

is accessible through the Microsoft

0:39

graph. And also there's data with for

0:41

things like Entra, Intune and more which

0:44

we have long been able to interact with

0:47

programmatically.

0:49

So what we're looking at is the various

0:51

types of data like our email messages, I

0:55

can think about our documents in our

0:58

OneDrive, our SharePoint. We have our

1:01

spreadsheets of data, we have meeting

1:05

transcripts,

1:06

we have chats in Teams.

1:09

We have all these different types of

1:11

data. We also have data that's

1:12

integrated through various types of

1:16

connectors. That's supposed to be a

1:17

puzzle piece.

1:19

Um

1:20

but you have all those Copilot

1:21

connectors.

1:23

And also what it's going to do is

1:25

because of integration with things like

1:27

Entra, it understands certain business

1:30

relationships, hi who my manager is,

1:32

what is the org chart.

1:34

And then for all of this data we protect

1:36

it. There's permissioning, we apply

1:39

sensitivity labels, we have information

1:42

protection.

1:44

And then we had this availability and

1:48

widespread use of generative AI.

1:51

And what that meant is in addition just

1:54

interacting with the graph API to grab a

1:56

document and maybe do sort of keyword

1:59

searches on things. We have to use

2:01

natural language because in natural

2:03

language what is complicated, one word

2:06

can mean many things, many words can

2:08

mean the same thing.

2:10

And so traditional lexical searches when

2:13

you're just looking for that keyword, it

2:14

doesn't meet the need.

2:16

Instead we want to search based on the

2:18

meaning of what we're looking for and

2:21

the meaning of the data we had.

2:24

And so this is where

2:27

the semantic

2:30

index

2:33

came in.

2:34

So these are high-dimensional vectors

2:38

that represent the meaning of data. So

2:41

that's embedding it's called is created

2:44

for all of the different chunks of data

2:47

stored in a semantic index and then when

2:50

I'm looking for something it takes what

2:53

I'm looking for

2:55

and it converts that to an embedding

2:58

that high-dimensional vector and it

3:00

looks for data that really is the

3:03

closest neighbor to it so it has the

3:04

closest meaning.

3:06

And that's how we find data using

3:09

natural language that relates to what

3:11

we're looking for.

3:12

And that semantic index is widely used

3:15

today by M365 Copilot for finding the

3:19

relevant data to ground requests on. And

3:22

it's still checking for the permissions,

3:24

it's checking the sensitivity labels, it

3:26

enforces the same permissions and

3:29

labeling if it goes and creates things.

3:33

But just being able to find the closest

3:35

data

3:36

really isn't enough.

3:39

Because I want to understand how data

3:41

relates to other data, how people relate

3:43

to data, how people relate to other

3:45

people, the rhythm of business.

3:48

That's a completely different set of

3:49

requirements.

3:51

And if you think about all the things I

3:52

just said, it's what we have in our

3:54

brains.

3:55

We have that mapping of okay well these

3:58

this PowerPoint and this Word doc and

3:59

that spreadsheet I know it's about this

4:00

project which relates to that meeting. I

4:02

just had a chat with Bob about that. So

4:05

we have this rich graph of relationships

4:08

and understand the full context. So if I

4:11

want now agentic agents to be able to

4:15

maybe take over certain parts of tasks

4:19

or entire workstreams or help me

4:22

I need AI to be able to have that same

4:25

type of context. And that is work IQ.

4:28

That is the whole goal around it.

4:32

So

4:33

how does this come into play?

4:35

Well firstly when I think about the

4:37

vision for what is work IQ and a caveat,

4:41

not everything I talk about today at

4:43

time of recording is available but it's

4:45

on its way.

4:46

So when I think about the data that is

4:48

in scope of this, absolutely yes the

4:51

M365 data but I'm also going to think

4:54

about things like my Dynamics 365 data.

4:58

I'm going to think about Power Apps.

5:06

I'm going to think about Power BI.

5:11

And kind of those things will grow and

5:13

increase over time. Think of all the

5:15

Copilot connectors of which there are

5:16

hundreds. We have all of these different

5:19

things and ways to bring in data.

5:21

And I can really think of this whole set

5:24

here as our data layer.

5:32

while understanding, while respecting

5:35

all of the data permissions, those data

5:37

sensitivity labels.

5:39

And as I mentioned if I create a doc off

5:41

of data that has a certain sensitivity

5:43

label like highly confidential, the

5:45

output will respect and maintain that

5:47

labeling.

5:48

So this is our data layer, fantastic.

5:52

The next thing we now think about is

5:54

really where this this whole power and

5:56

what's new to what we're used to comes

5:58

in

6:00

is this idea of

6:02

context.

6:04

The inferred understanding which again

6:07

we do in our brains and now I want for

6:10

agents. Now a large part of this is

6:13

memory.

6:15

And this is going to span all of these

6:16

different areas. So we think about this

6:18

context.

6:22

And a huge part is memory.

6:27

And also activity. So the activities

6:32

that is performed. So when I think of

6:34

memory, that's going to persist across

6:37

conversations, across interactions to

6:40

enable

6:42

agents that are using work IQ to have

6:44

very rich context and be able to infer

6:47

information. So think about my chat

6:50

history. Think about the activities I

6:52

perform, what I do in Outlook, tasks I'm

6:55

doing, what happened in meetings, who I

6:58

work with and about what. That is the

7:00

full context. I talked to Jane about

7:03

Office of the CTO core business.

7:06

We are working on this PowerPoint about

7:09

the next field trip.

7:11

And what it's also going to start to

7:13

learn is what are the most talked about

7:15

items between certain parties.

7:17

Which ones have the highest priority?

7:20

What are most meetings about? Well that

7:23

must be a high priority project. So all

7:26

of these different signals get fed into

7:27

this idea of memory. And I can think

7:30

about that as an implicit memory that's

7:32

being built.

7:34

And then I think as time goes on

7:37

relevancy changes. So that memory will

7:40

move with you over time.

7:43

So it will start to say the most recent

7:46

things, well they will have more

7:48

relevance. So it still maintains older

7:51

memories

7:52

but in terms of what it's going to focus

7:54

on with relevance, it's going to be this

7:56

sliding window of the most relevance.

7:59

It's going to rewrite relevance

8:01

as time goes on. So the things I'm doing

8:03

this week

8:05

are likely

8:12

It's going to get even better about the

8:13

things I do over a month period for

8:15

example.

8:17

I can also do explicit memory.

8:21

So I can configure custom instructions

8:23

to tune how it responds. I can ask it to

8:26

remember certain types of things. So I

8:29

can actually say hey remember I like X.

8:32

We can see this. So if I jump over for a

8:34

second

8:36

to here I'm just looking at the work

8:38

Copilot chat experience.

8:40

If I go and look at my settings and look

8:42

at my personalization

8:44

we'll firstly notice

8:47

I can add custom instructions

8:50

for how I want it to respond, how I want

8:52

it to act.

8:54

But it's also got this idea of saved

8:57

memories. These are explicit things I

8:59

have called out

9:01

about how I want it to act.

9:03

So in my case I told it once to remember

9:06

I prefer brief factual responses, I

9:08

don't want a ton of emojis.

9:10

I can delete certain memories, I could

9:13

delete all of them.

9:14

Notice it's also here as thinking about

9:16

hey chat history. We're going to use

9:18

this about personalizing our responses

9:20

as well. So there's this whole concept

9:22

here of memory both explicit and

9:26

implicit.

9:28

And then it's going to use this as part

9:30

of its inferencing because it has a

9:31

real-time understanding of work, of

9:34

actions, of relationships. It's going to

9:36

learn who has specific skills based on

9:39

work patterns. What is the right next

9:42

action?

9:43

It can prompt me

9:45

based on the context it has gathered and

9:49

predict things like who are the people

9:51

I'm most likely going to want to work

9:52

with about something. What is most

9:54

likely file I'm going to want to use. So

9:57

if I jump back over here for a second,

10:00

I could say

10:03

um regarding

10:05

um Mars base, set up a meeting

10:09

with and I just do {slash}

10:13

and it's saying these three people.

10:17

Because these three people

10:20

are the people that have had meetings

10:22

and worked on documents about a Mars

10:25

base. So, it has worked out that

10:26

context.

10:28

I could also go and look at different

10:29

files. So, there's like oh villain

10:31

threat briefings and it's understanding

10:34

the context of exactly what I'm doing to

10:37

help me with the various tasks I want to

10:40

do.

10:41

And the big focus here is this is

10:44

primarily based around

10:46

personal memory.

10:48

There are contexts of maybe larger

10:49

organization, but for the most part this

10:51

is all about personal memory.

10:53

And then there's also this idea

10:56

of business

11:01

understanding.

11:07

And what this is doing is it's really

11:09

building a semantic index

11:12

and ontology

11:16

on top of my Dynamics data, my Power

11:19

Apps Dataverse data, either structured

11:21

data.

11:23

So, it's going to learn and understand

11:24

that structured data as well, which is

11:26

really important. So, I think about I

11:28

want to ask questions about my systems

11:30

of record, my Dynamics 365 sales, my

11:33

Dynamics 365 customer service. Hey, help

11:35

me evaluate issues related to I don't

11:38

know inventory, sales. That will all be

11:41

available as well. That's that complete

11:43

understanding of kind of how we work and

11:46

that state of the business.

11:49

And then what it adds

11:51

as the next layer

11:53

is I can think about this idea

11:57

of skills and tools.

12:00

So, we'll add in

12:02

skills

12:05

tools.

12:10

For example,

12:12

there's a whole layer of fine-tuned

12:15

models that power certain agentic sub

12:18

processes. Think about um there's a

12:21

process optimized for deep search

12:23

retrieval.

12:25

There's one for better fidelity creating

12:27

office documents, creating a meeting,

12:29

many more. They're basically there to

12:31

help the agentic processes have a super

12:33

high fidelity output.

12:36

So, the skills help describe what to do.

12:40

Now, I'm going to do a little

12:41

demonstration. I'm going to show this in

12:43

the chat experience, but I could do

12:45

exactly the same thing in Outlook, for

12:47

example.

12:49

So, I could say here just looking at the

12:51

chat

12:52

um recommend

12:55

how to resolve any conflicts in my

12:58

calendar tomorrow.

13:05

So, this is hooking into Work IQ. It's

13:06

looking into the skills

13:09

and it's understanding.

13:11

So, it's identified various conflicts

13:14

and it's got recommended resolution

13:16

plan. So, hey move or shorten the prep

13:18

time,

13:19

prioritize the kryptonite removal from

13:21

planet. It's a shorter window.

13:23

Maybe I could have partial attendance.

13:26

So, it it's giving me

13:29

options for how I can handle that

13:31

because it understands calendars. It

13:33

understands the options it could do.

13:36

And then hey, do I want to apply these

13:37

changes? It will actually go and make

13:39

those changes for me. That's really the

13:41

whole key point about these sets of

13:44

capabilities.

13:48

I could ask it to draft an executive

13:50

summary of a certain project, highlight

13:52

the purpose, the progress, the

13:53

implications.

13:55

I can in PowerPoint maybe ask it to

13:59

create a slide summary. In fact, let's

14:01

go and do that one. So, if I go over

14:03

here again, actually this time I'll go

14:04

into PowerPoint. Again, I could use the

14:06

local app,

14:08

but I've opened up

14:10

Copilot

14:11

in PowerPoint.

14:14

So, I might say create a single slide

14:17

summary

14:19

of my Word

14:21

document

14:23

related to a hero base on Mars.

14:32

So, now is it's working out

14:35

okay, how to find the right Word

14:36

document, i.e. the the full context and

14:39

inference. It's checking here and it's

14:41

put the most likely one at the top. So,

14:43

I'm just going to confirm that is the

14:45

right document.

14:49

Then it might give me some other options

14:50

maybe about style I want to do and other

14:52

stuff. And then it will go ahead and

14:55

create the content.

15:00

I'm just going to skip this. I don't

15:01

care about the format.

15:03

So, now it's going to review the Word

15:04

document.

15:05

It's going to inference based on what it

15:08

believes is the most important points

15:11

from it.

15:12

And then it can use its skills

15:15

to create that very high fidelity new

15:18

slide in this case and add it to my

15:21

deck.

15:29

Okay, so it's finished and well,

15:32

a nice one-slide summary

15:35

of the top five considerations for my

15:39

base on Mars for my superheroes. It

15:41

doesn't seem

15:43

um

15:44

totally convinced it's a good idea, but

15:46

hey, whatever.

15:49

I can ask it other things. Hey, I've got

15:51

to sync with some person, prep me using

15:54

our last two one-on-one meeting

15:55

transcripts, the latest version of this

15:57

product overview. Give me a crisp

15:59

agenda, three specific things I should

16:01

update them on and two tough questions I

16:03

should ask to ensure we stay on track.

16:05

So, it's all about really

16:07

massive amounts of context and

16:10

capabilities to hook into many different

16:13

things to help me have the best

16:14

experience. And then for tooling, I'm

16:17

hooking into MCP server tools, APIs,

16:19

plugins, agent flows, Power Automate.

16:23

So, tools do the work.

16:26

And I can bring my own tools. These are

16:27

going to evolve over time.

16:31

And then I think about this and I've

16:32

tried to sort of demonstrate this. All

16:34

of these

16:36

are then getting used by the various

16:39

experiences.

16:44

So, obviously we think about M365,

16:47

the Copilots there, Dynamics 365.

16:53

Your own agents though. So, the whole

16:55

point here is we have this idea of the

16:58

Work IQ API.

17:02

So, everything I'm doing here around

17:06

everything,

17:07

I can create my own agents.

17:09

Copilot Studio, Microsoft Foundry and I

17:11

can have GitHub Copilot helping me do it

17:13

but other platforms as well.

17:15

Now, I already did a separate video on

17:17

using Work IQ with GitHub Copilot CLI,

17:20

so you could check that out in detail,

17:23

but just to give you a super quick idea

17:26

of just directly hooking in via the Work

17:28

IQ API.

17:32

So, I'm going to fire up Copilot.

17:35

It's going to automatically load in the

17:38

Work IQ

17:39

plugin and skill because I've already

17:42

configured that for the environment. And

17:44

I'm just going to ask it to do

17:45

something.

17:46

So,

17:47

schedule a meeting with Clark

17:52

next Tuesday

17:54

to discuss Mars

17:57

base.

18:00

And it will work out that okay, I need

18:02

to use the Work IQ skill. You can see

18:05

it's doing that already because it's

18:07

about calendar appointments.

18:11

Then it's asking it hey, I want to

18:13

schedule a meeting with Clark. It's

18:15

worked out the date.

18:17

And then it's going to go ahead and

18:18

actually schedule that meeting with Work

18:20

IQ. So, this is just using the Work IQ

18:24

API from outside the standard kind of

18:28

M365 experiences or the chat.

18:34

And hey, I could then carry on.

18:36

Let me know if you need any adjustments

18:39

and it will go and do all of that.

18:41

So, that's just another example of how

18:43

we can

18:45

leverage it.

18:48

And then on top of this,

18:50

>> [laughter]

18:50

>> the whole big

18:52

set of capabilities is going to grow

18:54

over time,

18:55

but we have multiple models. So, all of

18:59

these different things it is

19:02

multimodal.

19:04

So, yes, we obviously think about the

19:06

Open AI models.

19:08

We think about the Anthropic

19:13

models. There's There's others as well.

19:16

And over time, hey,

19:19

the

19:21

the best models to use for a certain

19:22

type of hey, long reasoning cycle or

19:26

really quick interaction is going to

19:28

change. Today, the time of recording,

19:30

Copilot co-work is made possible by late

19:33

2025. There are now very complex

19:36

reasoning models that can reason for a

19:37

really long time, i.e. multiple days

19:39

before going off the rails, but they're

19:41

100% going to change over time and 100%

19:44

it's not just one right model.

19:47

Different models are good for different

19:48

sets of circumstances.

19:51

And really the the key point here is

19:54

that as I obviously I'm going to create

19:56

agents.

19:58

That's the whole goal of all of this.

20:01

We have agents

20:06

that are going to

20:07

work autonomously

20:09

or even provide assistance

20:12

without context

20:14

they're really limited to what they can

20:16

do. So Work IQ supplies that full

20:21

context of how we work, our data. When I

20:25

build in Copilot Studio, I just get all

20:26

this automatically.

20:28

And yes, this is part of the Microsoft

20:32

experiences, but now you can bring it to

20:34

your own agents.

20:37

So how I work is available to any of the

20:40

agentic capabilities you choose to do.

20:42

Now, as I mentioned again, not

20:44

everything is here at the time of

20:46

recording, but hey, it it's coming in

20:49

the next couple of months if it's not

20:50

there today.

20:51

So go ahead, go and play.

20:54

Uh go and light up your agents to

20:57

maximize what they can do

21:00

by using Work IQ for that full how we do

21:04

business, how we work, and then

21:06

obviously Foundry IQ

21:10

for that exposure and usage of

21:12

institutional knowledge, Fabric IQ, hey,

21:15

the state of your business. So all those

21:16

things together is that complete 360 of

21:20

how my organization functions. I hope

21:22

that was useful. Till next video, take

21:23

care.

Interactive Summary

The video introduces Work IQ, a system designed to provide AI agents with a comprehensive understanding of how individuals and organizations work, going beyond simple data retrieval. It explains that Work IQ integrates with M365, Dynamics 365, Power Apps, and Power BI, respecting data permissions and sensitivity labels. A key component is the 'context' layer, which includes implicit and explicit memory of user activities, conversations, and preferences, as well as business understanding derived from structured data. Work IQ also incorporates a layer of 'skills and tools,' which are fine-tuned models and external integrations that enable agents to perform specific tasks with high fidelity. The video demonstrates Work IQ's capabilities through examples like resolving calendar conflicts, drafting executive summaries, creating PowerPoint slides from documents, and scheduling meetings via the Work IQ API with tools like GitHub Copilot. The ultimate goal is to empower AI agents with the full context of work to enable autonomous actions or assistance, making them more effective and versatile.

Suggested questions

7 ready-made prompts