HomeVideos

Enterprise Deep Research: The Next Killer App for Enterprise AI — Ofer Mendelevitch, Vectara

Now Playing

Enterprise Deep Research: The Next Killer App for Enterprise AI — Ofer Mendelevitch, Vectara

Transcript

135 segments

0:04

Hi, I'm Offer from Victara. At Victara,

0:07

we developed a trustworthy agent

0:09

operating system. And there's a lot of

0:11

really cool use cases with this like

0:13

document generation, conversational AI

0:16

or chat bots, either internal or

0:19

external, and enterprise deep research,

0:21

which I'm going to talk about today. But

0:23

before I jump into Enterprise Deep

0:25

Research, let me tell you a little bit

0:27

more about our operating system for

0:29

agents. First of all, it's a SAS

0:32

platform, but also runs on your own VPC

0:34

or on premise in your own data center.

0:38

And here's some of the main features

0:39

that we really are proud of. We have

0:43

very advanced multimodal injust to

0:45

support images, tables in a way that

0:49

makes them, you know, findable and

0:51

retrieved to be able to make sense of

0:53

them in a in a rag or a gentic rag

0:55

workflow. Very strong focus on again

0:58

retrieval accuracy with hybrid

1:00

retrieval, lots of features around

1:02

metadata, reranking, etc. And then we're

1:06

we're kind of known for a lot of work

1:08

around hallucination mitigation, both

1:10

hallucination detection and correction.

1:12

In fact, our hallucination detection

1:15

model, also called HHM,

1:18

has just passed 5 mill downloads about

1:21

couple months ago. I think it's at 5.5

1:23

right now or something like that. And

1:25

generally our our operating system

1:28

platform is what you would need for

1:30

enterprisegrade deployment. So security,

1:33

role- based access controls, bring your

1:35

own model, custom prompts,

1:37

observability, monitoring, everything

1:39

you would need.

1:41

So

1:42

why does this matter? Well, in any

1:45

generative AI application, an enterprise

1:47

deep research is no different.

1:49

Hallucinations are still a problem and

1:51

you want to base your applications on

1:54

really robust information. In fact, this

1:58

is a statistics that shows that about

2:00

73% of LM customers implementing use

2:05

cases say that factual accuracy is their

2:07

top challenge right now. So that's why

2:09

we spend so much time in hallucination

2:11

mitigation which enables enterprise deep

2:14

research at really high quality.

2:17

Okay, so with that in mind, let me jump

2:19

into what is deep research. Deep

2:21

research itself is something many of you

2:23

probably know already. It's when an AI

2:25

agent conducts indepth multi-step

2:28

investigation,

2:30

usually by autonomously browsing or

2:33

searching the web in some way, getting

2:35

results, synthesizing all these results

2:38

together to generate a comprehensive

2:40

report for you with citations and all

2:42

the information you need to answer a

2:44

particular question. Many have

2:46

implemented this sort of web- based deep

2:48

research. Gemini or Google has that chat

2:51

GPT anthropic perplexity etc. Here's an

2:55

example what it looks like. If you

2:56

haven't used it, I highly encourage you

2:57

to use it. It's a very powerful tool.

2:59

And I use this all the time. This is the

3:01

screenshot of how you choose it in

3:03

Gemini, for example. And here's how you

3:04

choose it in Chat GPT. And this is

3:07

usually something that takes about, you

3:08

know, 20 30 minutes to complete because

3:10

it does a lot of work underneath the

3:12

covers.

3:14

Now, enterprise deep research, think

3:16

about it as exactly the same idea only

3:19

now it goes to your private data. So

3:22

again the same process multi- aent with

3:25

reflection with synthesis of the final

3:28

results parallel execution of of agents

3:30

underneath and it queries your

3:32

enterprise data of course using in this

3:34

case victarogentic rank capabilities

3:37

with all the bells and whistles of high

3:39

accuracy and hallucination mitigation

3:42

and then we have corpus understanding

3:44

which allows you to plan properly based

3:46

on your data.

3:49

There are many really amazing use cases

3:51

for this and I'm going to just mention a

3:53

few here that I like. One is responding

3:56

to an RFP. I've had this in my career

3:59

multiple times when you have to respond

4:00

to an RFP and getting the answers to 150

4:04

questions is really difficult. So having

4:07

being able to use enterprise deep

4:09

research to go through all of your

4:10

enterprise data sets, picking up the

4:12

right documents and answering those

4:14

questions is a really cool use case.

4:17

Employee on boarding is this idea of if

4:19

you come to a new team or you join a new

4:21

company and a company wants to onboard

4:23

you quickly, it's usually very

4:25

difficult. Nobody knows what's going on.

4:28

There's no like onboarding guide. The

4:31

last one was generated three years ago

4:32

and it's not up to date etc. So again

4:35

being able to generate a ondemand

4:38

onboarding guide using all the

4:40

documentation we have on Jira or on

4:43

notion or Google Drive or SharePoint.

4:46

very very powerful.

4:48

And then in different industries there's

4:50

also different use cases. For example,

4:51

in financial services you might have the

4:54

generation of an investment memo as a

4:56

really cool use case. And you can

4:57

imagine the same thing in healthcare, in

4:59

insurance and other industries as well.

5:02

So those are some of the use cases.

5:04

There's a lot more I'm offering. You can

5:06

connect with me here in the links I'm

5:08

showing below. And if you are interested

5:10

to learn more about Victara and

5:12

enterprise deep research, please contact

5:14

us and we'll happy to to do a demo for

5:17

you. Thanks very much.

Interactive Summary

Offer from Victara introduces their agent operating system, designed for enterprise-grade generative AI applications. The platform focuses on retrieval accuracy, hallucination mitigation, and secure deployment. A key feature discussed is 'Enterprise Deep Research,' which extends the capabilities of traditional web-based deep research by enabling AI agents to autonomously query and synthesize information from an organization's private, internal data sources, with practical applications in RFP responses, employee onboarding, and industry-specific documentation.

Suggested questions

3 ready-made prompts