HomeVideos

How BharatGen is building India AI with NVIDIA Nemotron

Now Playing

How BharatGen is building India AI with NVIDIA Nemotron

Transcript

71 segments

0:06

The seeds were sown through a consortium of academic institutions.

0:11

IIT Bombay took the lead,

0:12

we went through a call for proposals

0:14

and we were selected to build

0:16

the small models up to 10 billion parameters,

0:19

with 235 crore funding,

0:22

over a period of two years.

0:23

We applied to the India AI Mission,

0:25

for building models up to 1 trillion parameters.

0:28

The proposal was looked upon very favorably,

0:31

and the whole initiative grew into,

0:33

completely government owned section

0:36

We just had a whole bunch of models

0:39

launched with the honorable PM,

0:41

multilingual across 12 languages, the speech models

0:43

and 22 languages, text models,

0:46

and we're very happy with the collaborations

0:47

that have also grown around this.

0:49

With hospitals,

0:50

with state governments,

0:51

with the several line departments

0:54

and departments of water and sanitation,

0:56

How can we use our workload?

0:58

with healthcare making it easily comprehensible by the patient,

0:58

with healthcare making it easily comprehensible by the patient,

1:02

making it possible for an ordinary person to learn other languages

1:06

and communicate in that language.

1:08

I saw so many interesting use cases of GyanBharatam for example.

1:11

There have been lots of interesting engagement with finance sector as well,

1:14

and even in the government space, education is a huge potential.

1:20

Work we been doing with Kotak Education Foundation and spoken tutorials.

1:23

Giving them both co-pilots,

1:25

that will help them converse better

1:27

and be more effective in their assessments.

1:29

So we use them as catalysts, as very good learning points.

1:33

NVIDIA has been a solid partner in that entire journey.

1:36

We went through many cycles.

1:37

We started Megatron, Nemotron.

1:40

We did find a very healthy

1:41

ecosystem building around Nemotron

1:43

So we are grateful for that, especially on the pre-training and post-training part.

1:47

You know, open source, which is what NVIDIA stands for, right?

1:50

Open source is not just the code,

1:54

but is also the dialog.

1:55

We are very grateful to NVIDIA for helping us scale our model to multiple nodes.

2:00

But again, it's not just scaling to multiple nodes.

2:02

How is it being scaled?

2:03

How do you maintain good efficiency and throughput.

2:06

So observability comes very handy there.

2:09

The development, flexibility and scalability

2:11

has been very important

2:14

learning for us in our journey together with NVIDIA.

2:17

The BCM and Slurm,

2:19

via NCP,

2:21

Nemo 2.0 for the pre-training,

2:24

NemoRL for the post training

2:26

are very specific examples of how we have leveraged

2:29

the open source ecosystem that NVIDIA has been creating

2:33

and while that is very important in terms of training,

2:37

there's also other important aspect,

2:39

which is inference.

2:40

We are in conversations with NVIDIA on how we could do the inference.

2:43

We'll continue working together,

2:45

build large models.

2:46

Anyone who stands for open source is,

2:48

partner for life.

2:49

So we like to work with NVIDIA’s open source initiatives.

2:52

And as I said,

2:53

it triggers both in-house capability,

2:56

avoids re-invention of it.

2:57

And I think contributes to the community as a whole.

Interactive Summary

The video highlights the collaboration between IIT Bombay and NVIDIA under the India AI Mission to develop multilingual AI models. It covers the journey from building small-scale models to scaling up to 1 trillion parameters, emphasizing real-world applications in healthcare, education, and finance. The partnership focuses on leveraging NVIDIA’s open-source ecosystem, particularly tools like Megatron, Nemotron, and Nemo, to ensure efficient model training, scalability, and future inference capabilities.

Suggested questions

3 ready-made prompts