HomeVideos

Stop Paying for AI: 5 Best FREE API Endpoints for Developers

Now Playing

Stop Paying for AI: 5 Best FREE API Endpoints for Developers

Transcript

97 segments

0:00

Hey guys, we are back with another

0:02

video. This time I will be going through

0:05

some free ways to hit API endpoints

0:09

using things such as Mistral, Google

0:12

API, hugging face, a few different

0:15

things. Uh, previously I made a video

0:17

about how to use the hugging face free

0:19

API backend. Of course, all these do

0:22

have limits, but this is enough to at

0:23

least get you started if you want to

0:25

test some of your MCP servers and

0:28

different other things. Uh, I apologize

0:30

for my voice. I'm coming off an illness

0:32

this past week. So, hopefully at least

0:34

this audio is coming through clear

0:36

enough for you to get the point and I

0:38

should be back to 100% pretty soon. So,

0:40

we are back in the home lab. I have my

0:42

new Orange Pi 6 Plus running very well

0:46

in the Kubernetes cluster. I plan to

0:48

also make a video on that. If I jump

0:51

over here into Open Web UI, I have quite

0:53

a few Open AI API connections set up.

0:57

I'm going to go through each of these

0:59

and also show you how to get these set

1:01

up. So, starting off towards the top

1:04

here, this is the Google API, which is

1:07

very easy to get set up. If you go into

1:09

Google AI studio, get API key, and then

1:12

you can generate your own. As you can

1:15

see here, I have the free tier. It does

1:17

have a limit uh but it's fairly generous

1:19

in my testing. So, you can do a lot of

1:22

testing with that. Uh coming back, we

1:24

also have this local endpoint and I will

1:29

post the link to the other video that

1:31

talks about this, but essentially this

1:33

one is running off of my local machine,

1:37

my local laptop. It's just a simple

1:39

Python wrapper that exposes the NPU that

1:42

I have. So if you have one of these

1:44

newer Intel Ultra processors that has

1:47

the built-in NPU, you can leverage it

1:49

with this application that I built. It

1:52

doesn't allow you to have super powerful

1:55

models depending on your computer. Uh

1:57

but you can at least do some basic

1:59

things like I'll show here.

2:02

Tell me a story. [clears throat]

2:05

And this should come through. It's just

2:06

a 1.8 billion model. Nothing crazy. As

2:10

you can see, it's going to ramp up my

2:12

NPU and then also my GPU is going to

2:15

push a little bit here and it comes back

2:17

with the response. So depending on how

2:19

strong your laptop or desktop is, you

2:22

might be able to leverage that as well.

2:24

So coming back here, right, you also see

2:26

that I have hugging face, I have Gro,

2:28

open router, and Mistrol. So all of

2:31

these, as you can see, I have them open

2:33

here too. They all have free API key

2:36

offerings. Again, you won't get a ton of

2:38

usage out of this. It's going to limit

2:40

you after a certain number of calls, uh,

2:43

I believe per day, per month, depending

2:46

on each platform. But you can see here I

2:48

am able to run a decent amount of

2:50

requests even with strong models like

2:53

GPTO OSS 12 billion. Uh this is under

2:56

grow right and then hugging face. It

2:58

also shows you here uh it says 10 cents

3:01

which isn't a lot but you can get a few

3:04

calls. Uh and I'm not sure how often

3:07

this refreshes but um I haven't used it

3:10

up too often. Uh and then open router is

3:13

also pretty generous. If you come in

3:14

here, sign up for an account, create

3:16

your API key, you could do the same

3:18

thing. Uh, and then Mistral as well,

3:20

they have an offering where you can

3:23

create your own API key, hook it up to

3:25

open web UI and give yourselves a little

3:28

bit more testing capability without

3:30

having to spend a bunch of money on

3:32

something like cloud or whatever else to

3:34

actually give yourself that API

3:36

capability. Uh, so I hope this is

3:39

helpful. Hopefully this gives everyone

3:41

some additional ideas to try to extend

3:44

some of your testing capability instead

3:46

of getting stuck with uh just using a

3:48

single API provider such as hugging face

3:51

or something else you've heard of. And

3:53

yeah, as always, like, comment, and

3:55

subscribe and let me know what more you

3:56

want to see. Thanks.

Interactive Summary

The video outlines various free methods to access API endpoints for testing, featuring services like Google API, Hugging Face, Groq, Open Router, and Mistral. It also introduces a local endpoint solution that leverages the NPU of newer Intel Ultra processors. While these free offerings have usage limits, they provide sufficient capabilities for initial testing without requiring substantial financial investment in cloud services. The speaker briefly mentions their home lab setup, including an Orange Pi 6 Plus running in a Kubernetes cluster.

Suggested questions

5 ready-made prompts