HomeVideos

Can AI Replace Power BI Developers? | 3-Tier Framework Explained

Now Playing

Can AI Replace Power BI Developers? | 3-Tier Framework Explained

Transcript

459 segments

0:00

Hello everyone, welcome back to

0:01

Analytical Guy. In this video, we will

0:04

talk about a very hot topic, can AI

0:06

replace Power BI developers? Power BI is

0:09

here for more than 10 years and now

0:12

everyone is thinking that AI can replace

0:14

Power BI. So, we will understand this in

0:18

this particular video. So, stay tuned

0:20

till the end. All right, so let's try to

0:22

understand if AI can replace Power BI

0:24

developers using three-tier framework.

0:27

So, first tier in this framework is AI

0:30

does this really well. So, it can be

0:33

technical execution such as using DAX

0:36

for various tasks or M code etc. So,

0:38

this is tier one. Then tier two would be

0:41

AI helps

0:43

but human leads. For example, AI can

0:46

accelerate the work but business

0:48

judgment and context are required to

0:50

make the right call. So, this is where

0:52

human leads, right? Coming to the third

0:55

tier is humans are irreplaceable. So, if

1:00

we talk about any particular skill such

1:02

as business communication, if you're

1:03

talking to stakeholders, understanding

1:05

the context, judgment, all these are the

1:08

things which are irreplaceable as of now

1:12

and then I'll explain you all the skill

1:14

sets required for this particular tier

1:16

because this tier is really important

1:18

for us to grow in our field. All right,

1:20

so let's start with tier one.

1:23

AI does this really well. So, we are

1:25

talking about technical execution. So,

1:28

in technical execution, I have seen

1:31

Cloud Code handles all these tasks

1:34

really well such as if you have to work

1:37

on DAX or M code and if you have seen my

1:40

previous videos, I have done end-to-end

1:44

Power BI report development using Cloud.

1:46

So, you can refer to the top screen and

1:49

you can have that link to see how it's

1:51

done. But, what we have seen earlier as

1:54

well, Cloud Code does really well and

1:56

various other AI platforms. So, what DAX

2:00

does this? For example, if you are on

2:02

Power BI report and you want to create a

2:05

new formula, right? And for example, you

2:07

want to have total sales. So, you need

2:09

to have a formula, right? So, formulas

2:11

are created using DAX language. DAX is

2:14

data analysis expression. This is a

2:16

language which is understood by Power BI

2:19

database, right? So, it writes measures,

2:21

it can create calculated columns, right?

2:24

So, these things can be done really well

2:27

using Cloud Code. That doesn't mean that

2:30

you don't need to learn DAX, but what

2:32

I'm saying is

2:33

uh you need to know the concepts, but

2:36

majority of the part can be done using

2:39

Cloud Code. Same goes with the M code.

2:41

So, M code is a language

2:44

understood by Power Query. So, if you're

2:46

cleaning your data or transforming your

2:48

data when you're importing your data set

2:50

in Power Query, so that's where M code

2:52

is required and these two things are

2:55

essentially done really well by Cloud,

2:57

right?

2:59

It handles time intelligence,

3:01

iterations, complex filter context. So,

3:03

it's all good.

3:05

Right? Second technical execution is

3:08

working on semantic modeling and this is

3:11

the most important part. For example, if

3:13

you have to create if you have multiple

3:15

tables, you will have to have

3:17

relationships, right? So, once you have

3:20

for example, geography related data, you

3:23

want to have hierarchies like

3:25

cities should come under state, states

3:27

should come under country, all those

3:29

things. So, hierarchies matter. Date

3:31

table matters. I mean, you should have a

3:33

date calendar table in your Power BI.

3:35

Star schema setup. So, if you're working

3:37

on multiple tables and you have

3:39

dimensions and fact, so this is where

3:41

the semantic modeling concepts come into

3:44

the picture and once you provide the

3:46

skill in Cloud Code, this is

3:49

predominantly handled quite nicely by

3:52

Cloud and various other AI tools.

3:54

Third is theme and visual formatting.

3:57

So, if you talk about JSON theme files,

3:59

visual level formatting, color palettes,

4:02

all those things, if for example, you

4:04

you have a particular set of brand guide

4:06

for your company, you can easily create

4:09

that JSON inside the skills and then the

4:12

Cloud will handle that in all the pages

4:15

it creates for Power BI.

4:17

So, the next technical execution over

4:20

here in tier one is custom visual

4:22

development. So, if we talk about PV PBI

4:26

viz projects, for example, if you're

4:28

working on custom reports, so you want

4:30

to create a custom visual which is not

4:32

as a native visual inside Power BI, you

4:34

can create that. So, you can have HTML

4:37

code and then add that in PBI viz and

4:39

that's what makes it even more

4:42

interesting because you can have more

4:45

you know,

4:46

whatever the visuals you were not able

4:48

to create earlier, now you can do that

4:49

using

4:51

HTML code that you can generate through

4:53

various AI and that's also D3 or React

4:56

is also feasible and you can build a

4:58

capability layer and formatting pane

5:00

options. So, this is also really nice.

5:03

And finally, we have one more skill in

5:06

technical execution, that's deployment

5:08

automation. So, if you are working on

5:11

for example, a project and multiple team

5:15

members are there working on the same

5:16

project and you want to connect through

5:18

API endpoints as well, so this is easily

5:21

handled by

5:23

AI. So, you can easily provide the

5:26

information for example, get related

5:28

information regarding REST API scripts,

5:31

CI/CD pipelines. So, this is all taken

5:34

care by

5:36

AI. So, this is

5:38

these are some of the skills where AI is

5:40

really strong and we need to cope up and

5:44

we have to match so that we understand

5:46

what AI is, you know, bringing in so

5:48

that we know what's happening and we can

5:51

improvise on that. All right, so now

5:52

let's talk about tier two of framework

5:55

where AI helps but human leads.

5:58

So, first point in this particular tier

6:01

is performance optimization and this is

6:03

the most important element because you

6:06

are creating reports. If you're

6:08

refreshing it and the business user is

6:10

not able to utilize it on time, then

6:13

there is no uh need to create any report

6:16

per se. So, it is really important that

6:18

we are focusing on performance

6:20

optimization. So, what AI can do is it

6:23

can suggest you differences between

6:25

import versus direct query versus

6:28

composite. So, what exactly you need to

6:31

they can suggest. It can write

6:32

aggregation tables. It can recommend

6:34

partitioning strategies. But,

6:37

what AI cannot tell you

6:41

these things. We know the actual data

6:43

volume, right? So, we know this. We know

6:46

the refresh SLAs. We know the gateway

6:49

infrastructure. We know the

6:50

organizational tolerance for latency.

6:53

So, we have so much of context and we

6:55

cannot provide everything inside AI,

6:57

right? So, these are some of the things

6:59

we still need to know. That's the reason

7:02

performance optimization in my opinion

7:05

is still a gray zone and we need to come

7:07

into the picture.

7:09

Second point is RLS

7:12

design. This is important. So, AI can do

7:15

these things. AI can write your DAX

7:17

security filter expression. So, you

7:19

know, we use user principal name for RLS

7:23

row level security, right? For all the

7:25

path-based hierarchy filters. But, what

7:28

AI can not do as of now. I mean, we need

7:32

to, you know, come into the picture for

7:34

this. Designing the organization level

7:37

access hierarchy from scratch. So, let's

7:39

say let's assume we have already created

7:41

this and we provide this context to AI,

7:44

but still we need to have we have so

7:47

many more information that we can't

7:49

provide to AI such as, you know, knowing

7:52

which cost center share data and who

7:55

signs off the access policy, all those

7:57

things which are quite internal in the

8:00

office, right?

8:02

Now, third and the final skill that is

8:05

there in gray zone is data quality

8:08

validation. So, if we talk about data

8:10

quality validation, AI can run your

8:12

statistical checks, it can find nulls,

8:14

outliers, all those things. AI is really

8:17

good in this, right? But, what I feel is

8:20

AI still still can't do these things and

8:22

human must know when a revenue figure

8:26

that passes every check is still wrong.

8:29

Let's assume you're working on a project

8:31

and you don't have any idea about that

8:33

particular data set and you create a

8:35

report and then you share that report

8:37

with the actual business owner and then

8:40

that business owner provide you that,

8:41

"Hey, these figures doesn't match and

8:43

they are way off the correct figures."

8:46

Because they know the context, right?

8:48

And you don't know the context. That's

8:49

where humans come into the picture and

8:53

this is where I would say it still comes

8:55

in tier two. So, data quality validation

8:58

is a important aspect. Though, when I

9:00

created end-to-end Power BI reporting

9:02

through Cloud, my data quality was 100%

9:06

accurate and that was so good, but it's

9:08

not necessary that it comes that way all

9:11

the time. All right, so now let's go to

9:13

tier three of this framework and in my

9:16

opinion, this is the most important tier

9:18

and we should focus on that.

9:20

So, first of all, tier three is human is

9:23

irreplaceable as of now.

9:27

So, what are the skills? So, number one

9:29

is requirements discovery.

9:31

So,

9:33

business users don't say I need a time

9:36

intelligence measure. So, it's not like

9:38

your business

9:39

owner or stakeholders are saying, "Give

9:41

me the time time intelligence measure."

9:43

It is us that we understand this is what

9:45

is required. So, developer sits in the

9:47

room, asks the right questions and

9:50

translates chaos into a spec. So, the

9:53

most important part is asking the right

9:56

questions. So, for example, you are on

9:59

Cloud and you mention that I want these

10:02

four pages and one page should have,

10:05

let's say, overall

10:08

overview of the data set. Second page is

10:10

on geography, third is product analysis,

10:13

fourth is inventory. So, you have

10:15

provided all the context and it provides

10:17

you those pages. But, it don't you

10:21

you've not asked the right questions.

10:22

So, it will assume and do

10:25

uh behind the scenes for you, right? So,

10:27

asking the right questions is still a

10:29

very important part and this is what

10:31

resonates with the context. And that's

10:34

what we call prompting as well. Right?

10:37

Second is tribal knowledge and business

10:39

context. And

10:42

So, for example, if you're working on,

10:44

let's say, retail data set, that's what

10:45

we did last time as well. So, if you are

10:49

predominantly a beginner and you don't

10:51

know anything about your business,

10:52

right? You will not be able to ask the

10:55

right questions, first of all. Then, you

10:56

won't be able to understand your data.

10:58

So, why that one cost center is

11:00

excluded? Why Q3 2022 is anomalous? You

11:04

know, which vice president will reject a

11:06

report if it uses green? So many

11:08

questions are there, so much of context

11:10

is there. You can't put in everything in

11:13

Cloud or any other AI tool, right?

11:17

Third is iterative co-design.

11:20

So, what iterative co-design means? So,

11:23

seeking a stakeholder's face when a

11:25

layout doesn't click. For example, you

11:26

are sitting in the presentation room and

11:29

you're discussing with the stakeholder,

11:31

right? So, you can have different

11:33

questions and you can pivot and, you

11:35

know, brainstorm and come to a

11:36

particular conclusion that this is what

11:38

we want, right? So, this kind of

11:41

brainstorming session

11:43

is not there in AI. I mean, you can do

11:45

it yourself, but this kind of

11:48

brainstorming is missing. Prototyping on

11:50

a whiteboard. So, this is what a

11:52

traditional way of

11:54

designing a thing was there, right?

11:56

Reading in the room. No AI can attend a

11:58

discovery workshop and adapt to what the

12:00

group energy is telling it. So, this is

12:02

something I feel like this is what we

12:05

call people element is there and it is

12:08

irreplaceable.

12:10

These are four more skills which I feel

12:12

are irreplaceable. So, which is on

12:15

trust, governance, and the judgment

12:18

call. So, first is stakeholder trust

12:20

adoption. So, for example, you have

12:22

created a report and you have been

12:24

working with your boss for so many

12:25

years. Now, he trusts you that you have

12:27

been doing good and whatever you deliver

12:30

would be accurate. Now, the same thing

12:32

has been done through AI. Now, there

12:34

would be some credibility issue. Boss

12:36

might not be able to trust what has been

12:38

generated through AI. It will take some

12:40

time, but definitely this is something

12:42

which is important. Same goes with

12:44

cross-team orchestration. So, aligning

12:46

with different departments and there

12:48

would be so much of politics, patience,

12:51

and, you know, interpersonal trust. So,

12:53

for example, you want to, you know,

12:56

adapt on this particular methodology,

12:58

but the other department wants to go

13:01

with the other one. So, it is so hard to

13:03

achieve. So, that's the reason humans

13:04

are irreplaceable in these aspects as

13:06

well.

13:07

And this is one of the most important

13:09

element, I would say, governance and

13:10

data strategy. Security becomes so

13:13

important when we are talking about AI.

13:16

So, now it's a brutal truth that if even

13:19

if you're working on Power BI reporting,

13:21

you have to use AI. I mean, if you're

13:23

not using AI, then your job is on stake.

13:27

So, if you're using AI plus Power BI,

13:30

then security

13:32

is very important. Security becomes so

13:36

important that every organization, you

13:39

know, whenever they are interviewing

13:40

someone on mid-level

13:43

data analyst or senior level, so they're

13:45

looking for someone who knows how to

13:47

work on governance and security.

13:50

And finally, the judgment on done. You

13:52

know, knowing when a report is good

13:54

enough to ship versus when it is

13:56

confused, when it will confuse the

13:58

audience. So, this requires the existing

14:01

context and knowledge. So, this is where

14:04

humans are still irreplaceable. All

14:06

right. So, now that we know all these

14:08

three tiers, then what should we focus

14:10

on?

14:11

So, this is where the real shift AI is

14:14

creating. So, if you see on the

14:16

left-hand side,

14:18

these were the things that we used to

14:20

focus on, like ours writing DAX from

14:22

scratch, manual theme JSON editing,

14:25

scripting, deployment pipelines,

14:27

debugging M code. So, we still have to

14:29

do it, but, you know, start with AI. Let

14:32

AI create these things for you and then

14:34

you have to debug. So, more time is

14:36

spent on reviewing AI-generated DAX,

14:39

describing the look and iterating,

14:40

reviewing and approving generated

14:42

scripts, specifying the transformation

14:44

and validating the output. So, I believe

14:47

this is the shift that is happening.

14:49

Now, the future is clear. Even if you're

14:51

working as a Power BI developer, you

14:52

have to use AI to enable yourself so

14:56

that you are more productive, you are

14:57

faster, you are able to create better

14:59

reports. So, now when you're using AI,

15:02

this becomes very important.

15:06

AI is only as good as the prompt it

15:09

receives,

15:10

right? Writing a good prompt requires

15:12

the same skills the developer always

15:14

had. So, what it means is So, whenever

15:18

you're working on Power BI reporting,

15:20

you're working on basic skills, right?

15:22

Like understanding whatever is required

15:26

by the stakeholder. So, that is the

15:28

translation.

15:29

So, let's say you're sitting in the

15:31

board room and you're discussing with so

15:33

many stakeholders what kind of reporting

15:35

that they want, what kind of overall

15:37

structure they want in data strategy,

15:40

right? So, when you are discussing with

15:42

them, what kind of questions you're

15:44

asking them, what kind of analysis you

15:47

they expect from you and then what you

15:49

understand, right? So,

15:51

you both should be on the same page.

15:53

That's where the same concept applies in

15:56

prompting, right? So, when you're using

15:58

AI, the prompt is really important. So,

16:01

it can be very small. You don't need to

16:03

have a very very big prompt, but

16:06

even small prompt can give you better

16:08

results, but it should be really precise

16:09

and good.

16:11

Right? Same concept over here. Bad spec

16:14

is bad output. Same concept. So, this is

16:17

where I believe uh we can derive more

16:21

value. Domain expertise compounds. So,

16:24

let's say you're working in the finance

16:25

sector

16:26

>> [snorts]

16:26

>> and you're working on creating Power BI

16:28

reports. So, I believe if you have good

16:31

understanding of how finance works, how

16:33

accounting works, then you can become

16:36

successful Power BI developer.

16:37

Otherwise, it is really hard to just

16:40

continue with your technical skills.

16:41

Same goes with any other

16:44

domain. Even if you're working on mining

16:46

sector, for example, and you're working

16:47

on Power BI reporting, you need to have

16:49

in-depth knowledge and you have to have

16:51

those skills so that you can improvise

16:53

on your reporting structure. Finally,

16:57

this is my opinion. So, I mean, you must

16:59

have seen so many memes on this. AI

17:01

won't replace people, but people who

17:03

would be using it will replace you. So,

17:05

this is actually true. So, if you're not

17:08

using AI as a developer and you're just

17:11

working as a traditional developer, just

17:14

opening Power BI report, dragging

17:15

dropping the visuals, creating data

17:17

model, that's great. I mean, you should

17:20

know the concepts. If you don't know the

17:21

concepts, you won't be able to survive

17:23

with just AI. Right? AI can help you if

17:26

you know the concepts. So, my two cents

17:29

would be understand all the concepts,

17:31

work on your data modeling, work on

17:34

concepts of DAX. You don't need to learn

17:36

everything in DAX, but at least the

17:37

concepts. Work on the concepts of how

17:39

Power Query is done. So, how how to

17:41

utilize that, how cleaning is done, how

17:44

manipulation is done, all those things,

17:46

right? So, once you have understood the

17:48

concepts, then start utilizing AI to

17:51

enhance your reporting. So, that's how I

17:53

would say this approach should be.

17:55

All right. So, this was it in this

17:57

particular video. If you have any

17:58

questions, please let me know in the

17:59

comments below and I would be trying to

18:02

help you out. Thanks a lot for watching

18:03

this video.

Interactive Summary

This video examines whether AI will replace Power BI developers by using a three-tier framework. The tiers range from tasks where AI excels (technical execution like DAX, M code, and semantic modeling), to tasks where AI helps but human leadership is required (performance optimization, RLS design, and data validation), to a final tier where humans are currently irreplaceable (requirements discovery, context, and stakeholder management). The author concludes that while AI will not replace developers, developers who use AI will replace those who do not, emphasizing the importance of understanding core concepts while leveraging AI tools for increased productivity.

Suggested questions

3 ready-made prompts