Kips Class 10 AI Unit 7: Evaluation

Unit 7: Evaluation

Worksheet 1:
Answer these questions to gauge your understanding of the subject.
Question 1: Why is the process of evaluation important in any AI model?
Answer:
When we are at the modelling stage, we take up various modelling types for a project. The selection of the model we take up depends on how we are going to evaluate the project. An efficient evaluation model proves helpful in selecting the most suitable modelling method that would represent our data. Therefore, the model evaluation stage is an essential part of the process of selecting an appropriate model for a project.

Question 2: Fill in the correct terms in the table given below.

Question 2 Pic

Answer:
Question 2 Answer pic


Worksheet 2:
Consider an AI prediction model that predicts the colour of a car in each image provided to it. No
w, answer the following questions:


Check the correct classification with respect to the given scenario:
Worksheet 2 Question
Answer:

Worksheet 2 Answer


Worksheet 3:
Answer the following questions:
Question 1: Is high accuracy equivalent to good performance?
Answer:
Let us take the example of forest fire. Assuming that the model always predicts that there is no fire. But in reality, there is a 2% chance of forest fire breaking out. In this case, for 98 cases, the model will be right but for those 2 cases in which there was a forest fire, then too the model predicted no fire.
Here,
True Positives = 0
True Negatives = 98
Total cases = 100

Therefore, accuracy becomes: (98 + 0) / 100 = 98%

98% is a fairly high accuracy for an AI model. But this parameter is useless for us as the actual cases where the fire broke out are not taken into account. Hence, there is a need to look at another parameter which takes account of such cases as well.

Question 2: What percentage of accuracy is reasonable for representing a good performance?
Answer:
No amount of percentage is reasonable for representing a good performance. Even though the accuracy is 98% or 99%, it is useless. Let us take the example of forest fire. Assuming that the model always predicts that there is no fire. But in reality, there is a 2% chance of forest fire breaking out. In this case, for 98 cases, the model will be right but for those 2 cases in which there was a forest fire, then too the model predicted no fire.
Here,
True Positives = 0
True Negatives = 98
Total cases = 100

Therefore, accuracy becomes: (98 + 0) / 100 = 98%

98% is a fairly high accuracy for an AI model. But this parameter is useless for us as the actual cases where the fire broke out are not taken into account.

Question 3: Is good precision equivalent to good model performance? Why?
Answer:
Precision is equivalent to good model performance in few cases but not in all cases. Taking the example of forest fire, in this case, assuming that the model always predict that there is a forest fire irrespective of the reality. In this case, all the Positive conditions would be taken into account that is, True Positive (Prediction = Yes and Reality = Yes) and False Positive (Prediction = Yes and Reality = No). In this case, the firefighters will check for the fire all the time to see if the alarm was True or False. Similarly, here if the Precision is low (which means there are more False alarms than the actual ones) then the firefighters would get complacent and might not go and check every time considering it could be a false alarm. This makes Precision an important evaluation criteria. If Precision is high, this means the True Positive cases are more, giving lesser False alarms.

Question 4: What is the difference between Precision and Recall?
Answer:

Precision: Precision is defined as the percentage of true positive cases versus all the cases where the prediction is true.
Precision = TP/(TP + FP) x 100%
Precision takes into account True Positive (TP) and False Positive (FP).

Recall: Recall can be defined as the fraction of positive cases that are correctly identified.
Recall = TP/(TP + FN)
Recalls considers True Positive (TP) and False Negative (FN).


No comments:

Post a Comment

Also read!

Class 6 Solutions

• Class 7

Class 7 Computer Kips Solutions
Class 7 Gul Mohar English Solutions
English Grammar Class 7
English Writing Skills Class 7
Class 7 Map Pointing Solutions
Class 7 NCERT Civics Solutions
Class 7 NCERT Civics Notes
Class 7 NCERT Civics Extra Questions
Class 7 NCERT Geography Solutions
Class 7 NCERT Geography Notes
Class 7 NCERT Geography Extra Questions
Class 7 NCERT History Solutions
Class 7 NCERT History Notes
Class 7 NCERT History Extra Questions
Class 7 NCERT Maths Solutions
Class 7 NCERT Science Solutions
Class 7 NCERT Science Notes
Class 7 NCERT Science Extra Questions

• Class 8

Class 8 Kips Artificial Intelligence Solutions
Class 8 Gul Mohar English Solutions
English Grammar Class 8
English Writing Skills Class 8
Class 8 Map Pointing Solutions
Class 8 NCERT Civics Solutions
Class 8 NCERT Civics Notes
Class 8 NCERT Civics Extra Questions
Class 8 NCERT Geography Solutions
Class 8 NCERT Geography Notes
Class 8 NCERT Geography Extra Questions
Class 8 NCERT History Solutions
Class 8 NCERT History Notes
Class 8 NCERT History Extra Questions
Class 8 NCERT Maths Solutions
Class 8 NCERT Science Solutions
Class 8 NCERT Science Notes
Class 8 NCERT Science Extra Questions
Class 8 NCERT Science Exemplar
Class 8 NCERT Science MCQs

• Class 9

Class 9 Kips Artificial Intelligence Solutions
Class 9 Map Pointing Solutions
Class 9 NCERT Civics Solutions
Class 9 NCERT Geography Solutions
Class 9 NCERT History Solutions
Class 9 NCERT Maths Solutions
Class 9 NCERT Science Solutions

• Class 10

Class 10 Kips Artificial Intelligence Solutions
Class 10 NCERT English Solutions
→ Class 10 Map Pointing Solutions
Class 10 NCERT Civics Solutions
Class 10 NCERT Civics Notes
Class 10 NCERT Civics Extra Questions
Class 10 NCERT Geography Solutions
Class 10 NCERT Geography Notes
Class 10 NCERT Geography Extra Questions
Class 10 NCERT History Solutions
→ Class 10 NCERT History Notes
Class 10 NCERT History Extra Questions
Class 10 NCERT Maths Solutions
Class 10 NCERT Science Solutions
Class 10 NCERT Science Notes
Class 10 NCERT Science Extra Questions

• Computer languages
Python Basics

• Extra Activities
Extra Activities

• Extra Knowledge
Extra Information
General Knowledge
Historical Places in India
Latest technology
Physical Sciences
Facts (Animals)
Facts (Extra)

• Mathematics quick links
Cubes of numbers
Squares of numbers
Mathematical Terms
Maths Tricks