Which of the following statements is/are correct regarding entropy as a…
2023
Which of the following statements is/are correct regarding entropy as a measure of uncertainty in data?
I. Low entropy indicates that the data labels are relatively homogeneous.
II. High entropy indicates that the data labels are more mixed or uncertain.
Answer: A. Both I and II — Key idea: Entropy measures uncertainty or impurity in class labels. Low entropy: labels are mostly homogeneous, so there is little uncertainty. High entropy:…
- A.
Both I and II
- B.
Only II
- C.
Neither I nor II
- D.
Only I
Attempted by 2 students.
Show answer & explanation
Correct answer: A
Key idea: Entropy measures uncertainty or impurity in class labels.
Low entropy: labels are mostly homogeneous, so there is little uncertainty.
High entropy: labels are highly mixed, so uncertainty is high.
Check the statements:
Statement I: Correct, because homogeneous labels have low entropy.
Statement II: Correct, because mixed labels have high entropy.
Answer: Both I and II are correct.