Entropy of a discrete random variable with possible values {π₯1,π₯2,β¦,π₯π}β¦
2017
Entropy of a discrete random variable with possible valuesΒ {π₯1,π₯2,β¦,π₯π}Β and probability density functionΒ π(π)Β is
\(H(X) = \: β \sum\limits_{i=1}^{n}P(x_i) \log _bP(x_i)\)
The value ofΒ πΒ gives the units of entropy. The unit forΒ π = 10Β is
- A.
bits
- B.
bann
- C.
nats
- D.
deca
Attempted by 56 students.
Show answer & explanation
Correct answer: B
Answer: The unit for base 10 is the ban (also called the hartley or decimal digit).
Explanation: The base of the logarithm in the entropy formula determines the unit of information. Common mappings are:
Base 2 β bits
Base e (natural log) β nats
Base 10 β bans (also called hartleys or decimal digits)
Useful conversions:
1 ban β log2(10) β 3.3219 bits
1 nat β log2(e) β 1.4427 bits
Therefore, when b = 10 in the entropy formula, the unit is the ban (hartley).