Entropy (probability distribution)

Entropy in a probability distribution $⟨P_1,\dots ,P_n⟩$ is $H(⟨P_1,\dots ,P_n⟩)={\sum }_{i=1}^n-P_i{\log }_2{P}_i$Maximum for a uniform distribution, minimum for a single point.