In this section, we introduce the entropy as a concept which expresses the expected information for discrete random variables.