The very title of this book is borrowed from the information theory vocabulary,
and, quite naturally, it is an outline of this theory that will serve as an introduction.
The subject of information theory is the scientific study of communications. To this
end it defines a quantitative measurement of the communicated content, i.e. informa-
tion, and deals with two operations essential for communication techniques: source
coding and channel encoding.