Introduction to Information Entropy

This is intended to be an introductory book on information entropy. The concept of information theory is too broad to be captured by single definition. The term entropy is used in information theory to describe the amount of uncertainty. The information entropy is a fundamental quantity related to thermodynamical entropy which measures the extent of single particle density. The information and entropy both depend upon the choice of probability distribution. Quantum information science will lead to the creation of a quantum computer to solve problem that could not be solved by classical computer. The ideas from information theory have been applied to many problems of science and technology and in other different fields. Quantum Information entropy plays a crucial role in stronger formulation of uncertainty relation. The quantum information entropy of some important potentials is discussed which are widely used in different fields. The information entropy of these potentials is studied in position as well as momentum space and uncertainty relations are verified.