Information Theory

Questions on this topic? Just ask!

Mathematical theory that is concerned with the statistical regularities (formal structure and disruptive factors) in the transmission and processing of information² and which can be viewed as a discipline fundamental to various sciences (among them biology, psychology, theoretical linguistics). Numerous terms that play a role in the description of linguistic regularities are tied to knowledge about and definitions of information ( bit, code, data, entropy, communication, redundancy, sign). The development of a theory of a qualitative concept of information is still in its infancy; it belongs to the investigational agenda of situation semantics. ( also computational linguistics, mathematical linguistics)

Shannon, C.E.

and W.Weaver. 1949. The mathematical theory of communication. Urbana, IL.

Stumpers, F.L. 1953. A bibliography of information theory—communication theory—cybernetics. Cambridge, MA.

computational linguistics, mathematical linguistics

This is the complete article, containing 130 words (approx. 1 page at 300 words per page).

View More Summaries on Information theory