Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Editorial
. 2020 Apr 11;22(4):435.
doi: 10.3390/e22040435.

Information Theory and Language

Łukasz Dębowski  1 , Christian Bentz  2   3
Affiliations
Editorial

Information Theory and Language

Łukasz Dębowski et al. Entropy (Basel). .

Abstract

Human language is a system of communication [...].

Keywords: complexity; criticality; entropy; language resources; mutual information; natural language; semantics; statistical language laws; statistical language models; syntax.

PubMed Disclaimer

Conflict of interest statement

The authors declare no conflict of interest.

References

    1. Shannon C. A mathematical theory of communication. Bell Syst. Tech. J. 1948;30:379–423. doi: 10.1002/j.1538-7305.1948.tb01338.x. - DOI
    1. Shannon C. Prediction and entropy of printed English. Bell Syst. Tech. J. 1951;30:50–64. doi: 10.1002/j.1538-7305.1951.tb01366.x. - DOI
    1. Harris Z. Mathematical Structures of Language. Interscience Publishers; New York, NY, USA: 1968.
    1. Harris Z. A Theory of Language and Information: A Mathematical Approach. Clarendon Press; Oxford, UK: 1991.
    1. Kolmogorov A.N. Three approaches to the quantitative definition of information. Probl. Inf. Transm. 1965;1:1–7. doi: 10.1080/00207166808803030. - DOI

Publication types

LinkOut - more resources