Editorial
doi: 10.3390/e22040435.
Information Theory and Language
Affiliations
- PMID: 33286209
- PMCID: PMC7516908
- DOI: 10.3390/e22040435
Item in Clipboard
Editorial
Information Theory and Language
Entropy (Basel).
.
Abstract
Human language is a system of communication [...].
Keywords: complexity; criticality; entropy; language resources; mutual information; natural language; semantics; statistical language laws; statistical language models; syntax.
Conflict of interest statement
The authors declare no conflict of interest.
Similar articles
-
The syntax-semantics interface in animal vocal communication.Philos Trans R Soc Lond B Biol Sci. 2020 Jan 6;375(1789):20180405. doi: 10.1098/rstb.2018.0405. Epub 2019 Nov 18. Philos Trans R Soc Lond B Biol Sci. 2020. PMID: 31735156 Free PMC article. Review.
-
Quantifying the information in the long-range order of words: semantic structures and universal linguistic constraints.Cortex. 2014 Jun;55:5-16. doi: 10.1016/j.cortex.2013.08.008. Epub 2013 Aug 29. Cortex. 2014. PMID: 24074456 Review.
-
Idiom, syntax, and advanced theory of mind abilities in children with autism spectrum disorders.J Speech Lang Hear Res. 2014 Feb;57(1):120-30. doi: 10.1044/1092-4388(2013/12-0308). J Speech Lang Hear Res. 2014. PMID: 23882003
-
The simpler syntax hypothesis.Trends Cogn Sci. 2006 Sep;10(9):413-8. doi: 10.1016/j.tics.2006.07.007. Epub 2006 Aug 8. Trends Cogn Sci. 2006. PMID: 16899400
-
Lexical Predictability During Natural Reading: Effects of Surprisal and Entropy Reduction.Cogn Sci. 2018 Jun;42 Suppl 4(Suppl 4):1166-1183. doi: 10.1111/cogs.12597. Epub 2018 Feb 14. Cogn Sci. 2018. PMID: 29442360 Free PMC article.
Cited by
-
Zipf's law in China's local government work reports: A 21-year study using natural language processing and regression analysis.PLoS One. 2025 May 20;20(5):e0324713. doi: 10.1371/journal.pone.0324713. eCollection 2025. PLoS One. 2025. PMID: 40392917 Free PMC article.
References
-
- Shannon C. A mathematical theory of communication. Bell Syst. Tech. J. 1948;30:379–423. doi: 10.1002/j.1538-7305.1948.tb01338.x. - DOI
-
- Shannon C. Prediction and entropy of printed English. Bell Syst. Tech. J. 1951;30:50–64. doi: 10.1002/j.1538-7305.1951.tb01366.x. - DOI
-
- Harris Z. Mathematical Structures of Language. Interscience Publishers; New York, NY, USA: 1968.
-
- Harris Z. A Theory of Language and Information: A Mathematical Approach. Clarendon Press; Oxford, UK: 1991.
-
- Kolmogorov A.N. Three approaches to the quantitative definition of information. Probl. Inf. Transm. 1965;1:1–7. doi: 10.1080/00207166808803030. - DOI
Publication types
LinkOut - more resources
Full Text Sources
