Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2013 Jul;5(3):522-40.
doi: 10.1111/tops.12034. Epub 2013 Jun 13.

A model of language processing as hierarchic sequential prediction

Affiliations
Free article

A model of language processing as hierarchic sequential prediction

Marten van Schijndel et al. Top Cogn Sci. 2013 Jul.
Free article

Abstract

Computational models of memory are often expressed as hierarchic sequence models, but the hierarchies in these models are typically fairly shallow, reflecting the tendency for memories of superordinate sequence states to become increasingly conflated. This article describes a broad-coverage probabilistic sentence processing model that uses a variant of a left-corner parsing strategy to flatten sentence processing operations in parsing into a similarly shallow hierarchy of learned sequences. The main result of this article is that a broad-coverage model with constraints on hierarchy depth can process large newspaper corpora with the same accuracy as a state-of-the-art parser not defined in terms of sequential working memory operations.

Keywords: Computational linguistics; Memory models; Parsing; Sequence models; Working memory.

PubMed Disclaimer

Publication types

LinkOut - more resources