Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2010 Jun 3:4:6.
doi: 10.3389/fnbot.2010.00006. eCollection 2010.

Reading as active sensing: a computational model of gaze planning in word recognition

Marcello Ferro  1 , Dimitri Ognibene, Giovanni Pezzulo, Vito Pirrelli
Affiliations

Reading as active sensing: a computational model of gaze planning in word recognition

Marcello Ferro et al. Front Neurorobot. .

Abstract

WE OFFER A COMPUTATIONAL MODEL OF GAZE PLANNING DURING READING THAT CONSISTS OF TWO MAIN COMPONENTS: a lexical representation network, acquiring lexical representations from input texts (a subset of the Italian CHILDES database), and a gaze planner, designed to recognize written words by mapping strings of characters onto lexical representations. The model implements an active sensing strategy that selects which characters of the input string are to be fixated, depending on the predictions dynamically made by the lexical representation network. We analyze the developmental trajectory of the system in performing the word recognition task as a function of both increasing lexical competence, and correspondingly increasing lexical prediction ability. We conclude by discussing how our approach can be scaled up in the context of an active sensing strategy applied to a robotic setting.

Keywords: SOM; active sensing; lexical representation network; prediction; reading; serial order encoding.

PubMed Disclaimer

Figures

Figure 1
Figure 1
Architecture of a THSOM.
Figure 2
Figure 2
THSOM temporal layer plasticity. (A) potentiation; (B) depression.
Figure 3
Figure 3
T2HSOM temporal layer plasticity. (A) potentiation; (B,C) depression.
Figure 4
Figure 4
Sample map during learning. Darker edges represent more probable transitions, and lighter edges represent less probable ones.
Figure 5
Figure 5
Representation of a capital “A” in the graphical grid.
Figure 6
Figure 6
Results of the word identification experiment for 66 words in the corpus. The vertical dotted line indicates the optimal confidence threshold. (A) THSOM model; (B) T2HSOM model.
Figure 7
Figure 7
Training corpus word frequency histogram (A) and saccade frequency histogram test results; (B) THSOM model; (C) T2HSOM model.
Figure 8
Figure 8
Transition probabilities over morpheme boundaries in CREDERE (‘believe’). (A) THSOM model; (B) T2HSOM model.
Figure 9
Figure 9
Results of the first algorithm having complete knowledge of the word statistics.
See this image and copyright information in PMC

Similar articles

See all similar articles

Cited by

  • Embodiment and Schizophrenia: A Review of Implications and Applications.
    Tschacher W, Giersch A, Friston K. Tschacher W, et al. Schizophr Bull. 2017 Jul 1;43(4):745-753. doi: 10.1093/schbul/sbw220. Schizophr Bull. 2017. PMID: 28338892 Free PMC article. Review.
  • Deep Active Inference and Scene Construction.
    Heins RC, Mirza MB, Parr T, Friston K, Kagan I, Pooresmaeili A. Heins RC, et al. Front Artif Intell. 2020 Oct 28;3:509354. doi: 10.3389/frai.2020.509354. eCollection 2020. Front Artif Intell. 2020. PMID: 33733195 Free PMC article.
  • Generative models, linguistic communication and active inference.
    Friston KJ, Parr T, Yufik Y, Sajid N, Price CJ, Holmes E. Friston KJ, et al. Neurosci Biobehav Rev. 2020 Nov;118:42-64. doi: 10.1016/j.neubiorev.2020.07.005. Epub 2020 Jul 17. Neurosci Biobehav Rev. 2020. PMID: 32687883 Free PMC article. Review.
  • Deep temporal models and active inference.
    Friston KJ, Rosch R, Parr T, Price C, Bowman H. Friston KJ, et al. Neurosci Biobehav Rev. 2018 Jul;90:486-501. doi: 10.1016/j.neubiorev.2018.04.004. Epub 2018 May 8. Neurosci Biobehav Rev. 2018. PMID: 29747865 Free PMC article.
  • Deep temporal models and active inference.
    Friston KJ, Rosch R, Parr T, Price C, Bowman H. Friston KJ, et al. Neurosci Biobehav Rev. 2017 Jun;77:388-402. doi: 10.1016/j.neubiorev.2017.04.009. Epub 2017 Apr 14. Neurosci Biobehav Rev. 2017. PMID: 28416414 Free PMC article. Review.
See all "Cited by" articles

References

    1. Altmann G. T. M., Kamide Y. (1999). Incremental interpretation at verbs: restricting the domain of subsequent reference. Cognition 73, 247–26410.1016/S0010-0277(99)00059-1 - DOI - PubMed
    1. Baayen H. (2007). “Storage and computation in the mental lexicon,” In The Mental Lexicon: Core Perspectives, eds Jarema G., Libben G. (Amsterdam: Elsevier; ), 81–104
    1. Baddeley A. D. (1964). Immediate memory and the “perception” of letter sequences. Q. J. Exp. Psychol. 16, 364–36710.1080/17470216408416394 - DOI
    1. Baddeley A. D. (2007). Working Memory, Thought, and Action Oxford: Oxford University Press
    1. Ballard D. H. (1991). Animate vision. Artif. Intell. 48, 1–2710.1016/0004-3702(91)90080-4 - DOI