Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2013 Dec 11:4:907.
doi: 10.3389/fpsyg.2013.00907. eCollection 2013.

Novelty or surprise?

Andrew Barto  1 , Marco Mirolli  2 , Gianluca Baldassarre  2
Affiliations

Novelty or surprise?

Andrew Barto et al. Front Psychol. .

Abstract

Novelty and surprise play significant roles in animal behavior and in attempts to understand the neural mechanisms underlying it. They also play important roles in technology, where detecting observations that are novel or surprising is central to many applications, such as medical diagnosis, text processing, surveillance, and security. Theories of motivation, particularly of intrinsic motivation, place novelty and surprise among the primary factors that arouse interest, motivate exploratory or avoidance behavior, and drive learning. In many of these studies, novelty and surprise are not distinguished from one another: the words are used more-or-less interchangeably. However, while undeniably closely related, novelty and surprise are very different. The purpose of this article is first to highlight the differences between novelty and surprise and to discuss how they are related by presenting an extensive review of mathematical and computational proposals related to them, and then to explore the implications of this for understanding behavioral and neuroscience data. We argue that opportunities for improved understanding of behavior and its neural basis are likely being missed by failing to distinguish between novelty and surprise.

Keywords: expectation; intrinsic motivation; novelty; novelty detection; surprise.

PubMed Disclaimer

References

    1. Asaad W. F., Rainer G., Miller E. K. (1998). Neural activity in the primate prefrontal cortex during associative learning. Neuron 21, 1399–1407 10.1016/S0896-6273(00)80658-3 - DOI - PubMed
    1. Baldassarre G., Mirolli M. (eds.). (2013). Intrinsically Motivated Learning in Natural and Artificial Systems. Berlin: Springer-Verlag; 10.1007/978-3-642-32375-1 - DOI
    1. Barto A. G. (1990). Connectionist learning for control: an overview, in Neural Networks for Control, eds Miller T., Sutton R. S., Werbos P. J. (Cambridge, MA: MIT Press; ), 5–58
    1. Barto A. G. (1995). Adaptive critics and the basal ganglia, in Models of Information Processing in the Basal Ganglia, eds Houk J. C., Davis J. L., Beiser D. G. (Cambridge, MA: MIT Press; ), 215–232
    1. Berlyne D. E. (1960). Conflict, Arousal, and Curiosity. New York, NY: McGraw-Hill; 10.1037/11164-000 - DOI

LinkOut - more resources