No matter how: Top-down effects of verbal and semantic category knowledge on early visual perception

Abstract

Language is assumed to augment human cognition. But can language also affect basic mechanisms of perception, suggesting cognitive penetrability of perception? This idea is highly controversial: linguistic categorization may induce top-down effects on ongoing perceptual processing. Alternatively, such effects may not concern perception proper, but pre-perceptual shifts of attention or downstream processes, such as perceptual judgment. This study provides a critical test of these views by investigating categorical perception (CP) of novel objects in a balanced learning design, controlling for perceptual experience and low-level visual differences. To better understand which linguistic representations induce CP, we manipulated the type of information categories were based on: bare verbal labels, in-depth semantic knowledge, or the combined information from labels associated with semantic knowledge. We used event-related brain potentials (ERPs) derived from the EEG in a visual search task to localize CP effects at perceptual or pre/post-perceptual stages. The results replicated behavioral CP with facilitated visual search when target and distractors belonged to different linguistic categories. ERPs revealed CP effects in the P1 and N1 components, associated with early visual processing. Attentional selection, reflected in the N2, also was influenced by linguistic categories. The N2 and the N400, a measure of high-level semantic processing, were sensitive to the depth of semantic knowledge associated with objects. CP, however, did not differ between category types, suggesting that any linguistic categorization can lead to CP. The findings support cognitive penetrability of perception, with linguistic categories informing perceptual predictions down to the processing of low-level visual features.

Keywords: Categorical perception; Event-related potentials; Linguistic relativity; Semantic knowledge; Top-down effects.