Haptic object recognition based on shape relates to visual object recognition ability

Abstract

Visual object recognition depends in large part on a domain-general ability (Richler et al. Psychol Rev 126(2): 226-251, 2019). Given evidence pointing towards shared mechanisms for object perception across vision and touch, we ask whether individual differences in haptic and visual object recognition are related. We use existing validated visual tests to estimate visual object recognition ability and relate it to performance on two novel tests of haptic object recognition ability (n = 66). One test includes complex objects that participants chose to explore with a hand grasp. The other test uses a simpler stimulus set that participants chose to explore with just their fingertips. Only performance on the haptic test with complex stimuli correlated with visual object recognition ability, suggesting a shared source of variance across task structures, stimuli, and modalities. A follow-up study using a visual version of the haptic test with simple stimuli shows a correlation with the original visual tests, suggesting that the limited complexity of the stimuli did not limit correlation with visual object recognition ability. Instead, we propose that the manner of exploration may be a critical factor in whether a haptic test relates to visual object recognition ability. Our results suggest a perceptual ability that spans at least across vision and touch, however, it may not be recruited during just fingertip exploration.

Fig. 1

Example stimuli. a Example Sheinbug stimulus, every Sheinbug has similar components and configuration. The top row is two different Sheinbugs, the bottom row are the same examples rotated. b Example Ziggerin stimulus, every Ziggerin has a similar vertical rod structure with two geometric protrusions. The top row is two different Ziggerins, the bottom row are the same examples rotated. c Example Spaceship mounted onto a wooden base. The top row are two different spaceships, the bottom row are the same spaceships rotated

Fig. 2

The haptic Novel Object Memory Test with button stimuli. a Example stimuli on a single trial mounted on an index card as presented to participants. b Schematic of the learning phase. Each target is studied once, followed by three test trials. The test phase only includes test trials with the targets interleaved

Fig. 3

Scatterplots of tests controlling for Raven’s performance. Each circle is a participant. The fit line with 95% credible intervals is plotted. a Scatterplot of hMatch-Spaceships performance residuals and hNOMT-buttons performance residuals after controlling for RAPM performance. b Scatterplot of hMatch-Spaceships performance residuals and o_v residuals after controlling for RAPM. c Scatterplot of hNOMT-buttons performance residuals and o_v residuals after controlling for RAPM