The perceptual analysis of structure from motion for rotating objects undergoing affine stretching transformations

Abstract

In two experiments, we evaluated the ability of human observers to make use of second-order temporal relations across three or more views of an apparent motion sequence for the perceptual analysis of three-dimensional form. Ratings of perceived rigidity were obtained in Experiment 1 for objects rotating in depth that were simultaneously subjected to sinusoidal affine stretching transformations along the line of sight or in a direction parallel to the image plane. Such transformations are theoretically interesting because they cannot be detected by analyses that are restricted to first-order temporal relations (i.e., two views), but they can be detected by more conventional analyses of structure from motion in which second-order temporal relations over three or more views are used. The current results show that human observers can perceive stretching transformations of a rotating 3-D object in a direction parallel to the image plane but that they fail to perceive stretching transformations along the line of sight. This result suggests that human observers can make use of some limited second-order temporal information. This finding was confirmed in Experiment 2, in which we investigated the effects of several specific optical consequences of sinusoidal stretching transformations applied in different directions. The results indicate that observers may be sensitive to the sign of acceleration, but that they cannot make use of the precise magnitude of second-order relations necessary to recover euclidean metric structure.