Finger kinematic modeling and real-time hand motion estimation

Abstract

This paper describes methods and experimental studies concerned with quantitative reconstruction of finger movements in real-time, by means of multi-camera system and 24 surface markers. The approach utilizes a kinematic model of the articulated hand which consists in a hierarchical chain of rigid body segments characterized by 22 functional degrees of freedom and the global roto-translation. This work is focused on the experimental evaluation of a kinematical hand model for biomechanical analysis purposes. From a static posture, a completely automatic calibration procedure, based on anthropometric measures and geometric constraints, computes axes, and centers of rotations which are then utilized as the base of an interactive real-time animation of the hand model. The motion tracking, based on automatic marker labeling and predictive filter, is empowered by introducing constraints from functional finger postures. The validation is performed on four normal subjects through different right-handed motor tasks involving voluntary flexion-extension of the thumb, voluntary abduction-adduction of the thumb, grasping, and finger pointing. Performances are tested in terms of repeatability of angular profiles, model-based ability to predict marker trajectories and tracking success during real-time motion estimation. Results show intra-subject repeatability of the model calibration both to different postures and to re-marking in the range of 0.5 and 2 mm, respectively. Kinematic estimation proves satisfactory in terms of prediction capability (index finger: maximum RMSE 2.02 mm; thumb: maximum RMSE 3.25 mm) and motion reproducibility (R (2) coefficients--index finger: 0.96, thumb: 0.94). During fast grasping sequence (60 Hz), the percentage of residual marker occlusions is less than 1% and processing and visualization frequency of 50 Hz confirms the real-time capability of the motion estimation system.