3D Heterogeneous Sensing System for Multimode Parrallel Signal No-Spatiotemporal Misalignment Recognition

Abstract

The spatiotemporal error caused by planar tiled structure design and the waste of communication resources brought on by the transmission of a single channel are two challenges facing the development of multifunctional intelligent sensors with high-density integration. A homo-spatiotemporal multisensory parallel transmission system (HMPTs) is expanded to realize multisignal no-spatiotemporal misalignment recognition and efficient parallel transmission. First, this system optimizes the distribution of multifunctional sensors, completes the 3D vertical heterogeneous layout of four sensors, and achieves material multi-information detection at a single place with no-spatiotemporal deviation. Additionally, the system couples and transmittes multiple sensory signals, delivering a fourfold increase in transmission efficiency and one-third of the power consumption compared to a single-channel transmission system. Finally, this system is used for the recognition of mixed materials, and human-computer interaction to realize the assignment of materials in VR, demonstrating the great accuracy and transmission efficiency of HMPTs as well as its feasibility in practical application. This is an a priori effort to enhance machine perception accuracy, improve signal transmission effectiveness, and advance human-machine-object triadic integration.

Keywords: VR interaction; homospatiotemporal recognition; multimode sensor; parallel transmission.