Joint-learning-based coded aperture compressive temporal imaging

Abstract

Coded aperture compressive temporal imaging (CACTI) is a recently developed imaging technique based on the theory of compressed sensing. It uses an optical imaging system to sample a high-speed dynamic scene (a set of consecutive video frames), integrates the sampled data in time according to masks (sensing matrix), and thus obtains compressive measurements. Considerable effort has been devoted to the sampling strategy and the ill-posed inverse process of reconstructing a three-dimensional (3D) high-speed dynamic scene from two-dimensional (2D) compressive measurements. The importance of the reconstruction algorithm and the optimization mask is evident. In this paper, a flexible, efficient, and superior quality Landweber iterative method is proposed for video reconstruction through jointly learning the optimal binary mask strategy, relaxation strategy, and regularization strategy. To solve the sparse representation problem in iteration, multiple denoisers are introduced to obtain more regularization prior information. By combining the mathematical structure of the Landweber iterative reconstruction method with deep learning, the challenging parameter selection procedure is successfully tackled. Extensive experimental results demonstrate the superiority of the proposed method.