Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2018 Mar 30;18(4):1042.
doi: 10.3390/s18041042.

A Hybrid Bionic Image Sensor Achieving FOV Extension and Foveated Imaging

Qun Hao  1 , Zihan Wang  2 , Jie Cao  3   4 , Fanghua Zhang  5
Affiliations

A Hybrid Bionic Image Sensor Achieving FOV Extension and Foveated Imaging

Qun Hao et al. Sensors (Basel). .

Abstract

Based on bionic compound eye and human foveated imaging mechanisms, a hybrid bionic image sensor (HBIS) is proposed in this paper to extend the field of view (FOV) with high resolution. First, the hybrid bionic imaging model was developed and the structure parameters of the HBIS were deduced. Second, the properties of the HBIS were simulated, including FOV extension, super-resolution imaging, foveal ratio and so on. Third, a prototype of the HBIS was developed to validate the theory. Imaging experiments were carried out, and the results are in accordance with the simulations, proving the potential of the HBIS for large FOV and high-resolution imaging with low cost.

Keywords: Risley prisms; artificial compound eyes; foveated imaging; super-resolution.

PubMed Disclaimer

Conflict of interest statement

The authors declare no conflict of interest.

Figures

Figure 1
Figure 1
Schematic design of the hybrid bionic image sensor (HBIS); (a) the basic structure of the HBIS; (b) the situation in which the thin end of one prism is aligned with the thick end of the other prism; (c) the situation in which the two prisms are aligned, and the thick ends are oriented to vertical or horizontal directions.
Figure 2
Figure 2
The central ommatidium imaging (a) and ray tracing (b) models with Risley prisms. Risley prisms are located close to the entrance pupil of the optical system of the central ommaditium. The red lines of (b) represent light beams in the air, and the blue lines are light beams inside the prisms.
Figure 3
Figure 3
Sub-pixel scan patterns of (a) h = 5 and (b) h = 4, and (c) the model for inverse solutions of Risley prisms.
Figure 4
Figure 4
Vertical and horizontal whole field of view (FOV) and FOV extension ratio (FER) versus the wedge angle, α, and the refractive index, n. For (a,b), n = 1.5; for (c,d), α = 4°.
Figure 5
Figure 5
The maximum alignment error (AE) versus (a) initial phase angles, (b) wedge angle (α) and (c) refractive index (n).
Figure 6
Figure 6
Bandwidth saving ratio (BSR) versus (a) the wedge angle, α, and (b) the refractive index, n.
Figure 7
Figure 7
The hybrid bionic image sensor (HBIS) prototype.
Figure 8
Figure 8
The stitched image with extended field of view (FOV) (a) and the super-resolution image of the fovea (b). The colored rectangles with dashed lines denote the FOV covered by ommatidia of C12, C21, C23 and C32 in (a), respectively. For the three pairs of local regions in (b), the left ones are pieces of the super-resolution image, and the right ones are pieces of a sub-image.
Figure 9
Figure 9
An indoor super-resolution image of the fovea; (a) shows the super-resolution image; the left columns of (b–f) correspond to the local regions of (a) marked as 1 to 5, and the right columns of (b–f) come from the matched regions of one sub-image.
Figure 10
Figure 10
Field of view (FOV) distribution of periphery ommatidia and fovea scan field. (a) φh = 18.4°, φv = 12.9°, α = 4°; (b) φh = 11.3°, φv = 8.5°, α = 11°.
See this image and copyright information in PMC

References

    1. Song Y.M., Xie Y., Malyarchuk V., Xiao J., Jung I., Choi K.J., Liu Z., Park H., Lu C., Kim R.H. Digital cameras with designs inspired by the arthropod eye. Nature. 2013;497:95–99. doi: 10.1038/nature12083. - DOI - PubMed
    1. Wu S., Jiang T., Zhang G., Schoenemann B., Neri F., Zhu M., Bu C., Han J., Kuhnert K.-D. Artificial compound eye: A survey of the state-of-the-art. Artif. Intell. Rev. 2017;48:573–603. doi: 10.1007/s10462-016-9513-7. - DOI
    1. Shi C., Wang Y., Liu C., Wang T., Zhang H., Liao W., Xu Z., Yu W. SCECam: A spherical compound eye camera for fast location and recognition of objects at a large field of view. Opt. Express. 2017;25:32333–32345. doi: 10.1364/OE.25.032333. - DOI
    1. Yi Q., Hong H. Continuously zoom imaging probe for the multi-resolution foveated laparoscope. Biomed. Opt. Express. 2016;7:1175–1182. - PMC - PubMed
    1. Cao J., Hao Q., Xia W., Peng Y., Cheng Y., Mu J., Wang P. Design and realization of retina-like three-dimensional imaging based on a moems mirror. Opt. Lasers Eng. 2016;82:1–13. doi: 10.1016/j.optlaseng.2015.12.020. - DOI