Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2022 Jun;18(3):e2373.
doi: 10.1002/rcs.2373. Epub 2022 Feb 8.

Facial landmark-guided surface matching for image-to-patient registration with an RGB-D camera

Yixian Su  1 , Yu Sun  1 , Mohamed Hosny  1   2 , Wenpeng Gao  1 , Yili Fu  1
Affiliations

Facial landmark-guided surface matching for image-to-patient registration with an RGB-D camera

Yixian Su et al. Int J Med Robot. 2022 Jun.

Abstract

Background: Fiducial marker-based image-to-patient registration is the most common way in image-guided neurosurgery, which is labour-intensive, time consuming, invasive and error prone.

Methods: We proposed a method of facial landmark-guided surface matching for image-to-patient registration using an RGB-D camera. Five facial landmarks are localised from preoperative magnetic resonance (MR) images using deep learning and RGB image using Adaboost with multi-scale block local binary patterns, respectively. The registration of two facial surface point clouds derived from MR images and RGB-D data is initialised by aligning these five landmarks and further refined by weighted iterative closest point algorithm.

Results: Phantom experiment results show the target registration error is less than 3 mm when the distance from the camera to the phantom is less than 1000 mm. The registration takes less than 10 s.

Conclusions: The proposed method is comparable to the state-of-the-arts in terms of the accuracy yet more time-saving and non-invasive.

Keywords: RGB-D camera; deep learning; facial landmark; image-to-patient registration; surface matching.

PubMed Disclaimer

References

REFERENCES

    1. Harmsen S, Teraphongphom N, Tweedle MF, Basilion JP, Rosenthal EL. Optical surgical navigation for precision in tumor resections. Molecular Imaging Biol. 2017;19(3):357-362.
    1. Dorward NL, Alberti O, Palmer JD, Kitchen ND, Thomas DG. Accuracy of true frameless stereotaxy: in vivo measurement and laboratory phantom studies. J Neurosurgery. 1999;90(1):160-168.
    1. Sukegawa S, Kanno T, Furuki Y. Application of computer-assisted navigation systems in oral and maxillofacial surgery. Japanese Dental Sci Rev. 2018;54(3):139-149.
    1. Esfandiari H, Weidert S, Kövesházi I, Anglin C, Street J, Hodgson AJ. Deep learning-based x-ray inpainting for improving spinal 2D-3D registration. Int J Med Robot Comput Assist Surg. 2021;17(2):e2228.
    1. Gueziri HE, Drouin S, Yan CX, Collins DL. Toward real-time rigid registration of intra-operative ultrasound with preoperative ct images for lumbar spinal fusion surgery. Int J Comput Assist Radiol Surg. 2019;14(11):1933-1943.

LinkOut - more resources