Soft tissue motion tracking with application to tablet-based incision planning in laser surgery
- PMID: 27250855
- DOI: 10.1007/s11548-016-1420-5
Soft tissue motion tracking with application to tablet-based incision planning in laser surgery
Abstract
Purpose: Recent research has revealed that incision planning in laser surgery deploying stylus and tablet outperforms micromanipulator control. However, vision-based adaption to dynamic surgical scenes has not been addressed so far. In this study, scene motion compensation for tablet-based planning by means of tissue deformation tracking is discussed.
Methods: A stereo-based method for motion tracking with piecewise affine deformation modeling is presented. Proposed parametrization relies on the epipolar constraint to enforce left-right consistency in the energy minimization problem. Furthermore, the method implements illumination-invariant tracking and appearance-based occlusion detection. Performance is assessed on laparoscopic and laryngeal in vivo data. In particular, tracking accuracy is measured under various conditions such as occlusions and simulated laser cuttings. Experimental validation is extended to a user study conducted on a tablet-based interface that integrates the tracking for image stabilization.
Results: Tracking accuracy measurement reveals a root-mean-square error of 2.45 mm for the laparoscopic and 0.41 mm for the laryngeal dataset. Results successfully demonstrate stereoscopic tracking under changes in illumination, translation, rotation and scale. In particular, proposed occlusion detection scheme can increase robustness against tracking failure. Moreover, assessed user performance indicates significantly increased path tracing accuracy and usability if proposed tracking is deployed to stabilize the view during free-hand path definition.
Conclusion: The presented algorithm successfully extends piecewise affine deformation tracking to stereo vision taking the epipolar constraint into account. Improved surgical performance as demonstrated for laser incision planning highlights the potential of presented method regarding further applications in computer-assisted surgery.
Keywords: Epipolar constraint; Soft tissue deformation tracking; Stereo vision; Surgeon interface; User performance.
Similar articles
-
Stereo vision-based tracking of soft tissue motion with application to online ablation control in laser microsurgery.Med Image Anal. 2017 Aug;40:80-95. doi: 10.1016/j.media.2017.06.004. Epub 2017 Jun 8. Med Image Anal. 2017. PMID: 28624755
-
Soft tissue tracking for minimally invasive surgery: learning local deformation online.Med Image Comput Comput Assist Interv. 2008;11(Pt 2):364-72. doi: 10.1007/978-3-540-85990-1_44. Med Image Comput Comput Assist Interv. 2008. PMID: 18982626
-
Probabilistic tracking of affine-invariant anisotropic regions.IEEE Trans Pattern Anal Mach Intell. 2013 Jan;35(1):130-43. doi: 10.1109/TPAMI.2012.81. IEEE Trans Pattern Anal Mach Intell. 2013. PMID: 22450819
-
Video-based 3D reconstruction, laparoscope localization and deformation recovery for abdominal minimally invasive surgery: a survey.Int J Med Robot. 2016 Jun;12(2):158-78. doi: 10.1002/rcs.1661. Epub 2015 Apr 30. Int J Med Robot. 2016. PMID: 25931190 Review.
-
Tracking and mapping in medical computer vision: A review.Med Image Anal. 2024 May;94:103131. doi: 10.1016/j.media.2024.103131. Epub 2024 Mar 2. Med Image Anal. 2024. PMID: 38442528 Review.
Cited by
-
Endoscopic vitreoretinal surgery: principles, applications and new directions.Int J Retina Vitreous. 2019 Jun 18;5:15. doi: 10.1186/s40942-019-0165-z. eCollection 2019. Int J Retina Vitreous. 2019. PMID: 31236288 Free PMC article. Review.
-
Preclinical Performance Evaluation of a Robotic Endoscope for Non-Contact Laser Surgery.Ann Biomed Eng. 2021 Feb;49(2):585-600. doi: 10.1007/s10439-020-02577-y. Epub 2020 Aug 12. Ann Biomed Eng. 2021. PMID: 32785862 Free PMC article.
-
μRALP and Beyond: Micro-Technologies and Systems for Robot-Assisted Endoscopic Laser Microsurgery.Front Robot AI. 2021 Sep 8;8:664655. doi: 10.3389/frobt.2021.664655. eCollection 2021. Front Robot AI. 2021. PMID: 34568434 Free PMC article. Review.
-
A dataset of laryngeal endoscopic images with comparative study on convolution neural network-based semantic segmentation.Int J Comput Assist Radiol Surg. 2019 Mar;14(3):483-492. doi: 10.1007/s11548-018-01910-0. Epub 2019 Jan 16. Int J Comput Assist Radiol Surg. 2019. PMID: 30649670
-
Surgical data science: The new knowledge domain.Innov Surg Sci. 2017 Apr;2(3):109-121. doi: 10.1515/iss-2017-0004. Epub 2017 Apr 20. Innov Surg Sci. 2017. PMID: 28936475 Free PMC article.
References
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources