Skip to Main content Skip to Navigation
Journal articles

Robust 3D Motion Tracking for Vision-Based Control in Robotic Heart Surgery

Bo Yang 1 Chao Liu 2, *
* Corresponding author
2 DEXTER - Conception et commande de robots pour la manipulation
LIRMM - Laboratoire d'Informatique de Robotique et de Microélectronique de Montpellier
Abstract : Recently, model-based visual tracking techniques using endoscopic images have been proposed for estimating beating heart motion and thus actively compensating motion in robot-assisted minimally invasive surgery. However, most existing methods suffer the problems of computation burden with increasing size of target region and number of parameters, and also limited capability to handle partial occlusions. In this paper, an overlapped thin-plate spline approach is proposed. By dividing the target region into overlapped sub-regions, overall computational burden is greatly reduced and robustness against environment disturbances is improved. With the proposed tracking scheme, 3D coordinates of point of interest on beating heart surfaces can be extracted and used to compensate heart motion by a surgical robot, which presents a step further towards successful robotic beating heart surgery using a model-based visual tracking technique. The performance of the proposed tracking method is demonstrated through experiments on phantom data and in vivo videos recorded by the da Vinci surgical platform.
Document type :
Journal articles
Complete list of metadata
Contributor : Chao Liu <>
Submitted on : Wednesday, February 17, 2016 - 12:33:53 PM
Last modification on : Tuesday, March 9, 2021 - 5:09:29 PM

Links full text




Bo Yang, Chao Liu. Robust 3D Motion Tracking for Vision-Based Control in Robotic Heart Surgery. Asian Journal of Control, Asian Control Association (ACA) and Chinese Automatic Control Society (CACS) 2014, 16 (3), pp.632-645. ⟨10.1002/asjc.785⟩. ⟨lirmm-01275348⟩



Record views