Skip to Main content Skip to Navigation
Journal articles

Motion prediction via online instantaneous frequency estimation for vision-based beating heart tracking

Bo Yang 1 Chao Liu 2 Wenfeng Zheng 1 Shan Liu 1 
2 DEXTER - Robotique médicale et mécanismes parallèles
LIRMM - Laboratoire d'Informatique de Robotique et de Microélectronique de Montpellier
Abstract : The beating heart tracking based on stereo endoscope remains challenging due to highly dynamic scenes and poor imaging conditions in minimally invasive surgery. This paper proposes a new prediction method for robust tracking of heart motion. The dual time-varying Fourier series is used for modeling the motion of points of interest (POI) on heart surfaces, which is driven jointly by breathing and heartbeat motion. A dual Kalman filtering scheme is used to estimate the frequencies and Fourier coefficients of the model respectively. A novel orthogonal decomposition algorithm is developed to measure the instantaneous frequencies of breathing and heartbeat motion online from the 3D trajectory of the POI. The difference in direction between breathing and heartbeat motion is exploited by using principal component analysis on the past trajectory, and optimal 1D principal component signals are extracted for measuring the corresponding frequencies. The frequencies calculated from the orthogonal subbands are fused based on an additive noise model for optimal frequency measurement. The proposed method is evaluated and compared with other available prediction methods based on the simulated data and the real-measured signals from the videos recorded by the daVinci® surgical robot. The prediction algorithm is finally incorporated into a well-established visual tracking method to handle long-term occlusions.
Document type :
Journal articles
Complete list of metadata
Contributor : Chao Liu Connect in order to contact the contributor
Submitted on : Thursday, October 26, 2017 - 4:55:34 PM
Last modification on : Friday, August 5, 2022 - 3:03:30 PM




Bo Yang, Chao Liu, Wenfeng Zheng, Shan Liu. Motion prediction via online instantaneous frequency estimation for vision-based beating heart tracking. Information Fusion, Elsevier, 2017, 35, pp.58-67. ⟨10.1016/j.inffus.2016.09.004⟩. ⟨lirmm-01624759⟩



Record views