Evaluation of Contactless Human-Machine Interface for Robotic Surgical Training

Fabien Despinoy 1, 2 Nabil Zemiti 2 Germain Forestier 3 Luis Alonso Sanchez Secades 4 Pierre Jannin 1 Philippe Poignet 2
1 LTSI - Laboratoire Traitement du Signal et de l'Image
2 DEXTER - Conception et commande de robots pour la manipulation
LIRMM - Laboratoire d'Informatique de Robotique et de Microélectronique de Montpellier
3 MIPS - Modélisation, Intelligence, Processus et Système
4 LIRMM - Laboratoire d'Informatique de Robotique et de Microélectronique de Montpellier
Abstract : Purpose: Teleoperated robotic systems are nowadays routinely used for specific interventions. Benefits of robotic training courses have already been acknowledged by the community since manipulation of such systems requires dedicated training. However, robotic surgical simulators remain expensive and require a dedicated human-machine interface. Methods: We present a low-cost contactless optical sensor, the Leap Motion, as a novel control device to manipulate the RAVEN-II robot. We compare peg manipulations during a training task with a contact-based device, the electro-mechanical Sigma.7. We perform two complementary analyses to quantitatively assess the performance of each control method: a metric-based comparison and a novel unsupervised spatiotemporal trajectory clustering. Results: We show that contactless control does not offer as good manipulability as the contact-based. Where part of the metric-based evaluation presents the mechanical control better than the contactless one, the unsupervised spatiotemporal trajectory clustering from the surgical tool motions highlights specific signature inferred by the human-machine interfaces. Conclusion: Even if the current implementation of contactless control does not overtake manipulation with high-standard mechanical interface, we demonstrate that using the optical sensor complete control of the surgical instruments is feasible. The proposed method allows fine tracking of the trainee's hands in order to execute dexterous laparoscopic training gestures. This work is promising for development of future human-machine interfaces dedicated to robotic surgical training systems.
Keywords : Human-Machine Interface Robotic Surgical Training Unsupervised Trajectory Analysis Contactless Teleoperation Hand Tracking
Document type :
Journal articles
Complete list of metadatas

Cited literature [41 references]  Display  Hide  Download
https://hal-lirmm.ccsd.cnrs.fr/lirmm-01577226
Contributor : Nabil Zemiti <>
Submitted on : Wednesday, January 31, 2018 - 5:24:25 PM
Last modification on : Friday, September 27, 2019 - 11:24:07 AM
Long-term archiving on : Friday, May 25, 2018 - 10:47:28 PM

File

Despinoy - Evaluation of Conta...
Files produced by the author(s)

Identifiers

Collections

UNIV-RENNES1 | LIRMM | MIPS | DEXTER | UNIV-MONTPELLIER | LTSI | CNRS | TDS-MACS | SCD-UHA | SITE-ALSACE | UNIV-RENNES

Citation

Fabien Despinoy, Nabil Zemiti, Germain Forestier, Luis Alonso Sanchez Secades, Pierre Jannin, et al.. Evaluation of Contactless Human-Machine Interface for Robotic Surgical Training. International Journal of Computer Assisted Radiology and Surgery, Springer Verlag, 2018, 13 (1), pp.13-24. ⟨10.1007/s11548-017-1666-6⟩. ⟨lirmm-01577226⟩

Export

BibTeX TEI DC DCterms EndNote

Share

Metrics

Record views

1745

Files downloads

342

Contact

CCSD