Workflow and Activity Modeling for Monitoring Surgical Procedures

Nicolas Padoy 1
1 MAGRIT - Visual Augmentation of Complex Environments
INRIA Lorraine, LORIA - Laboratoire Lorrain de Recherche en Informatique et ses Applications
Abstract : The department of surgery is the core unit of the patient care system within a hospital. Due to continuous technical and medical developments, such departments are equipped with increasingly high-tech surgery rooms. This provides higher benefits for patient treatment, but also increases the complexity of the procedures' workflow. This also induces the presence of multiple electronic systems providing rich and various information about the surgical processes. The focus of this work is the development of statistical methods that permit the modeling and monitoring of surgical processes, based on signals available in the surgery room. These methods combine low-level signals with high-level information, and can be used to detect events and trigger pre-defined actions. A main application is the development of context-aware surgery rooms, providing adaptive user interfaces, better synchronization within the surgery department and automatic documentation. We introduce and formalize the problem of recognizing phases within a workflow, using a representation of interventions in terms of multidimensional time-series formed by synchronized signals acquired over time. We then propose methods for the modeling, offline segmentation and on-line recognition of surgical phases. The main method, a variant of hidden Markov models augmented by phase probability variables, is demonstrated on two medical applications. The first one is the monitoring of endoscopic interventions, using cholecystectomy as illustrative surgery. Phases are recognized using signals indicating tool usage and recorded from real procedures. The second application is the monitoring of a generic surgery room workflow. In this case, phase recognition is performed by using 4D information from surgeries performed in a mock-up operating room in presence of a multi-view reconstruction system
Document type :
Complete list of metadatas

Cited literature [174 references]  Display  Hide  Download
Contributor : Marie-Odile Berger <>
Submitted on : Thursday, May 27, 2010 - 6:13:02 PM
Last modification on : Friday, May 18, 2018 - 1:26:57 AM
Long-term archiving on : Friday, October 19, 2012 - 3:10:56 PM


  • HAL Id : tel-01748567, version 2



Nicolas Padoy. Workflow and Activity Modeling for Monitoring Surgical Procedures. Human-Computer Interaction [cs.HC]. Université Henri Poincaré - Nancy 1; Technische Universität München, 2010. English. ⟨NNT : 2010NAN10025⟩. ⟨tel-01748567v2⟩



Record views


Files downloads