Contextual Anatomic Mimesis: Hybrid In-Situ Visualization Method for Improving Multi-Sensory Depth Perception in Medical Augmented Reality

The need to improve medical diagnosis and reduce invasive surgery is dependent upon seeing into a living human system. The use of diverse types of medical imaging and endoscopic instruments has provided significant breakthroughs, but not without limiting the surgeon’s natural, intuitive and direct 3D perception into the human body. This paper presents a method for the use of Augmented Reality (AR) for the convergence of improved perception of 3D medical imaging data (mimesis) in context to the patient’s own anatomy (in-situ) incorporating the physician’s intuitive multi-sensory interaction and integrating direct manipulation with endoscopic instruments. The effectiveness has been demonstrated in a series of experiments at the Chirurgische Klinik in Munich, Germany utilizing a video see-through, stereoscopic Head-Mounted-Display (HMD) tracked by an external infra-red tracking system with cadaver and in-vivo studies. The results can be applied for designing medical AR training and educational applications.     «

The need to improve medical diagnosis and reduce invasive surgery is dependent upon seeing into a living human system. The use of diverse types of medical imaging and endoscopic instruments has provided significant breakthroughs, but not without limiting the surgeon’s natural, intuitive and direct 3D perception into the human body. This paper presents a method for the use of Augmented Reality (AR) for the convergence of improved perception of 3D medical imaging data (mimesis) in context t...     »