Toward long-term and accurate augmented-reality display for minimally-invasive surgery

GA Puerto-Souza, GL Mariottini - 2013 IEEE international …, 2013 - ieeexplore.ieee.org
2013 IEEE international conference on robotics and automation, 2013ieeexplore.ieee.org
Augmented-Reality (AR) displays increase surgeon's visual awareness of high-risk surgical
targets (eg, the location of a tumor) by accurately overlaying pre-operative radiological 3-D
model onto the intra-operative laparoscopic video. Existing AR systems lack in accuracy and
robustness against frequent illumination changes, camera motions, and organ occlusions,
which rapidly cause the loss of image (anchor) points, and thus the loss of the AR display
after a few seconds. In this paper, we present a new AR system, which represents the first …
Augmented-Reality (AR) displays increase surgeon's visual awareness of high-risk surgical targets (e.g., the location of a tumor) by accurately overlaying pre-operative radiological 3-D model onto the intra-operative laparoscopic video. Existing AR systems lack in accuracy and robustness against frequent illumination changes, camera motions, and organ occlusions, which rapidly cause the loss of image (anchor) points, and thus the loss of the AR display after a few seconds. In this paper, we present a new AR system, which represents the first step toward long term and accurate augmented surgical display. Our system leverages feature matching to automatically recover the overlay by predicting the image locations of a high number of anchor points that were lost after a sudden image change. Additionally, a weighted sliding-window least-squares approach is also used to increase the accuracy of the AR display over time. The effectiveness of the proposed system in maintaining a long term, stable, and accurate augmentation has been tested over a set of real partial-nephrectomy laparascopic monocular videos from a DaVinci surgical robot.
ieeexplore.ieee.org
以上显示的是最相近的搜索结果。 查看全部搜索结果