scholarly journals Performance Improvement for Two-Lens Panoramic Endoscopic System during Minimally Invasive Surgery

2019 ◽  
Vol 2019 ◽  
pp. 1-11
Author(s):  
Dinh Thai Kim ◽  
Ching Hwa Cheng ◽  
Don Gey Liu ◽  
Kai-Che Jack Liu ◽  
Shih Wei Wayne Huang ◽  
...  
Keyword(s):  
Minimally Invasive Surgery ◽  
Minimally Invasive ◽  
Performance Improvement ◽  
Invasive Surgery ◽  
Ground Truth ◽  
Previous Method ◽  
Field Of View ◽  
Frame Rate ◽  
Specular Reflections ◽  
Field Of Vision

One of the major challenges for Minimally Invasive Surgery (MIS) is the limited field of vision (FOV) of the endoscope. A previous study by the authors designed a MIS Panoramic Endoscope (MISPE) that gives the physician a broad field of view, but this approach is still limited, in terms of performance and quality because it encounters difficulty when there is smoke, specular reflections, or a change in viewpoint. This study proposes a novel algorithm that increases the MISPE’s performance. The method calculates the disparity for the region that is overlapped by the two cameras to allow image stitching. An improved evaluation of the homography matrix uses a frame-by-frame calculation, so the stitched videos are more stable for MIS. The experimental results show that the revised MISPE has a FOV that is 55% greater, and the system operates stably in real time. The proposed system allows a frame rate of 26.7 fps on a single CPU computer. The proposed stitching method is 1.55 times faster than the previous method. The stitched image that is obtained using the proposed method is as similar as the ground truth as the SURF-based stitching method that was used in the previous study.

scholarly journals Real-Time Expanded Field-of-View for Minimally Invasive Surgery Using Multi-Camera Visual Simultaneous Localization and Mapping

Sensors ◽  
2021 ◽  
Vol 21 (6) ◽  
pp. 2106
Author(s):  
Ahmed Afifi ◽  
Chisato Takada ◽  
Yuichiro Yoshimura ◽  
Toshiya Nakaguchi
Keyword(s):  
Minimally Invasive Surgery ◽  
Minimally Invasive ◽  
Real Time ◽  
Invasive Surgery ◽  
Simultaneous Localization And Mapping ◽  
Field Of View ◽  
Time Dynamic ◽  
Matrix Estimation ◽  
Localization And Mapping

Minimally invasive surgery is widely used because of its tremendous benefits to the patient. However, there are some challenges that surgeons face in this type of surgery, the most important of which is the narrow field of view. Therefore, we propose an approach to expand the field of view for minimally invasive surgery to enhance surgeons’ experience. It combines multiple views in real-time to produce a dynamic expanded view. The proposed approach extends the monocular Oriented features from an accelerated segment test and Rotated Binary robust independent elementary features—Simultaneous Localization And Mapping (ORB-SLAM) to work with a multi-camera setup. The ORB-SLAM’s three parallel threads, namely tracking, mapping and loop closing, are performed for each camera and new threads are added to calculate the relative cameras’ pose and to construct the expanded view. A new algorithm for estimating the optimal inter-camera correspondence matrix from a set of corresponding 3D map points is presented. This optimal transformation is then used to produce the final view. The proposed approach was evaluated using both human models and in vivo data. The evaluation results of the proposed correspondence matrix estimation algorithm prove its ability to reduce the error and to produce an accurate transformation. The results also show that when other approaches fail, the proposed approach can produce an expanded view. In this work, a real-time dynamic field-of-view expansion approach that can work in all situations regardless of images’ overlap is proposed. It outperforms the previous approaches and can also work at 21 fps.

Comparison of a supplemental wide field of view versus a single field of view with zoom on performance in minimally invasive surgery

2007 ◽  
Vol 22 (6) ◽  
pp. 1445-1451 ◽  
Author(s):  
Alex Cao ◽  
R. Darin Ellis ◽  
Elizabeth D. Klein ◽  
Gregory W. Auner ◽  
Michael D. Klein ◽  
...  
Keyword(s):  
Minimally Invasive Surgery ◽  
Minimally Invasive ◽  
Invasive Surgery ◽  
Field Of View ◽  
Wide Field ◽  
Wide Field Of View ◽  
Single Field

scholarly journals Designing a New Endoscope for Panoramic-View with Focus-Area 3D-Vision in Minimally Invasive Surgery

2019 ◽  
Vol 40 (2) ◽  
pp. 204-219
Author(s):  
Dinh Thai Kim ◽  
Ching-Hwa Cheng ◽  
Don-Gey Liu ◽  
Kai Che Jack Liu ◽  
Wayne Shih Wei Huang
Keyword(s):  
Minimally Invasive Surgery ◽  
Minimally Invasive ◽  
Real Time ◽  
Invasive Surgery ◽  
Depth Perception ◽  
Frame Rate ◽  
Image Stitching ◽  
Panoramic View ◽  
3D Vision ◽  
3D Surface

Abstract Purpose The minimally invasive surgery (MIS) has shown advantages when compared to traditional surgery. However, there are two major challenges in the MIS technique: the limited field of view (FOV) and the lack of depth perception provided by the standard monocular endoscope. Therefore, in this study, we proposed a New Endoscope for Panoramic-View with Focus-Area 3D-Vision (3DMISPE) in order to provide surgeons with a broad view field and 3D images in the surgical area for real-time display. Method The proposed system consisted of two endoscopic cameras fixed to each other. Compared to our previous study, the proposed algorithm for the stitching videos was novel. This proposed stitching algorithm was based on the stereo vision synthesis theory. Thus, this new method can support 3D reconstruction and image stitching at the same time. Moreover, our approach employed the same functions on reconstructing 3D surface images by calculating the overlap region’s disparity and performing image stitching with the two-view images from both the cameras. Results The experimental results demonstrated that the proposed method can combine two endoscope’s FOV into one wider FOV. In addition, the part in the overlap region could also be synthesized for a 3D display to provide more information about depth and distance, with an error of about 1 mm. In the proposed system, the performance could achieve a frame rate of up to 11.3 fps on a single Intel i5-4590 CPU computer and 17.6 fps on a computer with an additional GTX1060 Nvidia GeForce GPU. Furthermore, the proposed stitching method in this study could be made 1.4 times after when compared to that in our previous report. Besides, our method also improved stitched image quality by significantly reducing the alignment errors or “ghosting” when compared to the SURF-based stitching method employed in our previous study. Conclusion The proposed system can provide a more efficient way for the doctors with a broad area of view while still providing a 3D surface image in real-time applications. Our system give promises to improve existing limitations in laparoscopic surgery such as the limited FOV and the lack of depth perception.

Estimation of Incision Patterns Based on Visual Tracking of Surgical Tools in Minimally Invasive Surgery

2010 ◽  
Author(s):  
Xiaochuan Sun ◽  
Shahram Payandeh
Keyword(s):  
Minimally Invasive Surgery ◽  
Minimally Invasive ◽  
Invasive Surgery ◽  
Dimensional Space ◽  
Three Dimensional ◽  
Ground Truth ◽  
Specific Pattern ◽  
Coordinate Frame ◽  
Specific Procedure ◽  
Surgical Tools

In minimally invasive surgery, the positions of surgical tools are important in multiple instruments set-up and procedures. Typically, each surgery requires 4–5 incision holes and for each specific procedure, the layout of points defines specific pattern. Taking advantage of this possible one-to-one relationship between a specific procedure in minimally invasive surgery and the incision patterns, such patterns can be utilized in tele-monitoring of trainee during an emulated surgical operation. For example, in performance evaluation of trainee, this procedure would automatically estimate and verify the initial incision pattern to that of the predefined expected template associated with a particular surgical procedure. In this paper, we propose and analyze two models, based on color and shape respectively, to reconstruct the pattern. Both approaches use image information only to reconstruct the incision patterns in three dimensional space. The challenge of monocular endoscopic view is the lack of depth perception which hindered the vision-based tracking of laparoscopic tools. To address the problem, we present a method to determine not only the spatial tip position of the surgical tools, but also their orientation with respect to the camera coordinate frame. Detailed formulation shows that how segmented tool edges and camera field of view localize the 3D orientations of tools. Then, 3D position of the tool tip is reconstructed using either color or edge detection method. Finally, the orientations and the position of tool tips uniquely determine the poses of the tools. From above procedures, geometrical models of cylindrical tools can be constructed in each sequence of mono-camera images. To further use the tracking result in order to localize the incision point, we computed the vectors of the cylindrical tool center lines at multiple poses at number of frames. Extracted incision point is further analyzed as a recognition pattern to map into the patients’ pre-operative incision procedure. Accuracy of 3D tool pose estimation and incision pattern is evaluated in real image sequences with known ground truth.

V1695: Minimizing Minimally Invasive Surgery: the Three Port Robotic Pyeloplasty

2004 ◽  
Vol 171 (4S) ◽  
pp. 448-448
Author(s):  
Farjaad M. Siddiq ◽  
Patrick Villicana ◽  
Raymond J. Leveillee
Keyword(s):  
Minimally Invasive Surgery ◽  
Minimally Invasive ◽  
Invasive Surgery ◽  
Robotic Pyeloplasty
Sign in / Sign up

Export Citation Format

Share Document