scholarly journals Object Detection and Depth Estimation Approach Based on Deep Convolutional Neural Networks

Sensors ◽  
2021 ◽  
Vol 21 (14) ◽  
pp. 4755
Author(s):  
Huai-Mu Wang ◽  
Huei-Yung Lin ◽  
Chin-Chen Chang
Keyword(s):  
Neural Networks ◽  
Object Detection ◽  
Real Time ◽  
Convolutional Neural Networks ◽  
Prediction Accuracy ◽  
Depth Estimation ◽  
Disparity Estimation ◽  
Depth Information ◽  
Deep Convolutional Neural Networks ◽  
Epipolar Constraint

In this paper, we present a real-time object detection and depth estimation approach based on deep convolutional neural networks (CNNs). We improve object detection through the incorporation of transfer connection blocks (TCBs), in particular, to detect small objects in real time. For depth estimation, we introduce binocular vision to the monocular-based disparity estimation network, and the epipolar constraint is used to improve prediction accuracy. Finally, we integrate the two-dimensional (2D) location of the detected object with the depth information to achieve real-time detection and depth estimation. The results demonstrate that the proposed approach achieves better results compared to conventional methods.

scholarly journals Real-time intraoperative glioma diagnosis using fluorescence imaging and deep convolutional neural networks

2021 ◽  
Author(s):  
Biluo Shen ◽  
Zhe Zhang ◽  
Xiaojing Shi ◽  
Caiguang Cao ◽  
Zeyu Zhang ◽  
...  
Keyword(s):  
Neural Networks ◽  
Real Time ◽  
Fluorescence Imaging ◽  
Convolutional Neural Networks ◽  
Frozen Section ◽  
Fluorescent Imaging ◽  
Pathological Diagnosis ◽  
Pathological Examination ◽  
Deep Convolutional Neural Networks ◽  
Fluorescence Images

Abstract Purpose Surgery is the predominant treatment modality of human glioma but suffers difficulty on clearly identifying tumor boundaries in clinic. Conventional practice involves neurosurgeon’s visual evaluation and intraoperative histological examination of dissected tissues using frozen section, which is time-consuming and complex. The aim of this study was to develop fluorescent imaging coupled with artificial intelligence technique to quickly and accurately determine glioma in real-time during surgery. Methods Glioma patients (N = 23) were enrolled and injected with indocyanine green for fluorescence image–guided surgery. Tissue samples (N = 1874) were harvested from surgery of these patients, and the second near-infrared window (NIR-II, 1000–1700 nm) fluorescence images were obtained. Deep convolutional neural networks (CNNs) combined with NIR-II fluorescence imaging (named as FL-CNN) were explored to automatically provide pathological diagnosis of glioma in situ in real-time during patient surgery. The pathological examination results were used as the gold standard. Results The developed FL-CNN achieved the area under the curve (AUC) of 0.945. Comparing to neurosurgeons’ judgment, with the same level of specificity >80%, FL-CNN achieved a much higher sensitivity (93.8% versus 82.0%, P < 0.001) with zero time overhead. Further experiments demonstrated that FL-CNN corrected >70% of the errors made by neurosurgeons. FL-CNN was also able to rapidly predict grade and Ki-67 level (AUC 0.810 and 0.625) of tumor specimens intraoperatively. Conclusion Our study demonstrates that deep CNNs are better at capturing important information from fluorescence images than surgeons’ evaluation during patient surgery. FL-CNN is highly promising to provide pathological diagnosis intraoperatively and assist neurosurgeons to obtain maximum resection safely. Trial registration ChiCTR ChiCTR2000029402. Registered 29 January 2020, retrospectively registered

scholarly journals Identification of Tomato Disease Types and Detection of Infected Areas Based on Deep Convolutional Neural Networks and Object Detection Techniques

2019 ◽  
Vol 2019 ◽  
pp. 1-15 ◽  
Author(s):  
Qimei Wang ◽  
Feng Qi ◽  
Minghe Sun ◽  
Jianhua Qu ◽  
Jie Xue
Keyword(s):  
Neural Networks ◽  
Object Detection ◽  
Convolutional Neural Networks ◽  
Detection Methods ◽  
Disease Detection ◽  
Deep Convolutional Neural Networks ◽  
Detection Techniques ◽  
Tomato Diseases ◽  
Validation Set ◽  
Tomato Disease

This study develops tomato disease detection methods based on deep convolutional neural networks and object detection models. Two different models, Faster R-CNN and Mask R-CNN, are used in these methods, where Faster R-CNN is used to identify the types of tomato diseases and Mask R-CNN is used to detect and segment the locations and shapes of the infected areas. To select the model that best fits the tomato disease detection task, four different deep convolutional neural networks are combined with the two object detection models. Data are collected from the Internet and the dataset is divided into a training set, a validation set, and a test set used in the experiments. The experimental results show that the proposed models can accurately and quickly identify the eleven tomato disease types and segment the locations and shapes of the infected areas.

scholarly journals Object detection in real time based on improved single shot multi-box detector algorithm

2020 ◽  
Vol 2020 (1) ◽  
Author(s):  
Ashwani Kumar ◽  
Zuopeng Justin Zhang ◽  
Hongbo Lyu
Keyword(s):  
Neural Networks ◽  
Object Detection ◽  
Real Time ◽  
Convolutional Neural Networks ◽  
Single Layer ◽  
Single Shot ◽  
Convolutional Network ◽  
Detection Techniques ◽  
Computational Performance ◽  
Speed Up

Abstract In today’s scenario, the fastest algorithm which uses a single layer of convolutional network to detect the objects from the image is single shot multi-box detector (SSD) algorithm. This paper studies object detection techniques to detect objects in real time on any device running the proposed model in any environment. In this paper, we have increased the classification accuracy of detecting objects by improving the SSD algorithm while keeping the speed constant. These improvements have been done in their convolutional layers, by using depth-wise separable convolution along with spatial separable convolutions generally called multilayer convolutional neural networks. The proposed method uses these multilayer convolutional neural networks to develop a system model which consists of multilayers to classify the given objects into any of the defined classes. The schemes then use multiple images and detect the objects from these images, labeling them with their respective class label. To speed up the computational performance, the proposed algorithm is applied along with the multilayer convolutional neural network which uses a larger number of default boxes and results in more accurate detection. The accuracy in detecting the objects is checked by different parameters such as loss function, frames per second (FPS), mean average precision (mAP), and aspect ratio. Experimental results confirm that our proposed improved SSD algorithm has high accuracy.

Sign in / Sign up

Export Citation Format

Share Document