Ensemble Method of Deep Learning, Color Segmentation, and Image Transformation to Track, Localize, and Count Cotton Bolls Using a Moving Camera in Real-Time

2021 ◽  
Vol 64 (1) ◽  
pp. 341-352
Author(s):  
Kadeghe G. Fue ◽  
Wesley M. Porter ◽  
Edward M. Barnes ◽  
Glen C. Rains
Keyword(s):  
Image Processing ◽  
Deep Learning ◽  
Embedded System ◽  
Ensemble Method ◽  
Color Segmentation ◽  
Detection Accuracy ◽  
List Type ◽  
Learning Method ◽  
Image Transformation ◽  
Cotton Bolls

HighlightsAn ensemble method using color segmentation, deep learning, and image transformation was developed.Experiments were conducted to compare the method with other state-of-the-art tracking algorithms.The optimized ensemble method to track bolls achieved 94.4% accuracy using weakly trained tiny YOLOv2 models.The method achieved 7.6 frames per second and outperformed five other tracking methods.Abstract. In robotic applications, good perception can be computationally costly and create undesirable latency before a control decision is initiated. Most of the methods available for object detection deep learning are either fast with low accuracy or slow with high accuracy. Fast and accurate methods are necessary to track and localize objects such as cotton bolls that may be visible or occluded by each other or not well illuminated. In this study, an ensemble of a deep learning method and other image processing techniques was used to detect cotton bolls in-field on defoliated plants. In each image, a trained deep learning method, the YOLOv2 model, was used to detect open cotton bolls, and color segmentation was applied to confirm if the bolls detected by the YOLOv2 model were actually white to avoid false positives. Boll tracking was performed by following the spatial movement of good features on the edges of the bolls using the Lucas-Kanade algorithm. An image transformation algorithm was applied to the next image in case the previously detected boll was lost to retrieve the information of the missing boll. Each tracked and localized boll was stored and counted to give the total number of bolls detected. In this study, detection accuracy was sacrificed for image processing speed by using the YOLOv2 model. Detection accuracy was improved by using an ensemble method that combined image color segmentation, optical flow, and image transformation. This method was compared to eight other open-source methods implemented in OpenCV. The ensemble method detected and counted bolls at a speed of 7.6 fps with an accuracy of 94.4% using the Jetson TX2 embedded system to process 1K resolution images, outperforming the other OpenCV methods in various measurements. Keywords: Boll counting, Cotton, Cotton harvesting, DarkFlow, Darknet, Deep learning, Machine vision, YOLOv2.

scholarly journals Deep Learning- Based Surveillance System using Face Recognition

2020 ◽  
Vol 32 ◽  
pp. 03011
Author(s):  
Divya Kapil ◽  
Aishwarya Kamtam ◽  
Akhil Kedare ◽  
Smita Bharne
Keyword(s):  
Neural Network ◽  
Image Processing ◽  
Deep Learning ◽  
Face Recognition ◽  
Convolutional Neural Network ◽  
Surveillance System ◽  
Surveillance Systems ◽  
Learning Method ◽  
Security Systems ◽  
The Face

Surveillance systems are used for the monitoring the activities directly or indirectly. Most of the surveillance system uses the face recognition techniques to monitor the activities. This system builds the automated contemporary biometric surveillance system based on deep learning. The application of the system can be used in various ways. The face prints of the persons will be stored inside the database with relevant statistics and does the face recognition. When any unknown face is recognized then alarm will ring so one can alert the security systems and in addition actions will be taken. The system learns changes while detecting faces automatically using deep learning and gain correct accuracy in face recognition. A deep learning method including Convolutional Neural Network (CNN) is having great significance in the area of image processing. This system can be applicable to monitor the activities for the housing society premises.

scholarly journals Ball Classification through Object Detection using Deep Learning for Handball

Mekatronika ◽  
2020 ◽  
Vol 2 (2) ◽  
pp. 49-54
Author(s):  
Arzielah Ashiqin Alwi ◽  
Ahmad Najmuddin Ibrahim ◽  
Muhammad Nur Aiman Shapiee ◽  
Muhammad Ar Rahim Ibrahim ◽  
Mohd Azraai Mohd Razman ◽  
...  
Keyword(s):  
Image Processing ◽  
Computer Vision ◽  
Deep Learning ◽  
Performance Analysis ◽  
Object Detection ◽  
High Speed ◽  
Detection Accuracy ◽  
Narrow Angle ◽  
Target Locations ◽  
Ball Detection

Dynamic gameplay, fast-paced and fast-changing gameplay, where angle shooting (top and bottom corner) has the best chance of a good goal, are the main aspects of handball. When it comes to the narrow-angle area, the goalkeeper has trouble blocked the goal. Therefore, this research discusses image processing to investigate the shooting precision performance analysis to detect the ball's accuracy at high speed. In the handball goal, the participants had to complete 50 successful shots at each of the four target locations. Computer vision will then be implemented through a camera to identify the ball, followed by determining the accuracy of the ball position of floating, net tangle and farthest or smallest using object detection as the accuracy marker. The model will be trained using Deep Learning (DL)  models of YOLOv2, YOLOv3, and Faster R-CNN and the best precision models of ball detection accuracy were compared. It was found that the best performance of the accuracy of the classifier Faster R-CNN produces 99% for all ball positions.

scholarly journals Detection of Cotton Plant Diseases Using Deep Transfer Learning

2021 ◽  
Author(s):  
Vani Rajasekar ◽  
K Venu ◽  
Soumya Ranjan Jena ◽  
R. Janani Varthini ◽  
S. Ishwarya
Keyword(s):  
Neural Networks ◽  
Image Processing ◽  
Deep Learning ◽  
State Of The Art ◽  
Plant Diseases ◽  
The Other ◽  
Convolution Kernel ◽  
Learning Method ◽  
Specific Task ◽  
Classification Problems

Agriculture is a vital part of every country’s economy, and India is regarded an agro-based nation. One of the main purposes of agriculture is to yield healthy crops without any disease. Cotton is a significant crop in India in relation to income. India is the world’s largest producer of cotton. Cotton crops are affected when leaves fall off early or become afflicted with diseases. Farmers and planting experts, on the other hand, have faced numerous concerns and ongoing agricultural obstacles for millennia, including much cotton disease. Because severe cotton disease can result in no grain harvest, a rapid, efficient, less expensive and reliable approach for detecting cotton illnesses is widely wanted in the agricultural information area. Deep learning method is used to solve the issue because it will perform exceptionally well in image processing and classification problems. The network was built using a combination of the benefits of both the ResNet pre-trained on ImageNet and the Xception component, and this technique outperforms other state-of-the-art techniques. Every convolution layer with in dense block is tiny, so each convolution kernel is still in charge of learning the tiniest details. The deep convolution neural networks for the detection of plant leaf diseases contemplate utilising a pre-trained model acquired from usual enormous datasets, and then applying it to a specific task educated with their own data. The experimental results show that for ResNet-50, a training accuracy of 0.95 and validation accuracy of 0.98 is obtained whereas training loss of 0.33 and validation loss of 0.5.

Image intelligent automatic processing analysis based on artificial intelligence vision generator

2020 ◽  
pp. 1-10
Author(s):  
Ruijuan Wang ◽  
Wei Zhuo
Keyword(s):  
Artificial Intelligence ◽  
Image Processing ◽  
Deep Learning ◽  
Human Error ◽  
Processing System ◽  
Image Data ◽  
Visual Image ◽  
Automated Analysis ◽  
Learning Method ◽  
Deep Learning Model

The image intelligent processing analysis technology uses a computer to imitate and execute some intellectual functions of the human brain, and realizes an image processing system with artificial intelligence, that is, an image processing analysis technology is an understanding of an image. The degree of intelligent automated analysis and processing is low, many operations need to be done manually, causing human error, inaccurate detection, and time-consuming and laborious. Deep learning method can extract features step by step in the original image from the bottom to the top. Therefore, based on feature analysis technology, this paper uses the deep learning method to intelligently and automatically analyse the visual image. This method only needs to send the image into the system, and then the manual analysis is not needed, and the analysis result of the final image can be obtained. The process is completely intelligent and automatically processed. First, improve the deep learning model and use massive image data to choose and optimize parameters. Results indicate that our method not only automatically derives the semantic information of the image, but also accurately understands the image accurately and improve the work efficiency.

scholarly journals A Hybrid Crack Detection Approach for Scanning Electron Microscope Image Using Deep Learning Method

Scanning ◽  
2021 ◽  
Vol 2021 ◽  
pp. 1-13
Author(s):  
Lun Zhao ◽  
Yunlong Pan ◽  
Sen Wang ◽  
Liang Zhang ◽  
Md Shafiqul Islam
Keyword(s):  
Deep Learning ◽  
Electron Microscope ◽  
Scanning Electron Microscope ◽  
Crack Detection ◽  
Rapid Development ◽  
Detection Accuracy ◽  
Learning Method ◽  
Sem Images ◽  
Bounding Boxes ◽  
Scanning Electron

The scanning electron microscope (SEM) is widely used in the analysis and research of materials, including fracture analysis, microstructure morphology, and nanomaterial analysis. With the rapid development of materials science and computer vision technology, the level of detection technology is constantly improving. In this paper, the deep learning method is used to intelligently identify microcracks in the microscopic morphology of SEM image. A deep learning model based on image level is selected to reduce the interference of other complex microscopic topography, and a detection method with dense continuous bounding boxes suitable for SEM images is proposed. The dense and continuous bounding boxes were used to obtain the local features of the cracks and rotating the bounding boxes to reduce the feature differences between the bounding boxes. Finally, the bounding boxes with filled regression were used to highlight the microcrack detection effect. The results show that the detection accuracy of our approach reached 71.12%, and the highest mIOU reached 64.13%. Also, microcracks in different magnifications and in different backgrounds were detected successfully.

scholarly journals Deep Learning Based Pectoral Muscle Segmentation on MIAS Mammograms

2020 ◽  
Author(s):  
Young Jae Kim ◽  
Eun Young Yoo ◽  
Kwang Gi Kim
Keyword(s):  
Breast Cancer ◽  
Image Processing ◽  
Deep Learning ◽  
Cross Validation ◽  
Pectoral Muscle ◽  
Training Data ◽  
Dice Similarity Coefficient ◽  
Detection Accuracy ◽  
Pectoral Muscle Detection ◽  
Fold Cross Validation

Abstract Background: The purpose of this study was to propose a deep learning-based method for automated detection of the pectoral muscle, in order to reduce misdetection in a computer-aided diagnosis (CAD) system for diagnosing breast cancer in mammography. This study also aimed to assess the performance of the deep learning method for pectoral muscle detection by comparing it to an image processing-based method using the random sample consensus (RANSAC) algorithm. Methods: Using the 322 images in the Mammographic Image Analysis Society (MIAS) database, the pectoral muscle detection model was trained with the U-Net architecture. Of the total data, 80% was allocated as training data and 20% was allocated as test data, and the performance of the deep learning model was tested by 5-fold cross validation. Results: The image processing-based method for pectoral muscle detection using RANSAC showed 92% detection accuracy. Using the 5-fold cross validation, the deep learning-based method showed a mean sensitivity of 95.55%, mean specificity of 99.88%, mean accuracy of 99.67%, and mean Dice similarity coefficient (DSC) of 95.88%. Conclusions: The proposed deep learning-based method of pectoral muscle detection performed better than an existing image processing-based method. In the future, by collecting data from various medical institutions and devices to further train the model and improve its reliability, we expect that this model could greatly reduce misdetection rates by CAD systems for breast cancer diagnosis.

scholarly journals Location Invariant Animal Recognition Using Mixed Source Datasets and Deep Learning

2020 ◽  
Author(s):  
Andrew Shepley ◽  
Greg Falzon ◽  
Paul Meek ◽  
Paul Kwan
Keyword(s):  
Image Processing ◽  
Deep Learning ◽  
Object Detection ◽  
Transfer Learning ◽  
Large Scale ◽  
Camera Trap ◽  
List Type ◽  
Learning Models ◽  
Geographical Regions ◽  
Flickr Images

AbstractA time-consuming challenge faced by camera trap practitioners all over the world is the extraction of meaningful data from images to inform ecological management. The primary methods of image processing used by practitioners includes manual analysis and citizen science. An increasingly popular alternative is automated image classification software. However, most automated solutions are not sufficiently robust to be deployed on a large scale. Key challenges include limited access to images for each species and lack of location invariance when transferring models between sites. This prevents optimal use of ecological data and results in significant expenditure of time and resources to annotate and retrain deep learning models.In this study, we aimed to (a) assess the value of publicly available non-iconic FlickR images in the training of deep learning models for camera trap object detection, (b) develop an out-of-the-box location invariant automated camera trap image processing solution for ecologist using deep transfer learning and (c) explore the use of small subsets of camera trap images in optimisation of a FlickR trained deep learning model for high precision ecological object detection.We collected and annotated a dataset of images of “pigs” (Sus scrofa and Phacochoerus africanus) from the consumer image sharing website FlickR. These images were used to achieve transfer learning using a RetinaNet model in the task of object detection. We compared the performance of this model to the performance of models trained on combinations of camera trap images obtained from five different projects, each characterised by 5 different geographical regions. Furthermore, we explored optimisation of the FlickR model via infusion of small subsets of camera trap images to increase robustness in difficult images.In most cases, the mean Average Precision (mAP) of the FlickR trained model when tested on out of sample camera trap sites (67.21-91.92%) was significantly higher than the mAP achieved by models trained on only one geographical location (4.42-90.8%) and rivalled the mAP of models trained on mixed camera trap datasets (68.96-92.75%). The infusion of camera trap images into the FlickR training further improved AP by 5.10-22.32% to 83.60-97.02%.Ecology researchers can use FlickR images in the training of automated deep learning solutions for camera trap image processing to significantly reduce time and resource expenditure by allowing the development of location invariant, highly robust out-of-the-box solutions. This would allow AI technologies to be deployed on a large scale in ecological applications.

Sign in / Sign up

Export Citation Format

Share Document