scholarly journals Automatic Recognition of Ripening Tomatoes by Combining Multi-Feature Fusion with a Bi-Layer Classification Strategy for Harvesting Robots

Sensors ◽  
2019 ◽  
Vol 19 (3) ◽  
pp. 612 ◽  
Author(s):  
Jingui Wu ◽  
Baohua Zhang ◽  
Jun Zhou ◽  
Yingjun Xiong ◽  
Baoxing Gu ◽  
...  
Keyword(s):  
Feature Fusion ◽  
Relevance Vector Machine ◽  
Automatic Recognition ◽  
Detection Accuracy ◽  
Multiple Features ◽  
Relief Algorithm ◽  
Inertial Moment ◽  
Classification Strategy ◽  
Robotic Harvesting ◽  
Tomato Detection

Automatic recognition of ripening tomatoes is a main hurdle precluding the replacement of manual labour by robotic harvesting. In this paper, we present a novel automatic algorithm for recognition of ripening tomatoes using an improved method that combines multiple features, feature analysis and selection, a weighted relevance vector machine (RVM) classifier, and a bi-layer classification strategy. The algorithm operates using a two-layer strategy. The first-layer classification strategy aims to identify tomato-containing regions in images using the colour difference information. The second classification strategy is based on a classifier that is trained on multi-medium features. In our proposed algorithm, to simplify the calculation and to improve the recognition efficiency, the processed images are divided into 9 × 9 pixel blocks, and these blocks, rather than single pixels, are considered as the basic units in the classification task. Six colour-related features, namely the Red (R), Green (G), Blue (B), Hue (H), Saturation (S) and Intensity (I) components, respectively, colour components, and five textural features (entropy, energy, correlation, inertial moment and local smoothing) were extracted from pixel blocks. Relevant features and their weights were analysed using the iterative RELIEF (I-RELIEF) algorithm. The image blocks were classified into different categories using a weighted RVM classifier based on the selected relevant features. The final results of tomato recognition were determined by combining the block classification results and the bi-layer classification strategy. The algorithm demonstrated the detection accuracy of 94.90% on 120 images, this suggests that the proposed algorithm is effective and suitable for tomato detection

scholarly journals Multi-Feature Fusion for Weak Target Detection on Sea-Surface Based on FAR Controllable Deep Forest Model

2021 ◽  
Vol 13 (4) ◽  
pp. 812
Author(s):  
Jiahuan Zhang ◽  
Hongjun Song
Keyword(s):  
Target Detection ◽  
Feature Fusion ◽  
Feature Space ◽  
Sea Surface ◽  
Detection Accuracy ◽  
Forest Model ◽  
High Profile ◽  
Deep Forest ◽  
Positive Effect ◽  
Weak Target

Target detection on the sea-surface has always been a high-profile problem, and the detection of weak targets is one of the most difficult problems and the key issue under this problem. Traditional techniques, such as imaging, cannot effectively detect these types of targets, so researchers choose to start by mining the characteristics of the received echoes and other aspects for target detection. This paper proposes a false alarm rate (FAR) controllable deep forest model based on six-dimensional feature space for efficient and accurate detection of weak targets on the sea-surface. This is the first attempt at the deep forest model in this field. The validity of the model was verified on IPIX data, and the detection probability was compared with other proposed methods. Under the same FAR condition, the average detection accuracy rate of the proposed method could reach over 99.19%, which is 9.96% better than the results of the current most advanced method (K-NN FAR-controlled Detector). Experimental results show that multi-feature fusion and the use of a suitable detection framework have a positive effect on the detection of weak targets on the sea-surface.

Improved SSD-assisted algorithm for surface defect detection of electromagnetic luminescence

2021 ◽  
pp. 1748006X2199538
Author(s):  
Zhenying Xu ◽  
Ziqian Wu ◽  
Wei Fan
Keyword(s):  
Defect Detection ◽  
Feature Fusion ◽  
Recognition Rate ◽  
Detection Methods ◽  
Small Scale ◽  
Detection Accuracy ◽  
Single Shot ◽  
Surface Defect Detection ◽  
Feature Pyramid ◽  
Small Feature

Defect detection of electromagnetic luminescence (EL) cells is the core step in the production and preparation of solar cell modules to ensure conversion efficiency and long service life of batteries. However, due to the lack of feature extraction capability for small feature defects, the traditional single shot multibox detector (SSD) algorithm performs not well in EL defect detection with high accuracy. Consequently, an improved SSD algorithm with modification in feature fusion in the framework of deep learning is proposed to improve the recognition rate of EL multi-class defects. A dataset containing images with four different types of defects through rotation, denoising, and binarization is established for the EL. The proposed algorithm can greatly improve the detection accuracy of the small-scale defect with the idea of feature pyramid networks. An experimental study on the detection of the EL defects shows the effectiveness of the proposed algorithm. Moreover, a comparison study shows the proposed method outperforms other traditional detection methods, such as the SIFT, Faster R-CNN, and YOLOv3, in detecting the EL defect.

scholarly journals MTI-YOLO: A Light-Weight and Real-Time Deep Neural Network for Insulator Detection in Complex Aerial Images

Energies ◽  
2021 ◽  
Vol 14 (5) ◽  
pp. 1426
Author(s):  
Chuanyang Liu ◽  
Yiquan Wu ◽  
Jingjing Liu ◽  
Jiaming Han
Keyword(s):  
Feature Detection ◽  
Feature Fusion ◽  
Memory Storage ◽  
Aerial Images ◽  
Detection Accuracy ◽  
Composite Insulator ◽  
Running Time ◽  
Scale Feature ◽  
Multi Scale ◽  
Good Trade

Insulator detection is an essential task for the safety and reliable operation of intelligent grids. Owing to insulator images including various background interferences, most traditional image-processing methods cannot achieve good performance. Some You Only Look Once (YOLO) networks are employed to meet the requirements of actual applications for insulator detection. To achieve a good trade-off among accuracy, running time, and memory storage, this work proposes the modified YOLO-tiny for insulator (MTI-YOLO) network for insulator detection in complex aerial images. First of all, composite insulator images are collected in common scenes and the “CCIN_detection” (Chinese Composite INsulator) dataset is constructed. Secondly, to improve the detection accuracy of different sizes of insulator, multi-scale feature detection headers, a structure of multi-scale feature fusion, and the spatial pyramid pooling (SPP) model are adopted to the MTI-YOLO network. Finally, the proposed MTI-YOLO network and the compared networks are trained and tested on the “CCIN_detection” dataset. The average precision (AP) of our proposed network is 17% and 9% higher than YOLO-tiny and YOLO-v2. Compared with YOLO-tiny and YOLO-v2, the running time of the proposed network is slightly higher. Furthermore, the memory usage of the proposed network is 25.6% and 38.9% lower than YOLO-v2 and YOLO-v3, respectively. Experimental results and analysis validate that the proposed network achieves good performance in both complex backgrounds and bright illumination conditions.

Automatic Recognition of Porcine Abnormalities Based on a Sound Detection and Recognition System

2019 ◽  
Vol 62 (6) ◽  
pp. 1755-1765
Author(s):  
Sunan Zhang ◽  
Jianyan Tian ◽  
Amit Banerjee ◽  
Jiangli Li
Keyword(s):  
Large Scale ◽  
Rapid Development ◽  
Recognition System ◽  
Automatic Recognition ◽  
Farm Animals ◽  
Support Vector ◽  
Support Vector Data Description ◽  
Detection Accuracy ◽  
Sound Detection ◽  
Detection And Recognition

Abstract. With the rapid development of large-scale breeding, manual long-term monitoring of the daily activities and health of livestock is costly and time-consuming. Therefore, the application of bio-acoustics to automatic monitoring has received increasing attention. Although bio-acoustical techniques have been applied to the recognition of animal sounds in many studies, there is a dearth of studies on the automatic recognition of abnormal sounds from farm animals. In this study, an automatic detection and recognition system based on bio-acoustics is proposed to hierarchically recognize abnormal animal states in a large-scale pig breeding environment. In this system, we extracted the mel-frequency cepstral coefficients (MFCC) and subband spectrum centroid (SSC) as composite feature parameters. At the first level, support vector data description (SVDD) is used to detect abnormal sounds in the acoustic data. At the second level, a back-propagation neural network (BPNN) is used to classify five kinds of abnormal sounds in pigs. Furthermore, improved spectral subtraction is developed to reduce the noise interference as much as possible. Experimental results show that the average detection accuracy and the average recognition accuracy of the proposed system are 94.2% and 95.4%, respectively. The effectiveness of the proposed sound detection and recognition system was also verified through tests at a pig farm. Keywords: Abnormal sounds, MFCC, SSC, States of pigs, SVDD.

scholarly journals Application of Two-Level Joint Information Fusion Model in Intelligent Vehicle

2016 ◽  
Vol 12 (03) ◽  
pp. 77
Author(s):  
Yan Ting Lan ◽  
Jiinying Huang ◽  
Xiaodong Chen
Keyword(s):  
Information Fusion ◽  
Feature Fusion ◽  
Target Identification ◽  
Information Source ◽  
Evidence Theory ◽  
Intelligent Vehicles ◽  
Fusion Model ◽  
Multiple Features ◽  
Model Combining ◽  
Real Vehicle

This paper proposes a two-level joint information fusion model combining BP neural network and D-S evidence theory. The model of great practical value reduces target identification error probability by multiple features of the target information, shows good scalability with its two steps of information fusion model, and conveniently increases/reduces feature fusion information source according to different situations and different objects. The method used for intelligent vehicles has good flexibility and robustness in tracking and avoiding obstacle. The simulation and real vehicle tests have verified effectiveness of the method.

scholarly journals Intelligent Ship Detection in Remote Sensing Images Based on Multi-Layer Convolutional Feature Fusion

2020 ◽  
Vol 12 (20) ◽  
pp. 3316 ◽  
Author(s):  
Yulian Zhang ◽  
Lihong Guo ◽  
Zengfa Wang ◽  
Yang Yu ◽  
Xinwei Liu ◽  
...  
Keyword(s):  
Remote Sensing ◽  
Feature Fusion ◽  
Atmospheric Correction ◽  
Recall Rate ◽  
Google Earth ◽  
Superior Performance ◽  
Detection Accuracy ◽  
Remote Sensing Images ◽  
Feature Maps ◽  
Ship Detection

Intelligent detection and recognition of ships from high-resolution remote sensing images is an extraordinarily useful task in civil and military reconnaissance. It is difficult to detect ships with high precision because various disturbances are present in the sea such as clouds, mist, islands, coastlines, ripples, and so on. To solve this problem, we propose a novel ship detection network based on multi-layer convolutional feature fusion (CFF-SDN). Our ship detection network consists of three parts. Firstly, the convolutional feature extraction network is used to extract ship features of different levels. Residual connection is introduced so that the model can be designed very deeply, and it is easy to train and converge. Secondly, the proposed network fuses fine-grained features from shallow layers with semantic features from deep layers, which is beneficial for detecting ship targets with different sizes. At the same time, it is helpful to improve the localization accuracy and detection accuracy of small objects. Finally, multiple fused feature maps are used for classification and regression, which can adapt to ships of multiple scales. Since the CFF-SDN model uses a pruning strategy, the detection speed is greatly improved. In the experiment, we create a dataset for ship detection in remote sensing images (DSDR), including actual satellite images from Google Earth and aerial images from electro-optical pod. The DSDR dataset contains not only visible light images, but also infrared images. To improve the robustness to various sea scenes, images under different scales, perspectives and illumination are obtained through data augmentation or affine transformation methods. To reduce the influence of atmospheric absorption and scattering, a dark channel prior is adopted to solve atmospheric correction on the sea scenes. Moreover, soft non-maximum suppression (NMS) is introduced to increase the recall rate for densely arranged ships. In addition, better detection performance is observed in comparison with the existing models in terms of precision rate and recall rate. The experimental results show that the proposed detection model can achieve the superior performance of ship detection in optical remote sensing image.

scholarly journals MFVT:An Anomaly Traffic Detection Method Merging Feature Fusion Network and Vision Transformer Architecture

2021 ◽  
Author(s):  
Ming Li ◽  
Dezhi Han ◽  
Dun Li ◽  
Han Liu ◽  
Chin- Chen Chang
Keyword(s):  
Deep Learning ◽  
Intrusion Detection ◽  
Network Traffic ◽  
Feature Fusion ◽  
Imbalanced Data ◽  
Network Intrusion Detection ◽  
Detection Accuracy ◽  
Data Sets ◽  
Imbalanced Data Sets ◽  
Network Intrusion

Abstract Network intrusion detection, which takes the extraction and analysis of network traffic features as the main method, plays a vital role in network security protection. The current network traffic feature extraction and analysis for network intrusion detection mostly uses deep learning algorithms. Currently, deep learning requires a lot of training resources, and have weak processing capabilities for imbalanced data sets. In this paper, a deep learning model (MFVT) based on feature fusion network and Vision Transformer architecture is proposed, to which improves the processing ability of imbalanced data sets and reduces the sample data resources needed for training. Besides, to improve the traditional raw traffic features extraction methods, a new raw traffic features extraction method (CRP) is proposed, the CPR uses PCA algorithm to reduce all the processed digital traffic features to the specified dimension. On the IDS 2017 dataset and the IDS 2012 dataset, the ablation experiments show that the performance of the proposed MFVT model is significantly better than other network intrusion detection models, and the detection accuracy can reach the state-of-the-art level. And, When MFVT model is combined with CRP algorithm, the detection accuracy is further improved to 99.99%.

scholarly journals Infield Apple Detection and Grading Based on Multi-Feature Fusion

Horticulturae ◽  
2021 ◽  
Vol 7 (9) ◽  
pp. 276
Author(s):  
Guangrui Hu ◽  
Enyu Zhang ◽  
Jianguo Zhou ◽  
Jian Zhao ◽  
Zening Gao ◽  
...  
Keyword(s):  
Walking Speed ◽  
Surface Defects ◽  
Feature Fusion ◽  
First Grade ◽  
Fruit Shape ◽  
Second Grade ◽  
Support Vector ◽  
Multiple Features ◽  
Detection Algorithms ◽  
Learning Framework

A field-based apple detection and grading device was developed and used to detect and grade apples in the field using a deep learning framework. Four features were selected for apple grading, namely, size, color, shape, and surface defects, and detection algorithms were designed to discriminate between the four features using machine vision and other methods. Then, the four apple features were fused, and a support vector machine (SVM) was used for infield apple grading into three grades: first-grade fruit, second-grade fruit, and other-grade fruit. The results showed that for a single index, the accuracy of detecting the apple size, the fruit shape, the color, and the surface defects, were 99.04%, 97.71%, 98%, and 95.85%. The grading accuracies for the first-grade fruit, second-grade fruit, other-grade fruit, and the average grading accuracy based on multiple features were 94.55%, 95.71%, 100%, and 95.49%, respectively. The field experiment showed that the average grading accuracy was 94.12% when the feeding interval of the apples was less than 1.5 s and the walking speed did not exceed 0.5 m/s, meeting the accuracy requirements of field-based apple grading.

scholarly journals SHIP DETECTION BASED ON MULTIPLE FEATURES IN RANDOM FOREST MODEL FOR HYPERSPECTRAL IMAGES

2018 ◽  
Vol XLII-3 ◽  
pp. 891-895
Author(s):  
N. Li ◽  
L. Ding ◽  
H. Zhao ◽  
J. Shi ◽  
D. Wang ◽  
...  
Keyword(s):  
Random Forest ◽  
Near Infrared ◽  
Texture Features ◽  
Short Wave ◽  
Hyperspectral Images ◽  
Support Vector ◽  
High Signal ◽  
Detection Accuracy ◽  
Multiple Features ◽  
Single Feature

A novel method for detecting ships which aim to make full use of both the spatial and spectral information from hyperspectral images is proposed. Firstly, the band which is high signal-noise ratio in the range of near infrared or short-wave infrared spectrum, is used to segment land and sea on Otsu threshold segmentation method. Secondly, multiple features that include spectral and texture features are extracted from hyperspectral images. Principal components analysis (PCA) is used to extract spectral features, the Grey Level Co-occurrence Matrix (GLCM) is used to extract texture features. Finally, Random Forest (RF) model is introduced to detect ships based on the extracted features. To illustrate the effectiveness of the method, we carry out experiments over the EO-1 data by comparing single feature and different multiple features. Compared with the traditional single feature method and Support Vector Machine (SVM) model, the proposed method can stably achieve the target detection of ships under complex background and can effectively improve the detection accuracy of ships.

Sign in / Sign up

Export Citation Format

Share Document