scholarly journals Automatic Identification of Local Features Representing Image Content with the Use of Convolutional Neural Networks

2020 ◽  
Vol 10 (15) ◽  
pp. 5186
Author(s):  
Paweł Tarasiuk ◽  
Arkadiusz Tomczyk ◽  
Bartłomiej Stasiak
Keyword(s):  
Neural Networks ◽  
Convolutional Neural Networks ◽  
Sparse Matrices ◽  
Local Features ◽  
Automatic Identification ◽  
Image Content ◽  
Data Set ◽  
Practical Applications ◽  
A Value ◽  
Working Principle

Image analysis has many practical applications and proper representation of image content is its crucial element. In this work, a novel type of representation is proposed where an image is reduced to a set of highly sparse matrices. Equivalently, it can be viewed as a set of local features of different types, as precise coordinates of detected keypoints are given. Additionally, every keypoint has a value expressing feature intensity at a given location. These features are extracted from a dedicated convolutional neural network autoencoder. This kind of representation has many advantages. First of all, local features are not manually designed but are automatically trained for a given class of images. Second, as they are trained in a network that restores its input on the output, they may be expected to minimize information loss. Consequently, they can be used to solve similar tasks replacing original images; such an ability was illustrated with image classification task. Third, the generated features, although automatically synthesized, are relatively easy to interpret. Taking a decoder part of our network, one can easily generate a visual building block connected with a specific feature. As the proposed method is entirely new, a detailed analysis of its properties for a relatively simple data set was conducted and is described in this work. Moreover, to present the quality of trained features, it is compared with results of convolutional neural networks having a similar working principle (sparse coding).

scholarly journals Use of Images of Leaves and Fruits of Apple Trees for Automatic Identification of Symptoms of Diseases and Nutritional Disorders

2017 ◽  
Vol 5 (2) ◽  
pp. 1-14
Author(s):  
Lucas Garcia Nachtigall ◽  
Ricardo Matsumura Araujo ◽  
Gilmar Ribeiro Nachtigall
Keyword(s):  
Machine Learning ◽  
Neural Networks ◽  
Convolutional Neural Networks ◽  
Rapid Diagnosis ◽  
Nutritional Deficiencies ◽  
Automatic Identification ◽  
Apple Trees ◽  
Data Set ◽  
Apple Fruits

Rapid diagnosis of symptoms caused by pest attack, diseases and nutritional or physiological disorders in apple orchards is essential to avoid greater losses. This paper aimed to evaluate the efficiency of Convolutional Neural Networks (CNN) to automatically detect and classify symptoms of diseases, nutritional deficiencies and damage caused by herbicides in apple trees from images of their leaves and fruits. A novel data set was developed containing labeled examples consisting of approximately 10,000 images of leaves and apple fruits divided into 12 classes, which were classified by algorithms of machine learning, with emphasis on models of deep learning. The results showed trained CNNs can overcome the performance of experts and other algorithms of machine learning in the classification of symptoms in apple trees from leaves images, with an accuracy of 97.3% and obtain 91.1% accuracy with fruit images. In this way, the use of Convolutional Neural Networks may enable the diagnosis of symptoms in apple trees in a fast, precise and usual way.

scholarly journals Use of Images of Leaves and Fruits of Apple Trees for Automatic Identification of Symptoms of Diseases and Nutritional Disorders

2020 ◽  
pp. 1072-1086
Author(s):  
Lucas Garcia Nachtigall ◽  
Ricardo Matsumura Araujo ◽  
Gilmar Ribeiro Nachtigall
Keyword(s):  
Machine Learning ◽  
Neural Networks ◽  
Convolutional Neural Networks ◽  
Rapid Diagnosis ◽  
Nutritional Deficiencies ◽  
Automatic Identification ◽  
Apple Trees ◽  
Data Set ◽  
Apple Fruits

Rapid diagnosis of symptoms caused by pest attack, diseases and nutritional or physiological disorders in apple orchards is essential to avoid greater losses. This paper aimed to evaluate the efficiency of Convolutional Neural Networks (CNN) to automatically detect and classify symptoms of diseases, nutritional deficiencies and damage caused by herbicides in apple trees from images of their leaves and fruits. A novel data set was developed containing labeled examples consisting of approximately 10,000 images of leaves and apple fruits divided into 12 classes, which were classified by algorithms of machine learning, with emphasis on models of deep learning. The results showed trained CNNs can overcome the performance of experts and other algorithms of machine learning in the classification of symptoms in apple trees from leaves images, with an accuracy of 97.3% and obtain 91.1% accuracy with fruit images. In this way, the use of Convolutional Neural Networks may enable the diagnosis of symptoms in apple trees in a fast, precise and usual way.

scholarly journals Convolutional Neural Networks Model in Premature Detection of Melanoma

2019 ◽  
Vol 8 (12S2) ◽  
pp. 6-11 ◽  
Keyword(s):  
Neural Networks ◽  
Skin Cancer ◽  
Convolutional Neural Networks ◽  
Additional Data ◽  
Data Set ◽  
Non Invasive ◽  
Convolution Filter ◽  
The University ◽  
Improved Accuracy

The objective of this research is provide to the specialists in skin cancer, a premature, rapid and non-invasive diagnosis of melanoma identification, using an image of the lesion, to apply to the treatment of a patient, the method used is the architecture contrast of Convolutional neural networks proposed by Laura Kocobinski of the University of Boston, against our architecture, which reduce the depth of the convolution filter of the last two convolutional layers to obtain maps of more significant characteristics. The performance of the model was reflected in the accuracy during the validation, considering the best result obtained, which is confirmed with the additional data set. The findings found with the application of this base architecture were improved accuracy from 0.79 to 0.83, with 30 epochs, compared to Kocobinski's AlexNet architecture, it was not possible to improve the accuracy of 0.90, however, the complexity of the network played an important role in the results we obtained, which was able to balance and obtain better results without increasing the epochs, the application of our research is very helpful for doctors, since it will allow them to quickly identify if an injury is melanoma or not and consequently treat it efficiently.

scholarly journals Multiple-Oriented and Small Object Detection with Convolutional Neural Networks for Aerial Image

2019 ◽  
Vol 11 (18) ◽  
pp. 2176 ◽  
Author(s):  
Chen ◽  
Zhong ◽  
Tan
Keyword(s):  
Neural Networks ◽  
Object Detection ◽  
Convolutional Neural Networks ◽  
Aerial Images ◽  
Superior Performance ◽  
Aerial Image ◽  
Detection Accuracy ◽  
Small Object ◽  
Data Set ◽  
Orientation Information

Detecting objects in aerial images is a challenging task due to multiple orientations and relatively small size of the objects. Although many traditional detection models have demonstrated an acceptable performance by using the imagery pyramid and multiple templates in a sliding-window manner, such techniques are inefficient and costly. Recently, convolutional neural networks (CNNs) have successfully been used for object detection, and they have demonstrated considerably superior performance than that of traditional detection methods; however, this success has not been expanded to aerial images. To overcome such problems, we propose a detection model based on two CNNs. One of the CNNs is designed to propose many object-like regions that are generated from the feature maps of multi scales and hierarchies with the orientation information. Based on such a design, the positioning of small size objects becomes more accurate, and the generated regions with orientation information are more suitable for the objects arranged with arbitrary orientations. Furthermore, another CNN is designed for object recognition; it first extracts the features of each generated region and subsequently makes the final decisions. The results of the extensive experiments performed on the vehicle detection in aerial imagery (VEDAI) and overhead imagery research data set (OIRDS) datasets indicate that the proposed model performs well in terms of not only the detection accuracy but also the detection speed.

scholarly journals Evaluation of convolutional neural networks for the classification of falls from heterogeneous thermal vision sensors

2020 ◽  
Vol 16 (5) ◽  
pp. 155014772092048
Author(s):  
Miguel Ángel López-Medina ◽  
Macarena Espinilla ◽  
Chris Nugent ◽  
Javier Medina Quero
Keyword(s):  
Neural Networks ◽  
High Resolution ◽  
Convolutional Neural Networks ◽  
Viewing Angle ◽  
Vision Sensor ◽  
Low Resolution ◽  
Data Set ◽  
Wide Viewing Angle ◽  
Vision Sensors ◽  
Thermal Vision

The automatic detection of falls within environments where sensors are deployed has attracted considerable research interest due to the prevalence and impact of falling people, especially the elderly. In this work, we analyze the capabilities of non-invasive thermal vision sensors to detect falls using several architectures of convolutional neural networks. First, we integrate two thermal vision sensors with different capabilities: (1) low resolution with a wide viewing angle and (2) high resolution with a central viewing angle. Second, we include fuzzy representation of thermal information. Third, we enable the generation of a large data set from a set of few images using ad hoc data augmentation, which increases the original data set size, generating new synthetic images. Fourth, we define three types of convolutional neural networks which are adapted for each thermal vision sensor in order to evaluate the impact of the architecture on fall detection performance. The results show encouraging performance in single-occupancy contexts. In multiple occupancy, the low-resolution thermal vision sensor with a wide viewing angle obtains better performance and reduction of learning time, in comparison with the high-resolution thermal vision sensors with a central viewing angle.

scholarly journals Inter-Class Angular Loss for Convolutional Neural Networks

2019 ◽  
Vol 33 ◽  
pp. 3894-3901 ◽  
Author(s):  
Le Hui ◽  
Xiang Li ◽  
Chen Gong ◽  
Meng Fang ◽  
Joey Tianyi Zhou ◽  
...  
Keyword(s):  
Neural Networks ◽  
Convolutional Neural Networks ◽  
Deep Neural Networks ◽  
Learning Difficulties ◽  
Feature Space ◽  
Superior Performance ◽  
Strongly Correlated ◽  
Discriminative Ability ◽  
Practical Applications ◽  
Classification Tasks

Convolutional Neural Networks (CNNs) have shown great power in various classification tasks and have achieved remarkable results in practical applications. However, the distinct learning difficulties in discriminating different pairs of classes are largely ignored by the existing networks. For instance, in CIFAR-10 dataset, distinguishing cats from dogs is usually harder than distinguishing horses from ships. By carefully studying the behavior of CNN models in the training process, we observe that the confusion level of two classes is strongly correlated with their angular separability in the feature space. That is, the larger the inter-class angle is, the lower the confusion will be. Based on this observation, we propose a novel loss function dubbed “Inter-Class Angular Loss” (ICAL), which explicitly models the class correlation and can be directly applied to many existing deep networks. By minimizing the proposed ICAL, the networks can effectively discriminate the examples in similar classes by enlarging the angle between their corresponding class vectors. Thorough experimental results on a series of vision and nonvision datasets confirm that ICAL critically improves the discriminative ability of various representative deep neural networks and generates superior performance to the original networks with conventional softmax loss.

scholarly journals Automatic Gully Detection: Neural Networks and Computer Vision

2020 ◽  
Vol 12 (11) ◽  
pp. 1743
Author(s):  
Artur M. Gafurov ◽  
Oleg P. Yermolayev
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Convolutional Neural Networks ◽  
Large Scale ◽  
Satellite Images ◽  
Gully Erosion ◽  
Training Data ◽  
Russian Plain ◽  
Data Set ◽  
High Resolution Satellite Images

Transition from manual (visual) interpretation to fully automated gully detection is an important task for quantitative assessment of modern gully erosion, especially when it comes to large mapping areas. Existing approaches to semi-automated gully detection are based on either object-oriented selection based on multispectral images or gully selection based on a probabilistic model obtained using digital elevation models (DEMs). These approaches cannot be used for the assessment of gully erosion on the territory of the European part of Russia most affected by gully erosion due to the lack of national large-scale DEM and limited resolution of open source multispectral satellite images. An approach based on the use of convolutional neural networks for automated gully detection on the RGB-synthesis of ultra-high resolution satellite images publicly available for the test region of the east of the Russian Plain with intensive basin erosion has been proposed and developed. The Keras library and U-Net architecture of convolutional neural networks were used for training. Preliminary results of application of the trained gully erosion convolutional neural network (GECNN) allow asserting that the algorithm performs well in detecting active gullies, well differentiates gullies from other linear forms of slope erosion — rills and balkas, but so far has errors in detecting complex gully systems. Also, GECNN does not identify a gully in 10% of cases and in another 10% of cases it identifies not a gully. To solve these problems, it is necessary to additionally train the neural network on the enlarged training data set.

scholarly journals Fully Convolutional Neural Networks for Automotive Radar Interference Mitigation

2020 ◽  
Author(s):  
Nicolae-Catalin Ristea ◽  
Andrei Anghel ◽  
Radu Tudor Ionescu
Keyword(s):  
Neural Networks ◽  
Convolutional Neural Networks ◽  
Large Scale ◽  
Interference Mitigation ◽  
Continuous Wave ◽  
Automotive Radar ◽  
Driver Assistance Systems ◽  
Data Set ◽  
Radar Sensors ◽  
Fully Convolutional Neural Networks

The interest of the automotive industry has progressively focused on subjects related to driver assistance systems as well as autonomous cars. In order to achieve remarkable results, cars combine a variety of sensors to perceive their surroundings robustly. Among them, radar sensors are indispensable because of their independence of light conditions and the possibility to directly measure velocity. However, radar interference is an issue that becomes prevalent with the increasing amount of radar systems in automotive scenarios. In this paper, we address this issue for frequency modulated continuous wave (FMCW) radars with fully convolutional neural networks (FCNs), a state-of-the-art deep learning technique. We propose two FCNs that take spectrograms of the beat signals as input, and provide the corresponding clean range profiles as output. We propose two architectures for interference mitigation which outperform the classical zeroing technique. Moreover, considering the lack of databases for this task, we release as open source a large scale data set that closely replicates real world automotive scenarios for single-interference cases, allowing others to compare objectively their future work in this domain. The data set is available for download at: http://github.com/ristea/arim.

scholarly journals Plant Diseases Identification through a Discount Momentum Optimizer in Deep Learning

2021 ◽  
Vol 11 (20) ◽  
pp. 9468
Author(s):  
Yunyun Sun ◽  
Yutong Liu ◽  
Haocheng Zhou ◽  
Huijuan Hu
Keyword(s):  
Neural Networks ◽  
Deep Learning ◽  
Convolutional Neural Networks ◽  
Adaptive Learning ◽  
Learning Rate ◽  
Plant Diseases ◽  
Stochastic Gradient Descent ◽  
Automatic Identification ◽  
Deep Convolutional Neural Networks ◽  
Adaptive Learning Rate

Deep learning proves its promising results in various domains. The automatic identification of plant diseases with deep convolutional neural networks attracts a lot of attention at present. This article extends stochastic gradient descent momentum optimizer and presents a discount momentum (DM) deep learning optimizer for plant diseases identification. To examine the recognition and generalization capability of the DM optimizer, we discuss the hyper-parameter tuning and convolutional neural networks models across the plantvillage dataset. We further conduct comparison experiments on popular non-adaptive learning rate methods. The proposed approach achieves an average validation accuracy of no less than 97% for plant diseases prediction on several state-of-the-art deep learning models and holds a low sensitivity to hyper-parameter settings. Experimental results demonstrate that the DM method can bring a higher identification performance, while still maintaining a competitive performance over other non-adaptive learning rate methods in terms of both training speed and generalization.

Sign in / Sign up

Export Citation Format

Share Document