scholarly journals Automated Counting of Rice Panicle by Applying Deep Learning Model to Images from Unmanned Aerial Vehicle Platform

Sensors ◽  
2019 ◽  
Vol 19 (14) ◽  
pp. 3106 ◽  
Author(s):  
Chengquan Zhou ◽  
Hongbao Ye ◽  
Jun Hu ◽  
Xiaoyan Shi ◽  
Shan Hua ◽  
...  
Keyword(s):  
Deep Learning ◽  
Unmanned Aerial Vehicle ◽  
Field Experiments ◽  
Disease Diagnosis ◽  
Global Scale ◽  
High Definition ◽  
Convolutional Networks ◽  
Fully Convolutional Networks ◽  
Detection And Counting ◽  
Aerial Vehicle

The number of panicles per unit area is a common indicator of rice yield and is of great significance to yield estimation, breeding, and phenotype analysis. Traditional counting methods have various drawbacks, such as long delay times and high subjectivity, and they are easily perturbed by noise. To improve the accuracy of rice detection and counting in the field, we developed and implemented a panicle detection and counting system that is based on improved region-based fully convolutional networks, and we use the system to automate rice-phenotype measurements. The field experiments were conducted in target areas to train and test the system and used a rotor light unmanned aerial vehicle equipped with a high-definition RGB camera to collect images. The trained model achieved a precision of 0.868 on a held-out test set, which demonstrates the feasibility of this approach. The algorithm can deal with the irregular edge of the rice panicle, the significantly different appearance between the different varieties and growing periods, the interference due to color overlapping between panicle and leaves, and the variations in illumination intensity and shading effects in the field. The result is more accurate and efficient recognition of rice-panicles, which facilitates rice breeding. Overall, the approach of training deep learning models on increasingly large and publicly available image datasets presents a clear path toward smartphone-assisted crop disease diagnosis on a global scale.

scholarly journals Transfer Change Rules from Recurrent Fully Convolutional Networks for Hyperspectral Unmanned Aerial Vehicle Images without Ground Truth Data

2020 ◽  
Vol 12 (7) ◽  
pp. 1099 ◽  
Author(s):  
Ahram Song ◽  
Yongil Kim
Keyword(s):  
Unmanned Aerial Vehicle ◽  
Three Dimensional ◽  
Ground Truth ◽  
Training Data ◽  
Fine Tuning ◽  
Target Domain ◽  
Ground Truth Data ◽  
Convolutional Networks ◽  
Fully Convolutional Networks ◽  
Aerial Vehicle

Change detection (CD) networks based on supervised learning have been used in diverse CD tasks. However, such supervised CD networks require a large amount of data and only use information from current images. In addition, it is time consuming to manually acquire the ground truth data for newly obtained images. Here, we proposed a novel method for CD in case of a lack of training data in an area near by another one with the available ground truth data. The proposed method automatically entails generating training data and fine-tuning the CD network. To detect changes in target images without ground truth data, the difference images were generated using spectral similarity measure, and the training data were selected via fuzzy c-means clustering. Recurrent fully convolutional networks with multiscale three-dimensional filters were used to extract objects of various sizes from unmanned aerial vehicle (UAV) images. The CD network was pre-trained on labeled source domain data; then, the network was fine-tuned on target images using generated training data. Two further CD networks were trained with a combined weighted loss function. The training data in the target domain were iteratively updated using he prediction map of the CD network. Experiments on two hyperspectral UAV datasets confirmed that the proposed method is capable of transferring change rules and improving CD results based on training data extracted in an unsupervised way.

scholarly journals Main Coronary Vessel Segmentation Using Deep Learning in Smart Medical

2020 ◽  
Vol 2020 ◽  
pp. 1-9
Author(s):  
Zhanchao Xian ◽  
Xiaoqing Wang ◽  
Shaodi Yan ◽  
Dahao Yang ◽  
Junyu Chen ◽  
...  
Keyword(s):  
Deep Learning ◽  
Coronary Artery ◽  
Automatic Segmentation ◽  
Disease Diagnosis ◽  
Vessel Segmentation ◽  
X Ray ◽  
Convolutional Networks ◽  
Fully Convolutional Networks ◽  
Main Vessel ◽  
Artery Disease

The automatic segmentation of main vessels on X-ray angiography (XRA) images is of great importance in the smart coronary artery disease diagnosis system. However, existing methods have been developed to this task, but these methods have difficulty in recognizing the coronary artery structure in XRA images. Main vessel segmentation is still a challenging task due to the diversity and small-size region of the vessel in the XRA images. In this study, we propose a robust method for main vessel segmentation by using deep learning architectures with fully convolutional networks. Four deep learning models based on the UNet architecture are evaluated on a clinical dataset, which consists of 3200 X-ray angiography images collected from 1118 patients. Using the precision (Pre), recall (Re), and F1 score (F1) as evaluation metrics, the average Pre, Re, and F1 for main vessel segmentation in the entire experimental dataset is 0.901, 0.898, and 0.900, respectively. 89.8% of the images exhibited a high F1 score >0.8. For the main vessel segmentation in XRA images, our deep learning methods demonstrated that vessels could be segmented in real time with a more optimized implementation, to further facilitate the online diagnosis in smart medical.

scholarly journals Vision-based autonomous navigation approach for unmanned aerial vehicle transmission-line inspection

2018 ◽  
Vol 15 (1) ◽  
pp. 172988141775282 ◽  
Author(s):  
Xiaolong Hui ◽  
Jiang Bian ◽  
Xiaoguang Zhao ◽  
Min Tan
Keyword(s):  
Unmanned Aerial Vehicle ◽  
Transmission Lines ◽  
Autonomous Navigation ◽  
Three Dimensional ◽  
Transmission Tower ◽  
Correlation Filters ◽  
Convolutional Networks ◽  
Fully Convolutional Networks ◽  
Perspective Image ◽  
Aerial Vehicle

This article presents an autonomous navigation approach based on a transmission tower for unmanned aerial vehicle (UAV) power line inspection. For this complex vision task, a perspective navigation model, which plays an important role in the description and analysis of the flight strategy, is introduced. Based on the proposed navigation model, valuable cues are excavated from a perspective image, which enhances the capability of the perception of three-dimensional direction and simultaneously improves the safety of intelligent inspection. Specifically, for robust and continuous localization of the transmission tower, a developed detecting-tracking visual strategy—comprised tower detection based on a faster region-based convolutional neural network and tower tracking by kernelized correlation filters—is presented. Further, segmentation by fully convolutional networks is applied to the extraction of transmission lines, from which the vanishing point (VP), an important basis for determining the flight heading, can be obtained. For more robust navigation, the designed scheme addresses the scenario of a nonexistent VP. Finally, the proposed navigation approach and constructed UAV platform were evaluated in a practical environment and achieved satisfactory results. To the best of our knowledge, this article marks the first time that a navigation approach based on a transmission tower is proposed and implemented.

Unmanned Aerial Vehicle for Road Monitoring: Fully Convolutional Networks Approach

2019 ◽  
Vol 12 (6) ◽  
Author(s):  
Laksh kotian ◽  
Asita chheda ◽  
Vaibhav Narwane ◽  
Rakesh Raut
Keyword(s):  
Unmanned Aerial Vehicle ◽  
Convolutional Networks ◽  
Fully Convolutional Networks ◽  
Aerial Vehicle

Development of Wire Suspended Robot System (ARANEUS 2.0) for Bridge Inspection

10.29007/zw9k ◽  
2020 ◽  
Author(s):  
Kazuhide Nakata ◽  
Kazuki Umemoto ◽  
Kenji Kaneko ◽  
Ryusuke Fujisawa
Keyword(s):  
Unmanned Aerial Vehicle ◽  
Concrete Surface ◽  
Wire Length ◽  
High Definition ◽  
Bridge Inspection ◽  
Robot System ◽  
Inspection Method ◽  
Aerial Vehicle ◽  
The Wire

This study addresses the development of a robot for inspection of old bridges. By suspending the robot with a wire and controlling the wire length, the movement of the robot is realized. The robot mounts a high-definition camera and aims to detect cracks on the concrete surface of the bridge using this camera. An inspection method using an unmanned aerial vehicle (UAV) has been proposed. Compared to the method using an unmanned aerial vehicle, the wire suspended robot system has the advantage of insensitivity to wind and ability to carry heavy equipments, this makes it possible to install a high-definition camera and a cleaning function to find cracks that are difficult to detect due to dirt.

scholarly journals Automatic Deep Learning Semantic Segmentation of Ultrasound Thyroid Cineclips using Recurrent Fully Convolutional Networks

IEEE Access ◽  
2020 ◽  
pp. 1-1
Author(s):  
Jeremy M. Webb ◽  
Duane D. Meixner ◽  
Shaheeda A. Adusei ◽  
Eric C. Polley ◽  
Mostafa Fatemi ◽  
...  
Keyword(s):  
Deep Learning ◽  
Semantic Segmentation ◽  
Convolutional Networks ◽  
Fully Convolutional Networks

scholarly journals Identifying the Branch of Kiwifruit Based on Unmanned Aerial Vehicle (UAV) Images Using Deep Learning Method

Sensors ◽  
2021 ◽  
Vol 21 (13) ◽  
pp. 4442
Author(s):  
Zijie Niu ◽  
Juntao Deng ◽  
Xu Zhang ◽  
Jun Zhang ◽  
Shijia Pan ◽  
...  
Keyword(s):  
Deep Learning ◽  
Unmanned Aerial Vehicle ◽  
Semantic Segmentation ◽  
Dynamic Monitoring ◽  
Support Vector ◽  
Distribution Maps ◽  
Time Operation ◽  
Aerial Vehicle ◽  
Uav Images ◽  
Segmentation Image

It is important to obtain accurate information about kiwifruit vines to monitoring their physiological states and undertake precise orchard operations. However, because vines are small and cling to trellises, and have branches laying on the ground, numerous challenges exist in the acquisition of accurate data for kiwifruit vines. In this paper, a kiwifruit canopy distribution prediction model is proposed on the basis of low-altitude unmanned aerial vehicle (UAV) images and deep learning techniques. First, the location of the kiwifruit plants and vine distribution are extracted from high-precision images collected by UAV. The canopy gradient distribution maps with different noise reduction and distribution effects are generated by modifying the threshold and sampling size using the resampling normalization method. The results showed that the accuracies of the vine segmentation using PSPnet, support vector machine, and random forest classification were 71.2%, 85.8%, and 75.26%, respectively. However, the segmentation image obtained using depth semantic segmentation had a higher signal-to-noise ratio and was closer to the real situation. The average intersection over union of the deep semantic segmentation was more than or equal to 80% in distribution maps, whereas, in traditional machine learning, the average intersection was between 20% and 60%. This indicates the proposed model can quickly extract the vine distribution and plant position, and is thus able to perform dynamic monitoring of orchards to provide real-time operation guidance.

Sign in / Sign up

Export Citation Format

Share Document