scholarly journals Instance Segmentation with Mask R-CNN Applied to Loose-Housed Dairy Cows in a Multi-Camera Setting

Animals ◽  
2020 ◽  
Vol 10 (12) ◽  
pp. 2402
Author(s):  
Jennifer Salau ◽  
Joachim Krieter
Keyword(s):  
Dairy Cows ◽  
Transfer Learning ◽  
Automated Analysis ◽  
Training Data ◽  
Human Observer ◽  
Data Set ◽  
Use Of Resources ◽  
Herd Structure ◽  
Bounding Boxes ◽  
Technical Basis

With increasing herd sizes came an enhanced requirement for automated systems to support the farmers in the monitoring of the health and welfare status of their livestock. Cattle are a highly sociable species, and the herd structure has important impact on the animal welfare. As the behaviour of the animals and their social interactions can be influenced by the presence of a human observer, a camera based system that automatically detects the animals would be beneficial to analyse dairy cattle herd activity. In the present study, eight surveillance cameras were mounted above the barn area of a group of thirty-six lactating Holstein Friesian dairy cows at the Chamber of Agriculture in Futterkamp in Northern Germany. With Mask R-CNN, a state-of-the-art model of convolutional neural networks was trained to determine pixel level segmentation masks for the cows in the video material. The model was pre-trained on the Microsoft common objects in the context data set, and transfer learning was carried out on annotated image material from the recordings as training data set. In addition, the relationship between the size of the used training data set and the performance on the model after transfer learning was analysed. The trained model achieved averaged precision (Intersection over union, IOU = 0.5) 91% and 85% for the detection of bounding boxes and segmentation masks of the cows, respectively, thereby laying a solid technical basis for an automated analysis of herd activity and the use of resources in loose-housing.

Seismic trace interpolation for irregularly spatial sampled data using convolutional autoencoder

Geophysics ◽  
2020 ◽  
Vol 85 (2) ◽  
pp. V119-V130 ◽  
Author(s):  
Yingying Wang ◽  
Benfeng Wang ◽  
Ning Tu ◽  
Jianhua Geng
Keyword(s):  
Transfer Learning ◽  
Field Data ◽  
Learning Strategy ◽  
Complete Data ◽  
Training Data ◽  
Sampled Data ◽  
Data Set ◽  
Network Training ◽  
Convolutional Autoencoder ◽  
Irregularly Sampled Data

Seismic trace interpolation is an important technique because irregular or insufficient sampling data along the spatial direction may lead to inevitable errors in multiple suppression, imaging, and inversion. Many interpolation methods have been studied for irregularly sampled data. Inspired by the working idea of the autoencoder and convolutional neural network, we have performed seismic trace interpolation by using the convolutional autoencoder (CAE). The irregularly sampled data are taken as corrupted data. By using a training data set including pairs of the corrupted and complete data, CAE can automatically learn to extract features from the corrupted data and reconstruct the complete data from the extracted features. It can avoid some assumptions in the traditional trace interpolation method such as the linearity of events, low-rankness, or sparsity. In addition, once the CAE network training is completed, the corrupted seismic data can be interpolated immediately with very low computational cost. A CAE network composed of three convolutional layers and three deconvolutional layers is designed to explore the capabilities of CAE-based seismic trace interpolation for an irregularly sampled data set. To solve the problem of rare complete shot gathers in field data applications, the trained network on synthetic data is used as an initialization of the network training on field data, called the transfer learning strategy. Experiments on synthetic and field data sets indicate the validity and flexibility of the trained CAE. Compared with the curvelet-transform-based method, CAE can lead to comparable or better interpolation performances efficiently. The transfer learning strategy enhances the training efficiency on field data and improves the interpolation performance of CAE with limited training data.

scholarly journals A novel augmented deep transfer learning for classification of COVID-19 and other thoracic diseases from X-rays

2021 ◽  
Author(s):  
Fouzia Altaf ◽  
Syed M. S. Islam ◽  
Naeem Khalid Janjua
Keyword(s):  
Deep Learning ◽  
Medical Imaging ◽  
Transfer Learning ◽  
Medical Images ◽  
Training Data ◽  
Target Domain ◽  
Data Set ◽  
Learning Technique ◽  
Multi Class Classification ◽  
Effective Transfer

AbstractDeep learning has provided numerous breakthroughs in natural imaging tasks. However, its successful application to medical images is severely handicapped with the limited amount of annotated training data. Transfer learning is commonly adopted for the medical imaging tasks. However, a large covariant shift between the source domain of natural images and target domain of medical images results in poor transfer learning. Moreover, scarcity of annotated data for the medical imaging tasks causes further problems for effective transfer learning. To address these problems, we develop an augmented ensemble transfer learning technique that leads to significant performance gain over the conventional transfer learning. Our technique uses an ensemble of deep learning models, where the architecture of each network is modified with extra layers to account for dimensionality change between the images of source and target data domains. Moreover, the model is hierarchically tuned to the target domain with augmented training data. Along with the network ensemble, we also utilize an ensemble of dictionaries that are based on features extracted from the augmented models. The dictionary ensemble provides an additional performance boost to our method. We first establish the effectiveness of our technique with the challenging ChestXray-14 radiography data set. Our experimental results show more than 50% reduction in the error rate with our method as compared to the baseline transfer learning technique. We then apply our technique to a recent COVID-19 data set for binary and multi-class classification tasks. Our technique achieves 99.49% accuracy for the binary classification, and 99.24% for multi-class classification.

scholarly journals The Model for The Classification of The Ripeness Stage of Pomegranate Fruits In Orchards Using

2021 ◽  
Author(s):  
Nguyen Ha Huy Cuong
Keyword(s):  
Transfer Learning ◽  
Initial Step ◽  
Training Data ◽  
Transfer Model ◽  
Technical Solution ◽  
Learning Method ◽  
Data Set ◽  
Aggregation Model ◽  
Training Time ◽  
Proposed Model

Abstract In agriculture, a timely and accurate estimate of ripeness in the orchard improves the post-harvest process. Choosing fruits based on their maturity stages can reduce storage costs and increase market results. In addition, the estimation of the ripeness of the fruit based on the detection of input and output indicators has brought about practical effects in the harvesting process, as well as determining the amount of water needed for irrigation. pepper, the amount of fertilizer for the end of the season appropriate. In this paper, propose a technical solution for a model to detect persimmon green grapefruit fruit at agricultural farms, Vietnam. Aggregation model and transfer learning method are used. The proposed model contains two object detection sub models and the decision model is the pre-processed model, the transfer model and the corresponding aggregation model. Improving the YOLO algorithm is trained with more than one hundred object types, the total proposed processing is 500,000 images, from the COCO image data set used as a preprocessing model. Aggregation model and transfer learning method are also used as an initial step to train the model transferred by the transfer learning technique. Only images are used for transfer model training. Finally, the aggregation model with the techniques used to make decisions selects the best results from the pre-trained model and the transfer model. Using our proposed model, it has improved and reduced the time when analyzing the maximum number of training data sets and training time. The accuracy of model union is 98.20%. The test results of the classifier are proposed through a data set of 10000 images of each layer for sensitivity of 98.2%, specificity 97.2% with accuracy of 96.5% and 0, 98 in training for all grades.

Automatic velocity analysis using convolutional neural network and transfer learning

Geophysics ◽  
2019 ◽  
Vol 85 (1) ◽  
pp. V33-V43 ◽  
Author(s):  
Min Jun Park ◽  
Mauricio D. Sacchi
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Transfer Learning ◽  
Input Data ◽  
Synthetic Data ◽  
Velocity Model ◽  
Training Data ◽  
Velocity Analysis ◽  
Time Step ◽  
Data Set

Velocity analysis can be a time-consuming task when performed manually. Methods have been proposed to automate the process of velocity analysis, which, however, typically requires significant manual effort. We have developed a convolutional neural network (CNN) to estimate stacking velocities directly from the semblance. Our CNN model uses two images as one input data for training. One is an entire semblance (guide image), and the other is a small patch (target image) extracted from the semblance at a specific time step. Labels for each input data set are the root mean square velocities. We generate the training data set using synthetic data. After training the CNN model with synthetic data, we test the trained model with another synthetic data that were not used in the training step. The results indicate that the model can predict a consistent velocity model. We also noticed that when the input data are extremely different from those used for the training, the CNN model will hardly pick the correct velocities. In this case, we adopt transfer learning to update the trained model (base model) with a small portion of the target data to improve the accuracy of the predicted velocity model. A marine data set from the Gulf of Mexico is used for validating our new model. The updated model performed a reasonable velocity analysis in seconds.

ALS Point Cloud Classification With Small Training Data Set Based on Transfer Learning

2020 ◽  
Vol 17 (8) ◽  
pp. 1406-1410 ◽  
Author(s):  
Chuan Zhao ◽  
Haitao Guo ◽  
Jun Lu ◽  
Donghang Yu ◽  
Daoji Li ◽  
...  
Keyword(s):  
Transfer Learning ◽  
Point Cloud ◽  
Training Data ◽  
Data Set ◽  
Cloud Classification ◽  
Point Cloud Classification

A Novel Epileptic Seizure Detection Algorithm Using Transfer K-Plane Clustering

2020 ◽  
Vol 10 (2) ◽  
pp. 484-488
Author(s):  
Lifang Peng ◽  
Bin Huang ◽  
Kefu Chen ◽  
Leyuan Zhou
Keyword(s):  
Transfer Learning ◽  
Epileptic Seizure ◽  
Clustering Algorithms ◽  
Training Data ◽  
Fuzzy Membership ◽  
Data Sets ◽  
Learning Mechanisms ◽  
Target Domain ◽  
Data Set ◽  
Clustering Effect

To recognize epileptic EEG signals, traditional clustering algorithms often need to satisfy three conditions to obtain better clustering results. The first condition is that the algorithm must not be sensitive to noise. The second condition is that the data set must be sufficient. The third condition is that the training data set and the testing data set must follow the same distribution. However, in actual applications, there are few data sets that are free of noise and have sufficient data volume. To address the effects of insufficient data sets and noise on clustering, this paper introduces fuzzy membership and transfer learning mechanisms based on K-plane clustering (KPC) and proposes a fuzzy KPC algorithm based on transfer learning (TFKPC). To improve the clustering effect, the TFKPC algorithm uses the knowledge summarized by the historical domain to guide the clustering process of the current (target) domain when the information is insufficient. In addition, the influence of noise on the clustering result is reduced by introducing fuzzy membership. Experiments show that the TFKPC algorithm proposed in this paper has a better clustering effect in the Epileptic Seizure Recognition Data Set than other comparison methods.

scholarly journals VGG16 Transfer Learning Architecture for Salak Fruit Quality Classification

Telematika ◽  
2021 ◽  
Vol 18 (1) ◽  
pp. 37
Author(s):  
Rismiyati Rismiyati ◽  
Ardytha Luthfiarta
Keyword(s):  
Machine Learning ◽  
Transfer Learning ◽  
State Of The Art ◽  
Learning Rate ◽  
Training Data ◽  
Data Set ◽  
Quality Classification ◽  
Testing Data ◽  
Pixel Value

Purpose: This study aims to differentiate the quality of salak fruit with machine learning. Salak is classified into two classes, good and bad class.Design/methodology/approach: The algorithm used in this research is transfer learning with the VGG16 architecture. Data set used in this research consist of 370 images of salak, 190 from good class and 180 from bad class. The image is preprocessed by resizing and normalizing pixel value in the image. Preprocessed images is split into 80% training data and 20% testing data. Training data is trained by using pretrained VGG16 model. The parameters that are changed during the training are epoch, momentum, and learning rate. The resulting model is then used for testing. The accuracy, precision and recall is monitored to determine the best model to classify the images.Findings/result: The highest accuracy obtained from this study is 95.83%. This accuracy is obtained by using a learning rate = 0.0001 and momentum 0.9. The precision and recall for this model is 97.2 and 94.6.Originality/value/state of the art: The use of transfer learning to classify salak which never been used before.

scholarly journals A deep transfer learning approach for wearable sleep stage classification with photoplethysmography

2021 ◽  
Vol 4 (1) ◽  
Author(s):  
Mustafa Radha ◽  
Pedro Fonseca ◽  
Arnaud Moreau ◽  
Marco Ross ◽  
Andreas Cerny ◽  
...  
Keyword(s):  
Transfer Learning ◽  
Learning Strategy ◽  
Sleep Stage ◽  
Sleep Apnoea ◽  
Training Data ◽  
Data Set ◽  
Data Intensive ◽  
Deep Recurrent Neural Network ◽  
Stage Classification ◽  
Sleep Stage Classification

AbstractUnobtrusive home sleep monitoring using wrist-worn wearable photoplethysmography (PPG) could open the way for better sleep disorder screening and health monitoring. However, PPG is rarely included in large sleep studies with gold-standard sleep annotation from polysomnography. Therefore, training data-intensive state-of-the-art deep neural networks is challenging. In this work a deep recurrent neural network is first trained using a large sleep data set with electrocardiogram (ECG) data (292 participants, 584 recordings) to perform 4-class sleep stage classification (wake, rapid-eye-movement, N1/N2, and N3). A small part of its weights is adapted to a smaller, newer PPG data set (60 healthy participants, 101 recordings) through three variations of transfer learning. Best results (Cohen’s kappa of 0.65 ± 0.11, accuracy of 76.36 ± 7.57%) were achieved with the domain and decision combined transfer learning strategy, significantly outperforming the PPG-trained and ECG-trained baselines. This performance for PPG-based 4-class sleep stage classification is unprecedented in literature, bringing home sleep stage monitoring closer to clinical use. The work demonstrates the merit of transfer learning in developing reliable methods for new sensor technologies by reusing similar, older non-wearable data sets. Further study should evaluate our approach in patients with sleep disorders such as insomnia and sleep apnoea.

scholarly journals Multi-attribute self-attention guided vehicle local region detection based on convolutional neural network architecture

2020 ◽  
Vol 17 (4) ◽  
pp. 172988142094434
Author(s):  
Jingbo Chen ◽  
Shengyong Chen ◽  
Linjie Bian
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Quantitative Evaluation ◽  
Network Architecture ◽  
Local Region ◽  
Training Data ◽  
Detection Methods ◽  
Data Set ◽  
Region Detection ◽  
Bounding Boxes

Many pieces of information are included in the front region of a vehicle, especially in windshield and bumper regions. Thus, windshield or bumper region detection is making sense to extract useful information. But the existing windshield and bumper detection methods based on traditional artificial features are not robust enough. Those features may become invalid in many real situations (e.g. occlude, illumination change, viewpoint change.). In this article, we propose a multi-attribute-guided vehicle discriminately region detection method based on convolutional neural network and not rely on bounding box regression. We separate the net into two branches, respectively, for identification (ID) and Model attributes training. Therefore, the feature spaces of different attributes become more independent. Additionally, we embed a self-attention block into our framework to improve the performance of local region detection. We train our model on PKU_VD data set which has a huge number of images inside. Furthermore, we labeled the handcrafted bounding boxes on 5000 randomly picked testing images, and 1020 of them are used for evaluation and 3980 as the training data for YOLOv3. We use Intersection over Union for quantitative evaluation. Experiments were conducted in three different latest convolutional neural network trunks to illustrate the detection performance of the proposed method. Simultaneously, in terms of quantitative evaluation, the performance of our method is close to YOLOv3 even without handcrafted bounding boxes.

Transfer Learning Based on Regularized Common Spatial Patterns Using Cosine Similarities of Spatial Filters for Motor-Imagery BCI

2019 ◽  
Vol 28 (07) ◽  
pp. 1950123 ◽  
Author(s):  
Yilu Xu ◽  
Qingguo Wei ◽  
Hua Zhang ◽  
Ronghua Hu ◽  
Jizhong Liu ◽  
...  
Keyword(s):  
Transfer Learning ◽  
Motor Imagery ◽  
Spatial Patterns ◽  
Covariance Matrices ◽  
Training Data ◽  
Spatial Filters ◽  
Data Set ◽  
Common Spatial Patterns ◽  
Public Data ◽  
Target Subject

In motor-imagery brain–computer interface (BCI), transfer learning based on the framework of regularized common spatial patterns (RCSP) can make full use of the training data derived from other subjects to reduce calibration time for a new subject. Covariance matrices are commonly used to estimate the difference between subjects. However, the classification performances vary greatly depending on different assumptions of the distribution of covariance matrices. Therefore, to directly observe the variations of the target subject’s features after transferring, we neglect the distribution of covariance matrices and instead compare cosine similarities of spatial filters between the target subject and the composite subject whose data comes from the target subject and a source subject. Two RCSP algorithms based on cosine measure are proposed to use the samples of all source subjects and most useful source subjects, respectively. Experiments on one public data set from BCI competition show that our proposed approaches significantly improve the classification performances compared to the conventional CSP algorithm in almost every case, based on a small training set.

Sign in / Sign up

Export Citation Format

Share Document