scholarly journals Deep Learning in Physiological Signal Data: A Survey

Sensors ◽  
2020 ◽  
Vol 20 (4) ◽  
pp. 969 ◽  
Author(s):  
Beanbonyka Rim ◽  
Nak-Jun Sung ◽  
Sedong Min ◽  
Min Hong
Keyword(s):  
Deep Learning ◽  
Signal Analysis ◽  
Medical Application ◽  
Learning Task ◽  
Physiological Data ◽  
Learning Approaches ◽  
Physiological Signal ◽  
Novel Approach ◽  
Model Training ◽  
Electrocardiogram Ecg

Deep Learning (DL), a successful promising approach for discriminative and generative tasks, has recently proved its high potential in 2D medical imaging analysis; however, physiological data in the form of 1D signals have yet to be beneficially exploited from this novel approach to fulfil the desired medical tasks. Therefore, in this paper we survey the latest scientific research on deep learning in physiological signal data such as electromyogram (EMG), electrocardiogram (ECG), electroencephalogram (EEG), and electrooculogram (EOG). We found 147 papers published between January 2018 and October 2019 inclusive from various journals and publishers. The objective of this paper is to conduct a detailed study to comprehend, categorize, and compare the key parameters of the deep-learning approaches that have been used in physiological signal analysis for various medical applications. The key parameters of deep-learning approach that we review are the input data type, deep-learning task, deep-learning model, training architecture, and dataset sources. Those are the main key parameters that affect system performance. We taxonomize the research works using deep-learning method in physiological signal analysis based on: (1) physiological signal data perspective, such as data modality and medical application; and (2) deep-learning concept perspective such as training architecture and dataset sources.

scholarly journals Deep Learning-Based Object Detection for Unmanned Aerial Systems (UASs)-Based Inspections of Construction Stormwater Practices

Sensors ◽  
2021 ◽  
Vol 21 (8) ◽  
pp. 2834
Author(s):  
Billur Kazaz ◽  
Subhadipto Poddar ◽  
Saeed Arabi ◽  
Michael A. Perez ◽  
Anuj Sharma ◽  
...  
Keyword(s):  
Deep Learning ◽  
Object Detection ◽  
Pollution Prevention ◽  
Aerial Images ◽  
Unmanned Aerial Systems ◽  
Construction Sites ◽  
State Regulations ◽  
Novel Approach ◽  
Model Training ◽  
Aerial Systems

Construction activities typically create large amounts of ground disturbance, which can lead to increased rates of soil erosion. Construction stormwater practices are used on active jobsites to protect downstream waterbodies from offsite sediment transport. Federal and state regulations require routine pollution prevention inspections to ensure that temporary stormwater practices are in place and performing as intended. This study addresses the existing challenges and limitations in the construction stormwater inspections and presents a unique approach for performing unmanned aerial system (UAS)-based inspections. Deep learning-based object detection principles were applied to identify and locate practices installed on active construction sites. The system integrates a post-processing stage by clustering results. The developed framework consists of data preparation with aerial inspections, model training, validation of the model, and testing for accuracy. The developed model was created from 800 aerial images and was used to detect four different types of construction stormwater practices at 100% accuracy on the Mean Average Precision (MAP) with minimal false positive detections. Results indicate that object detection could be implemented on UAS-acquired imagery as a novel approach to construction stormwater inspections and provide accurate results for site plan comparisons by rapidly detecting the quantity and location of field-installed stormwater practices.

Linear and Nonlinear Approaches to the Analysis of R-R Interval Variability

2004 ◽  
Vol 5 (3) ◽  
pp. 211-221 ◽  
Author(s):  
Autumn Schumacher
Keyword(s):  
Signal Analysis ◽  
Interval Data ◽  
Isolated Rat Heart ◽  
Physiological Signals ◽  
Physiological Data ◽  
Analysis Techniques ◽  
Physiological Signal ◽  
Quantification Analysis ◽  
Linear And Nonlinear ◽  
Signal Variability

Analysis techniques derived from linear and non-linear dynamics systems theory qualify and quantify physiological signal variability. Both clinicians and researchers use physiological signals in their scopes of practice. The clinician monitors patients with signal-analysis technology, and the researcher analyzes physiological data with signal-analysis techniques. Understanding the theoretical basis for analyzing physiological signals within one’s scope of practice ensures proper interpretation of the relationship between physiological function and signal variability. This article explains the concepts of linear and nonlinear signal analysis and illustrates these concepts with descriptions of power spectrum analysis and recurrence quantification analysis. This article also briefly describes the relevance of these 2 techniques to R-to-R wave interval (i.e., heart rate variability) signal analysis and demonstrates their application to R-to-R wave interval data obtained from an isolated rat heart model.

Machine learning based pervasive analytics for ECG signal analysis

2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Aarathi S. ◽  
Vasundra S.
Keyword(s):  
Machine Learning ◽  
Signal Analysis ◽  
Early Stage ◽  
Learning Approaches ◽  
Content Type ◽  
Arrhythmia Detection ◽  
Computer Aided ◽  
Diagnosis Accuracy ◽  
Project Model ◽  
Electrocardiogram Ecg

Purpose Pervasive analytics act as a prominent role in computer-aided prediction of non-communicating diseases. In the early stage, arrhythmia diagnosis detection helps prevent the cause of death suddenly owing to heart failure or heart stroke. The arrhythmia scope can be identified by electrocardiogram (ECG) report. Design/methodology/approach The ECG report has been used extensively by several clinical experts. However, diagnosis accuracy has been dependent on clinical experience. For the prediction methods of computer-aided heart disease, both accuracy and sensitivity metrics play a remarkable part. Hence, the existing research contributions have optimized the machine-learning approaches to have a great significance in computer-aided methods, which perform predictive analysis of arrhythmia detection. Findings In reference to this, this paper determined a regression heuristics by tridimensional optimum features of ECG reports to perform pervasive analytics for computer-aided arrhythmia prediction. The intent of these reports is arrhythmia detection. From an empirical outcome, it has been envisioned that the project model of this contribution is more optimal and added a more advantage when compared to existing or contemporary approaches. Originality/value In reference to this, this paper determined a regression heuristics by tridimensional optimum features of ECG reports to perform pervasive analytics for computer-aided arrhythmia prediction. The intent of these reports is arrhythmia detection. From an empirical outcome, it has been envisioned that the project model of this contribution is more optimal and added a more advantage when compared to existing or contemporary approaches.

scholarly journals Combining Deep Learning and Qualitative Spatial Reasoning to Learn Complex Structures from Sparse Examples with Noise

2019 ◽  
Vol 33 ◽  
pp. 2911-2918 ◽  
Author(s):  
Nikhil Krishnaswamy ◽  
Scott Friedman ◽  
James Pustejovsky
Keyword(s):  
Deep Learning ◽  
Heuristic Search ◽  
Spatial Reasoning ◽  
Spatial Relations ◽  
Search Space ◽  
Training Data ◽  
Learning Approaches ◽  
Qualitative Spatial Reasoning ◽  
Heuristic Search Algorithms ◽  
Novel Approach

Many modern machine learning approaches require vast amounts of training data to learn new concepts; conversely, human learning often requires few examples—sometimes only one—from which the learner can abstract structural concepts. We present a novel approach to introducing new spatial structures to an AI agent, combining deep learning over qualitative spatial relations with various heuristic search algorithms. The agent extracts spatial relations from a sparse set of noisy examples of block-based structures, and trains convolutional and sequential models of those relation sets. To create novel examples of similar structures, the agent begins placing blocks on a virtual table, uses a CNN to predict the most similar complete example structure after each placement, an LSTM to predict the most likely set of remaining moves needed to complete it, and recommends one using heuristic search. We verify that the agent learned the concept by observing its virtual block-building activities, wherein it ranks each potential subsequent action toward building its learned concept. We empirically assess this approach with human participants’ ratings of the block structures. Initial results and qualitative evaluations of structures generated by the trained agent show where it has generalized concepts from the training data, which heuristics perform best within the search space, and how we might improve learning and execution.

scholarly journals Fall Detection from Electrocardiogram (ECG) Signals and Classification by Deep Transfer Learning

Information ◽  
2021 ◽  
Vol 12 (2) ◽  
pp. 63
Author(s):  
Fatima Sajid Butt ◽  
Luigi La Blunda ◽  
Matthias F. Wagner ◽  
Jörg Schäfer ◽  
Inmaculada Medina-Bulo ◽  
...  
Keyword(s):  
Transfer Learning ◽  
Fall Detection ◽  
Daily Activities ◽  
Continuous Wavelet ◽  
Learning Approaches ◽  
Ecg Signals ◽  
Electrocardiogram Signals ◽  
Novel Approach ◽  
The Neural Network ◽  
Electrocardiogram Ecg

Fall is a prominent issue due to its severe consequences both physically and mentally. Fall detection and prevention is a critical area of research because it can help elderly people to depend less on caregivers and allow them to live and move more independently. Using electrocardiograms (ECG) signals independently for fall detection and activity classification is a novel approach used in this paper. An algorithm has been proposed which uses pre-trained convolutional neural networks AlexNet and GoogLeNet as a classifier between the fall and no fall scenarios using electrocardiogram signals. The ECGs for both falling and no falling cases were obtained as part of the study using eight volunteers. The signals are pre-processed using an elliptical filter for signal noises such as baseline wander and power-line interface. As feature extractors, frequency-time representations (scalograms) were obtained by applying a continuous wavelet transform on the filtered ECG signals. These scalograms were used as inputs to the neural network and a significant validation accuracy of 98.08% was achieved in the first model. The trained model is able to distinguish ECGs with a fall activity from an ECG with a no fall activity with an accuracy of 98.02%. For the verification of the robustness of the proposed algorithm, our experimental dataset was augmented by adding two different publicly available datasets to it. The second model can classify fall, daily activities and no activities with an accuracy of 98.44%. These models were developed by transfer learning from the domain of real images to the medical images. In comparison to traditional deep learning approaches, the transfer learning not only avoids “reinventing the wheel,” but also presents a lightweight solution to otherwise computationally heavy problems.

scholarly journals Developing the Smart Sorting Screw System Based on Deep Learning Approaches

2021 ◽  
Vol 11 (20) ◽  
pp. 9751
Author(s):  
Wan-Ju Lin ◽  
Jian-Wen Chen ◽  
Hong-Tsu Young ◽  
Che-Lun Hung ◽  
Kuan-Ming Li
Keyword(s):  
Deep Learning ◽  
Learning Approaches ◽  
Panoramic Image ◽  
Defective Region ◽  
Learning Technique ◽  
Convolutional Autoencoder ◽  
Screw Surface ◽  
Model Training ◽  
Anomaly Models ◽  
The Internet Of Things

The deep learning technique has turned into a mature technique. In addition, many researchers have applied deep learning methods to classify products into defective categories. However, due to the limitations of the devices, the images from factories cannot be trained and inferenced in real-time. As a result, the AI technology could not be widely implemented in actual factory inspections. In this study, the proposed smart sorting screw system combines the internet of things technique and an anomaly network for detecting the defective region of the screw product. The proposed system has three prominent characteristics. First, the spiral screw images are stitched into a panoramic image to comprehensively detect the defective region that appears on the screw surface. Second, the anomaly network comprising of convolutional autoencoder (CAE) and adversarial autoencoder (AAE) networks is utilized to automatically recognize the defective areas in the absence of a defective-free image for model training. Third, the IoT technique is employed to upload the screw image to the cloud platform for model training and inference, in order to determine if the defective screw product is a pass or fail on the production line. The experimental results show that the image stitching method can precisely merge the spiral screw image to the panoramic image. Among these two anomaly models, the AAE network obtained the best maximum IOU of 0.41 and a maximum dice coefficient score of 0.59. The proposed system has the ability to automatically detect a defective screw image, which is helpful in reducing the flow of the defective products in order to enhance product quality.

scholarly journals Deep learning with robustness to missing data: A novel approach to the detection of COVID-19

PLoS ONE ◽  
2021 ◽  
Vol 16 (7) ◽  
pp. e0255301
Author(s):  
Erdi Çallı ◽  
Keelin Murphy ◽  
Steef Kurstjens ◽  
Tijs Samson ◽  
Robert Herpers ◽  
...  
Keyword(s):  
Deep Learning ◽  
Missing Data ◽  
Laboratory Tests ◽  
Input Data ◽  
Statistical Significance ◽  
Test Time ◽  
Rt Pcr ◽  
Novel Approach ◽  
Medical Facilities ◽  
Model Training

In the context of the current global pandemic and the limitations of the RT-PCR test, we propose a novel deep learning architecture, DFCN (Denoising Fully Connected Network). Since medical facilities around the world differ enormously in what laboratory tests or chest imaging may be available, DFCN is designed to be robust to missing input data. An ablation study extensively evaluates the performance benefits of the DFCN as well as its robustness to missing inputs. Data from 1088 patients with confirmed RT-PCR results are obtained from two independent medical facilities. The data includes results from 27 laboratory tests and a chest x-ray scored by a deep learning model. Training and test datasets are taken from different medical facilities. Data is made publicly available. The performance of DFCN in predicting the RT-PCR result is compared with 3 related architectures as well as a Random Forest baseline. All models are trained with varying levels of masked input data to encourage robustness to missing inputs. Missing data is simulated at test time by masking inputs randomly. DFCN outperforms all other models with statistical significance using random subsets of input data with 2-27 available inputs. When all 28 inputs are available DFCN obtains an AUC of 0.924, higher than any other model. Furthermore, with clinically meaningful subsets of parameters consisting of just 6 and 7 inputs respectively, DFCN achieves higher AUCs than any other model, with values of 0.909 and 0.919.

scholarly journals Analyzing effect of quadruple multiple sequence alignments on deep learning based protein inter-residue distance prediction

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Aashish Jain ◽  
Genki Terashi ◽  
Yuki Kagaya ◽  
Sai Raghavendra Maddhuri Venkata Subramaniya ◽  
Charles Christoffer ◽  
...  
Keyword(s):  
Deep Learning ◽  
Structure Prediction ◽  
Tertiary Structure ◽  
3D Structure ◽  
Evolutionary Information ◽  
Learning Approaches ◽  
Sequence Alignments ◽  
Multiple Sequence ◽  
Multiple Sequence Alignments ◽  
Novel Approach

AbstractProtein 3D structure prediction has advanced significantly in recent years due to improving contact prediction accuracy. This improvement has been largely due to deep learning approaches that predict inter-residue contacts and, more recently, distances using multiple sequence alignments (MSAs). In this work we present AttentiveDist, a novel approach that uses different MSAs generated with different E-values in a single model to increase the co-evolutionary information provided to the model. To determine the importance of each MSA’s feature at the inter-residue level, we added an attention layer to the deep neural network. We show that combining four MSAs of different E-value cutoffs improved the model prediction performance as compared to single E-value MSA features. A further improvement was observed when an attention layer was used and even more when additional prediction tasks of bond angle predictions were added. The improvement of distance predictions were successfully transferred to achieve better protein tertiary structure modeling.

Cyberbullying detection from tweets using deep learning

Kybernetes ◽  
2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Shubham Bharti ◽  
Arun Kumar Yadav ◽  
Mohit Kumar ◽  
Divakar Yadav
Keyword(s):  
Machine Learning ◽  
Deep Learning ◽  
Short Term Memory ◽  
Comprehensive Evaluation ◽  
Learning Algorithms ◽  
Machine Learning Algorithms ◽  
Word Embedding ◽  
Learning Approaches ◽  
Content Type ◽  
Model Training

PurposeWith the rise of social media platforms, an increasing number of cases of cyberbullying has reemerged. Every day, large number of people, especially teenagers, become the victim of cyber abuse. A cyberbullied person can have a long-lasting impact on his mind. Due to it, the victim may develop social anxiety, engage in self-harm, go into depression or in the extreme cases, it may lead to suicide. This paper aims to evaluate various techniques to automatically detect cyberbullying from tweets by using machine learning and deep learning approaches.Design/methodology/approachThe authors applied machine learning algorithms approach and after analyzing the experimental results, the authors postulated that deep learning algorithms perform better for the task. Word-embedding techniques were used for word representation for our model training. Pre-trained embedding GloVe was used to generate word embedding. Different versions of GloVe were used and their performance was compared. Bi-directional long short-term memory (BLSTM) was used for classification.FindingsThe dataset contains 35,787 labeled tweets. The GloVe840 word embedding technique along with BLSTM provided the best results on the dataset with an accuracy, precision and F1 measure of 92.60%, 96.60% and 94.20%, respectively.Research limitations/implicationsIf a word is not present in pre-trained embedding (GloVe), it may be given a random vector representation that may not correspond to the actual meaning of the word. It means that if a word is out of vocabulary (OOV) then it may not be represented suitably which can affect the detection of cyberbullying tweets. The problem may be rectified through the use of character level embedding of words.Practical implicationsThe findings of the work may inspire entrepreneurs to leverage the proposed approach to build deployable systems to detect cyberbullying in different contexts such as workplace, school, etc and may also draw the attention of lawmakers and policymakers to create systemic tools to tackle the ills of cyberbullying.Social implicationsCyberbullying, if effectively detected may save the victims from various psychological problems which, in turn, may lead society to a healthier and more productive life.Originality/valueThe proposed method produced results that outperform the state-of-the-art approaches in detecting cyberbullying from tweets. It uses a large dataset, created by intelligently merging two publicly available datasets. Further, a comprehensive evaluation of the proposed methodology has been presented.

scholarly journals Generative Adversarial Networks for Data Augmentation in Structural Adhesive Inspection

2021 ◽  
Vol 11 (7) ◽  
pp. 3086
Author(s):  
Ricardo Silva Peres ◽  
Miguel Azevedo ◽  
Sara Oleiro Araújo ◽  
Magno Guedes ◽  
Fábio Miranda ◽  
...  
Keyword(s):  
Deep Learning ◽  
Data Augmentation ◽  
Manufacturing Sector ◽  
Data Availability ◽  
Training Data ◽  
Generative Adversarial Networks ◽  
Learning Approaches ◽  
Adversarial Networks ◽  
Novel Approach ◽  
Structural Adhesive

The technological advances brought forth by the Industry 4.0 paradigm have renewed the disruptive potential of artificial intelligence in the manufacturing sector, building the data-driven era on top of concepts such as Cyber–Physical Systems and the Internet of Things. However, data availability remains a major challenge for the success of these solutions, particularly concerning those based on deep learning approaches. Specifically in the quality inspection of structural adhesive applications, found commonly in the automotive domain, defect data with sufficient variety, volume and quality is generally costly, time-consuming and inefficient to obtain, jeopardizing the viability of such approaches due to data scarcity. To mitigate this, we propose a novel approach to generate synthetic training data for this application, leveraging recent breakthroughs in training generative adversarial networks with limited data to improve the performance of automated inspection methods based on deep learning, especially for imbalanced datasets. Preliminary results in a real automotive pilot cell show promise in this direction, with the approach being able to generate realistic adhesive bead images and consequently object detection models showing improved mean average precision at different thresholds when trained on the augmented dataset. For reproducibility purposes, the model weights, configurations and data encompassed in this study are made publicly available.

Sign in / Sign up

Export Citation Format

Share Document