scholarly journals Accelerating On-Device Learning with Layer-Wise Processor Selection Method on Unified Memory

Sensors ◽  
2021 ◽  
Vol 21 (7) ◽  
pp. 2364
Author(s):  
Donghee Ha ◽  
Mooseop Kim ◽  
KyeongDeok Moon ◽  
Chi Yoon Jeong
Keyword(s):  
Deep Learning ◽  
Mobile Devices ◽  
Network Model ◽  
Mobile Device ◽  
Learning Model ◽  
Selection Method ◽  
Superior Performance ◽  
Processing Unit ◽  
Average Power Consumption ◽  
Deep Learning Model

Recent studies have applied the superior performance of deep learning to mobile devices, and these studies have enabled the running of the deep learning model on a mobile device with limited computing power. However, there is performance degradation of the deep learning model when it is deployed in mobile devices, due to the different sensors of each device. To solve this issue, it is necessary to train a network model specific to each mobile device. Therefore, herein, we propose an acceleration method for on-device learning to mitigate the device heterogeneity. The proposed method efficiently utilizes unified memory for reducing the latency of data transfer during network model training. In addition, we propose the layer-wise processor selection method to consider the latency generated by the difference in the processor performing the forward propagation step and the backpropagation step in the same layer. The experiments were performed on an ODROID-XU4 with the ResNet-18 model, and the experimental results indicate that the proposed method reduces the latency by at most 28.4% compared to the central processing unit (CPU) and at most 21.8% compared to the graphics processing unit (GPU). Through experiments using various batch sizes to measure the average power consumption, we confirmed that device heterogeneity is alleviated by performing on-device learning using the proposed method.

scholarly journals Mobile Deep Learning System That Calculates UVI Using Illuminance Value of User’s Location

Sensors ◽  
2021 ◽  
Vol 21 (4) ◽  
pp. 1227
Author(s):  
Seung-Taek Oh ◽  
Deog-Hyeon Ga ◽  
Jae-Hyun Lim
Keyword(s):  
Deep Learning ◽  
Mobile Devices ◽  
Mobile Device ◽  
Local Level ◽  
Learning Model ◽  
Learning System ◽  
Ultraviolet Rays ◽  
Optimum Number ◽  
Data Set ◽  
Deep Learning Model

Ultraviolet rays are closely related with human health and, recently, optimum exposure to the UV rays has been recommended, with growing importance being placed on correct UV information. However, many countries provide UV information services at a local level, which makes it impossible for individuals to acquire user-based, accurate UV information unless individuals operate UV measurement devices with expertise on the relevant field for interpretation of the measurement results. There is a limit in measuring ultraviolet rays’ information by the users at their respective locations. Research about how to utilize mobile devices such as smartphones to overcome such limitation is also lacking. This paper proposes a mobile deep learning system that calculates UVI based on the illuminance values at the user’s location obtained with mobile devices’ help. The proposed method analyzed the correlation between illuminance and UVI based on the natural light DB collected through the actual measurements, and the deep learning model’s data set was extracted. After the selection of the input variables to calculate the correct UVI, the deep learning model based on the TensorFlow set with the optimum number of layers and number of nodes was designed and implemented, and learning was executed via the data set. After the data set was converted to the mobile deep learning model to operate under the mobile environment, the converted data were loaded on the mobile device. The proposed method enabled providing UV information at the user’s location through a mobile device on which the illuminance sensors were loaded even in the environment without UVI measuring equipment. The comparison of the experiment results with the reference device (spectrometer) proved that the proposed method could provide UV information with an accuracy of 90–95% in the summers, as well as in winters.

scholarly journals A robust and interpretable, end-to-end deep learning model for cytometry data

2020 ◽  
Author(s):  
Zicheng Hu ◽  
Alice Tang ◽  
Jaiveer Singh ◽  
Sanchita Bhattacharya ◽  
Atul J. Butte
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Network Model ◽  
Neural Network Model ◽  
Learning Model ◽  
Deep Convolutional Neural Network ◽  
Significant Information ◽  
End To End ◽  
Deep Learning Model

AbstractCytometry technologies are essential tools for immunology research, providing high-throughput measurements of the immune cells at the single-cell level. Traditional approaches in interpreting and using cytometry measurements include manual or automated gating to identify cell subsets from the cytometry data, providing highly intuitive results but may lead to significant information loss, in that additional details in measured or correlated cell signals might be missed. In this study, we propose and test a deep convolutional neural network for analyzing cytometry data in an end-to-end fashion, allowing a direct association between raw cytometry data and the clinical outcome of interest. Using nine large CyTOF studies from the open-access ImmPort database, we demonstrated that the deep convolutional neural network model can accurately diagnose the latent cytomegalovirus (CMV) in healthy individuals, even when using highly heterogeneous data from different studies. In addition, we developed a permutation-based method for interpreting the deep convolutional neural network model and identified a CD27-CD94+ CD8+ T cell population significantly associated with latent CMV infection. Finally, we provide a tutorial for creating, training and interpreting the tailored deep learning model for cytometry data using Keras and TensorFlow (github.com/hzc363/DeepLearningCyTOF).

scholarly journals Predicting Hepatocellular Carcinoma With Minimal Features From Electronic Health Records: Development of a Deep Learning Model

JMIR Cancer ◽  
10.2196/19812 ◽  
2021 ◽  
Vol 7 (4) ◽  
pp. e19812
Author(s):  
Chia-Wei Liang ◽  
Hsuan-Chia Yang ◽  
Md Mohaimenul Islam ◽  
Phung Anh Alex Nguyen ◽  
Yi-Ting Feng ◽  
...  
Keyword(s):  
Neural Network ◽  
Hepatocellular Carcinoma ◽  
Deep Learning ◽  
Electronic Health Records ◽  
Network Model ◽  
Neural Network Model ◽  
Learning Model ◽  
Health Records ◽  
Electronic Health ◽  
Deep Learning Model

Background Hepatocellular carcinoma (HCC), usually known as hepatoma, is the third leading cause of cancer mortality globally. Early detection of HCC helps in its treatment and increases survival rates. Objective The aim of this study is to develop a deep learning model, using the trend and severity of each medical event from the electronic health record to accurately predict the patients who will be diagnosed with HCC in 1 year. Methods Patients with HCC were screened out from the National Health Insurance Research Database of Taiwan between 1999 and 2013. To be included, the patients with HCC had to register as patients with cancer in the catastrophic illness file and had to be diagnosed as a patient with HCC in an inpatient admission. The control cases (non-HCC patients) were randomly sampled from the same database. We used age, gender, diagnosis code, drug code, and time information as the input variables of a convolution neural network model to predict those patients with HCC. We also inspected the highly weighted variables in the model and compared them to their odds ratio at HCC to understand how the predictive model works Results We included 47,945 individuals, 9553 of whom were patients with HCC. The area under the receiver operating curve (AUROC) of the model for predicting HCC risk 1 year in advance was 0.94 (95% CI 0.937-0.943), with a sensitivity of 0.869 and a specificity 0.865. The AUROC for predicting HCC patients 7 days, 6 months, 1 year, 2 years, and 3 years early were 0.96, 0.94, 0.94, 0.91, and 0.91, respectively. Conclusions The findings of this study show that the convolutional neural network model has immense potential to predict the risk of HCC 1 year in advance with minimal features available in the electronic health records.

scholarly journals Novel deep learning-based transcriptome data analysis for drug-drug interaction prediction with an application in diabetes

2021 ◽  
Vol 22 (1) ◽  
Author(s):  
Qichao Luo ◽  
Shenglong Mo ◽  
Yunfei Xue ◽  
Xiangzhou Zhang ◽  
Yuliang Gu ◽  
...  
Keyword(s):  
Deep Learning ◽  
Drug Interaction ◽  
Learning Model ◽  
Superior Performance ◽  
Public Health Issue ◽  
Transcriptome Data ◽  
Proposed Model ◽  
Drug Drug Interaction ◽  
Deep Learning Model ◽  
Drugbank Database

Abstract Background Drug-drug interaction (DDI) is a serious public health issue. The L1000 database of the LINCS project has collected millions of genome-wide expressions induced by 20,000 small molecular compounds on 72 cell lines. Whether this unified and comprehensive transcriptome data resource can be used to build a better DDI prediction model is still unclear. Therefore, we developed and validated a novel deep learning model for predicting DDI using 89,970 known DDIs extracted from the DrugBank database (version 5.1.4). Results The proposed model consists of a graph convolutional autoencoder network (GCAN) for embedding drug-induced transcriptome data from the L1000 database of the LINCS project; and a long short-term memory (LSTM) for DDI prediction. Comparative evaluation of various machine learning methods demonstrated the superior performance of our proposed model for DDI prediction. Many of our predicted DDIs were revealed in the latest DrugBank database (version 5.1.7). In the case study, we predicted drugs interacting with sulfonylureas to cause hypoglycemia and drugs interacting with metformin to cause lactic acidosis, and showed both to induce effects on the proteins involved in the metabolic mechanism in vivo. Conclusions The proposed deep learning model can accelerate the discovery of new DDIs. It can support future clinical research for safer and more effective drug co-prescription.

scholarly journals A Novel Hybrid Deep Learning Model for Detecting COVID-19-Related Rumors on Social Media Based on LSTM and Concatenated Parallel CNNs

2021 ◽  
Vol 11 (17) ◽  
pp. 7940
Author(s):  
Mohammed Al-Sarem ◽  
Abdullah Alsaeedi ◽  
Faisal Saeed ◽  
Wadii Boulila ◽  
Omair AmeerBakhsh
Keyword(s):  
Machine Learning ◽  
Social Media ◽  
Deep Learning ◽  
Short Term Memory ◽  
Learning Model ◽  
Superior Performance ◽  
Detection Methods ◽  
The Internet ◽  
Proposed Model ◽  
Deep Learning Model

Spreading rumors in social media is considered under cybercrimes that affect people, societies, and governments. For instance, some criminals create rumors and send them on the internet, then other people help them to spread it. Spreading rumors can be an example of cyber abuse, where rumors or lies about the victim are posted on the internet to send threatening messages or to share the victim’s personal information. During pandemics, a large amount of rumors spreads on social media very fast, which have dramatic effects on people’s health. Detecting these rumors manually by the authorities is very difficult in these open platforms. Therefore, several researchers conducted studies on utilizing intelligent methods for detecting such rumors. The detection methods can be classified mainly into machine learning-based and deep learning-based methods. The deep learning methods have comparative advantages against machine learning ones as they do not require preprocessing and feature engineering processes and their performance showed superior enhancements in many fields. Therefore, this paper aims to propose a Novel Hybrid Deep Learning Model for Detecting COVID-19-related Rumors on Social Media (LSTM–PCNN). The proposed model is based on a Long Short-Term Memory (LSTM) and Concatenated Parallel Convolutional Neural Networks (PCNN). The experiments were conducted on an ArCOV-19 dataset that included 3157 tweets; 1480 of them were rumors (46.87%) and 1677 tweets were non-rumors (53.12%). The findings of the proposed model showed a superior performance compared to other methods in terms of accuracy, recall, precision, and F-score.

scholarly journals A robust and interpretable end-to-end deep learning model for cytometry data

2020 ◽  
Vol 117 (35) ◽  
pp. 21373-21380
Author(s):  
Zicheng Hu ◽  
Alice Tang ◽  
Jaiveer Singh ◽  
Sanchita Bhattacharya ◽  
Atul J. Butte
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Network Model ◽  
Neural Network Model ◽  
Learning Model ◽  
Deep Convolutional Neural Network ◽  
Significant Information ◽  
End To End ◽  
Deep Learning Model

Cytometry technologies are essential tools for immunology research, providing high-throughput measurements of the immune cells at the single-cell level. Existing approaches in interpreting and using cytometry measurements include manual or automated gating to identify cell subsets from the cytometry data, providing highly intuitive results but may lead to significant information loss, in that additional details in measured or correlated cell signals might be missed. In this study, we propose and test a deep convolutional neural network for analyzing cytometry data in an end-to-end fashion, allowing a direct association between raw cytometry data and the clinical outcome of interest. Using nine large cytometry by time-of-flight mass spectrometry or mass cytometry (CyTOF) studies from the open-access ImmPort database, we demonstrated that the deep convolutional neural network model can accurately diagnose the latent cytomegalovirus (CMV) in healthy individuals, even when using highly heterogeneous data from different studies. In addition, we developed a permutation-based method for interpreting the deep convolutional neural network model. We were able to identify a CD27- CD94+ CD8+ T cell population significantly associated with latent CMV infection, confirming the findings in previous studies. Finally, we provide a tutorial for creating, training, and interpreting the tailored deep learning model for cytometry data using Keras and TensorFlow (https://github.com/hzc363/DeepLearningCyTOF).

scholarly journals Predicting Hepatocellular Carcinoma With Minimal Features From Electronic Health Records: Development of a Deep Learning Model (Preprint)

2020 ◽  
Author(s):  
Chia-Wei Liang ◽  
Hsuan-Chia Yang ◽  
Md Mohaimenul Islam ◽  
Phung Anh Alex Nguyen ◽  
Yi-Ting Feng ◽  
...  
Keyword(s):  
Neural Network ◽  
Hepatocellular Carcinoma ◽  
Deep Learning ◽  
Electronic Health Records ◽  
Network Model ◽  
Neural Network Model ◽  
Learning Model ◽  
Health Records ◽  
Electronic Health ◽  
Deep Learning Model

BACKGROUND Hepatocellular carcinoma (HCC), usually known as hepatoma, is the third leading cause of cancer mortality globally. Early detection of HCC helps in its treatment and increases survival rates. OBJECTIVE The aim of this study is to develop a deep learning model, using the trend and severity of each medical event from the electronic health record to accurately predict the patients who will be diagnosed with HCC in 1 year. METHODS Patients with HCC were screened out from the National Health Insurance Research Database of Taiwan between 1999 and 2013. To be included, the patients with HCC had to register as patients with cancer in the catastrophic illness file and had to be diagnosed as a patient with HCC in an inpatient admission. The control cases (non-HCC patients) were randomly sampled from the same database. We used age, gender, diagnosis code, drug code, and time information as the input variables of a convolution neural network model to predict those patients with HCC. We also inspected the highly weighted variables in the model and compared them to their odds ratio at HCC to understand how the predictive model works RESULTS We included 47,945 individuals, 9553 of whom were patients with HCC. The area under the receiver operating curve (AUROC) of the model for predicting HCC risk 1 year in advance was 0.94 (95% CI 0.937-0.943), with a sensitivity of 0.869 and a specificity 0.865. The AUROC for predicting HCC patients 7 days, 6 months, 1 year, 2 years, and 3 years early were 0.96, 0.94, 0.94, 0.91, and 0.91, respectively. CONCLUSIONS The findings of this study show that the convolutional neural network model has immense potential to predict the risk of HCC 1 year in advance with minimal features available in the electronic health records.

Abstract 312: A Multi-view Echocardiography Video Deep Learning Model Outperforms the Seattle Heart Failure Model in Predicting Mortality

Circulation ◽  
2020 ◽  
Vol 142 (Suppl_3) ◽  
Author(s):  
Alvaro Ulloa ◽  
Linyuan Jing ◽  
Brendan Carry ◽  
Christopher Good ◽  
David vanMaanen ◽  
...  
Keyword(s):  
Heart Failure ◽  
Deep Learning ◽  
Predictive Value ◽  
Learning Model ◽  
Superior Performance ◽  
Left Ventricular Ejection ◽  
Failure Model ◽  
All Cause Mortality ◽  
Heart Failure Model ◽  
Deep Learning Model

Introduction: Managing heart failure patients relies on mortality prediction models such as the Seattle Heart Failure (SHF) model. We hypothesized that a deep learning model that leverages echocardiography video data could improve prediction performance. Methods: We trained deep neural networks (DNN) to predict 1-year all-cause mortality using echocardiography videos and 158 additional clinical variables (labs, vitals, diagnoses, etc.) acquired from 34,362 patients (812,278 videos). We tested both the DNN and the SHF model on a separate cohort of 2,404 patients with heart failure who underwent 3,384 echocardiograms. We computed the area under the receiver operating characteristic curve (AUC) and its bootstrapped 95% confidence interval (CI) in the test set. Results: The DNN model (AUC of 0.76, 95% CI [0.74, 0.77]) outperformed the SHF model (AUC of 0.70, 95% CI [0.68, 0.71]). This superior performance was observed for patients with both reduced (n=2,026, AUC of 0.76 [0.74, 0.78] vs 0.70 [0.67, 0.72]) and preserved left ventricular ejection fraction (n=1,356, AUC of 0.75 [0.72, 0.78] vs 0.69 [0.66, 0.72]). A Cox Proportional Hazard survival analysis showed that, despite the prediction being for 1-year all-cause mortality, the result held long-term predictive power over the next 9 years with a superior hazard ratio of 2.9 [2.6, 3.2] for the DNN model compared to 2.2 [2, 2.4] for the SHF model. At mid-range operating points, the DNN model also maintained a higher negative predictive value, predicting survival, compared to the SHF model (89% vs 83%, respectively), while maintaining the same positive predictive value of 40%. Conclusion: A deep neural network that automatically analyzes echocardiography videos can outperform traditional risk modeling approaches such as the Seattle Heart Failure Model. This provides additional evidence that deep learning can help improve our ability to make clinically relevant predictions by leveraging complex datasets.

Sign in / Sign up

Export Citation Format

Share Document