scholarly journals Classification for Breast Ultrasound Using Convolutional Neural Network with Multiple Time-Domain Feature Maps

2021 ◽  
Vol 11 (21) ◽  
pp. 10216
Author(s):  
Hyungsuk Kim ◽  
Juyoung Park ◽  
Hakjoon Lee ◽  
Geuntae Im ◽  
Jongsoo Lee ◽  
...  
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Screening Method ◽  
Network Models ◽  
Multiple Time ◽  
Feature Maps ◽  
Multiple Feature ◽  
Phase Images ◽  
The Common

Ultrasound (US) imaging is widely utilized as a diagnostic screening method, and deep learning has recently drawn attention for the analysis of US images for the pathological status of tissues. While low image quality and poor reproducibility are the common obstacles in US analysis, the small size of the dataset is a new limitation for deep learning due to lack of generalization. In this work, a convolutional neural network (CNN) using multiple feature maps, such as entropy and phase images, as well as a B-mode image, was proposed to classify breast US images. Although B-mode images contain both anatomical and textual information, traditional CNNs experience difficulties in abstracting features automatically, especially with small datasets. For the proposed CNN framework, two distinct feature maps were obtained from a B-mode image and utilized as new inputs for training the CNN. These feature maps can also be made from the evaluation data and applied to the CNN separately for the final classification decision. The experimental results with 780 breast US images in three categories of benign, malignant, and normal, showed that the proposed CNN framework using multiple feature maps exhibited better performances than the traditional CNN with B-mode only for most deep network models.

Feature extraction-based image steganalysis using deep learning

2021 ◽  
pp. 188-198
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Secure Communication ◽  
Information Technologies ◽  
Network Models ◽  
Error Rates ◽  
Multimedia Data ◽  
Secret Message ◽  
Neural Network Models

The innovations in advanced information technologies has led to rapid delivery and sharing of multimedia data like images and videos. The digital steganography offers ability to secure communication and imperative for internet. The image steganography is essential to preserve confidential information of security applications. The secret image is embedded within pixels. The embedding of secret message is done by applied with S-UNIWARD and WOW steganography. Hidden messages are reveled using steganalysis. The exploration of research interests focused on conventional fields and recent technological fields of steganalysis. This paper devises Convolutional neural network models for steganalysis. Convolutional neural network (CNN) is one of the most frequently used deep learning techniques. The Convolutional neural network is used to extract spatio-temporal information or features and classification. We have compared steganalysis outcome with AlexNet and SRNeT with same dataset. The stegnalytic error rates are compared with different payloads.

scholarly journals Predicting Success of Outbound Telemarketing in Insurance Policy Loans Using an Explainable Multiple-Filter Convolutional Neural Network

2021 ◽  
Vol 11 (15) ◽  
pp. 7147
Author(s):  
Jinmo Gu ◽  
Jinhyuk Na ◽  
Jeongeun Park ◽  
Hayoung Kim
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
False Positive Rate ◽  
Direct Marketing ◽  
Network Models ◽  
Learning Models ◽  
Insurance Policy ◽  
Neural Network Models ◽  
Potential Customers

Outbound telemarketing is an efficient direct marketing method wherein telemarketers solicit potential customers by phone to purchase or subscribe to products or services. However, those who are not interested in the information or offers provided by outbound telemarketing generally experience such interactions negatively because they perceive telemarketing as spam. In this study, therefore, we investigate the use of deep learning models to predict the success of outbound telemarketing for insurance policy loans. We propose an explainable multiple-filter convolutional neural network model called XmCNN that can alleviate overfitting and extract various high-level features using hundreds of input variables. To enable the practical application of the proposed method, we also examine ensemble models to further improve its performance. We experimentally demonstrate that the proposed XmCNN significantly outperformed conventional deep neural network models and machine learning models. Furthermore, a deep learning ensemble model constructed using the XmCNN architecture achieved the lowest false positive rate (4.92%) and the highest F1-score (87.47%). We identified important variables influencing insurance policy loan prediction through the proposed model, suggesting that these factors should be considered in practice. The proposed method may increase the efficiency of outbound telemarketing and reduce the spam problems caused by calling non-potential customers.

scholarly journals Four-Dimension Deep Learning Method for Flower Quality Grading with Depth Information

Electronics ◽  
2021 ◽  
Vol 10 (19) ◽  
pp. 2353
Author(s):  
Xinyan Sun ◽  
Zhenye Li ◽  
Tingting Zhu ◽  
Chao Ni
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Classification Accuracy ◽  
Network Models ◽  
Depth Image ◽  
Depth Information ◽  
Neural Network Models ◽  
Flower Bud ◽  
Flower Quality

Grading the quality of fresh cut flowers is an important practice in the flower industry. Based on the flower maturing status, a classification method based on deep learning and depth information was proposed for the grading of flower quality. Firstly, the RGB image and the depth image of a flower bud were collected and transformed into fused RGBD information. Then, the RGBD information of a flower was set as inputs of a convolutional neural network to determine the flower bud maturing status. Four convolutional neural network models (VGG16, ResNet18, MobileNetV2, and InceptionV3) were adjusted for a four-dimensional (4D) RGBD input to classify flowers, and their classification performances were compared with and without depth information. The experimental results show that the classification accuracy was improved with depth information, and the improved InceptionV3 network with RGBD achieved the highest classification accuracy (up to 98%), which means that the depth information can effectively reflect the characteristics of the flower bud and is helpful for the classification of the maturing status. These results have a certain significance for the intelligent classification and sorting of fresh flowers.

Multi-organ auto-delineation in head-and-neck MRI for radiation therapy using mask scoring regional convolutional neural network

2021 ◽  
Author(s):  
Xianjin Dai ◽  
Yang Lei ◽  
Tonghe Wang ◽  
Jun Zhou ◽  
Soumon Rudra ◽  
...  
Keyword(s):  
Neural Network ◽  
Radiation Therapy ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Head And Neck ◽  
Cancer Patients ◽  
External Beam Radiation ◽  
Classification Error ◽  
Feature Maps ◽  
Beam Radiation

Abstract MRI allows accurate and reliable organ delineation for many disease sites in radiation therapy due to its superior soft-tissue contrast. Manual organ-at-risk (OAR) delineation is labor-intensive, time-consuming and subjective. This study aims to develop a deep learning-based automated multi-organ segmentation method to release the labor and accelerate the treatment planning process for head-and-neck (HN) cancer radiotherapy. We propose a novel regional convolutional neural network (R-CNN) architecture, namely, mask scoring R-CNN, where, a deep attention feature pyramid network is used as backbone to extract the coarse features given MRI, followed by the feature refinement using R-CNN. The final segmentation is obtained through mask and mask scoring networks taking those refined feature maps as input. With the mask scoring mechanism incorporated into conventional mask supervision, the classification error can be highly minimized in conventional mask R-CNN architecture. A retrospective study was carried out on a cohort of 60 HN cancer patients receiving external beam radiation therapy. Five-fold cross validation was performed for the assessment of our proposed method. The Dice similarity coefficients of brain stem, left/right cochlea, left/right eye, larynx, left/right lens, mandible, optic chiasm, left/right optic nerve, oral cavity, left/right parotid, pharynx, and spinal cord are 0.89±0.06, 0.68±0.14/0.68±0.18, 0.89±0.07/0.89±0.05, 0.90±0.07, 0.67±0.18/0.67±0.10, 0.82±0.10, 0.61±0.14, 0.67±0.11/0.68±0.11, 0.92±0.07, 0.85±0.06/0.86±0.05, 0.80±0.13, and 0.77±0.15, respectively. After the model training, all OARs can be segmented within 1 minute. We have proposed and investigated a novel deep learning-based fully automatic HN multi-organ segmentation algorithm for MRI of HN cancer patients. The accurate HN OAR delineation enables further development of MRI-only based radiotherapy workflow for HN cancer.

Efficient Imbalanced Multimedia Concept Retrieval by Deep Learning on Spark Clusters

2020 ◽  
pp. 274-294
Author(s):  
Yilin Yan ◽  
Min Chen ◽  
Saad Sadiq ◽  
Mei-Ling Shyu
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Imbalanced Data ◽  
Network Models ◽  
Multimedia Data ◽  
Neural Network Models ◽  
Minority Class ◽  
Imbalanced Data Classification

The classification of imbalanced datasets has recently attracted significant attention due to its implications in several real-world use cases. The classifiers developed on datasets with skewed distributions tend to favor the majority classes and are biased against the minority class. Despite extensive research interests, imbalanced data classification remains a challenge in data mining research, especially for multimedia data. Our attempt to overcome this hurdle is to develop a convolutional neural network (CNN) based deep learning solution integrated with a bootstrapping technique. Considering that convolutional neural networks are very computationally expensive coupled with big training datasets, we propose to extract features from pre-trained convolutional neural network models and feed those features to another full connected neutral network. Spark implementation shows promising performance of our model in handling big datasets with respect to feasibility and scalability.

scholarly journals Subclass Separation of White Blood Cell Images Using Convolutional Neural Network Models

2019 ◽  
Vol 25 (5) ◽  
pp. 63-68 ◽  
Author(s):  
Mesut Togacar ◽  
Burhan Ergen ◽  
Mehmet Emre Sertkaya
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Immune System ◽  
Blood Cell ◽  
Convolutional Neural Network ◽  
White Blood Cell ◽  
Blood Cells ◽  
White Blood Cells ◽  
Network Models ◽  
Neural Network Models

The white blood cells produced in the bone marrow and lymphoid tissue known as leucocytes are an important part of the immune system to protect the body against foreign invaders and infectious disease. These cells, which do not have color, have a few days or several weeks of life. A lot of clinic experience is required for a doctor to detect the amount of white blood cells in human blood and classify it. Thus, early and accurate diagnosis can be made in the formation of various disease types, including infection on the immune system, such as anemia and leukemia, while evaluating and determining the disease of a patient. The white blood cells can be separated into four subclasses, such as Eosinophil, Lymphocyte, Monocyte, and Neutrophil. This study focuses on the separation of the white blood cell images by the classification process using convolutional neural network models, which is a deep learning model. A deep learning network, which is slow in the training step due to the complex architecture, but fast in the test step, is used for the feature extraction instead of intricate methods. For the subclass separation of white blood cells, the experimental results show that the AlexNet architecture gives the correct recognition rate among the convolutional neural network architectures tested in the study. Various classifiers are performed on the features derived from the AlexNet architecture to evaluate the classification performance. The best performance in the classification of white blood cells is given by the quadratic discriminant analysis classifier with the accuracy of 97.78 %.

Deep Learning With TensorFlow: A Review

2019 ◽  
Vol 45 (2) ◽  
pp. 227-248 ◽  
Author(s):  
Bo Pang ◽  
Erik Nijkamp ◽  
Ying Nian Wu
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Network Models ◽  
Optimization Method ◽  
Stochastic Gradient Descent ◽  
Processing Unit ◽  
Neural Network Models ◽  
Core Concepts ◽  
High Level

This review covers the core concepts and design decisions of TensorFlow. TensorFlow, originally created by researchers at Google, is the most popular one among the plethora of deep learning libraries. In the field of deep learning, neural networks have achieved tremendous success and gained wide popularity in various areas. This family of models also has tremendous potential to promote data analysis and modeling for various problems in educational and behavioral sciences given its flexibility and scalability. We give the reader an overview of the basics of neural network models such as the multilayer perceptron, the convolutional neural network, and stochastic gradient descent, the most commonly used optimization method for neural network models. However, the implementation of these models and optimization algorithms is time-consuming and error-prone. Fortunately, TensorFlow greatly eases and accelerates the research and application of neural network models. We review several core concepts of TensorFlow such as graph construction functions, graph execution tools, and TensorFlow’s visualization tool, TensorBoard. Then, we apply these concepts to build and train a convolutional neural network model to classify handwritten digits. This review is concluded by a comparison of low- and high-level application programming interfaces and a discussion of graphical processing unit support, distributed training, and probabilistic modeling with TensorFlow Probability library.

scholarly journals DEGnext: classification of differentially expressed genes from RNA-seq data using a convolutional neural network with transfer learning

2022 ◽  
Vol 23 (1) ◽  
Author(s):  
Tulika Kakati ◽  
Dhruba K. Bhattacharyya ◽  
Jugal K. Kalita ◽  
Trina M. Norden-Krichmar
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Transfer Learning ◽  
Differentially Expressed Genes ◽  
Fine Tuning ◽  
Differentially Expressed ◽  
Rna Seq ◽  
Feature Maps

Abstract Background A limitation of traditional differential expression analysis on small datasets involves the possibility of false positives and false negatives due to sample variation. Considering the recent advances in deep learning (DL) based models, we wanted to expand the state-of-the-art in disease biomarker prediction from RNA-seq data using DL. However, application of DL to RNA-seq data is challenging due to absence of appropriate labels and smaller sample size as compared to number of genes. Deep learning coupled with transfer learning can improve prediction performance on novel data by incorporating patterns learned from other related data. With the emergence of new disease datasets, biomarker prediction would be facilitated by having a generalized model that can transfer the knowledge of trained feature maps to the new dataset. To the best of our knowledge, there is no Convolutional Neural Network (CNN)-based model coupled with transfer learning to predict the significant upregulating (UR) and downregulating (DR) genes from both trained and untrained datasets. Results We implemented a CNN model, DEGnext, to predict UR and DR genes from gene expression data obtained from The Cancer Genome Atlas database. DEGnext uses biologically validated data along with logarithmic fold change values to classify differentially expressed genes (DEGs) as UR and DR genes. We applied transfer learning to our model to leverage the knowledge of trained feature maps to untrained cancer datasets. DEGnext’s results were competitive (ROC scores between 88 and 99$$\%$$ % ) with those of five traditional machine learning methods: Decision Tree, K-Nearest Neighbors, Random Forest, Support Vector Machine, and XGBoost. DEGnext was robust and effective in terms of transferring learned feature maps to facilitate classification of unseen datasets. Additionally, we validated that the predicted DEGs from DEGnext were mapped to significant Gene Ontology terms and pathways related to cancer. Conclusions DEGnext can classify DEGs into UR and DR genes from RNA-seq cancer datasets with high performance. This type of analysis, using biologically relevant fine-tuning data, may aid in the exploration of potential biomarkers and can be adapted for other disease datasets.

Sign in / Sign up

Export Citation Format

Share Document