scholarly journals A Study into Math Document Classification using Deep Learning

2020 ◽  
Author(s):  
Fatimah Alshamari ◽  
Abdou Youssef
Keyword(s):  
Deep Learning ◽  
Classification Performance ◽  
Document Classification ◽  
Design Parameters ◽  
Technological Advancement ◽  
Scientific Publications ◽  
Specific Domain ◽  
Decision Choices ◽  
And Mathematics

Document classification is a fundamental task for many applications, including document annotation, document understanding, and knowledge discovery. This is especially true in STEM fields where the growth rate of scientific publications is exponential, and where the need for document processing and understanding is essential to technological advancement. Classifying a new publication into a specific domain based on the content of the document is an expensive process in terms of cost and time. Therefore, there is a high demand for a reliable document classification system. In this paper, we focus on classification of mathematics documents, which consist of English text and mathematics formulas and symbols. The paper addresses two key questions. The first question is whether math-document classification performance is impacted by math expressions and symbols, either alone or in conjunction with the text contents of documents. Our investigations show that Text-Only embedding produces better classification results. The second question we address is the optimization of a deep learning (DL) model, the LSTM combined with one dimension CNN, for math document classification. We examine the model with several input representations, key design parameters and decision choices, and choices of the best input representation for math documents classification.

A Study on the Auxiliary Diagnosis of Thyroid Disease Images Based on Multiple Dimensional Deep Learning Algorithms

2020 ◽  
Vol 16 (3) ◽  
pp. 199-205
Author(s):  
Yuejun Liu ◽  
Yifei Xu ◽  
Xiangzheng Meng ◽  
Xuguang Wang ◽  
Tianxu Bai
Keyword(s):  
Deep Learning ◽  
Learning Algorithms ◽  
Region Of Interest ◽  
Classification Performance ◽  
Thyroid Diseases ◽  
Great Success ◽  
Learning Models ◽  
Good Classification Performance ◽  
Spect Images

Background: Medical imaging plays an important role in the diagnosis of thyroid diseases. In the field of machine learning, multiple dimensional deep learning algorithms are widely used in image classification and recognition, and have achieved great success. Objective: The method based on multiple dimensional deep learning is employed for the auxiliary diagnosis of thyroid diseases based on SPECT images. The performances of different deep learning models are evaluated and compared. Methods: Thyroid SPECT images are collected with three types, they are hyperthyroidism, normal and hypothyroidism. In the pre-processing, the region of interest of thyroid is segmented and the amount of data sample is expanded. Four CNN models, including CNN, Inception, VGG16 and RNN, are used to evaluate deep learning methods. Results: Deep learning based methods have good classification performance, the accuracy is 92.9%-96.2%, AUC is 97.8%-99.6%. VGG16 model has the best performance, the accuracy is 96.2% and AUC is 99.6%. Especially, the VGG16 model with a changing learning rate works best. Conclusion: The standard CNN, Inception, VGG16, and RNN four deep learning models are efficient for the classification of thyroid diseases with SPECT images. The accuracy of the assisted diagnostic method based on deep learning is higher than that of other methods reported in the literature.

scholarly journals An Artificial Intelligence Framework for Plant Leaf Disease Detection and Classification Using AMBF with GKFCM and GLCM

2021 ◽  
Vol 36 (1) ◽  
pp. 443-450
Author(s):  
Mounika Jammula
Keyword(s):  
Artificial Intelligence ◽  
Deep Learning ◽  
Plant Disease ◽  
Bilateral Filter ◽  
Noise Removal ◽  
Classification Performance ◽  
Disease Classification ◽  
Gaussian Kernel ◽  
Shape Features

As of 2020, the total area planted with crops in India overtook 125.78 million hectares. India is the second biggest organic product maker in the world. Thus, an Indian economy greatly depends on farming products. Nowadays, farmers suffer a drop in production due to a lot of diseases and pests. Thus, to overcome this problem, this article presents the artificial intelligence based deep learning approach for plant disease classification. Initially, the adaptive mean bilateral filter (AMBF) for noise removal and enhancement operations. Then, Gaussian kernel fuzzy C-means (GKFCM) approach is used to segment the effected disease regions. The optimal features from color, texture and shape features are extracted by using GLCM. Finally, Deep learning convolutional neural network (DLCNN) is used for the classification of five class diseases. The segmentation and classification performance of proposed method outperforms as compared with the state of art approaches.

scholarly journals Breast Cancer Histopathology Image Classification Using an Ensemble of Deep Learning Models

Sensors ◽  
2020 ◽  
Vol 20 (16) ◽  
pp. 4373 ◽  
Author(s):  
Zabit Hameed ◽  
Sofia Zahia ◽  
Begonya Garcia-Zapirain ◽  
José Javier Aguirre ◽  
Ana María Vanegas
Keyword(s):  
Breast Cancer ◽  
Deep Learning ◽  
Diagnostic System ◽  
Microscopic Analysis ◽  
Classification Performance ◽  
Histopathological Analysis ◽  
Learning Approach ◽  
Ensemble Strategy ◽  
Histopathology Images

Breast cancer is one of the major public health issues and is considered a leading cause of cancer-related deaths among women worldwide. Its early diagnosis can effectively help in increasing the chances of survival rate. To this end, biopsy is usually followed as a gold standard approach in which tissues are collected for microscopic analysis. However, the histopathological analysis of breast cancer is non-trivial, labor-intensive, and may lead to a high degree of disagreement among pathologists. Therefore, an automatic diagnostic system could assist pathologists to improve the effectiveness of diagnostic processes. This paper presents an ensemble deep learning approach for the definite classification of non-carcinoma and carcinoma breast cancer histopathology images using our collected dataset. We trained four different models based on pre-trained VGG16 and VGG19 architectures. Initially, we followed 5-fold cross-validation operations on all the individual models, namely, fully-trained VGG16, fine-tuned VGG16, fully-trained VGG19, and fine-tuned VGG19 models. Then, we followed an ensemble strategy by taking the average of predicted probabilities and found that the ensemble of fine-tuned VGG16 and fine-tuned VGG19 performed competitive classification performance, especially on the carcinoma class. The ensemble of fine-tuned VGG16 and VGG19 models offered sensitivity of 97.73% for carcinoma class and overall accuracy of 95.29%. Also, it offered an F1 score of 95.29%. These experimental results demonstrated that our proposed deep learning approach is effective for the automatic classification of complex-natured histopathology images of breast cancer, more specifically for carcinoma images.

scholarly journals Multi-label classification of frog species via deep learning

2017 ◽  
Author(s):  
Jie Xie
Keyword(s):  
Deep Learning ◽  
Learning Algorithm ◽  
Single Species ◽  
Classification Performance ◽  
Time Frequency ◽  
Deep Learning Algorithm ◽  
Binary Relevance ◽  
Frog Species ◽  
Call Classification

Acoustic classification of frogs has received increasing attention for its promising application in ecological studies. Various studies have been proposed for classifying frog species, but most recordings are assumed to have only a single species. In this study, a method to classify multiple frog species in an audio clip is presented. To be specific, continuous frog recordings are first cropped into audio clips (10 seconds). Then, various time-frequency representations are generated for each 10-s recording. Next, instead of using traditional hand-crafted features, a deep learning algorithm is used to find the most important feature. Finally, a binary relevance based multi-label classification approach is proposed to classify simultaneously vocalizing frog species with our proposed features. Experimental results show that our proposed features extracted using deep learning can achieve better classification performance when compared to hand-crafted features for frog call classification.

scholarly journals Multi-label classification of frog species via deep learning

2017 ◽  
Author(s):  
Jie Xie
Keyword(s):  
Deep Learning ◽  
Learning Algorithm ◽  
Single Species ◽  
Classification Performance ◽  
Time Frequency ◽  
Deep Learning Algorithm ◽  
Binary Relevance ◽  
Frog Species ◽  
Call Classification

Acoustic classification of frogs has received increasing attention for its promising application in ecological studies. Various studies have been proposed for classifying frog species, but most recordings are assumed to have only a single species. In this study, a method to classify multiple frog species in an audio clip is presented. To be specific, continuous frog recordings are first cropped into audio clips (10 seconds). Then, various time-frequency representations are generated for each 10-s recording. Next, instead of using traditional hand-crafted features, a deep learning algorithm is used to find the most important feature. Finally, a binary relevance based multi-label classification approach is proposed to classify simultaneously vocalizing frog species with our proposed features. Experimental results show that our proposed features extracted using deep learning can achieve better classification performance when compared to hand-crafted features for frog call classification.

scholarly journals Identifying individuals with recent COVID-19 through voice classification using deep learning

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Pichatorn Suppakitjanusant ◽  
Somnuek Sungkanuparph ◽  
Thananya Wongsinin ◽  
Sirapong Virapongsiri ◽  
Nittaya Kasemkosin ◽  
...  
Keyword(s):  
Deep Learning ◽  
Classification Performance ◽  
The Other ◽  
Healthy Individuals ◽  
Model Accuracy ◽  
Subtle Change ◽  
Classification Of Images ◽  
A Prospective Study ◽  
Voice Classification

AbstractRecently deep learning has attained a breakthrough in model accuracy for the classification of images due mainly to convolutional neural networks. In the present study, we attempted to investigate the presence of subclinical voice feature alteration in COVID-19 patients after the recent resolution of disease using deep learning. The study was a prospective study of 76 post COVID-19 patients and 40 healthy individuals. The diagnoses of post COVID-19 patients were based on more than the eighth week after onset of symptoms. Voice samples of an ‘ah’ sound, coughing sound and a polysyllabic sentence were collected and preprocessed to log-mel spectrogram. Transfer learning using the VGG19 pre-trained convolutional neural network was performed with all voice samples. The performance of the model using the polysyllabic sentence yielded the highest classification performance of all models. The coughing sound produced the lowest classification performance while the ability of the monosyllabic ‘ah’ sound to predict the recent COVID-19 fell between the other two vocalizations. The model using the polysyllabic sentence achieved 85% accuracy, 89% sensitivity, and 77% specificity. In conclusion, deep learning is able to detect the subtle change in voice features of COVID-19 patients after recent resolution of the disease.

scholarly journals Classification of Dental Radiographs Using Deep Learning

2021 ◽  
Vol 10 (7) ◽  
pp. 1496
Author(s):  
Jose E. Cejudo ◽  
Akhilanand Chaurasia ◽  
Ben Feldberg ◽  
Joachim Krois ◽  
Falk Schwendicke
Keyword(s):  
Deep Learning ◽  
Classification Performance ◽  
Image Features ◽  
Dental Radiographs ◽  
Maxilla And Mandible ◽  
Expert Reasoning ◽  
Radiographic Data ◽  
Learning Architectures ◽  
Activation Mapping

Objectives: To retrospectively assess radiographic data and to prospectively classify radiographs (namely, panoramic, bitewing, periapical, and cephalometric images), we compared three deep learning architectures for their classification performance. Methods: Our dataset consisted of 31,288 panoramic, 43,598 periapical, 14,326 bitewing, and 1176 cephalometric radiographs from two centers (Berlin/Germany; Lucknow/India). For a subset of images L (32,381 images), image classifications were available and manually validated by an expert. The remaining subset of images U was iteratively annotated using active learning, with ResNet-34 being trained on L, least confidence informative sampling being performed on U, and the most uncertain image classifications from U being reviewed by a human expert and iteratively used for re-training. We then employed a baseline convolutional neural networks (CNN), a residual network (another ResNet-34, pretrained on ImageNet), and a capsule network (CapsNet) for classification. Early stopping was used to prevent overfitting. Evaluation of the model performances followed stratified k-fold cross-validation. Gradient-weighted Class Activation Mapping (Grad-CAM) was used to provide visualizations of the weighted activations maps. Results: All three models showed high accuracy (>98%) with significantly higher accuracy, F1-score, precision, and sensitivity of ResNet than baseline CNN and CapsNet (p < 0.05). Specificity was not significantly different. ResNet achieved the best performance at small variance and fastest convergence. Misclassification was most common between bitewings and periapicals. For bitewings, model activation was most notable in the inter-arch space for periapicals interdentally, for panoramics on bony structures of maxilla and mandible, and for cephalometrics on the viscerocranium. Conclusions: Regardless of the models, high classification accuracies were achieved. Image features considered for classification were consistent with expert reasoning.

scholarly journals Co-Training Semi-Supervised Deep Learning for Sentiment Classification of MOOC Forum Posts

Symmetry ◽  
2019 ◽  
Vol 12 (1) ◽  
pp. 8
Author(s):  
Jing Chen ◽  
Jun Feng ◽  
Xia Sun ◽  
Yang Liu
Keyword(s):  
Deep Learning ◽  
Large Scale ◽  
Sample Selection ◽  
Classification Performance ◽  
Sentiment Classification ◽  
Unlabeled Data ◽  
Learning Performance ◽  
Average Accuracy ◽  
Complex Features

Sentiment classification of forum posts of massive open online courses is essential for educators to make interventions and for instructors to improve learning performance. Lacking monitoring on learners’ sentiments may lead to high dropout rates of courses. Recently, deep learning has emerged as an outstanding machine learning technique for sentiment classification, which extracts complex features automatically with rich representation capabilities. However, deep neural networks always rely on a large amount of labeled data for supervised training. Constructing large-scale labeled training datasets for sentiment classification is very laborious and time consuming. To address this problem, this paper proposes a co-training, semi-supervised deep learning model for sentiment classification, leveraging limited labeled data and massive unlabeled data simultaneously to achieve performance comparable to those methods trained on massive labeled data. To satisfy the condition of two views of co-training, we encoded texts into vectors from views of word embedding and character-based embedding independently, considering words’ external and internal information. To promote the classification performance with limited data, we propose a double-check strategy sample selection method to select samples with high confidence to augment the training set iteratively. In addition, we propose a mixed loss function both considering the labeled data with asymmetric and unlabeled data. Our proposed method achieved a 89.73% average accuracy and an 93.55% average F1-score, about 2.77% and 3.2% higher than baseline methods. Experimental results demonstrate the effectiveness of the proposed model trained on limited labeled data, which performs much better than those trained on massive labeled data.

Deep Learning-Based Diabetic Retinopathy Detection

2021 ◽  
Vol 11 (3) ◽  
pp. 38-48
Author(s):  
Mohamed Jebran P. ◽  
Sufia Banu
Keyword(s):  
Diabetes Mellitus ◽  
Diabetic Retinopathy ◽  
Deep Learning ◽  
Learning Algorithm ◽  
Classification Performance ◽  
Learning Problems ◽  
Deep Learning Algorithm ◽  
Lesion Level ◽  
Fundus Photographs

Artificial intelligence (AI) is rapidly evolving from machine learning (ML) to deep learning (DL), which has ignited particular interest in ophthalmology as well. Deep learning has been applied in ophthalmology to fundus photographs, which achieve robust classification performance in the detection of diabetic retinopathy (DR). Diabetic retinopathy is a progressive condition observed in people who have had multiple years of diabetes mellitus. This paper focuses on examining how a deep learning algorithm can be applied for the detection and classification of diabetic retinopathy, both at the image level and at the lesion level. The performance of various neural networks is summarized by taking into account the sensitivity, precision, accuracy with respect to the size of the test datasets. Deep learning problems are discussed at the end.

scholarly journals Ensemble Learning Technique for Cloud Classification

2019 ◽  
Vol 9 (2) ◽  
pp. 2582-2587
Keyword(s):  
Deep Learning ◽  
Ensemble Learning ◽  
Ensemble Methods ◽  
Classification Performance ◽  
Cloud Type ◽  
Cloud Classification ◽  
Learning Techniques ◽  
Learning Technique ◽  
Better Than

Automatic cloud classification is one of the important areas of remote sensing for metrological applications. Machine learning and deep learning techniques have been used for automatic classification of the cloud type. Several pretrained models are developed using convolutional neural network (CNN), which is part of deep learning. The classification performance of pretrained networks can be further improved using ensemble methods. Ensemble learning can perform better than single learner. In this paper, we proposed two different ensemble learning techniques: ensemble of CNN and ensemble of classifier. In first approach, CNN ensemble is performed, where the features extracted by two or more CNN are combined together using single classifier. The second method is to ensemble the predictions of different classifiers produced by a single or multiple CNN. The accuracy of cloud classification of the proposed methods has improved compared to without ensemble of pretrained networks

Sign in / Sign up

Export Citation Format

Share Document