scholarly journals Attention-Based Transfer Learning for Efficient Pneumonia Detection in Chest X-ray Images

2021 ◽  
Vol 11 (3) ◽  
pp. 1242
Author(s):  
So-Mi Cha ◽  
Seung-Seok Lee ◽  
Bonggyun Ko
Keyword(s):  
Transfer Learning ◽  
Area Under The Curve ◽  
Attention Mechanism ◽  
Stable Model ◽  
X Rays ◽  
X Ray ◽  
Learning Framework ◽  
Computer Aided ◽  
Common Technique ◽  
Chest X Ray

Pneumonia is a form of acute respiratory infection commonly caused by germs, viruses, and fungi, and can prove fatal at any age. Chest X-rays is the most common technique for diagnosing pneumonia. There have been several attempts to apply transfer learning based on a Convolutional Neural Network to build a stable model in computer-aided diagnosis. Recently, with the appearance of an attention mechanism that automatically focuses on the critical part of the image that is crucial for the diagnosis of disease, it is possible to increase the performance of previous models. The goal of this study is to improve the accuracy of a computer-aided diagnostic approach that medical professionals can easily use as an auxiliary tool. In this paper, we proposed the attention-based transfer learning framework for efficient pneumonia detection in chest X-ray images. We collected features from three-types of pre-trained models, ResNet152, DenseNet121, ResNet18 as a role of feature extractor. We redefined the classifier for a new task and applied the attention mechanism as a feature selector. As a result, the proposed approach achieved accuracy, F-score, Area Under the Curve(AUC), precision and recall of 96.63%, 0.973, 96.03%, 96.23% and 98.46%, respectively.

scholarly journals Detection of COVID-19 Disease from Chest X-Ray Images: A Deep Transfer Learning Framework

2020 ◽  
Author(s):  
Shadman Sakib ◽  
Md. Abu Bakr Siddique ◽  
Mohammad Mahmudur Rahman Khan ◽  
Nowrin Yasmin ◽  
Anas Aziz ◽  
...  
Keyword(s):  
Transfer Learning ◽  
World Economy ◽  
X Rays ◽  
Test Dataset ◽  
X Ray ◽  
Learning Framework ◽  
Significant Step ◽  
Significant Performance ◽  
Normal Chest ◽  
Chest X Ray

AbstractWorld economy as well as public health have been facing a devastating effect caused by the disease termed as Coronavirus (COVID-19). A significant step of COVID-19 affected patient’s treatment is the faster and accurate detection of the disease which is the motivation of this study. In this paper, implementation of a deep transfer learning-based framework using a pre-trained network (ResNet-50) for detecting COVID-19 from the chest X-rays was done. Our dataset consists of 2905 chest X-ray images of three categories: COVID-19 affected (219 cases), Viral Pneumonia affected (1345 cases), and Normal Chest X-rays (1341 cases). The implemented neural network demonstrates significant performance in classifying the cases with an overall accuracy of 96%. Most importantly, the model has shown a significantly good performance over the current research-based methods in detecting the COVID-19 cases in the test dataset (Precision = 1.00, Recall = 1.00, F1-score = 1.00 and Specificity = 1.00). Therefore, our proposed approach can be adapted as a reliable method for faster and accurate COVID-19 affected case detection.

scholarly journals Automated segmentation and diagnosis of pneumothorax on chest X-rays with fully convolutional multi-scale ScSE-DenseNet: a retrospective study

2020 ◽  
Vol 20 (S14) ◽  
Author(s):  
Qingfeng Wang ◽  
Qiyu Liu ◽  
Guoting Luo ◽  
Zhiqin Liu ◽  
Jun Huang ◽  
...  
Keyword(s):  
Retrospective Study ◽  
Automatic Segmentation ◽  
Medical Emergency ◽  
Dice Similarity Coefficient ◽  
X Rays ◽  
X Ray ◽  
Learning Framework ◽  
Multi Scale ◽  
Life Threatening ◽  
Chest X Ray

Abstract Background Pneumothorax (PTX) may cause a life-threatening medical emergency with cardio-respiratory collapse that requires immediate intervention and rapid treatment. The screening and diagnosis of pneumothorax usually rely on chest radiographs. However, the pneumothoraces in chest X-rays may be very subtle with highly variable in shape and overlapped with the ribs or clavicles, which are often difficult to identify. Our objective was to create a large chest X-ray dataset for pneumothorax with pixel-level annotation and to train an automatic segmentation and diagnosis framework to assist radiologists to identify pneumothorax accurately and timely. Methods In this study, an end-to-end deep learning framework is proposed for the segmentation and diagnosis of pneumothorax on chest X-rays, which incorporates a fully convolutional DenseNet (FC-DenseNet) with multi-scale module and spatial and channel squeezes and excitation (scSE) modules. To further improve the precision of boundary segmentation, we propose a spatial weighted cross-entropy loss function to penalize the target, background and contour pixels with different weights. Results This retrospective study are conducted on a total of eligible 11,051 front-view chest X-ray images (5566 cases of PTX and 5485 cases of Non-PTX). The experimental results show that the proposed algorithm outperforms the five state-of-the-art segmentation algorithms in terms of mean pixel-wise accuracy (MPA) with $$0.93\pm 0.13$$ 0.93 ± 0.13 and dice similarity coefficient (DSC) with $$0.92\pm 0.14$$ 0.92 ± 0.14 , and achieves competitive performance on diagnostic accuracy with 93.45% and $$F_1$$ F 1 -score with 92.97%. Conclusion This framework provides substantial improvements for the automatic segmentation and diagnosis of pneumothorax and is expected to become a clinical application tool to help radiologists to identify pneumothorax on chest X-rays.

scholarly journals Pneumonia Detection using Chest X-Ray Images

2021 ◽  
Vol 9 (VI) ◽  
pp. 1611-1618
Author(s):  
Shruti Meshram
Keyword(s):  
Medical Center ◽  
Network Models ◽  
Ensemble Model ◽  
X Rays ◽  
Neural Network Models ◽  
X Ray ◽  
Learning Framework ◽  
Unseen Data ◽  
Chest X Ray ◽  
Bacteria And Fungi

Pneumonia is among the top diseases which cause most of the deaths all over the world. Virus, bacteria and fungi can all cause pneumonia. However, it is difficult to judge the pneumonia just by looking at chest X-rays. The aim of this study is to simplify the pneumonia detection process for experts as well as for novices. We suggest a novel deep learning framework for the detection of pneumonia using the concept of transfer learning. In this approach, features from images are extracted using different neural network models pre-trained on Image Net, which then are fed into a classifier for prediction. We prepared five different models and analyzed their performance. Thereafter, we proposed an ensemble model that combines outputs from all pre-trained models, which outperformed individual models, reaching the state-of-the-art performance in pneumonia recognition. Our ensemble model reached an accuracy of 96.4% with a recall of 99.62% on unseen data from the Guangzhou Women and Children’s Medical Center dataset.

scholarly journals Tinjauan Literatur Sistematik tentang Deteksi Covid-19 menggunakan Convolutional Neural Networks

2021 ◽  
Vol 8 (1) ◽  
pp. 9
Author(s):  
Buyut Khoirul Umri ◽  
Ema Utami ◽  
Mei P Kurniawan
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Literature Review ◽  
Transfer Learning ◽  
Convolutional Neural Networks ◽  
Large Scale ◽  
Image Data ◽  
X Rays ◽  
X Ray ◽  
Chest X Ray

Covid-19 menyerang sel-sel epitel yang melapisi saluran pernapasan sehingga dalam kasus ini dapat memanfaatkan gambar x-ray dada untuk menganalisis kesehatan paru-paru pada pasien. Menggunakan x-ray dalam bidang medis merupakan metode yang lebih cepat, lebih mudah dan tidak berbahaya yang dapat dimanfaatkan pada banyak hal. Salah satu metode yang paling sering digunakan dalam klasifikasi gambar adalah convolutional neural networks (CNN). CNN merupahan jenis neural network yang sering digunakan dalam data gambar dan sering digunakan dalam mendeteksi dan mengenali object pada sebuah gambar. Model arsitektur pada metode CNN juga dapat dikembangkan dengan transfer learning yang merupakan proses menggunakan kembali model pre-trained yang dilatih pada dataset besar, biasanya pada tugas klasifikasi gambar berskala besar. Tinjauan literature review ini digunakan untuk menganalisis penggunaan transfer learning pada CNN sebagai metode yang dapat digunakan untuk mendeteksi covid-19 pada gambar x-ray dada. Hasil sistematis review menunjukkan bahwa algoritma CNN dapat digunakan dengan akruasi yang baik dalam mendeteksi covid-19 pada gambar x-ray dada dan dengan pengembangan model transfer learning mampu mendapatkan performa yang maksimal dengan dataset yang besar maupun kecil.Kata Kunci—CNN, transfer learning, deteksi, covid-19Covid-19 attacks the epithelial cells lining the respiratory tract so that in this case it can utilize chest x-ray images to analyze the health of the lungs in patients. Using x-rays in the medical field is a faster, easier and harmless method that can be utilized in many ways. One of the most frequently used methods in image classification is convolutional neural networks (CNN). CNN is a type of neural network that is often used in image data and is often used in detecting and recognizing objects in an image. The architectural model in the CNN method can also be developed with transfer learning which is the process of reusing pre-trained models that are trained on large datasets, usually on the task of classifying large-scale images. This literature review review is used to analyze the use of transfer learning on CNN as a method that can be used to detect covid-19 on chest x-ray images. The systematic review results show that the CNN algorithm can be used with good accuracy in detecting covid-19 on chest x-ray images and by developing transfer learning models able to get maximum performance with large and small datasets.Keywords—CNN, transfer learning, detection, covid-19

scholarly journals Problems of Deploying CNN Transfer Learning to Detect COVID-19 from Chest X-rays

2020 ◽  
Author(s):  
Taban Majeed ◽  
Rasber Rashid ◽  
Dashti Ali ◽  
Aras Asaad
Keyword(s):  
Transfer Learning ◽  
Input Image ◽  
Machine Learning Algorithms ◽  
Diagnostic Process ◽  
X Rays ◽  
X Ray ◽  
Support Mechanism ◽  
Speed Up ◽  
Chest X Ray ◽  
The Many

AbstractThe Covid-19 first occurs in Wuhan, China in December 2019. After that the virus spread all around the world and at the time of writing this paper the total number of confirmed cases are above 4.7 million with over 315000 deaths. Machine learning algorithms built on radiography images can be used as a decision support mechanism to aid radiologists to speed up the diagnostic process. The aim of this work is to conduct a critical analysis to investigate the applicability of convolutional neural networks (CNNs) for the purpose of COVID-19 detection in chest X-ray images and highlight the issues of using CNN directly on the whole image. To achieve this task, we first use 12-off-the-shelf CNN architectures in transfer learning mode on 3 publicly available chest X-ray databases together with proposing a shallow CNN architecture in which we train it from scratch. Chest X-ray images fed into CNN models without any preprocessing to follow the many of researches using chest X-rays in this manner. Next, a qualitative investigation performed to inspect the decisions made by CNNs using a technique known as class activation maps (CAM). Using CAMs, one can map the activations contributed most to the decision of CNNs back to the original image to visualize the most discriminating regions on the input image.We conclude that CNN decisions should not be taken into consideration, despite their high classification accuracy, until clinicians can visually inspect, and approve, the region(s) of the input image used by CNNs that lead to its prediction.

scholarly journals A Novel Transfer Learning Based Approach for Pneumonia Detection in Chest X-ray Images

2020 ◽  
Vol 10 (2) ◽  
pp. 559 ◽  
Author(s):  
Vikash Chouhan ◽  
Sanjay Kumar Singh ◽  
Aditya Khamparia ◽  
Deepak Gupta ◽  
Prayag Tiwari ◽  
...  
Keyword(s):  
Transfer Learning ◽  
Medical Center ◽  
Network Models ◽  
Ensemble Model ◽  
X Rays ◽  
Neural Network Models ◽  
Learning Framework ◽  
Unseen Data ◽  
Chest X Ray ◽  
Bacteria And Fungi

Pneumonia is among the top diseases which cause most of the deaths all over the world. Virus, bacteria and fungi can all cause pneumonia. However, it is difficult to judge the pneumonia just by looking at chest X-rays. The aim of this study is to simplify the pneumonia detection process for experts as well as for novices. We suggest a novel deep learning framework for the detection of pneumonia using the concept of transfer learning. In this approach, features from images are extracted using different neural network models pretrained on ImageNet, which then are fed into a classifier for prediction. We prepared five different models and analyzed their performance. Thereafter, we proposed an ensemble model that combines outputs from all pretrained models, which outperformed individual models, reaching the state-of-the-art performance in pneumonia recognition. Our ensemble model reached an accuracy of 96.4% with a recall of 99.62% on unseen data from the Guangzhou Women and Children’s Medical Center dataset.

scholarly journals Transfer Learning with Deep Convolutional Neural Network (CNN) for Pneumonia Detection Using Chest X-ray

2020 ◽  
Vol 10 (9) ◽  
pp. 3233 ◽  
Author(s):  
Tawsifur Rahman ◽  
Muhammad E. H. Chowdhury ◽  
Amith Khandakar ◽  
Khandaker R. Islam ◽  
Khandaker F. Islam ◽  
...  
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Transfer Learning ◽  
Viral Pneumonia ◽  
Deep Convolutional Neural Network ◽  
X Rays ◽  
X Ray ◽  
Life Threatening ◽  
Chest X Ray ◽  
The Right

Pneumonia is a life-threatening disease, which occurs in the lungs caused by either bacterial or viral infection. It can be life-endangering if not acted upon at the right time and thus the early diagnosis of pneumonia is vital. The paper aims to automatically detect bacterial and viral pneumonia using digital x-ray images. It provides a detailed report on advances in accurate detection of pneumonia and then presents the methodology adopted by the authors. Four different pre-trained deep Convolutional Neural Network (CNN): AlexNet, ResNet18, DenseNet201, and SqueezeNet were used for transfer learning. A total of 5247 chest X-ray images consisting of bacterial, viral, and normal chest x-rays images were preprocessed and trained for the transfer learning-based classification task. In this study, the authors have reported three schemes of classifications: normal vs. pneumonia, bacterial vs. viral pneumonia, and normal, bacterial, and viral pneumonia. The classification accuracy of normal and pneumonia images, bacterial and viral pneumonia images, and normal, bacterial, and viral pneumonia were 98%, 95%, and 93.3%, respectively. This is the highest accuracy, in any scheme, of the accuracies reported in the literature. Therefore, the proposed study can be useful in more quickly diagnosing pneumonia by the radiologist and can help in the fast airport screening of pneumonia patients.

scholarly journals Artificial intelligence applied on chest X-ray can aid in the diagnosis of COVID-19 infection: a first experience from Lombardy, Italy

2020 ◽  
Author(s):  
Isabella Castiglioni ◽  
Davide Ippolito ◽  
Matteo Interlenghi ◽  
Caterina Beatrice Monti ◽  
Christian Salvatore ◽  
...  
Keyword(s):  
Artificial Intelligence ◽  
Neural Networks ◽  
Convolutional Neural Networks ◽  
Area Under The Curve ◽  
Training Dataset ◽  
List Type ◽  
X Rays ◽  
Independent Dataset ◽  
X Ray ◽  
Chest X Ray

AbstractObjectivesWe tested artificial intelligence (AI) to support the diagnosis of COVID-19 using chest X-ray (CXR). Diagnostic performance was computed for a system trained on CXRs of Italian subjects from two hospitals in Lombardy, Italy.MethodsWe used for training and internal testing an ensemble of ten convolutional neural networks (CNNs) with mainly bedside CXRs of 250 COVID-19 and 250 non-COVID-19 subjects from two hospitals. We then tested such system on bedside CXRs of an independent group of 110 patients (74 COVID-19, 36 non-COVID-19) from one of the two hospitals. A retrospective reading was performed by two radiologists in the absence of any clinical information, with the aim to differentiate COVID-19 from non-COVID-19 patients. Real-time polymerase chain reaction served as reference standard.ResultsAt 10-fold cross-validation, our AI model classified COVID-19 and non COVID-19 patients with 0.78 sensitivity (95% confidence interval [CI] 0.74–0.81), 0.82 specificity (95% CI 0.78–0.85) and 0.89 area under the curve (AUC) (95% CI 0.86–0.91). For the independent dataset, AI showed 0.80 sensitivity (95% CI 0.72–0.86) (59/74), 0.81 specificity (29/36) (95% CI 0.73–0.87), and 0.81 AUC (95% CI 0.73– 0.87). Radiologists’ reading obtained 0.63 sensitivity (95% CI 0.52–0.74) and 0.78 specificity (95% CI 0.61–0.90) in one centre and 0.64 sensitivity (95% CI 0.52–0.74) and 0.86 specificity (95% CI 0.71–0.95) in the other.ConclusionsThis preliminary experience based on ten CNNs trained on a limited training dataset shows an interesting potential of AI for COVID-19 diagnosis. Such tool is in training with new CXRs to further increase its performance.Key pointsArtificial intelligence based on convolutional neural networks was preliminary applied to chest-X-rays of patients suspected to be infected by COVID-19.Convolutional neural networks trained on a limited dataset of 250 COVID-19 and 250 non-COVID-19 were tested on an independent dataset of 110 patients suspected for COVID-19 infection and provided a balanced performance with 0.80 sensitivity and 0.81 specificity.Training on larger multi-institutional datasets may allow this tool to increase its performance.

scholarly journals Simple method for detecting idiopathic interstitial pneumonias by measuring vertical lung length on chest X-ray

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Masato Karayama ◽  
Yoichiro Aoshima ◽  
Hideki Yasui ◽  
Hironao Hozumi ◽  
Yuzo Suzuki ◽  
...  
Keyword(s):  
Operating Characteristic ◽  
Characteristic Curve ◽  
Area Under The Curve ◽  
X Rays ◽  
Simple Method ◽  
X Ray ◽  
Idiopathic Interstitial Pneumonias ◽  
Chest X Ray ◽  
Costophrenic Angle ◽  
Tracheal Carina

AbstractDetection of idiopathic interstitial pneumonias (IIPs) on chest X-ray is difficult for non-specialist physicians, especially in patients with mild IIPs. The current study aimed to evaluate the usefulness of a simple method for detecting IIPs by measuring vertical lung length (VLL) in chest X-rays to quantify decreased lung volume. A total of 280 consecutive patients with IIPs were randomly allocated to exploratory and validation cohorts, and 140 controls were selected for each cohort by propensity score-matching. Upper (uVLL; from apex to tracheal carina), lower (lVLL; from carina to costophrenic angle), and total VLL (tVLL; from apex to costophrenic angle), and the l/uVLL ratio were measured on chest X-rays. Patients in the exploratory cohort had significantly decreased uVLL, lVLL, tVLL, and l/uVLL ratio compared with controls (all p < 0.001). Receiver operating characteristic curve analyses demonstrated that lVLL (area under the curve [AUC] 0.86, sensitivity 0.65, specificity 0.92), tVLL (AUC 0.83, sensitivity 0.75, specificity 0.80), and l/uVLL ratio (AUC 0.80, sensitivity 0.72, specificity 0.79) had high diagnostic accuracies for IIPs. These results were reproduced in the validation cohort. IIP patients thus have decreased VLLs, and measurements of VLL may thus aid the accurate detection of IIPs.

Sign in / Sign up

Export Citation Format

Share Document