Evaluating Diagnostic Accuracy of a New Artificial-Intelligence Driven Diagnostic Support Tool

2021 ◽  
Author(s):  
Niv Ben-Shabat ◽  
Ariel Sloma ◽  
Tomer Weizman ◽  
David Kiderman ◽  
Howard Amital
BMJ Open ◽  
2021 ◽  
Vol 11 (3) ◽  
pp. e043665
Author(s):  
Srinivasa Rao Kundeti ◽  
Manikanda Krishnan Vaidyanathan ◽  
Bharath Shivashankar ◽  
Sankar Prasad Gorthi

IntroductionThe use of artificial intelligence (AI) to support the diagnosis of acute ischaemic stroke (AIS) could improve patient outcomes and facilitate accurate tissue and vessel assessment. However, the evidence in published AI studies is inadequate and difficult to interpret which reduces the accountability of the diagnostic results in clinical settings. This study protocol describes a rigorous systematic review of the accuracy of AI in the diagnosis of AIS and detection of large-vessel occlusions (LVOs).Methods and analysisWe will perform a systematic review and meta-analysis of the performance of AI models for diagnosing AIS and detecting LVOs. We will adhere to the Preferred Reporting Items for Systematic Reviews and Meta-analyses Protocols guidelines. Literature searches will be conducted in eight databases. For data screening and extraction, two reviewers will use a modified Critical Appraisal and Data Extraction for Systematic Reviews of Prediction Modelling Studies checklist. We will assess the included studies using the Quality Assessment of Diagnostic Accuracy Studies guidelines. We will conduct a meta-analysis if sufficient data are available. We will use hierarchical summary receiver operating characteristic curves to estimate the summary operating points, including the pooled sensitivity and specificity, with 95% CIs, if pooling is appropriate. Furthermore, if sufficient data are available, we will use Grading of Recommendations, Assessment, Development and Evaluations profiler software to summarise the main findings of the systematic review, as a summary of results.Ethics and disseminationThere are no ethical considerations associated with this study protocol, as the systematic review focuses on the examination of secondary data. The systematic review results will be used to report on the accuracy, completeness and standard procedures of the included studies. We will disseminate our findings by publishing our analysis in a peer-reviewed journal and, if required, we will communicate with the stakeholders of the studies and bibliographic databases.PROSPERO registration numberCRD42020179652.


2016 ◽  
Author(s):  
Po-Hao Chen ◽  
Emmanuel Botzolakis ◽  
Suyash Mohan ◽  
R. N. Bryan ◽  
Tessa Cook

Author(s):  
Shaoxu Wu ◽  
Xiong Chen ◽  
Jiexin Pan ◽  
Wen Dong ◽  
Xiayao Diao ◽  
...  

Abstract Background Cystoscopy plays an important role in bladder cancer (BCa) diagnosis and treatment, but its sensitivity needs improvement. Artificial intelligence has shown promise in endoscopy, but few cystoscopic applications have been reported. We report a Cystoscopy Artificial Intelligence Diagnostic System (CAIDS) for BCa diagnosis. Methods In total, 69,204 images from 10,729 consecutive patients from six hospitals were collected and divided into training, internal validation, and external validation sets. The CAIDS was built using a pyramid scene parsing network and transfer learning. A subset (n = 260) of the validation sets was used for a performance comparison between the CAIDS and urologists for complex lesion detection. The diagnostic accuracy, sensitivity, specificity, and positive and negative predictive values and 95% confidence intervals (CIs) were calculated using the Clopper-Pearson method. Results The diagnostic accuracies of the CAIDS were 0.977 (95% CI = 0.974–0.979) in the internal validation set and 0.990 (95% CI = 0.979–0.996), 0.982 (95% CI = 0.974–0.988), 0.978 (95% CI = 0.959–0.989), and 0.991 (95% CI = 0.987–0.994) in different external validation sets. In the CAIDS versus urologists’ comparisons, the CAIDS showed high accuracy and sensitivity (accuracy = 0.939, 95% CI = 0.902–0.964; and sensitivity = 0.954, 95% CI = 0.902–0.983) with a short latency of 12 s, much more accurate and quicker than the expert urologists. Conclusions The CAIDS achieved accurate BCa detection with a short latency. The CAIDS may provide many clinical benefits, from increasing the diagnostic accuracy for BCa, even for commonly misdiagnosed cases such as flat cancerous tissue (carcinoma in situ), to reducing the operation time for cystoscopy.


2018 ◽  
Vol 15 (8) ◽  
pp. 513-515 ◽  
Author(s):  
Maryam Alsharqi ◽  
Ross Upton ◽  
Angela Mumith ◽  
Paul Leeson

Sign in / Sign up

Export Citation Format

Share Document