scholarly journals A Software Tool for Exploring the Relation between Diagnostic Accuracy and Measurement Uncertainty

Diagnostics ◽  
2020 ◽  
Vol 10 (9) ◽  
pp. 610
Author(s):  
Theodora Chatzimichail ◽  
Aristides T. Hatjimihail

Screening and diagnostic tests are used to classify people with and without a disease. Diagnostic accuracy measures are used to evaluate the correctness of a classification in clinical research and practice. Although this depends on the uncertainty of measurement, there has been limited research on their relation. The objective of this work was to develop an exploratory tool for the relation between diagnostic accuracy measures and measurement uncertainty, as diagnostic accuracy is fundamental to clinical decision-making, while measurement uncertainty is critical to quality and risk management in laboratory medicine. For this reason, a freely available interactive program was developed for calculating, optimizing, plotting and comparing various diagnostic accuracy measures and the corresponding risk of diagnostic or screening tests measuring a normally distributed measurand, applied at a single point in time in non-diseased and diseased populations. This is done for differing prevalence of the disease, mean and standard deviation of the measurand, diagnostic threshold, standard measurement uncertainty of the tests and expected loss. The application of the program is illustrated with a case study of glucose measurements in diabetic and non-diabetic populations. The program is user-friendly and can be used as an educational and research tool in medical decision-making.

2020 ◽  
Author(s):  
Theodora Chatzimichail ◽  
Aristides T. Hatjimihail

Abstract Background Screening and diagnostic tests are used to classify people with and without a disease. Diagnostic accuracy measures are used to evaluate the correctness of a classification in clinical research and practice. Although the correctness of a classification based on a measurand depends on the uncertainty of measurement, there has been limited research on their relation. The objective for this work is to develop an exploratory tool for the relation between diagnostic accuracy measures and measurement uncertainty, as diagnostic accuracy is fundamental to clinical decision making, while measurement uncertainty is critical to quality and risk management in laboratory medicine. Results For this reason, a freely available interactive program has been developed, written in Wolfram Language. The program provides four modules for calculating, optimizing, plotting and comparing various diagnostic accuracy measures and the corresponding risk of diagnostic or screening tests measuring a normally distributed measurand, applied at a single point in time in non-diseased and diseased populations. This is done for differing prevalence of the disease, mean and standard deviation of the measurand, diagnostic threshold, standard measurement uncertainty of the tests and expected loss. The application of the program is illustrated with a case study of glucose measurements in diabetic and non-diabetic populations, that demonstrates the relation between diagnostic accuracy measures and measurement uncertainty. Conclusion The presented interactive program is user-friendly and can be used as a flexible educational and research tool in medical decision making, to explore the relation between diagnostic accuracy measures and measurement uncertainty.


2020 ◽  
Author(s):  
Theodora Chatzimichail ◽  
Aristides T. Hatjimihail

Abstract Background: Screening and diagnostic tests are used to classify people with and without a disease. Although diagnostic accuracy measures are used to evaluate the correctness of a classification in clinical research and practice, there has been limited research on their uncertainty. The objective for this work is to develop a tool for calculating the uncertainty of diagnostic accuracy measures, as diagnostic accuracy is fundamental to clinical decision-making.Results: For this reason, a freely available interactive program has been developed in Wolfram Language. The program provides six modules with nine submodules, for calculating and plotting the standard and expanded uncertainty and the resultant confidence intervals of various diagnostic accuracy measures of screening or diagnostic tests, which measure a normally distributed measurand, applied at a single point in time in non-diseased and diseased populations. This is done for differing population sample sizes, mean and standard deviation of the measurand, diagnostic threshold and standard measurement uncertainty of the test.The application of the program is illustrated with a case study of glucose measurements in diabetic and non-diabetic populations, that demonstrates the calculation of the uncertainty of diagnostic accuracy measures.Conclusion: The presented interactive program is user-friendly and can be used as a flexible educational and research tool in medical decision making, to calculate and explore the uncertainty of diagnostic accuracy measures.


Diagnostics ◽  
2021 ◽  
Vol 11 (3) ◽  
pp. 406
Author(s):  
Theodora Chatzimichail ◽  
Aristides T. Hatjimihail

Screening and diagnostic tests are applied for the classification of people into diseased and non-diseased populations. Although diagnostic accuracy measures are used to evaluate the correctness of classification in clinical research and practice, there has been limited research on their uncertainty. The objective for this work was to develop a tool for calculating the uncertainty of diagnostic accuracy measures, as diagnostic accuracy is fundamental to clinical decision-making. For this reason, the freely available interactive program Diagnostic Uncertainty has been developed in the Wolfram Language. The program provides six modules with nine submodules for calculating and plotting the standard combined, measurement and sampling uncertainty and the resultant confidence intervals of various diagnostic accuracy measures of screening or diagnostic tests, which measure a normally distributed measurand, applied at a single point in time to samples of non-diseased and diseased populations. This is done for differing sample sizes, mean and standard deviation of the measurand, diagnostic threshold and standard measurement uncertainty of the test. The application of the program is demonstrated with an illustrative example of glucose measurements in samples of diabetic and non-diabetic populations, that shows the calculation of the uncertainty of diagnostic accuracy measures. The presented interactive program is user-friendly and can be used as a flexible educational and research tool in medical decision-making, to calculate and explore the uncertainty of diagnostic accuracy measures.


2018 ◽  
Vol 38 (5) ◽  
pp. 593-600
Author(s):  
Marco Boeri ◽  
Alan J. McMichael ◽  
Joseph P. M. Kane ◽  
Francis A. O’Neill ◽  
Frank Kee

Background. In discrete-choice experiments (DCEs), respondents are presented with a series of scenarios and asked to select their preferred choice. In clinical decision making, DCEs allow one to calculate the maximum acceptable risk (MAR) that a respondent is willing to accept for a one-unit increase in treatment efficacy. Most published studies report the average MAR for the whole sample, without conveying any information about heterogeneity. For a sample of psychiatrists prescribing drugs for a series of hypothetical patients with schizophrenia, this article demonstrates how heterogeneity accounted for in the DCE modeling can be incorporated in the derivation of the MAR. Methods. Psychiatrists were given information about a group of patients’ responses to treatment on the Positive and Negative Syndrome Scale (PANSS) and the weight gain associated with the treatment observed in a series of 26 vignettes. We estimated a random parameters logit (RPL) model with treatment choice as the dependent variable. Results. Results from the RPL were used to compute the MAR for the overall sample. This was found to be equal to 4%, implying that, overall, psychiatrists were willing to accept a 4% increase in the risk of an adverse event to obtain a one-unit improvement of symptoms – measured on the PANSS. Heterogeneity was then incorporated in the MAR calculation, finding that MARs ranged between 0.5 and 9.5 across the sample of psychiatrists. Limitations. We provided psychiatrists with hypothetical scenarios, and their MAR may change when making decisions for actual patients. Conclusions. This analysis aimed to show how it is possible to calculate physician-specific MARs and to discuss how MAR heterogeneity could have implications for medical practice.


Author(s):  
Ken J. Farion ◽  
Michael J. Hine ◽  
Wojtek Michalowski ◽  
Szymon Wilk

Clinical decision-making is a complex process that is reliant on accurate and timely information. Clinicians are dependent (or should be dependent) on massive amounts of information and knowledge to make decisions that are in the best interest of the patient. Increasingly, information technology (IT) solutions are being used as a knowledge transfer mechanism to ensure that clinicians have access to appropriate knowledge sources to support and facilitate medical decision making. One particular class of IT that the medical community is showing increased interest in is clinical decision support systems (CDSSs).


2018 ◽  
Vol 13 (3) ◽  
pp. 151-158 ◽  
Author(s):  
Niels Lynøe ◽  
Gert Helgesson ◽  
Niklas Juth

Clinical decisions are expected to be based on factual evidence and official values derived from healthcare law and soft laws such as regulations and guidelines. But sometimes personal values instead influence clinical decisions. One way in which personal values may influence medical decision-making is by their affecting factual claims or assumptions made by healthcare providers. Such influence, which we call ‘value-impregnation,’ may be concealed to all concerned stakeholders. We suggest as a hypothesis that healthcare providers’ decision making is sometimes affected by value-impregnated factual claims or assumptions. If such claims influence e.g. doctor–patient encounters, this will likely have a negative impact on the provision of correct information to patients and on patients’ influence on decision making regarding their own care. In this paper, we explore the idea that value-impregnated factual claims influence healthcare decisions through a series of medical examples. We suggest that more research is needed to further examine whether healthcare staff’s personal values influence clinical decision-making.


2014 ◽  
Vol 13 (1) ◽  
pp. e392
Author(s):  
T. Kwon ◽  
I.G. Jeong ◽  
D. You ◽  
B. Lim ◽  
K-S. Han ◽  
...  

2017 ◽  
Vol 10 (3) ◽  
pp. S50
Author(s):  
Christopher Cook ◽  
Ricardo Petraco ◽  
Yousif Ahmad ◽  
Matthew Shun-Shin ◽  
Sukhjinder Nijjer ◽  
...  

Diagnosis ◽  
2014 ◽  
Vol 1 (1) ◽  
pp. 23-27 ◽  
Author(s):  
Pat Croskerry

AbstractPeople diagnose themselves or receive advice about their illnesses from a variety of sources ranging from their family or friends, alternate medicine, or through conventional medicine. In all cases, the diagnosing mechanism is the human brain which normally operates under the influence of a variety of biases. Most, but not all biases, reside in intuitive decision making, and no individual or group is immune from them. Two biases in particular, bias blind spot and myside bias, have presented obstacles to accepting the impact of bias on medical decision making. Nevertheless, there is now a widespread appreciation of the important role of bias in the majority of medical disciplines. The dual process model of decision making now seems well accepted, although a polarization of opinions has arisen with some arguing the merits of intuitive approaches over analytical ones and vice versa. We should instead accept that it is not one mode or the other that enables well-calibrated thinking but the discriminating use of both. A pivotal role for analytical thinking lies in its ability to allow decision makers the means to detach from the intuitive mode to mitigate bias; it is the gatekeeper for the final diagnostic decision. Exploring and cultivating such debiasing initiatives should be seen as the next major research area in clinical decision making. Awareness of bias and strategies for debiasing are important aspects of the critical thinker’s armamentarium. Promoting critical thinking in undergraduate, postgraduate and continuing medical education will lead to better calibrated diagnosticians.


2019 ◽  
Vol 43 (1 suppl 1) ◽  
pp. 513-524
Author(s):  
Álisson Oliveira dos Santos ◽  
Alexandre Sztajnberg ◽  
Tales Mota Machado ◽  
Daniel Magalhães Nobre ◽  
Adriano Neves de Paula e Souza ◽  
...  

ABSTRACT The medical education for clinical decision-making has undergone changes in recent years. Previously supported by printed material, problem solving in clinical practice has recently been aided by digital tools known as summaries platforms. Doctors and medical students have been using such tools from questions found in practice scenarios. These platforms have the advantage of high-quality, evidence-based and always up-to-date content. Its popularization was mainly due to the rise of the internet use and, more recently, of mobile devices such as tablets and smartphones, facilitating their use in clinical practice. Despite this platform is widely available, the most of them actually present several access barriers as costs, foreign language and not be able to Brazilian epidemiology. A free national platform of evidence-based medical summaries was proposed, using the crowdsourcing concept to resolve those barriers. Furthermore, concepts of gamification and content evaluation were implemented. Also, there is the possibility of evaluation by the users, who assigns note for each content created. The platform was built with modern technological tools and made available for web and mobile application. After development, an evaluation process was conducted by researchers to attest to the valid of content, usability, and user satisfying. Consolidated questionnaires and evaluation tools by the literature were applied. The process of developing the digital platform fostered interdisciplinarity, from the involvement of medical and information technology professionals. The work also allowed the reflection on the innovative educational processes, in which the learning from real life problems and the construction of knowledge in a collaborative way are integrated. The assessment results suggest that platform can be real alternative form the evidence-based medical decision-making.


Sign in / Sign up

Export Citation Format

Share Document