scholarly journals Automated scoring method for the CDMAM phantom

2009 ◽  
Author(s):  
M. Yip ◽  
W. Chukwu ◽  
E. Kottis ◽  
E. Lewis ◽  
J. Oduko ◽  
...  
Keyword(s):  
Automated Scoring ◽  
Scoring Method

SU-GG-I-122: An Automated Scoring Method to Quantitatively Evaluate Imaging Artifacts in 4D-CT Images

2010 ◽  
Vol 37 (6Part4) ◽  
pp. 3129-3129
Author(s):  
G Cui ◽  
B Jew ◽  
T Yamamoto ◽  
J Hong ◽  
B Loo ◽  
...  
Keyword(s):  
Ct Images ◽  
Automated Scoring ◽  
Scoring Method ◽  
4D Ct ◽  
Imaging Artifacts

scholarly journals Looking for a reference for large datasets: relative reliability of visual and automatic sleep scoring

2019 ◽  
Author(s):  
C. Berthomier ◽  
V. Muto ◽  
C. Schmidt ◽  
G. Vandewalle ◽  
M. Jaspar ◽  
...  
Keyword(s):  
Large Datasets ◽  
Automated Scoring ◽  
Scoring Method ◽  
Sleep Scoring ◽  
Sleep Studies ◽  
Fine Grain ◽  
Visual Scoring ◽  
Kappa Value ◽  
Consensus Scoring ◽  
Statistical Solutions

AbstractStudy ObjectivesNew challenges in sleep science require to describe fine grain phenomena or to deal with large datasets. Beside the human resource challenge of scoring huge datasets, the inter- and intra-expert variability may also reduce the sensitivity of such studies. Searching for a way to disentangle the variability induced by the scoring method from the actual variability in the data, visual and automatic sleep scorings of healthy individuals were examined.MethodsA first dataset (DS1, 4 recordings) scored by 6 experts plus an autoscoring algorithm was used to characterize inter-scoring variability. A second dataset (DS2, 88 recordings) scored a few weeks later was used to investigate intra-expert variability. Percentage agreements and Conger’s kappa were derived from epoch-by-epoch comparisons on pairwise, consensus and majority scorings.ResultsOn DS1 the number of epochs of agreement decreased when the number of expert increased, in both majority and consensus scoring, where agreement ranged from 86% (pairwise) to 69% (all experts). Adding autoscoring to visual scorings changed the kappa value from 0.81 to 0.79. Agreement between expert consensus and autoscoring was 93%. On DS2 intra-expert variability was evidenced by the kappa systematic decrease between autoscoring and each single expert between datasets (0.75 to 0.70).ConclusionsVisual scoring induces inter- and intra-expert variability, which is difficult to address especially in big data studies. When proven to be reliable and if perfectly reproducible, autoscoring methods can cope with intra-scorer variability making them a sensible option when dealing with large datasets.Statement of SignificanceWe confirmed and extended previous findings highlighting the intra- and inter-expert variability in visual sleep scoring. On large datasets those variability issues cannot be completely addressed by neither practical nor statistical solutions such as group training, majority or consensus scoring.When an automated scoring method can be proven to be as reasonably imperfect as visual scoring but perfectly reproducible, it can serve as a reliable scoring reference for sleep studies.

scholarly journals Assessment of Ki67 in Breast Cancer: Updated Recommendations from the International Ki67 in Breast Cancer Working Group

2020 ◽  
Author(s):  
Torsten O Nielsen ◽  
Samuel C Y Leung ◽  
David L Rimm ◽  
Andrew Dodson ◽  
Balazs Acs ◽  
...  
Keyword(s):  
Breast Cancer ◽  
Working Group ◽  
Clinical Utility ◽  
Current Evidence ◽  
Automated Scoring ◽  
Scoring Method ◽  
Control Programs ◽  
Visual Scoring ◽  
Er Positive ◽  
Further Development

Abstract Ki67 immunohistochemistry, commonly used as a proliferation marker in breast cancer, has limited value for treatment decisions due to questionable analytical validity. The International Ki67 Working Group (IKWG) consensus meeting, held in October 2019, assessed the current evidence for Ki67 immunohistochemistry analytical validity and clinical utility in breast cancer, including the series of scoring studies the IKWG conducted on centrally stained tissues. Consensus observations and recommendations are: 1) as for estrogen receptor and HER2 testing, pre-analytical handling considerations are critical. 2) A standardized visual scoring method has been established and is recommended for adoption. 3) Participation in and evaluation of quality assurance and quality control programs is recommended to maintain analytical validity. 4) The IKWG accepted that Ki67 IHC as a prognostic marker in breast cancer has clinical validity but concluded that clinical utility is evident only for prognosis estimation in anatomically favorable ER-positive and HER2-negative patients, to identify those who do not need adjuvant chemotherapy. In this T1-2, N0-1 patient group, the IKWG consensus is that Ki67 ≤ 5% or ≥ 30% can be used to estimate prognosis. In conclusion, analytical validity of Ki67 IHC can be reached with careful attention to pre-analytical issues and calibrated standardized visual scoring. Currently, clinical utility of Ki67 IHC in breast cancer care remains limited to prognosis assessment in stage I/II breast cancer. Further development of automated scoring might help to overcome some current limitations.

The Relation Between Linguistic Awareness Skills and Spelling in Adults: A Comparison Among Scoring Procedures

2020 ◽  
Vol 63 (4) ◽  
pp. 1240-1253
Author(s):  
Victoria S. Henbest ◽  
Lisa Fitton ◽  
Krystal L. Werfel ◽  
Kenn Apel
Keyword(s):  
Phonemic Awareness ◽  
Concurrent Validity ◽  
Word Reading ◽  
Continuous Measure ◽  
Scoring Methods ◽  
Syntactic Awareness ◽  
Scoring Method ◽  
Spelling Performance ◽  
Linguistic Awareness ◽  
Average Readers

Purpose Spelling is a skill that relies on an individual's linguistic awareness, the ability to overtly manipulate language. The ability to accurately spell is important for academic and career success into adulthood. The spelling skills of adults have received some attention in the literature, but there is limited information regarding which approach for analyzing adults' spelling is optimal for guiding instruction or intervention for those who struggle. Thus, we aimed to examine the concurrent validity of four different scoring methods for measuring adults' spellings (a dichotomous scoring method and three continuous methods) and to determine whether adults' linguistic awareness skills differentially predict spelling outcomes based on the scoring method employed. Method Sixty undergraduate college students who were determined to be average readers as measured by a word reading and contextual word reading task were administered a spelling task as well as morphological, orthographic, phonemic, and syntactic awareness tasks. Results All four scoring methods were highly correlated suggesting high concurrent validity among the measures. Two linguistic awareness skills, morphological awareness and syntactic awareness, predicted spelling performance on both the dichotomous and continuous scoring methods. Contrastively, phonemic awareness and orthographic awareness predicted spelling performance only when spelling was scored using a continuous measure error analysis. Conclusions The results of this study confirm that multiple linguistic awareness skills are important for spelling in adults who are average readers. The results also highlight the need for using continuous measures of spelling when planning intervention or instruction, particularly in the areas of orthographic and phonemic awareness.

Using Principal Component Scores to Enhance the Validity and Reliability of Big Five Personality Measures

2017 ◽  
Vol 38 (2) ◽  
pp. 83-93
Author(s):  
Jeffrey M. Cucina ◽  
Nicholas L. Vasilopoulos ◽  
Arwen H. DeCostanza
Keyword(s):  
Big Five ◽  
Discriminant Validity ◽  
Reliability And Validity ◽  
Principal Component ◽  
Big Five Personality ◽  
Validity And Reliability ◽  
Scoring Method ◽  
Five Factors ◽  
Big Five Factors ◽  
Component Scores

Abstract. Varimax rotated principal component scores (VRPCS) have previously been offered as a possible solution to the non-orthogonality of scores for the Big Five factors. However, few researchers have examined the reliability and validity of VRPCS. To address this gap, we use a lab study and a field study to investigate whether using VRPCS increase orthogonality, reliability, and criterion-related validity. Compared to the traditional unit-weighting scoring method, the use of VRPCS enhanced the reliability and discriminant validity of the Big Five factors, although there was little improvement in criterion-related validity. Results are discussed in terms of the benefit of using VRPCS instead of traditional unit-weighted sum scores.

Confound It!

2019 ◽  
Vol 35 (6) ◽  
pp. 855-867 ◽  
Author(s):  
John T. Kulas ◽  
Rachael Klahr ◽  
Lindsey Knights
Keyword(s):  
Social Desirability ◽  
Response Pattern ◽  
Experimental Manipulation ◽  
Scoring Method ◽  
Method Effect ◽  
Coding Method ◽  
The Social ◽  
Current Article ◽  
Method Factors ◽  
Psychological Inventory

Abstract. Many investigators have noted “reverse-coding” method factors when exploring response pattern structure with psychological inventory data. The current article probes for the existence of a confound in these investigations, whereby an item’s level of saturation with socially desirable content tends to covary with the item’s substantive scale keying. We first investigate its existence, demonstrating that 15 of 16 measures that have been previously implicated as exhibiting a reverse-scoring method effect can also be reasonably characterized as exhibiting a scoring key/social desirability confound. A second set of analyses targets the extent to which the confounding variable may confuse interpretation of factor analytic results and documents strong social desirability associations. The results suggest that assessment developers perhaps consider the social desirability scale value of indicators when constructing scale aggregates (and possibly scales when investigating inter-construct associations). Future investigations would ideally disentangle the confound via experimental manipulation.

COMPARISION OF DENTAL SCORING SYSTEM WITH RADIOGRAPHIC SKELETAL SYSTEM IN AGE ESTIMATION

JKCD ◽  
2019 ◽  
Vol 9 (1) ◽  
pp. 9-11
Author(s):  
Sadaf Ambreen
Keyword(s):  
Age Estimation ◽  
Scoring System ◽  
Skeletal Age ◽  
Chronological Age ◽  
Age Group ◽  
Dental Age ◽  
Scoring Method ◽  
Cross Sectional ◽  
Study Results ◽  
Male Subjects

Objectives: To compare Demirjian Dental scoring method with Greulich-Pyle (GP) Skeletal method of age estimation in pubertal children. Materials and Methods: Sample of the study included 267 male healthy subjects of 11-16 years of age group.. Demirjian Scoring system was utilized to evaluate the orthopantomograms to assess their Dental age and the Hand-Wrist radiographs were analyzed to calculate the skeletal age by utilizing GP atlas. Chronological age was obtained from the date of birth of the subject .Both methods were compared with one another and with the chronological age. It was a cross-sectional study and only healthy male subjects without any clinical abnormalities were included in the study. Results: A total of 267 male subjects of 11-16 years of age group were assessed by Demirjian and Greulich Pyle Methods. Both were compared with Chronological Age. Data obtained was statistically analyzed and the Student “t” test was applied in the study population. The mean difference between Chronolgical age and dental age was 0.69years and that of chronological age and skeletal age was 0.87 years. It was observed from dental age assessment that it does not differ much from the skeletal age. Conclusion: It was concluded that Demirjian method of Age Estimation is more precise than Greulich Pyle method of Age Estimation. Furthermore both methods can be used selectively in Medicolegal cases to access bone age which can be easily correlated to chronological age.

Sign in / Sign up

Export Citation Format

Share Document