Handbook of Automated Scoring: Theory into Practice Duanli Yan, André A. Rupp and Peter W. Foltz Chapman & Hall/CRC, 2020, 580 pages, £120, hardcover ISBN: 978‐1‐1385‐7827‐2

2021 ◽  
Author(s):  
Magdalen Beiting‐Parrish ◽  
Jay Verkuilen
Keyword(s):  
Automated Scoring

scholarly journals High-throughput behavioral screen in C. elegans reveals Parkinson’s disease drug candidates

2021 ◽  
Vol 4 (1) ◽  
Author(s):  
Salman Sohrabi ◽  
Danielle E. Mor ◽  
Rachel Kaletsky ◽  
William Keyes ◽  
Coleen T. Murphy
Keyword(s):  
Neural Network ◽  
Parkinson’S Disease ◽  
Parkinson's Disease ◽  
High Throughput ◽  
Potential Candidate ◽  
Automated Scoring ◽  
C Elegans ◽  
Drug Candidates ◽  
Branched Chain ◽  
Approved Drugs

AbstractWe recently linked branched-chain amino acid transferase 1 (BCAT1) dysfunction with the movement disorder Parkinson’s disease (PD), and found that RNAi-mediated knockdown of neuronal bcat-1 in C. elegans causes abnormal spasm-like ‘curling’ behavior with age. Here we report the development of a machine learning-based workflow and its application to the discovery of potentially new therapeutics for PD. In addition to simplifying quantification and maintaining a low data overhead, our simple segment-train-quantify platform enables fully automated scoring of image stills upon training of a convolutional neural network. We have trained a highly reliable neural network for the detection and classification of worm postures in order to carry out high-throughput curling analysis without the need for user intervention or post-inspection. In a proof-of-concept screen of 50 FDA-approved drugs, enasidenib, ethosuximide, metformin, and nitisinone were identified as candidates for potential late-in-life intervention in PD. These findings point to the utility of our high-throughput platform for automated scoring of worm postures and in particular, the discovery of potential candidate treatments for PD.

scholarly journals Automated scoring of fear-related behavior using EthoVision software

2009 ◽  
Vol 178 (2) ◽  
pp. 323-326 ◽  
Author(s):  
Jon Pham ◽  
Sara M. Cabrera ◽  
Carles Sanchis-Segura ◽  
Marcelo A. Wood
Keyword(s):  
Automated Scoring

A Review of Strategies for Validating Computer-Automated Scoring

2002 ◽  
Vol 15 (4) ◽  
pp. 391-412 ◽  
Author(s):  
Yongwei Yang ◽  
Chad W. Buckendahl ◽  
Piotr J. Juszkiewicz ◽  
Dennison S. Bhola
Keyword(s):  
Automated Scoring

Validation of automated scores of TOEFL iBT tasks against non-test indicators of writing ability

2010 ◽  
Vol 27 (3) ◽  
pp. 335-353 ◽  
Author(s):  
Sara Cushing Weigle
Keyword(s):  
Validity Evidence ◽  
Educational Testing ◽  
Automated Scoring ◽  
Self Assessment ◽  
Writing Ability ◽  
Testing Service ◽  
Independent Writing ◽  
Complex Skills ◽  
Toefl Ibt ◽  
Educational Testing Service

Automated scoring has the potential to dramatically reduce the time and costs associated with the assessment of complex skills such as writing, but its use must be validated against a variety of criteria for it to be accepted by test users and stakeholders. This study approaches validity by comparing human and automated scores on responses to TOEFL® iBT Independent writing tasks with several non-test indicators of writing ability: student self-assessment, instructor assessment, and independent ratings of non-test writing samples. Automated scores were produced using e-rater ®, developed by Educational Testing Service (ETS). Correlations between both human and e-rater scores and non-test indicators were moderate but consistent, providing criterion-related validity evidence for the use of e-rater along with human scores. The implications of the findings for the validity of automated scores are discussed.

scholarly journals Automated scoring for a Tablet-based Rey Figure copy task differentiates constructional, organisational, and motor abilities

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Marco A. Petilli ◽  
Roberta Daini ◽  
Francesca Lea Saibene ◽  
Marco Rabuffetti
Keyword(s):  
Principal Component ◽  
Drawing Process ◽  
Automated Scoring ◽  
Critical Dimensions ◽  
Multiple Functions ◽  
Motor Abilities ◽  
Complex Figure ◽  
Drawing Tasks ◽  
Pencil Drawing ◽  
Rey Complex Figure

AbstractAccuracy in copying a figure is one of the most sensitive measures of visuo-constructional ability. However, drawing tasks also involve other cognitive and motor abilities, which may influence the final graphic produced. Nevertheless, these aspects are not taken into account in conventional scoring methodologies. In this study, we have implemented a novel Tablet-based assessment, acquiring data and information for the entire execution of the Rey Complex Figure copy task (T-RCF). This system extracts 12 indices capturing various dimensions of drawing abilities. We have also analysed the structure of relationships between these indices and provided insights into the constructs that they capture. 102 healthy adults completed the T-RCF. A subgroup of 35 participants also completed a paper-and-pencil drawing battery from which constructional, procedural, and motor measures were obtained. Principal component analysis of the T-RCF indices was performed, identifying spatial, procedural and kinematic components as distinct dimensions of drawing execution. Accordingly, a composite score for each dimension was determined. Correlational analyses provided indications of their validity by showing that spatial, procedural, and kinematic scores were associated with constructional, organisational and motor measures of drawing, respectively. Importantly, final copy accuracy was found to be associated with all of these aspects of drawing. In conclusion, copying complex figures entails an interplay of multiple functions. T-RCF provides a unique opportunity to analyse the entire drawing process and to extract scores for three critical dimensions of drawing execution.

Sign in / Sign up

Export Citation Format

Share Document