scholarly journals Validation of automated scoring of science assessments

2016 ◽  
Vol 53 (2) ◽  
pp. 215-233 ◽  
Author(s):  
Ou Lydia Liu ◽  
Joseph A. Rios ◽  
Michael Heilman ◽  
Libby Gerard ◽  
Marcia C. Linn
2021 ◽  
Vol 11 (6) ◽  
pp. 283
Author(s):  
Brooke Rumper ◽  
Elizabeth Frechette ◽  
Daryl B. Greenfield ◽  
Kathy Hirsh-Pasek

The present study examined the roles that language of assessment, language dominance, and teacher language use during instruction play in Dual Language Learner (DLL) science scores. A total of 255 Head Start DLL children were assessed on equated science assessments in English and Spanish. First overall differences between the two languages were examined, then associations between performance on science assessments were compared and related to children’s language dominance, teacher quantity of English and Spanish, and teachers’ academic science language. When examined as a homogeneous group, DLLs did not perform differently on English or Spanish science assessments. However, when examined heterogeneously, Spanish-dominant DLLs performed better on Spanish science assessments. The percentage of English and Spanish used by teachers did not affect children’s science scores. Teachers’ use of Spanish academic science language impacted children’s performance on science assessments, but English did not. The results have implications for the assessment of DLLs and teacher language use during instruction.


2021 ◽  
Vol 4 (1) ◽  
Author(s):  
Salman Sohrabi ◽  
Danielle E. Mor ◽  
Rachel Kaletsky ◽  
William Keyes ◽  
Coleen T. Murphy

AbstractWe recently linked branched-chain amino acid transferase 1 (BCAT1) dysfunction with the movement disorder Parkinson’s disease (PD), and found that RNAi-mediated knockdown of neuronal bcat-1 in C. elegans causes abnormal spasm-like ‘curling’ behavior with age. Here we report the development of a machine learning-based workflow and its application to the discovery of potentially new therapeutics for PD. In addition to simplifying quantification and maintaining a low data overhead, our simple segment-train-quantify platform enables fully automated scoring of image stills upon training of a convolutional neural network. We have trained a highly reliable neural network for the detection and classification of worm postures in order to carry out high-throughput curling analysis without the need for user intervention or post-inspection. In a proof-of-concept screen of 50 FDA-approved drugs, enasidenib, ethosuximide, metformin, and nitisinone were identified as candidates for potential late-in-life intervention in PD. These findings point to the utility of our high-throughput platform for automated scoring of worm postures and in particular, the discovery of potential candidate treatments for PD.


2009 ◽  
Vol 178 (2) ◽  
pp. 323-326 ◽  
Author(s):  
Jon Pham ◽  
Sara M. Cabrera ◽  
Carles Sanchis-Segura ◽  
Marcelo A. Wood
Keyword(s):  

2002 ◽  
Vol 15 (4) ◽  
pp. 391-412 ◽  
Author(s):  
Yongwei Yang ◽  
Chad W. Buckendahl ◽  
Piotr J. Juszkiewicz ◽  
Dennison S. Bhola
Keyword(s):  

2010 ◽  
Vol 27 (3) ◽  
pp. 335-353 ◽  
Author(s):  
Sara Cushing Weigle

Automated scoring has the potential to dramatically reduce the time and costs associated with the assessment of complex skills such as writing, but its use must be validated against a variety of criteria for it to be accepted by test users and stakeholders. This study approaches validity by comparing human and automated scores on responses to TOEFL® iBT Independent writing tasks with several non-test indicators of writing ability: student self-assessment, instructor assessment, and independent ratings of non-test writing samples. Automated scores were produced using e-rater ®, developed by Educational Testing Service (ETS). Correlations between both human and e-rater scores and non-test indicators were moderate but consistent, providing criterion-related validity evidence for the use of e-rater along with human scores. The implications of the findings for the validity of automated scores are discussed.


Sign in / Sign up

Export Citation Format

Share Document