4. Inter-Rater Reliability of Postural Variables Using Multimedia Video Task Analysis

2005 ◽  
Author(s):  
A. Dartt ◽  
J. Rosecrance ◽  
P. Chen
Keyword(s):  
Task Analysis ◽  
Rater Reliability

scholarly journals Low Inter-rater Reliability of a High Stakes Assessment of Teacher Candidates

2021 ◽  
Author(s):  
Scott Lyness ◽  
Kent Peterson ◽  
Kenneth Yates
Keyword(s):  
Teacher Candidates ◽  
Task Analysis ◽  
Academic Language ◽  
Cognitive Task ◽  
Weighted Kappa ◽  
Performance Assessments ◽  
High Stakes ◽  
Rater Reliability ◽  
Pre Service Teacher

The Performance Assessment for California Teachers (PACT) is a high stakes summative assessment that was designed to measure pre-service teacher readiness. We examined the inter-rater reliability (IRR) of trained PACT evaluators who rated 19 candidates. As measured by Cohen’s weighted kappa, the overall IRR estimate was .17 (poor strength of agreement). IRR estimates ranged from -.29 (worse than expected by chance) to .54 (moderate strength of agreement); all were below the standard of .70 for consensus agreement. Follow up interviews of 10 evaluators revealed possible reasons we observed low IRR, such as departures from established PACT scoring protocol, and lack of, or inconsistent, use of a scoring aid document. Evaluators reported difficulties scoring the materials that candidates submitted, particularly the use of Academic Language. Cognitive Task Analysis (CTA) is suggested as a method to improve IRR in the PACT and other teacher performance assessments such as the edTPA.

Why Speech-Language Clinicians Should Be in the Classroom

1991 ◽  
Vol 22 (4) ◽  
pp. 277-277 ◽  
Author(s):  
Sharon L. Wadle
Keyword(s):  
Individual Differences ◽  
Task Analysis ◽  
Regular Classroom ◽  
Classroom Setting ◽  
Therapy Room

Lack of training is only an excuse for not collaborating outside of the therapy room. With our present training, speech-language clinicians have many skills to share in the regular classroom setting. This training has provided skills in task analysis, a language focus, an appreciation and awareness of individual differences in learning, and motivational techniques.

A Response Evocation Program for /ɝ/

1975 ◽  
Vol 40 (1) ◽  
pp. 92-105 ◽  
Author(s):  
Lawrence D. Shriberg
Keyword(s):  
Service Delivery ◽  
Motor Skills ◽  
Task Analysis ◽  
Professional Issues ◽  
Clinical Experiences ◽  
Program Outcomes ◽  
Program Step ◽  
Skills Learning ◽  
Learning Principles

A response evocation program, some principles underlying its development and administration, and a review of some clinical experiences with the program are presented. Sixty-five children with developmental articulation errors of the /ɝ/ phoneme were administered the program by one of 19 clinicians. Approximately 70% of program administrations resulted in a child emitting a good /ɝ/ within six minutes. Approximately 10% of children who were given additional training on program step failures emitted good /ɝ/'s in subsequent sessions. These preliminary observations are discussed in relation to the role of task analysis and motor skills learning principles in response evocation, clinician influences in program outcomes, and professional issues in service delivery to children with developmental articulation errors.

Structured Interview for Hoarding Disorder (SIHD)

2019 ◽  
Vol 35 (4) ◽  
pp. 512-520
Author(s):  
Caterina Novara ◽  
Paolo Cavedini ◽  
Stella Dorz ◽  
Susanna Pardini ◽  
Claudio Sica
Keyword(s):  
Convergent Validity ◽  
Structured Interview ◽  
Diagnostic Process ◽  
Schizophrenia Spectrum Disorders ◽  
Clinical Environment ◽  
Obsessive Compulsive ◽  
Rater Reliability ◽  
Hoarding Disorder ◽  
Compulsive Disorder ◽  
Schizophrenia Spectrum

Abstract. The Structured Interview for Hoarding Disorder (SIHD) is a semi-structured interview designed to assist clinicians in diagnosing a hoarding disorder (HD). This study aimed to validate the Italian version of the SIHD. For this purpose, its inter-rater reliability has been analyzed as well as its ability to differentiate HD from other disorders often comorbid. The sample was composed of 74 inpatients who had been diagnosed within their clinical environment: 9 with HD, 11 with obsessive-compulsive disorder (OCD) and HD, 22 with OCD, 19 with major depressive disorder (MDD), and 13 with schizophrenia spectrum disorders (SSD). The results obtained indicated “substantial” or “perfect” inter-rater reliability for all the core HD criteria, HD diagnosis, and specifiers. The SIHD differentiated between subjects suffering from and not suffering from a HD. Finally, the results indicated “good” convergent validity and high scores were shown in terms of both sensitivity and specificity for HD diagnosis. Altogether, the SIHD represents a useful instrument for evaluating the presence of HD and is a helpful tool for the clinician during the diagnostic process.

Review of Essentials of Task Analysis.

1987 ◽  
Vol 32 (2) ◽  
pp. 195-195
Author(s):  
No authorship indicated
Keyword(s):  
Task Analysis

Facilitating withdrawer re-engagement in emotionally focused couple therapy: A modified task analysis.

2017 ◽  
Vol 6 (3) ◽  
pp. 205-225 ◽  
Author(s):  
Nicholas A. Lee ◽  
Paul M. Spengler ◽  
Amy M. Mitchell ◽  
Elliot S. Spengler ◽  
Douglas A. Spiker
Keyword(s):  
Task Analysis ◽  
Couple Therapy ◽  
Emotionally Focused Couple Therapy ◽  
Emotionally Focused

Applied Cognitive Task Analysis (ACTA) Methodology

1997 ◽  
Author(s):  
Laura G. Militello ◽  
Robert J. B. Hutton ◽  
Rebecca M. Pliske ◽  
Betsy J. Knight ◽  
Gary Klein ◽  
...  
Keyword(s):  
Task Analysis ◽  
Cognitive Task ◽  
Cognitive Task Analysis

Synthetic task design: Cognitive task analysis of AWACS weapons director teams

2001 ◽  
Author(s):  
Richard P. Fahey ◽  
Anna L. Rowe ◽  
Kendra L. Dunlap ◽  
Dan O. deBoom
Keyword(s):  
Task Analysis ◽  
Cognitive Task ◽  
Task Design ◽  
Cognitive Task Analysis

Cognitive task analysis (l'Analyse des taches cognitives)

2000 ◽  
Author(s):  
J. M. C. Schraagen ◽  
◽  
N. Graff ◽  
J. Annett ◽  
M. H. Strub ◽  
...  
Keyword(s):  
Task Analysis ◽  
Cognitive Task ◽  
Cognitive Task Analysis
Sign in / Sign up

Export Citation Format

Share Document