Test-retest reliability and practice effects of a computerized neuropsychological battery: A solution-oriented approach.

2018 ◽  
Vol 30 (12) ◽  
pp. 1652-1662 ◽  
Author(s):  
Sophie J. M. Rijnen ◽  
Sophie D. van der Linden ◽  
Wilco H. M. Emons ◽  
Margriet M. Sitskoorn ◽  
Karin Gehring
Keyword(s):  
Practice Effects ◽  
Neuropsychological Battery ◽  
Retest Reliability ◽  
Test Retest Reliability ◽  
Oriented Approach

Neurocognitive assessment on a tablet device: Test–retest reliability and practice effects of ANAM Mobile

2019 ◽  
pp. 1-9
Author(s):  
Andrea S. Vincent ◽  
Eugenia Fuenzalida ◽  
Madison Beneda-Bender ◽  
Douglas J. Bryant ◽  
Elizabeth Peters
Keyword(s):  
Practice Effects ◽  
Retest Reliability ◽  
Neurocognitive Assessment ◽  
Tablet Device ◽  
Test Retest Reliability ◽  
Device Test

Empirical methods for assessing meaningful neuropsychological change following epilepsy surgery

1996 ◽  
Vol 2 (6) ◽  
pp. 556-564 ◽  
Author(s):  
Stephen M. Sawrie ◽  
Gordon J. Chelune ◽  
Richard I. Naugle ◽  
Hans O. Lüders
Keyword(s):  
Epilepsy Surgery ◽  
Intractable Epilepsy ◽  
Practice Effects ◽  
Cutoff Score ◽  
Regression To The Mean ◽  
Neuropsychological Battery ◽  
Reliable Change ◽  
Medical Interventions ◽  
The Mean ◽  
Test Retest Reliability

AbstractTraditional methods for assessing the neurocognitive effects of epilepsy surgery are confounded by practice effects, test-retest reliability issues, and regression to the mean. This study employs 2 methods for assessing individual change that allow direct comparison of changes across both individuals and test measures. Fifty-one medically intractable epilepsy patients completed a comprehensive neuropsychological battery twice, approximately 8 months apart, prior to any invasive monitoring or surgical intervention. First, a Reliable Change (RC) index score was computed for each test score to take into account the reliability of that measure, and a cutoff score was empirically derived to establish the limits of statistically reliable change. These indices were subsequently adjusted for expected practice effects. The second approach used a regression technique to establish “change norms” along a common metric that models both expected practice effects and regression to the mean. The RC index scores provide the clinician with a statistical means of determining whether a patient's retest performance is “significantly” changed from baseline. The regression norms for change allow the clinician to evaluate the magnitude of a given patient's change on 1 or more variables along a common metric that takes into account the reliability and stability of each test measure. Case data illustrate how these methods provide an empirically grounded means for evaluating neurocognitive outcomes following medical interventions such as epilepsy surgery. (JINS, 1996, 2, 556–564.)

scholarly journals Test-Retest Reliability, Convergent Validity and Practice Effects of the RBANS in a Memory Clinic Setting: A Pilot Study

2013 ◽  
Vol 02 (04) ◽  
pp. 11-16 ◽  
Author(s):  
Yanhong Dong ◽  
Claire L. Thompson ◽  
Shi Huey Joanne Tan ◽  
Leon Ben Swie Lim ◽  
Wanshin Pang ◽  
...  
Keyword(s):  
Pilot Study ◽  
Convergent Validity ◽  
Practice Effects ◽  
Memory Clinic ◽  
Retest Reliability ◽  
Clinic Setting ◽  
Test Retest Reliability

scholarly journals A-058 Test–Retest Reliability of the Grooved Pegboard Test in a Pediatric Medical Population

2020 ◽  
Vol 35 (6) ◽  
pp. 848-848
Author(s):  
David C ◽  
Vasserman M ◽  
Brooks B ◽  
Macallister W
Keyword(s):  
Children And Adolescents ◽  
Test Reliability ◽  
Practice Effects ◽  
Fine Motor ◽  
Limited Data ◽  
Motor Tasks ◽  
Retest Reliability ◽  
Medical Population ◽  
Test Retest Reliability ◽  
Grooved Pegboard Test

Abstract Objective The Grooved Pegboard Test (GPT) is among the most commonly used fine motor tasks, though there is limited data on its basic psychometric properties in children and adolescents with medical conditions. The purpose of this study was to establish test reliability for the GPT within this group. Method Participants (N = 44; 22 males, 22 females) were children and adolescents clinically referred for neuropsychological evaluation. Diagnoses included epilepsy (n = 24), cardiac conditions (n = 13), other (n = 5). Each completed the GPT twice: once in the morning and once in the afternoon, ranging from 64-390 minutes apart (x-=263 min., SD = 60 min.). Spearman correlations assessed test–retest reliability for speed of completion for both dominant (DH) and non-dominant hands (NDH) trials and number of peg drops. Paired sample t-test assessed for practice effects between administrations. Results Ages ranged between 6.11 to 18.10 years (x-=12.52 yrs., SD = 3.19 yrs.). GPT raw scores for first presentation ranged from 25-296 seconds (DH x-=80.91, SD = 25.1; NDH x-=95.34, SD = 49.42). The GPT showed high test–retest reliability for DH (ρ = 0.80, p < 0.001) and NDH (ρ = 0.83, p < 0.001). Number of drops showed non-significant correlations across trials (DH ρ = −0.03, p = 0.87; NDH ρ = 0.11, p = 0.49). Practice effects were identified for the DH (t = −3.25, p = 0.002) but not NDH (t = −1.83, p = 0.074). Conclusion Strong test–retest reliability of the GPT speed of completion in this population supports stability of test results over time, though practice effects are seen at short intervals. Number of pegs dropped, however, lacks sufficient retest reliability and may be of lesser clinical utility. Overall, this study provides increased confidence for continued use of the GPT.

scholarly journals Expressive language sampling as a source of outcome measures for treatment studies in fragile X syndrome: feasibility, practice effects, test-retest reliability, and construct validity

2020 ◽  
Vol 12 (1) ◽  
Author(s):  
Leonard Abbeduto ◽  
Elizabeth Berry-Kravis ◽  
Audra Sterling ◽  
Stephanie Sherman ◽  
Jamie O. Edgin ◽  
...  
Keyword(s):  
Construct Validity ◽  
Outcome Measures ◽  
Symptom Severity ◽  
Fragile X ◽  
Expressive Language ◽  
Practice Effects ◽  
Full Sample ◽  
Retest Reliability ◽  
Language Sampling ◽  
Test Retest Reliability

Abstract Background The evaluation of treatment efficacy for individuals with fragile X syndrome (FXS) or intellectual disability (ID) more generally has been hampered by the lack of adequate outcome measures. We evaluated expressive language sampling (ELS) as a procedure for generating outcome measures for treatment research in FXS. We addressed: (a) feasibility, (b) practice effects over two administrations, (c) test-retest reliability over the repeated administrations, and (d) construct validity. We addressed these issues for the full sample as well as for subgroups defined by age, IQ, and ASD status. Methods Participants were 106 individuals with FXS between ages 6 and 23 years who had IQs within the range of intellectual disability (IQ < 70). ELS procedures for collecting samples in conversation and narration were followed and analyzed separately. Five measures were derived from transcripts segmented into C-units (i.e., an independent clause and its modifiers): number of C-units per minute (talkativeness), number of different word roots (vocabulary), C-unit length in morphemes (syntax), percentage of C-units containing dysfluency (utterance planning), and percentage of C-units that were fully or partly unintelligible (articulatory quality). ELS procedures were administered twice at 4-week intervals for each participant. Standardized tests and informant reports were administered and provided measures for evaluating construct validity of ELS measures. Results We found low rates of noncompliance, suggesting the task can be completed meaningfully by most individuals with FXS, although noncompliance was higher for younger, lower IQ, and more autistic participants. Minimal practice effects and strong test-retest reliability over the 4-week interval were observed for the full sample and across the range of ages, IQs, and autism symptom severity. Evidence of convergent construct validity was observed for the measures of vocabulary, syntax, and unintelligibility for the full sample and across the range of IQ and autism symptom severity, but not for participants under age 12. Conversation and narration yielded largely similar results in all analyses. Conclusions The findings suggest that the ELS procedures are feasible and yield measures with adequate psychometric properties for a majority of 6 to 23 years with FXS who have ID. The procedures work equally well regardless of level of ID or degree of ASD severity. The procedures, however, are more challenging and have somewhat less adequate psychometric properties for individuals with FXS under age 12.

Test-Retest Reliability and Practice Effects of the Stability Evaluation Test

2017 ◽  
Vol 26 (3) ◽  
Author(s):  
Richelle M. Williams ◽  
Matthew A. Corvo ◽  
Kenneth C. Lam ◽  
Travis A. Williams ◽  
Lesley K. Gilmer ◽  
...  
Keyword(s):  
Postural Control ◽  
Repeated Measures ◽  
Healthy Adults ◽  
Composite Score ◽  
Practice Effects ◽  
Stability Evaluation ◽  
Retest Reliability ◽  
Evaluation Test ◽  
The Stability ◽  
Test Retest Reliability

Context: Postural control plays an essential role in concussion evaluation. The Stability Evaluation Test (SET) aims to objectively analyze postural control by measuring sway velocity on the NeuroCom VSR portable force platform (Natus, San Carlos, CA). Objective: To assess the test-retest reliability and practice effects of the SET protocol. Design: Cohort. Setting: Research laboratory. Patients or Other Participants: 50 healthy adults (20 men, 30 women, age 25.30 ± 3.60 y, height 166.60± 12.80 cm, mass 68.80 ± 13.90 kg). Interventions: All participants completed 4 trials of the SET. Each trial consisted of six 20-s balance tests with eyes closed, under the following conditions: double-leg firm (DFi), single-leg firm (SFi), tandem firm (TFi), double-leg foam (DFo), single-leg foam (SFo), and tandem foam (TFo). Each trial was separated by a 5-min seated rest period. Main Outcome Measures: The dependent variable was sway velocity (deg/s), with lower values indicating better balance. Sway velocity was recorded for each of the 6 conditions as well as a composite score for each trial. Test-retest reliability was analyzed across 4 trials with intraclass correlation coefficients (ICCs). Practice effects analyzed with repeated measures analysis of variance, followed by Tukey post hoc comparisons for any significant main effects (P < .05). Results: Sway-velocity reliability values were good to excellent: DFi (ICC = .88; 95%CI: .81, .92), SFi (ICC = .75; 95%CI: .61, .85), TFi (ICC = .84; 95%CI: .75, .90), DFo (ICC = .83; 95%CI: .74, .90), SFo (ICC = .82; 95%CI: .72, .89), TFo (ICC = .81; 95%CI: .69, .88), and composite score (ICC = .93; 95%CI: .88, .95). Significant practice effects (P < .05) were noted on the SFi, DFo, SFo, TFo conditions and composite scores. Conclusions: Our results suggest the SET has good to excellent reliability for the assessment of postural control in healthy adults. Due to the practice effects noted, a familiarization session is recommended (ie, all 6 conditions) before data are recorded. Future studies should evaluate injured patients to determine meaningful change scores during various injuries.

Sign in / Sign up

Export Citation Format

Share Document