scholarly journals Reliability and Validity of Play-Based Assessments of Motor and Cognitive Skills for Infants and Young Children: A Systematic Review

2015 ◽  
Vol 95 (1) ◽  
pp. 25-38 ◽  
Author(s):  
Michael G. O'Grady ◽  
Stacey C. Dusing
Keyword(s):  
Cognitive Development ◽  
Motor Development ◽  
Cognitive Skills ◽  
Assessment Tool ◽  
Data Extraction ◽  
Reliability And Validity ◽  
Assessment Tools ◽  
Measurement Properties ◽  
Study Selection ◽  
Controlled Environments

Background Play is vital for development. Infants and children learn through play. Traditional standardized developmental tests measure whether a child performs individual skills within controlled environments. Play-based assessments can measure skill performance during natural, child-driven play. Purpose The purpose of this study was to systematically review reliability, validity, and responsiveness of all play-based assessments that quantify motor and cognitive skills in children from birth to 36 months of age. Data Sources Studies were identified from a literature search using PubMed, ERIC, CINAHL, and PsycINFO databases and the reference lists of included papers. Study Selection Included studies investigated reliability, validity, or responsiveness of play-based assessments that measured motor and cognitive skills for children to 36 months of age. Data Extraction Two reviewers independently screened 40 studies for eligibility and inclusion. The reviewers independently extracted reliability, validity, and responsiveness data. They examined measurement properties and methodological quality of the included studies. Data Synthesis Four current play-based assessment tools were identified in 8 included studies. Each play-based assessment tool measured motor and cognitive skills in a different way during play. Interrater reliability correlations ranged from .86 to .98 for motor development and from .23 to .90 for cognitive development. Test-retest reliability correlations ranged from .88 to .95 for motor development and from .45 to .91 for cognitive development. Structural validity correlations ranged from .62 to .90 for motor development and from .42 to .93 for cognitive development. One study assessed responsiveness to change in motor development. Limitations Most studies had small and poorly described samples. Lack of transparency in data management and statistical analysis was common. Conclusions Play-based assessments have potential to be reliable and valid tools to assess cognitive and motor skills, but higher-quality research is needed. Psychometric properties should be considered for each play-based assessment before it is used in clinical and research practice.

scholarly journals Investigation of the Motor Skills Assessments of Typically Developing Preschool Children in China

2021 ◽  
Author(s):  
Huiqi Song ◽  
Jing Jing Wang ◽  
Patrick WC Lau
Keyword(s):  
Motor Skills ◽  
Motor Development ◽  
Intellectual Development ◽  
Assessment Tool ◽  
Reliability And Validity ◽  
Assessment Tools ◽  
Skill Assessment ◽  
Skills Assessment ◽  
Validity And Reliability ◽  
Development Assessment

Abstract Background: The assessment of perschoolers’ motor skills is essential to know young children’s motor development and evaluate the intervention effects of promotion in children’s sport activities. The purpose of this study was to review the motor skills assessment tools in Chinese preschool-aged children, compare them in the international context, and provide guidelines to find appropriate motor skill assessment tool in China. Methods: The comprehensive literature search was carried out in WANGFAGN, CNKI, VIP, ERIC, EMBASE, MEDLINE, Ovid PsycINFO, SPORTDiscus and BIOSIS previews databases. Relevant articles published between January 2000 and May 2020 were retrieved. Studies that described the discriminative and evaluative measures of motor skills among the population aged 3-6 years in China were included. Results: A total of 17 studies were included in this review describing 7 tools including 4 self-developed tools and 3 international tools used in China. TGMD-2 appeared in a large proportion of studies, international tools used in China were incomplete in terms of translation, verification of reliability and validity, item selection and the implementation. Regarding the self-constructed tools, the CDCC was the most utilized self-developed tool, but it was mainly applied in intellectual development assessment. Through the comparison between Chinese self-constructed and international tools, the construction of the CDCC and the Gross Motor Development Assessment Scale contained relatively complete development steps. The test content, validity and reliability, implementation instruction, and generalizability of self-constructed tools are still lacking. Conclusions: Both international and self-developed motor skills assessment tools have been rarely applied in China, available tools lack enough validation and appropriate adjustments. Cultural differences in motor development between Chinese and Western populations should be considered when constructing a Chinese localized MSAT.

scholarly journals How Do We Assess Patient Skills in a Competence-Based Program? Assessment of Patient Competences Using the Spanish Version of the Prolapse and Incontinence Knowledge Questionnaire and Real Practical Cases in Women with Pelvic Floor Disorders

2021 ◽  
Vol 18 (5) ◽  
pp. 2377
Author(s):  
Beatriz Sánchez-Sánchez ◽  
Beatriz Arranz-Martín ◽  
Beatriz Navarro-Brazález ◽  
Fernando Vergara-Pérez ◽  
Javier Bailón-Cerezo ◽  
...  
Keyword(s):  
Decision Making ◽  
Pelvic Floor ◽  
Discriminant Validity ◽  
Pelvic Floor Disorders ◽  
Assessment Tool ◽  
Pelvic Organ ◽  
Assessment Tools ◽  
Measurement Properties ◽  
Competence Assessment ◽  
Knowledge Questionnaire

Therapeutic patient education programs must assess the competences that patients achieve. Evaluation in the pedagogical domain ensures that learning has taken place among patients. The Prolapse and Incontinence Knowledge Questionnaire (PIKQ) is a tool for assessing patient knowledge about urinary (UI) and pelvic organ prolapse (POP) conditions. The aim of this study was to translate the Prolapse and Incontinence Knowledge Questionnaire (PIKQ) into Spanish and test its measurement properties, as well as propose real practical cases as a competence assessment tool. The cross-cultural adaptation was conducted by a standardized translation/back-translation method. Measurement properties analysis was performed by assessing the validity, reliability, responsiveness, and interpretability. A total of 275 women were recruited. The discriminant validity showed statistically significant differences in the PIKQ scores between patients and expert groups. Cronbach’s alpha revealed good internal consistency. The test–retest reliability showed excellent correlation with UI and POP scales. Regarding responsiveness, the effect size, and standardized response mean demonstrated excellent values. No floor or ceiling effects were shown. In addition, three “real practical cases” evaluating skills in identifying and analyzing, decision making, and problem-solving were developed and tested. The Spanish PIKQ is a comprehensible, valid, reliable, and responsive tool for the Spanish population. Real practical cases are useful competence assessment tools that are well accepted by women with pelvic floor disorders (PFD), improving their understanding and their decision-making regarding PFD.

The Role of Teaching Materials in Cognitive Development Focusing on the “Emergence of Symbolic Functioning” and Behaviour Issues

2021 ◽  
pp. 73-97
Author(s):  
Eiko Tatematsu
Keyword(s):  
Cognitive Development ◽  
Assessment Tool ◽  
Autism Spectrum ◽  
Social Adaptation ◽  
Assessment Tools ◽  
Cognitive Profiles ◽  
Teaching Materials ◽  
Teaching Device ◽  
Symbolic Functioning

The purpose of this chapter is to discuss the role of teaching materials focusing on the “Emergence of Symbolic Functioning” and latent behaviour issues. First, a literature review is performed on the behaviour issues associated with intellectual disability (ID) and autism spectrum disorder (ASD). Three kinds of assessment tools used in this study are described with underlying developmental meanings. Especially, one of those tools, a teaching device named “Tamahimo” is introduced as a practical assessment tool to visualize participants' cognitive conditions. Three cases, two adolescents and one young adult with ID, are discussed, with their autism-like behaviours and characteristic cognitive profiles evaluated using the assessment tools. All cognitive development is judged as corresponding to the “Emergence of Symbolic Functioning,” that is, the qualitative transition phase from non-symbolic to the explicit existence of a symbolic functioning stage. Factors preventing social adaptation are discussed as they relate to unstable cognitive conditions.

scholarly journals Tapping into Bloom Taxonomy’s Higher-Order Cognitive Processes: The Case for Multiple Choice Questions as a Valid Assessment Tool in the ESP Classroom

2021 ◽  
pp. 160-171
Author(s):  
Iryna Lenchuk ◽  
Amer Ahmed
Keyword(s):  
Cognitive Processes ◽  
Cognitive Skills ◽  
Assessment Tool ◽  
Multiple Choice ◽  
Higher Order Thinking ◽  
Thinking Skills ◽  
Higher Order ◽  
Assessment Tools ◽  
Multiple Choice Questions ◽  
Higher Order Thinking Skills

This article describes the results of Action Research conducted in an ESP classroom of Dhofar University located in Oman. Following the call of Oman Vision 2040 to emphasize educational practices that promote the development of higher-order cognitive processes, this study raises the following question: Can an online multiple choice question (MCQ) quiz tap into the higher-order cognitive skills of apply, analyze and evaluate? This question was also critical at the time of the COVID-19 pandemic when Omani universities switched to the online learning mode. The researchers administered an online MCQ quiz to 35 undergraduate students enrolled in an ESP course for Engineering and Sciences. The results showed that MCQ quizzes could be developed to tap into higher-order thinking skills when the stem of the MSQ is developed as a task or a scenario. The study also revealed that students performed better on MCQs that tap into low-level cognitive skills. This result can be attributed to the prevalent practice in Oman to develop assessment tools that tap only into a level of Bloom’s taxonomy, which involves the cognitive process of retrieving memorized information. The significance of the study lies in its pedagogical applications. The study calls for the use of teaching and assessment practices that target the development of higher-order thinking skills, which is aligned with the country’s strategic direction reflected in Oman vision 2040.

scholarly journals Development and Validation of the Suicide Behaviours Questionnaire – Autism Spectrum Conditions in Autistic, Possibly Autistic and Non-Autistic Adults.

2020 ◽  
Author(s):  
Sarah Cassidy ◽  
Louise Bradley ◽  
Heather Cogger-Ward ◽  
Jacqui Rodgers
Keyword(s):  
Assessment Tool ◽  
Autistic Traits ◽  
Autism Spectrum ◽  
Assessment Tools ◽  
Self Report ◽  
Measurement Properties ◽  
Autism Spectrum Conditions ◽  
Autistic People ◽  
Autistic Adults ◽  
Development And Validation

Abstract Background: Autistic people and those with high autistic traits are at high risk of experiencing suicidality. Yet, there are no suicidality assessment tools developed or validated for these groups.Methods: A widely used and validated suicidality assessment tool developed for the general population (SBQ-R), was adapted using feedback from autistic adults. The adapted tool was refined through 9 interviews, and an online survey with 251 autistic adults, to establish clarity and relevance of the items. Subsequently, 308 autistic, 113 possibly autistic, and 268 non-autistic adults completed the adapted tool online, alongside self-report measures of autistic traits (AQ), camouflaging autistic traits (CAT-Q), depression (PHQ-9), anxiety (ASA-A), thwarted belongingness and perceived burdensomeness (INQ-15), lifetime non-suicidal self-injury, and the original version of the suicidality assessment tool (SBQ-R). Analyses explored the appropriateness and measurement properties of the adapted tool between the groups.Results: There was evidence in support of content validity, structural validity, internal consistency, convergent and divergent validity, test retest validity, sensitivity and specificity (for distinguishing those with or without lifetime experience of suicide attempt), and hypothesis testing of the adapted tool (SBQ-ASC) in each group. The structure of the SBQ-ASC was equivalent between autistic and possibly autistic adults, regardless of gender, or use of visual aids to help quantify abstract rating scales.Limitations: The samples involved in the development and validation of the adapted tool were largely female, and largely diagnosed as autistic in adulthood, which is not representative of the wider autistic population. The SBQ-ASC has been developed for use in research and is not recommended to assess risk of future suicide attempts and/or self-harm.Conclusions: The SBQ-ASC is a brief self-report suicidality assessment tool, developed and validated with and for autistic adults, without co-occurring intellectual disability. The SBQ-ASC is appropriate for use in research to identify suicidal thoughts and behaviours in autistic and possibly autistic people, and model associations with risk and protective factors.

Iatrogenic Opioid Withdrawal in Critically Ill Patients: A Review of Assessment Tools and Management

2017 ◽  
Vol 51 (12) ◽  
pp. 1099-1111 ◽  
Author(s):  
Ada W. Chiu ◽  
Sofia Contreras ◽  
Sangeeta Mehta ◽  
Jennifer Korman ◽  
Marc M. Perreault ◽  
...  
Keyword(s):  
Critically Ill ◽  
Critically Ill Patients ◽  
Assessment Tool ◽  
Data Extraction ◽  
Management Strategies ◽  
Pediatric Intensive Care ◽  
Opioid Withdrawal ◽  
Assessment Tools ◽  
Critically Ill Children ◽  
Reference List

Objective: To (1) provide an overview of the epidemiology, clinical presentation, and risk factors of iatrogenic opioid withdrawal in critically ill patients and (2) conduct a literature review of assessment and management of iatrogenic opioid withdrawal in critically ill patients. Data Sources: We searched MEDLINE (1946–June 2017), EMBASE (1974–June 2017), and CINAHL (1982–June 2017) with the terms opioid withdrawal, opioid, opiate, critical care, critically ill, assessment tool, scale, taper, weaning, and management. Reference list of identified literature was searched for additional references as well as www.clinicaltrials.gov . Study Selection and Data Extraction: We restricted articles to those in English and dealing with humans. Data Synthesis: We identified 2 validated pediatric critically ill opioid withdrawal assessment tools: (1) Withdrawal Assessment Tool–Version 1 (WAT-1) and (2) Sophia Observation Withdrawal Symptoms Scale (SOS). Neither tool differentiated between opioid and benzodiazepine withdrawal. WAT-1 was evaluated in critically ill adults but not found to be valid. No other adult tool was identified. For management, we identified 5 randomized controlled trials, 2 prospective studies, and 2 systematic reviews. Most studies were small and only 2 studies utilized a validated assessment tool. Enteral methadone, α-2 agonists, and protocolized weaning were studied. Conclusion: We identified 2 validated assessment tools for pediatric intensive care unit patients; no valid tool for adults. Management strategies tested in small trials included methadone, α-2 agonists, and protocolized sedation/weaning. We challenge researchers to create validated tools assessing specifically for opioid withdrawal in critically ill children and adults to direct management.

scholarly journals N-PASS Versus mPAT in Assessment and Management of Neonatal Pain at Neonatal ICUs in Palestine

2019 ◽  
Vol 4 (06) ◽  
Author(s):  
Khamis Elessi ◽  
Shireen Abed ◽  
Tayseer Jamal Afifi ◽  
Rawan Utt ◽  
Mahmood Elblbessy ◽  
...  
Keyword(s):  
Pain Score ◽  
Pain Assessment ◽  
Assessment Tool ◽  
Disease Process ◽  
Reliability And Validity ◽  
Internal Consistency Reliability ◽  
Assessment Tools ◽  
Therapeutic Interventions ◽  
P Value ◽  
Neonatal Pain

Background: Neonates frequently experience pain as a result of diagnostic or therapeutic interventions or as a result of a disease process. Neonates cannot verbalize their pain experience and depend on others to recognize, assess and manage their pain. Neonates may suffer immediate or long-term consequences of unrelieved pain. Accurate assessment of pain is essential to provide adequate management. Observational scales, which include physiological and behavioral responses to pain, are available to aid consistent pain management. Pain assessment is considered as the fifth vital sign. Objectives: Aims of the present study were (1) to compare two commonly cited neonatal pain assessment tools, Neonatal Pain, Agitation and Sedation Scale (N-PASS) and modified Pain Assessment Tool (mPAT), with regard to their psychometric qualities, (2) to explore intuitive clinicians' ratings by relating them to the tools' items and (3) to ensure that neonates receive adequate pain control. Methods: Two coders applied both pain assessment tools to 850 neonates while undergoing a painful or a stressful procedure. Each neonate was assessed before, during and after the procedure. The evaluation before and after the procedure was done using NPASS, while pain score during the procedure was assessed by mPAT. Analyses of variances and regression analyses were used to investigate whether tools could discriminate between the procedures and whether tools' items were predictors of pain severity. Results: Internal consistency, reliability and validity were high for both assessment tools. N-PASS tool discriminated between painful and stressful situations better than mPAT. There was no relation between the age of neonate and the pain score. Moreover, P-value was statistically significant between mPAT score and post procedural assessment score as well as between pre and post procedural assessment scores. Conclusion: Both assessment tools performed equally well regarding physiologic parameters. However, N-PASS makes it possible to assess pain during sedation. It was noticed that gaps exist between practitioner knowledge and attitude regarding neonatal pain.

scholarly journals Patient Simulation: A Literary Synthesis of Assessment Tools in Anesthesiology

2009 ◽  
Vol 6 ◽  
pp. 3 ◽  
Author(s):  
Alice A. Edler ◽  
Ruth G. Fanning ◽  
Michael. I. Chen ◽  
Rebecca Claure ◽  
Dondee Almazan ◽  
...  
Keyword(s):  
Assessment Tool ◽  
Generalizability Theory ◽  
Patient Simulation ◽  
Reliability And Validity ◽  
Test Construction ◽  
Test Theory ◽  
Assessment Tools ◽  
Rater Training ◽  
Test Items ◽  
Construction Methods

High-fidelity patient simulation (HFPS) has been hypothesized as a modality for assessing competency of knowledge and skill in patient simulation, but uniform methods for HFPS performance assessment (PA) have not yet been completely achieved. Anesthesiology as a field founded the HFPS discipline and also leads in its PA. This project reviews the types, quality, and designated purpose of HFPS PA tools in anesthesiology. We used the systematic review method and systematically reviewed anesthesiology literature referenced in PubMed to assess the quality and reliability of available PA tools in HFPS. Of 412 articles identified, 50 met our inclusion criteria. Seventy seven percent of studies have been published since 2000; more recent studies demonstrated higher quality. Investigators reported a variety of test construction and validation methods. The most commonly reported test construction methods included ?占퐉odified Delphi Techniques??for item selection, reliability measurement using inter-rater agreement, and intra-class correlations between test items or subtests. Modern test theory, in particular generalizability theory, was used in nine (18%) of studies. Test score validity has been addressed in multiple investigations and shown a significant improvement in reporting accuracy. However the assessment of predicative has been low across the majority of studies. Usability and practicality of testing occasions and tools was only anecdotally reported. To more completely comply with the gold standards for PA design, both shared experience of experts and recognition of test construction standards, including reliability and validity measurements, instrument piloting, rater training, and explicit identification of the purpose and proposed use of the assessment tool, are required.

scholarly journals A Systematic Review of the Biomarker S100B: Implications for Sport-Related Concussion Management

2014 ◽  
Vol 49 (6) ◽  
pp. 830-850 ◽  
Author(s):  
Stefanie Schulte ◽  
Leslie W. Podlog ◽  
J. Jordan Hamson-Utley ◽  
Frederick G. Strathmann ◽  
Heiko K. Strüder
Keyword(s):  
Data Extraction ◽  
Reliability And Validity ◽  
Reference Value ◽  
High Sensitivity ◽  
Data Synthesis ◽  
Concussion Management ◽  
Study Selection ◽  
Healthy Athlete ◽  
Study Designs ◽  
Protein S100b

Objective: Elevated levels of the astroglial protein S100B have been shown to predict sport-related concussion. However, S100B levels within an athlete can vary depending on the type of physical activity (PA) engaged in and the methodologic approach used to measure them. Thus, appropriate reference values in the diagnosis of concussed athletes remain undefined. The purpose of our systematic literature review was to provide an overview of the current literature examining S100B measurement in the context of PA. The overall goal is to improve the use of the biomarker S100B in the context of sport-related concussion management. Data Sources: PubMed, SciVerse Scopus, SPORTDiscus, CINAHL, and Cochrane. Study Selection: We selected articles that contained (1) research studies focusing exclusively on humans in which (2) either PA was used as an intervention or the test participants or athletes were involved in PA and (3) S100B was measured as a dependent variable. Data Extraction: We identified 24 articles. Study variations included the mode of PA used as an intervention, sample types, sample-processing procedures, and analytic techniques. Data Synthesis: Given the nonuniformity of the analytical methods used and the data samples collected, as well as differences in the types of PA investigated, we were not able to determine a single consistent reference value of S100B in the context of PA. Thus, a clear distinction between a concussed athlete and a healthy athlete based solely on the existing S100B cutoff value of 0.1 μg/L remains unclear. However, because of its high sensitivity and excellent negative predictive value, S100B measurement seems to have the potential to be a diagnostic adjunct for concussion in sports settings. We recommend that the interpretation of S100B values be based on congruent study designs to ensure measurement reliability and validity.

Sign in / Sign up

Export Citation Format

Share Document