scholarly journals Interformat Reliability of Web-Based Parent-Rated Questionnaires Assessing for Neurodevelopmental Disorders among Preschoolers: A Community Developmental Health Check-up Setting Study (Preprint)

2020 ◽  
Author(s):  
Masanori Tanaka ◽  
Manabu Saito ◽  
Michio Takahashi ◽  
Masaki Adachi ◽  
Kazuhiko Nakamura

BACKGROUND Early detection and intervention for neurodevelopmental disorders are effective. Several paper types of questionnaires have been developed to assess these conditions in early childhood. However, the psychometric equivalence between the web and the paper versions of these questionnaires is unknown. OBJECTIVE This study examined the interformat reliability of the web-based parent-rated version of the Autism Spectrum Screening Questionnaire (ASSQ), Attention-Deficit/Hyperactivity Disorder Rating Scale (ADHD-RS), Developmental Coordination Disorder Questionnaire’07 (DCDQ), and Strengths and Difficulties Questionnaire (SDQ) among Japanese preschoolers in a community developmental health check-up setting. METHODS A set of paper-based questionnaires were distributed for voluntary completion to parents of children aged 5 years. The package of the paper form questionnaires included the ASSQ, ADHD-RS, DCDQ, Parent-reported SDQ (P-SDQ), and several additional demographic questions. Responses were received from 508 parents of children who agreed to participate in the study. After 3 months, 300 parents of children, who were among the initial responders, were randomly selected and asked to complete the web-based versions of these questionnaires voluntarily. A total of 140 parents of children replied to the web form and were included as a final sample in this study. RESULTS We obtained Cronbach’s alphas for both the web and paper forms of the ASSQ (web=.88, paper=.84), ADHD-RS total and subscales (web=.87-.94, paper=.86-.92), DCDQ total and subscales (web=.81-.93, paper=.74-.91), and P-SDQ Total Difficulties and subscales (web=.52-.80, paper=.51-.79). The intraclass correlation coefficients between the web and paper forms of each questionnaire were all significant at the 99.9% confidence level. (ASSQ: r=.66; ADHD-RS total and subscales: r=.66-74; DCDQ total and subscales: r=.66-.71; P-SDQ Total Difficulties and subscales: r=.55-.73). There were no significant differences between the web and paper forms for the total mean score of the ASSQ, total and subscale mean scores of DCDQ, and the P-SDQ Total Difficulties mean score and mean subscale scores. While significant differences were found between the web and paper forms for the mean scores on the ADHD-RS (Total: t132=2.83, P=.005; Inattention: t133=2.15, P=.03; Hyperactivity/Impulsivity: t133=3.21, P=.002), the effect sizes were small (Cohen d=.18-.22). CONCLUSIONS These results suggest that the web versions of the ASSQ, ADHD-RS, DCDQ, and P-SDQ had the same level of internal consistency, intra-rater reliability, and equality as the paper versions. These results indicate the web applicability of these questionnaires for assessing neurodevelopmental disorders.

10.2196/20172 ◽  
2021 ◽  
Vol 4 (1) ◽  
pp. e20172
Author(s):  
Masanori Tanaka ◽  
Manabu Saito ◽  
Michio Takahashi ◽  
Masaki Adachi ◽  
Kazuhiko Nakamura

Background Early detection and intervention for neurodevelopmental disorders are effective. Several types of paper questionnaires have been developed to assess these conditions in early childhood; however, the psychometric equivalence between the web-based and the paper versions of these questionnaires is unknown. Objective This study examined the interformat reliability of the web-based parent-rated version of the Autism Spectrum Screening Questionnaire (ASSQ), Attention-Deficit/Hyperactivity Disorder Rating Scale (ADHD-RS), Developmental Coordination Disorder Questionnaire 2007 (DCDQ), and Strengths and Difficulties Questionnaire (SDQ) among Japanese preschoolers in a community developmental health check-up setting. Methods A set of paper-based questionnaires were distributed for voluntary completion to parents of children aged 5 years. The package of the paper format questionnaires included the ASSQ, ADHD-RS, DCDQ, parent-reported SDQ (P-SDQ), and several additional demographic questions. Responses were received from 508 parents of children who agreed to participate in the study. After 3 months, 300 parents, who were among the initial responders, were randomly selected and asked to complete the web-based versions of these questionnaires. A total of 140 parents replied to the web-based format and were included as a final sample in this study. Results We obtained the McDonald ω coefficients for both the web-based and paper formats of the ASSQ (web-based: ω=.90; paper: ω=.86), ADHD-RS total and subscales (web-based: ω=.88-.94; paper: ω=.87-.93), DCDQ total and subscales (web-based: ω=.82-.94; paper: ω=.74-.92), and P-SDQ total and subscales (web-based: ω=.55-.81; paper: ω=.52-.80). The intraclass correlation coefficients between the web-based and paper formats were all significant at the 99.9% confidence level: ASSQ (r=0.66, P<.001); ADHD-RS total and subscales (r=0.66-0.74, P<.001); DCDQ total and subscales (r=0.66-0.71, P<.001); P-SDQ Total Difficulties and subscales (r=0.55-0.73, P<.001). There were no significant differences between the web-based and paper formats for total mean score of the ASSQ (P=.76), total (P=.12) and subscale (P=.11-.47) mean scores of DCDQ, and the P-SDQ Total Difficulties mean score (P=.20) and mean subscale scores (P=.28-.79). Although significant differences were found between the web-based and paper formats for mean ADHD-RS scores (total: t132=2.83, P=.005; Inattention subscale: t133=2.15, P=.03; Hyperactivity/Impulsivity subscale: t133=3.21, P=.002), the effect sizes were small (Cohen d=0.18-0.22). Conclusions These results suggest that the web-based versions of the ASSQ, ADHD-RS, DCDQ, and P-SDQ were equivalent, with the same level of internal consistency and intrarater reliability as the paper versions, indicating the applicability of the web-based versions of these questionnaires for assessing neurodevelopmental disorders.


2009 ◽  
Vol 70 (4) ◽  
pp. 172-178 ◽  
Author(s):  
Rhona M. Hanning ◽  
Dawna Royall ◽  
Jenn E. Toews ◽  
Lindsay Blashill ◽  
Jessica Wegener ◽  
...  

Purpose: The web-based Food Behaviour Questionnaire (FBQ) includes a 24-hour diet recall, a food frequency questionnaire, and questions addressing knowledge, attitudes, intentions, and food-related behaviours. The survey has been revised since it was developed and initially validated. The current study was designed to obtain qualitative feedback and to validate the FBQ diet recall. Methods: “Think aloud” techniques were used in cognitive interviews with dietitian experts (n=11) and grade six students (n=21).Multi-ethnic students (n=201) in grades six to eight at urban southern Ontario schools completed the FBQ and, subsequently, one-on-one diet recall interviews with trained dietitians. Food group and nutrient intakes were compared. Results: Users provided positive feedback on the FBQ. Suggestions included adding more foods, more photos for portion estimation, and online student feedback. Energy and nutrient intakes were positively correlated between FBQ and dietitian interviews, overall and by gender and grade (all p<0.001). Intraclass correlation coefficients were ≥0.5 for energy and macronutrients, although the web-based survey underestimated energy (-10.5%) and carbohydrate (-15.6%) intakes (p<0.05). Under-estimation of rice and pasta portions on the web accounted for 50% of this discrepancy. Conclusions: The FBQ is valid, relative to 24-hour recall interviews, for dietary assessment in diverse populations of Ontario children in grades six to eight.


2021 ◽  
Vol 12 ◽  
Author(s):  
Hanna Mayer-Benarous ◽  
Xavier Benarous ◽  
François Vonthron ◽  
David Cohen

Background: Several studies have reported contradictory results regarding the benefits of music interventions in children and adolescents with neurodevelopmental disorders (NDDs), including autism spectrum disorder (ASD).Methods: We performed a systematic review according to the PRISMA guidelines. We searched the Cochrane, PubMed and Medline databases from January 1970 to September 2020 to review all empirical findings, except case reports, measuring the effect of music therapy on youths with ASD, intellectual disability (ID), communication disorder (CD), developmental coordination disorder (DCD), specific learning disorder, and attention/deficit hyperactivity disorder (ADHD).Results: Thirty-nine studies (N = 1,774 participants) were included in this review (ASD: n = 22; ID: n = 7; CD and dyslexia: n = 5; DCD: n = 0; ADHD: n = 5 studies). Two main music therapies were used: educational music therapy and improvisational music therapy. A positive effect of educational music therapy on patients with ASD was reported in most controlled studies (6/7), particularly in terms of speech production. A positive effect of improvisational music therapy was reported in most controlled studies (6/8), particularly in terms of social functioning. The subgroup of patients with both ASD and ID had a higher response rate. Data are lacking for children with other NDDs, although preliminary evidence appears encouraging for educational music therapy in children with dyslexia.Discussion: Improvisational music therapy in children with NDDs appears relevant for individuals with both ASD and ID. More research should be encouraged to explore whether oral and written language skills may improve after educational music therapy, as preliminary data are encouraging.


2019 ◽  
Author(s):  
Marco Bardus ◽  
Nathalie Awada ◽  
Lilian A Ghandour ◽  
Elie-Jacques Fares ◽  
Tarek Gherbal ◽  
...  

BACKGROUND With thousands of health apps in app stores globally, it is crucial to systemically and thoroughly evaluate the quality of these apps due to their potential influence on health decisions and outcomes. The Mobile App Rating Scale (MARS) is the only currently available tool that provides a comprehensive, multidimensional evaluation of app quality, which has been used to compare medical apps from American and European app stores in various areas, available in English, Italian, Spanish, and German. However, this tool is not available in Arabic. OBJECTIVE This study aimed to translate and adapt MARS to Arabic and validate the tool with a sample of health apps aimed at managing or preventing obesity and associated disorders. METHODS We followed a well-established and defined “universalist” process of cross-cultural adaptation using a mixed methods approach. Early translations of the tool, accompanied by confirmation of the contents by two rounds of separate discussions, were included and culminated in a final version, which was then back-translated into English. Two trained researchers piloted the MARS in Arabic (MARS-Ar) with a sample of 10 weight management apps obtained from Google Play and the App Store. Interrater reliability was established using intraclass correlation coefficients (ICCs). After reliability was ascertained, the two researchers independently evaluated a set of additional 56 apps. RESULTS MARS-Ar was highly aligned with the original English version. The ICCs for MARS-Ar (0.836, 95% CI 0.817-0.853) and MARS English (0.838, 95% CI 0.819-0.855) were good. The MARS-Ar subscales were highly correlated with the original counterparts (<i>P</i>&lt;.001). The lowest correlation was observed in the area of usability (<i>r</i>=0.685), followed by aesthetics (<i>r</i>=0.827), information quality (<i>r</i>=0.854), engagement (<i>r</i>=0.894), and total app quality (<i>r</i>=0.897). Subjective quality was also highly correlated (<i>r</i>=0.820). CONCLUSIONS MARS-Ar is a valid instrument to assess app quality among trained Arabic-speaking users of health and fitness apps. Researchers and public health professionals in the Arab world can use the overall MARS score and its subscales to reliably evaluate the quality of weight management apps. Further research is necessary to test the MARS-Ar on apps addressing various health issues, such as attention or anxiety prevention, or sexual and reproductive health.


2015 ◽  
Vol 2015 ◽  
pp. 1-7 ◽  
Author(s):  
Nathalie Rommel ◽  
Charlotte Borgers ◽  
Dirk Van Beckevoort ◽  
Ann Goeleven ◽  
Eddy Dejaeger ◽  
...  

Background. We aimed to validate an easy-to-use videofluoroscopic analysis tool, the bolus residue scale (BRS), for detection and classification of pharyngeal retention in the valleculae, piriform sinuses, and/or the posterior pharyngeal wall.Methods. 50 randomly selected videofluoroscopic images of 10 mL swallows (recorded in 18 dysphagia patients and 8 controls) were analyzed by 4 experts and 6 nonexpert observers. A score from 1 to 6 was assigned according to the number of structures affected by residue. Inter- and intrarater reliabilities were assessed by calculation of intraclass correlation coefficients (ICCs) for expert and nonexpert observers. Sensitivity, specificity, and interrater agreement were analyzed for different BRS levels.Results. Intrarater reproducibility was almost perfect for experts (mean ICC 0.972) and ranged from substantial to almost perfect for nonexperts (mean ICC 0.835). Interjudge agreement of the experts ranged from substantial to almost perfect (mean ICC 0.780), but interrater reliability of nonexperts ranged from substantial to good (mean 0.719). BRS shows for experts a high specificity and sensitivity and for nonexperts a low sensitivity and high specificity.Conclusions. The BRS is a simple, easy-to-carry-out, and accessible rating scale to locate pharyngeal retention on videofluoroscopic images with a good specificity and reproducibility for observers of different expertise levels.


2019 ◽  
Vol 65 (4) ◽  
pp. 237-244 ◽  
Author(s):  
Clément Dondé ◽  
Frédéric Haesebaert ◽  
Emmanuel Poulet ◽  
Marine Mondino ◽  
Jérôme Brunelin

Objective: The aim of this study was to validate the French version of the 7-item Auditory Hallucination Rating Scale (AHRS) so as to facilitate fine-grained assessment of auditory hallucinations (AH) in native French-speaking patients with schizophrenia (SZ) in clinical settings and studies. Method: Patients ( N = 66) were diagnosed with SZ according to the Diagnostic and Statistical Manual of Mental Disorders. The French version of the AHRS was developed using a forward–backward translation procedure. Psychometric properties of the French version of the AHRS were tested including (i) construct validity with a confirmatory one-factor analysis, (ii) internal validity with Pearson correlations and Cronbach α coefficients, and (iii) external validity by correlations with the Scale for Assessment of Positive Symptoms (SAPS-H1), the Positive and Negative Syndrome Scale (PANSS-P3; concurrent), the PANSS-Negative subscale and age of subjects (divergent), and inter-rater intraclass correlation coefficients (ICCs). Results: (i) The confirmatory one-factor analysis found a root mean square error of approximation (RMSEA) = 0.00, 90% confidence interval = [0.000 to 0.011], and a comparative fit index = 0.994. (ii) Correlations between AHRS total score and individual items were mostly ≥0.4. Cronbach α coefficient was 0.61. (iii) Correlations with PANSS-P3 and SAPS-H1 were 0.42 and 0.53, respectively. In a subset of participants ( N = 16), ICC values were extremely high and significant for AHRS total and individual item scores (ICCs range 0.899 to 0.996) Conclusion: The French version of the AHRS is a psychometrically acceptable instrument for the evaluation of AH severity in French-speaking patients with SZ.


2019 ◽  
Vol 91 (1) ◽  
pp. 75-81 ◽  
Author(s):  
Leonhard A Bakker ◽  
Carin D Schröder ◽  
Harold H G Tan ◽  
Simone M A G Vugts ◽  
Ruben P A van Eijk ◽  
...  

ObjectiveThe Amyotrophic Lateral Sclerosis Functional Rating Scale-Revised (ALSFRS-R) is widely applied to assess disease severity and progression in patients with motor neuron disease (MND). The objective of the study is to assess the inter-rater and intra-rater reproducibility, i.e., the inter-rater and intra-rater reliability and agreement, of a self-administration version of the ALSFRS-R for use in apps, online platforms, clinical care and trials.MethodsThe self-administration version of the ALSFRS-R was developed based on both patient and expert feedback. To assess the inter-rater reproducibility, 59 patients with MND filled out the ALSFRS-R online and were subsequently assessed on the ALSFRS-R by three raters. To assess the intra-rater reproducibility, patients were invited on two occasions to complete the ALSFRS-R online. Reliability was assessed with intraclass correlation coefficients, agreement was assessed with Bland-Altman plots and paired samples t-tests, and internal consistency was examined with Cronbach’s coefficient alpha.ResultsThe self-administration version of the ALSFRS-R demonstrated excellent inter-rater and intra-rater reliability. The assessment of inter-rater agreement demonstrated small systematic differences between patients and raters and acceptable limits of agreement. The assessment of intra-rater agreement demonstrated no systematic changes between time points; limits of agreement were 4.3 points for the total score and ranged from 1.6 to 2.4 points for the domain scores. Coefficient alpha values were acceptable.DiscussionThe self-administration version of the ALSFRS-R demonstrates high reproducibility and can be used in apps and online portals for both individual comparisons, facilitating the management of clinical care and group comparisons in clinical trials.


2013 ◽  
Vol 25 (9) ◽  
pp. 1503-1511 ◽  
Author(s):  
Florindo Stella ◽  
Orestes Vicente Forlenza ◽  
Jerson Laks ◽  
Larissa Pires de Andrade ◽  
Michelle A. Ljubetic Avendaño ◽  
...  

ABSTRACTBackground:Patients with dementia may be unable to describe their symptoms, and caregivers frequently suffer emotional burden that can interfere with judgment of the patient's behavior. The Neuropsychiatric Inventory-Clinician rating scale (NPI-C) was therefore developed as a comprehensive and versatile instrument to assess and accurately measure neuropsychiatric symptoms (NPS) in dementia, thereby using information from caregiver and patient interviews, and any other relevant available data. The present study is a follow-up to the original, cross-national NPI-C validation, evaluating the reliability and concurrent validity of the NPI-C in quantifying psychopathological symptoms in dementia in a large Brazilian cohort.Methods:Two blinded raters evaluated 312 participants (156 patient-knowledgeable informant dyads) using the NPI-C for a total of 624 observations in five Brazilian centers. Inter-rater reliability was determined through intraclass correlation coefficients for the NPI-C domains and the traditional NPI. Convergent validity included correlations of specific domains of the NPI-C with the Brief Psychiatric Rating Scale (BPRS), the Cohen-Mansfield Agitation Index (CMAI), the Cornell Scale for Depression in Dementia (CSDD), and the Apathy Inventory (AI).Results:Inter-rater reliability was strong for all NPI-C domains. There were high correlations between NPI-C/delusions and BPRS, NPI-C/apathy-indifference with the AI, NPI-C/depression-dysphoria with the CSDD, NPI-C/agitation with the CMAI, and NPI-C/aggression with the CMAI. There was moderate correlation between the NPI-C/aberrant vocalizations and CMAI and the NPI-C/hallucinations with the BPRS.Conclusion:The NPI-C is a comprehensive tool that provides accurate measurement of NPS in dementia with high concurrent validity and inter-rater reliability in the Brazilian setting. In addition to universal assessment, the NPI-C can be completed by individual domains.


2019 ◽  
Author(s):  
Kareem Khan ◽  
Charlotte L Hall ◽  
E Bethan Davies ◽  
Chris Hollis ◽  
Cris Glazebrook

BACKGROUND The prevalence of certain neurodevelopmental disorders, specifically autism spectrum disorder (ASD) and attention deficit hyperactivity disorder (ADHD), has been increasing over the last four decades. Nonpharmacological interventions are available that can improve outcomes and reduce associated symptoms such as anxiety, but these are often difficult to access. Children and young people are using the internet and digital technology at higher rates than any other demographic, but although Web-based interventions have the potential to improve health outcomes in those with long-term conditions, no previous reviews have investigated the effectiveness of Web-based interventions delivered to children and young people with neurodevelopmental disorders. OBJECTIVE This study aimed to review the effectiveness of randomized controlled trials (RCTs) of Web-based interventions delivered to children and young people with neurodevelopmental disorders. METHODS Six databases and one trial register were searched in August and September 2018. RCTs were included if they were published in a peer-reviewed journal. Interventions were included if they (1) aimed to improve the diagnostic symptomology of the targeted neurodevelopmental disorder or associated psychological symptoms as measured by a valid and reliable outcome measure; (2) were delivered on the Web; (3) targeted a youth population (aged ≤18 years or reported a mean age of ≤18 years) with a diagnosis or suspected diagnosis of a neurodevelopmental disorder. Methodological quality was rated using the Joanna Briggs Institute Critical Appraisal Checklist for RCTs. RESULTS Of 5140 studies retrieved, 10 fulfilled the inclusion criteria. Half of the interventions were delivered to children and young people with ASDs with the other five targeting ADHD, tic disorder, dyscalculia, and specific learning disorder. In total, 6 of the 10 trials found that a Web-based intervention was effective in improving condition-specific outcomes or reducing comorbid psychological symptoms in children and young people. The 4 trials that failed to find an effect were all delivered by apps. The meta-analysis was conducted on five of the trials and did not show a significant effect, with a high level of heterogeneity detected (n=182 [33.4%, 182/545], 5 RCTs; pooled standardized mean difference=–0.39; 95% CI –0.98 to 0.20; Z=–1.29; <italic>P</italic>=.19 [I<sup>2</sup>=72%; <italic>P</italic>=.006]). CONCLUSIONS Web-based interventions can be effective in reducing symptoms in children and young people with neurodevelopmental disorders; however, caution should be taken when interpreting these findings owing to methodological limitations, the minimal number of papers retrieved, and small samples of included studies. Overall, the number of studies was small and mainly limited to ASD, thus restricting the generalizability of the findings. CLINICALTRIAL PROSPERO International Prospective Register of Systematic Reviews: CRD42018108824; http://www.crd.york.ac.uk/PROSPERO/display_record.php?ID=CRD42018108824


2012 ◽  
Vol 9 (2) ◽  
pp. 295-299 ◽  
Author(s):  
Leanne Liggett ◽  
Andrew Gray ◽  
Winsome Parnell ◽  
Rob McGee ◽  
Yvette McKenzie

Background:Objective measures, such as accelerometers, are increasingly being used to measure physical activity (PA) levels in children, and the use of validated and reliable instruments is desirable when measuring the effectiveness of programs. The purpose of this study was to determine the validity and reliability of the New Lifestyles NL-1000 accelerometer among preschoolers using a modified version of the Children’s Activity Rating Scale (CARS).Methods:Fourteen preschoolers wore the NL-1000 at their waist while the device measured activity levels [in seconds of moderate-to-vigorous physical activity (MVPA)]. They were also videoed for approximately 12 minutes while participating in normal activities at an early childhood center. At approximately 2-minute intervals, activity level readings derived from the NL-1000 were recorded. The video footage was analyzed using a modified CARS technique and the CARS scores compared with data obtained from the accelerometer.Results:Within subject reliability was measured using intraclass correlation coefficients (0.58 for CARS and 0.59 for NL-1000). Furthermore, 95% of the variation in CARS could be explained by variation in the accelerometer counts, with 2.4% of the variation being participant-specific.Conclusion:The NL-1000 is a sufficiently reliable and valid tool for assessing MVPA in preschoolers.


Sign in / Sign up

Export Citation Format

Share Document