Interformat Reliability of Web-Based Parent-Rated Questionnaires Assessing for Neurodevelopmental Disorders among Preschoolers: A Community Developmental Health Check-up Setting Study (Preprint)
BACKGROUND Early detection and intervention for neurodevelopmental disorders are effective. Several paper types of questionnaires have been developed to assess these conditions in early childhood. However, the psychometric equivalence between the web and the paper versions of these questionnaires is unknown. OBJECTIVE This study examined the interformat reliability of the web-based parent-rated version of the Autism Spectrum Screening Questionnaire (ASSQ), Attention-Deficit/Hyperactivity Disorder Rating Scale (ADHD-RS), Developmental Coordination Disorder Questionnaire’07 (DCDQ), and Strengths and Difficulties Questionnaire (SDQ) among Japanese preschoolers in a community developmental health check-up setting. METHODS A set of paper-based questionnaires were distributed for voluntary completion to parents of children aged 5 years. The package of the paper form questionnaires included the ASSQ, ADHD-RS, DCDQ, Parent-reported SDQ (P-SDQ), and several additional demographic questions. Responses were received from 508 parents of children who agreed to participate in the study. After 3 months, 300 parents of children, who were among the initial responders, were randomly selected and asked to complete the web-based versions of these questionnaires voluntarily. A total of 140 parents of children replied to the web form and were included as a final sample in this study. RESULTS We obtained Cronbach’s alphas for both the web and paper forms of the ASSQ (web=.88, paper=.84), ADHD-RS total and subscales (web=.87-.94, paper=.86-.92), DCDQ total and subscales (web=.81-.93, paper=.74-.91), and P-SDQ Total Difficulties and subscales (web=.52-.80, paper=.51-.79). The intraclass correlation coefficients between the web and paper forms of each questionnaire were all significant at the 99.9% confidence level. (ASSQ: r=.66; ADHD-RS total and subscales: r=.66-74; DCDQ total and subscales: r=.66-.71; P-SDQ Total Difficulties and subscales: r=.55-.73). There were no significant differences between the web and paper forms for the total mean score of the ASSQ, total and subscale mean scores of DCDQ, and the P-SDQ Total Difficulties mean score and mean subscale scores. While significant differences were found between the web and paper forms for the mean scores on the ADHD-RS (Total: t132=2.83, P=.005; Inattention: t133=2.15, P=.03; Hyperactivity/Impulsivity: t133=3.21, P=.002), the effect sizes were small (Cohen d=.18-.22). CONCLUSIONS These results suggest that the web versions of the ASSQ, ADHD-RS, DCDQ, and P-SDQ had the same level of internal consistency, intra-rater reliability, and equality as the paper versions. These results indicate the web applicability of these questionnaires for assessing neurodevelopmental disorders.