Validity evidence based on the relationship between interim and summative assessment scores

2011 ◽  
Author(s):  
Neal Kingston ◽  
Wenhao Wang ◽  
Angela E. Broaddus ◽  
Laura M. B. Kramer
2017 ◽  
Vol 33 (6) ◽  
pp. 460-466 ◽  
Author(s):  
Séli Chaves-Sousa ◽  
Iolanda Ribeiro ◽  
Fernanda Leopoldina Viana ◽  
Ana Paula Vale ◽  
Sandra Santos ◽  
...  

Abstract. This article presents data concerning the validity evidence of a test of word reading (TLP – Teste de Leitura de Palavras) that assesses single-word reading accuracy in Portuguese students from Grades 1 to 4. The test is composed of four vertically scaled forms, one for each grade, allowing for the evaluation of students’ word reading progression. In the internal structure-related evidence validity study, administration of the TLP to 905 Portuguese elementary students confirmed its one-dimensional structure. In the evidence based on the relationship with other variables’ study, 280 Portuguese elementary students were assessed with each TLP test form and criterion measures (reading tests, digit span, and vocabulary measures). Significant correlations were observed between results from the TLP test forms, reading instruments, short-term memory, and vocabulary measures. These results revealed adequate evidence based on internal structure and evidence based on the relationship to other variables of the TLP for the assessment of word reading accuracy in Portuguese elementary students.


2021 ◽  
pp. 019874292110123
Author(s):  
Matthew C. Lambert ◽  
Douglas Cullinan ◽  
Michael H. Epstein ◽  
Jodie Martin

This study examined the internal structure of the Scales for Assessing Emotional Disturbance-3 Rating Scale (RS), a teacher-completed RS developed to measure emotional disturbance (ED). As defined in U.S. law and regulations, ED involves five characteristics or patterns of behavioral and emotional maladaptation. RS data obtained on a sample of students with ED were used to examine validity evidence based on the internal structure of the assessment. Of particular interest was the extent to which multivariate factors derived from the RS data conform to the five characteristics of ED stated in the definition. Results indicate that the RS data fit a 5-factor model reasonably well. A subsequent bifactor analysis identified a considerable proportion of common variance across factors, suggesting the presence of a strong general ED factor, two distinct group factors (Inability to Learn and Inappropriate Behavior), and three weak group factors. The findings provided evidence of the validity of the SAED-3 RS based on internal structure and pointed to support for use of the RS in contributing to the process of determining whether a student qualifies for the ED education disability. Implications for improved research on the nature of ED and how students with ED can be better served are discussed.


Author(s):  
Katalin Dózsa ◽  
Fruzsina Mezei ◽  
Tamás Tóth ◽  
Ábel Perjés ◽  
Péter Pollner

Abstract Background: Expectations towards general practitioners (GPs) are continuously increasing to provide a more systematic preventive- and definitive-based care, a wider range of multidisciplinary team-based services and to integrate state-of-the-art digital solutions into daily practice. Aided by development programmes, Hungarian primary care is facing the challenge to fulfil its role as the provider of comprehensive, high quality, patient-centred, preventive care, answering the challenges caused by non-communicable diseases (NCDs). Aim: The article aims to provide an insight into the utilization of simple, digital, medical devices. We show the relationship between the primary health care (PHC) practice models and the used types of devices. We point at further development directions of GP practices regarding the utilization of evidence-based medical technologies and how such devices support the screening and chronic care of patients with NCDs in everyday practice. Methods: Data were collected using an online self-assessment questionnaire from 1800 Hungarian GPs registered in Hungary. Descriptive statistics, Wilcoxon’s test and χ2 test were applied to analyze the ownership and utilization of 32 types of medical devices, characteristics of the GP practices and to highlight the differences between traditional and cluster-based operating model. Findings: Based on the responses from 27.7% of all Hungarian GPs, the medical device infrastructure was found to be limited especially in single GP-practices. Those involved in development projects of GP’s clusters in the last decade reported a wider range and significantly more intensive utilization of evidence-based technologies (average number of devices: 5.42 versus 7.56, P<.001), but even these GPs are not using some of their devices (e.g., various point of care testing devices) due to the lack of financing. In addition, GPs involved in GPs-cluster development model programmes showed significantly greater willingness for sharing relatively expensive, extra workforce-demanding technologies (χ2 = 24.5, P<.001).


2020 ◽  
Vol 18 (7) ◽  
pp. 177-182
Author(s):  
Kevin Kupietz, PhD ◽  
Lesley Gray, MPH

Introduction: The greatest enemy of a global pandemic is not the virus itself, but the fear, rumor, and stigma that envelopes people. This article explores the context and history of fear and stigma relating to pandemic, summarizing key actions to mitigate the harms during an active pandemic.Method: Our article draws from accounts in literature and journalist accounts documenting the relationship between infectious diseases and major disease outbreaks that have garnered fear and stigmatization. Results: Fear, stigma, and discrimination are not new concepts for pandemics. These social effects run the risk of diverting attention from the presenting disease and government responses. Reactions to fear, stigma, and discrimination risk sabotaging effective efforts to contain, manage, and eradicate the disease.Conclusion: Emergency managers have an important role in dispelling myths, disseminating appropriate and evidence-based information without exacerbating fears. Knowledge about the roots of fear and bias along with a good understanding of historical plagues and pandemics is vital to ensure those in the field of emergency management can effectively manage irrational fears.


2021 ◽  
Vol 43 (2) ◽  
pp. 137
Author(s):  
Matthew Mo ◽  
Mike Roache

Heat stress events in Australian flying-fox camps have resulted in significant numbers of flying-fox deaths. The frequency and intensity of such events have increased in recent decades, attributed to anthropogenic climate change. Evidence-based interventions are required to address this growing threat. Responders currently use different combinations of a range of intervention methods. We undertook a systematic review of heat stress interventions, which we classified as either ‘camp-scale’ or ‘individual-scale’. Camp-scale interventions included manual and automated misting of roost vegetation, whereas individual-scale interventions included spraying individual animals or removing them for intensive cooling and rehydration procedures. Our study showed that to date, evaluation of the efficacy of heat stress interventions has been largely anecdotal rather than empirical. This highlights the need for dedicated rigorous studies to evaluate the effectiveness of all the intervention methods described here. It will be especially important to understand the relationship between camp temperature and humidity levels and their influence on flying-foxes’ ability to regulate their body temperature, because high relative humidity reduces the ability of mammals to cool themselves using evaporative heat loss. The development of biophysiological measures such as temperature and humidity indices for different flying-fox species would enable meaningful interpretations of intervention trials under controlled conditions.


Author(s):  
Thomas St. James O’Connor ◽  
Elizabeth Meakes

Describes the relationship between practice and theory (praxis) along with an examination of changes in the last 40 years in the praxis of pastoral care and counselling in the Canadian Association for Spiritual Care (CASC) that led to spiritual care and psycho-spiritual therapy. Developments in spiritual practices include growth in multi-faith, evidence-based spiritual care, and spiritually integrated psychotherapy (psycho-spiritual therapy). Suggests further areas of research and reflection including process theology.


Author(s):  
Lisa Sanetti ◽  
Melissa A. Collier-Meek ◽  
Lindsay Fallon

Research has linked the use of evidence-supported treatments to effective, efficient therapeutic outcomes. Questions related to the best way to disseminate and implement evidence-supported treatments in the field has led to discussions about transportability of treatments from controlled to applied settings. Specifically, scholars have focused on issues related to treatment fidelity, acceptability, and adoption versus adaptation of evidence-based treatments in practice. Treatment fidelity, a multidimensional construct, pertains to how extensively a treatment is delivered to a client, and it may be affected by several variables. Although the relationship is complex, treatment fidelity is considered an important moderator of client outcomes. Furthermore, the acceptability of a treatment appears to be of importance. Simply, if a treatment is perceived to be acceptable, it is more likely to be implemented with high levels of fidelity, increasing the chances that successful therapeutic outcomes will result. Nevertheless data indicate that some clinicians are wary of using evidence-supported treatments; their chief concern is feasibility of implementation, which could affect treatment fidelity and acceptability. Thus, there is a debate about whether evidence-supported treatments should be adopted strictly as developed or whether they might be adapted to improve implementation and acceptability. In adaptation of a treatment, relevant clinician variables (e.g., training received, availability of resources) and client factors (e.g., cultural fit) might be considered to promote therapeutic outcomes. This chapter describes how the key to treatment success may be to strike a balance between fidelity and adaptation of evidence-based treatments and fidelity with flexibility.


Author(s):  
Dustin T. Weiler ◽  
Jason J. Saleem

With an increase in the number of nursing students and the limited number of open clinical positions, high-fidelity patient simulators (HFPS) have become the new norm. Multiple studies have evaluated HFPS effectiveness and several suggest that HFPS does has an effect on critical thinking. This study intends to provide data to support that suggestion. In addition, this study was designed to identify a possible correlation between role assignment and improvements in critical thinking after completion of a HFPS scenario. Analysis revealed that role assignment, for most of the roles, did have a statistically significant effect on the post-simulation critical thinking assessment scores. The relationship between role assignments and HFPS scenario outcomes (such as critical thinking), as well as the nature of the correlation, may help scenario developers better understand how critical thinking improvement can be affected by the involvement of the participant based on the roles assigned to them.


Sign in / Sign up

Export Citation Format

Share Document