scholarly journals Training and standardization of simulated patients for multicentre studies in clinical pharmacy education

2020 ◽  
Vol 18 (4) ◽  
pp. 2038
Author(s):  
Karina A. Resende ◽  
Afonso M. Cavaco ◽  
Márcia A. Luna-Leite ◽  
Bianca R. Acacio ◽  
Núbia N. Pinto ◽  
...  
Keyword(s):  
Role Play ◽  
Training Session ◽  
Simulated Patient ◽  
Pharmacy Education ◽  
Simulated Patients ◽  
Complete Agreement ◽  
Patient Assessment ◽  
Cronbach’S Alpha ◽  
Cronbach's Alpha ◽  
Standardization Process

Objective: To evaluate the training and standardization methods of multiple simulated patients (SPs) performing a single scenario in a multicenter study. Methods: A prospective quasi-experimental study, using a multicenter approach, evaluated the performance of five different individuals with the same biotype during a simulation session in a high-fidelity environment. The SPs training and standardization process consisted of four steps and six web or face-to-face mediated: Step 1: simulation scenario design and pilot test. Step 2: SPs selection, recruitment and beginning training (Session 1: performance instructions and memorization request.) Session 2: check the SPs’ performances and adjustments). Step 3 and session 3: training role-play and performance’s evaluation. Step 4: SPs' standardization and performances’ evaluation (Sessions 4 and 5: first and second rounds of SPs' standardization assessment. Session 6: Global training and standardization evaluation. SPs performance consistency was estimated using Cronbach's alpha and ICC. Results: In the evaluation of training results, the Maastricht Simulated Patient Assessment dimensions of SPs performances "It seems authentic", "Can be a real patient" and "Answered questions naturally", presented “moderate or complete agreement” of all evaluators. The dimensions "Seems to retain information unnecessarily", "Remains in his/her role all the time", "Challenges/tests the student", and "Simulates physical complaints in an unrealistic way" presented “moderate or complete disagreement” in all evaluations. The SPs "Appearance fits the role" showed “moderate or complete agreement” in most evaluations. In the second round of evaluations, the SPs had better performance than the first ones. This could indicate the training process’s had good influence on SPs performances. The Cronbach's alpha in the second assessment was better than the first (varied from 0.699 to 0.978). The same improvement occurred in the second round of intraclass correlation coefficient that was between 0.424 and 0.978. The SPs were satisfied with the training method and standardization process. They could perceive improvement on their role-play authenticity. Conclusions: The SPs training and standardization process revealed good SPs reliability and simulation reproducibility, demonstrating to be a feasible method for SPs standardization in multicenter studies. The Maastricht Simulated Patient Assessment was regarded as missing the assessment of the information consistency between the simulation script and the SPs provision.

scholarly journals Training and standardization of simulated patients for multicentre studies in clinical pharmacy education

2020 ◽  
Vol 18 (4) ◽  
pp. 2038
Author(s):  
Karina A. Resende ◽  
Afonso M. Cavaco ◽  
Márcia A. Luna-Leite ◽  
Bianca R. Acacio ◽  
Núbia N. Pinto ◽  
...  
Keyword(s):  
Role Play ◽  
Training Session ◽  
Simulated Patient ◽  
Pharmacy Education ◽  
Simulated Patients ◽  
Complete Agreement ◽  
Patient Assessment ◽  
Cronbach’S Alpha ◽  
Cronbach's Alpha ◽  
Standardization Process

Objective: To evaluate the training and standardization methods of multiple simulated patients (SPs) performing a single scenario in a multicenter study. Methods: A prospective quasi-experimental study, using a multicenter approach, evaluated the performance of five different individuals with the same biotype during a simulation session in a high-fidelity environment. The SPs training and standardization process consisted of four steps and six web or face-to-face mediated: Step 1: simulation scenario design and pilot test. Step 2: SPs selection, recruitment and beginning training (Session 1: performance instructions and memorization request.) Session 2: check the SPs’ performances and adjustments). Step 3 and session 3: training role-play and performance’s evaluation. Step 4: SPs' standardization and performances’ evaluation (Sessions 4 and 5: first and second rounds of SPs' standardization assessment. Session 6: Global training and standardization evaluation. SPs performance consistency was estimated using Cronbach's alpha and ICC. Results: In the evaluation of training results, the Maastricht Simulated Patient Assessment dimensions of SPs performances "It seems authentic", "Can be a real patient" and "Answered questions naturally", presented “moderate or complete agreement” of all evaluators. The dimensions "Seems to retain information unnecessarily", "Remains in his/her role all the time", "Challenges/tests the student", and "Simulates physical complaints in an unrealistic way" presented “moderate or complete disagreement” in all evaluations. The SPs "Appearance fits the role" showed “moderate or complete agreement” in most evaluations. In the second round of evaluations, the SPs had better performance than the first ones. This could indicate the training process’s had good influence on SPs performances. The Cronbach's alpha in the second assessment was better than the first (varied from 0.699 to 0.978). The same improvement occurred in the second round of intraclass correlation coefficient that was between 0.424 and 0.978. The SPs were satisfied with the training method and standardization process. They could perceive improvement on their role-play authenticity. Conclusions: The SPs training and standardization process revealed good SPs reliability and simulation reproducibility, demonstrating to be a feasible method for SPs standardization in multicenter studies. The Maastricht Simulated Patient Assessment was regarded as missing the assessment of the information consistency between the simulation script and the SPs provision.

Measuring the Assessment and Counseling Provided with the Supply of Nonprescription Asthma Reliever Medication: A Simulated Patient Study

2009 ◽  
Vol 43 (9) ◽  
pp. 1512-1518 ◽  
Author(s):  
Carl R Schneider ◽  
Alan W Everett ◽  
Elizabeth Geelhoed ◽  
Peter A Kendall ◽  
Rhonda M Clifford
Keyword(s):  
Community Pharmacy ◽  
Asthma Control ◽  
Simulated Patient ◽  
Simulated Patients ◽  
Community Pharmacies ◽  
Patient Assessment ◽  
Pharmacy Staff ◽  
Medication Counseling ◽  
Reliever Medication ◽  
Pharmacy Setting

Background: Over one quarter of asthma reliever medications are provided without prescription by community pharmacies in Australia. Evidence that community pharmacies provide these medications with sufficient patient assessment and medication counseling to ensure compliance with the government's Quality Use of Medicines principles is currently tacking. Objective: To assess current practice when asthma reliever medication is provided in the community pharmacy setting and to identify factors that correlate with assessment of asthma control. Methods: Researchers posing as patients visited a sample of Perth metropolitan community pharmacies in May 2007. During the visit, the simulated patient enacted a standardized scenario of someone with moderately controlled asthma who wished to purchase a salbutamol (albuterol) inhaler without prescription. Results of the encounter were recorded immediately after the visit. Regression analysis was performed, with medication use frequency (a marker of asthma control) as the dependent variable. Results: One hundred sixty community pharmacies in the Perth metropolitan area were visited in May 2007. Pharmacists and/or pharmacy assistants provided some form of assessment in 84% of the visits. Counseling was provided to the simulated patients in 24% of the visits. Only 4 pharmacy staff members asked whether the simulated patient knew how to use the inhaler. Significant correlation was found between assessment and/or counseling of reliever use frequency and 3 independent variables: visit length (p < 0.001), number of assessment questions asked (p < 0.001), and the simulated patient who conducted the visit (p < 0.02). Conclusions: Both patient assessment and medication counseling were suboptimal compared with recommended practice when nonprescription asthma reliever medication was supplied in the community pharmacy setting. Pharmacy and pharmacist demographic variables do not appear to affect assessment of asthma control. This research indicates the need for substantial improvements in practice in order to provide reliever medication in line with Quality Use of Medication principles of ensuring safe and effective use of medication.

scholarly journals Moving beyond Cronbach’s Alpha and Inter-Rater Reliability: A Primer on Generalizability Theory for Pharmacy Education

2021 ◽  
Vol 12 (1) ◽  
pp. 14
Author(s):  
Michael Peeters
Keyword(s):  
Measurement Error ◽  
Generalizability Theory ◽  
Pharmacy Education ◽  
Learning Assessment ◽  
Multiple Sources ◽  
Cronbach’S Alpha ◽  
Rater Reliability ◽  
Complex Learning ◽  
Cronbach's Alpha ◽  
Learning Assessments

Background: When available, empirical evidence should help guide decision-making. Following each administration of a learning assessment, data becomes available for analysis. For learning assessments, Kane’s Framework for Validation can helpfully categorize evidence by inference (i.e., scoring, generalization, extrapolation, implications). Especially for test-scores used within a high-stakes setting, generalization evidence is critical. While reporting Cronbach’s alpha, inter-rater reliability, and other reliability coefficients for a single measurement error are somewhat common in pharmacy education, dealing with multiple concurrent sources of measurement error within complex learning assessments is not. Performance-based assessments (e.g., OSCEs) that use raters, are inherently complex learning assessments. Primer: Generalizability Theory (G-Theory) can account for multiple sources of measurement error. G-Theory is a powerful tool that can provide a composite reliability (i.e., generalization evidence) for more complex learning assessments, including performance-based assessments. It can also help educators explore ways to make a learning assessment more rigorous if needed, as well as suggest ways to better allocate resources (e.g., staffing, space, fiscal). A brief review of G-Theory is discussed herein focused on pharmacy education. Moving Forward: G-Theory has been common and useful in medical education, though has been used rarely in pharmacy education. Given the similarities in assessment methods among health-professions, G-Theory should prove helpful in pharmacy education as well. Within this Journal and accompanying this Idea Paper, there are multiple reports that demonstrate use of G-Theory in pharmacy education.

scholarly journals Validation of a 5-item tool to measure patient assessment of clinician compassion in the emergency department

2019 ◽  
Vol 19 (1) ◽  
Author(s):  
Praveen Sabapathi ◽  
Michael B. Roberts ◽  
Brian M. Fuller ◽  
Michael A. Puskarich ◽  
Christopher W. Jones ◽  
...  
Keyword(s):  
Emergency Department ◽  
Factor Analysis ◽  
Patient Satisfaction ◽  
Confirmatory Factor Analysis ◽  
Test Reliability ◽  
Patient Assessment ◽  
Cronbach’S Alpha ◽  
Cronbach's Alpha ◽  
Reliable Tool ◽  
Confirmatory Factor

Abstract Background To test if the 5-item compassion measure (a tool previously validated in the outpatient setting to measure patient assessment of clinician compassion) is a valid and reliable tool to quantify a distinct construct (i.e. clinical compassion) among patients evaluated in the emergency department (ED). Methods Cross-sectional study conducted in three academic emergency departments in the U.S. between November 2018 and April 2019. We enrolled adult patients who were evaluated in the EDs of the participating institutions and administered the 5-item compassion measure after completion of care in the ED. Validity testing was performed using confirmatory factor analysis. Cronbach’s alpha was used to test reliability. Convergent validity with patient assessment of overall satisfaction questions was tested using Spearman correlation coefficients and we tested if the 5-item compassion measure assessed a construct distinct from overall patient satisfaction using confirmatory factor analysis. Results We analyzed 866 patient responses. Confirmatory factor analysis found all five items loaded well on a single construct and our model was found to have good fit. Reliability was excellent (Cronbach’s alpha = 0.93) among the entire cohort. These results remained consistent on sub-analyses stratified by individual institutions. The 5-item compassion measure had moderate correlation with overall patient satisfaction (r = 0.66) and patient recommendation of the ED to friends and family (r = 0.57), but reflected a patient experience domain (i.e. compassionate care) distinctly different from patient satisfaction. Conclusions The 5-item compassion measure is a valid and reliable tool to measure patient assessment of clinical compassion in the ED.

scholarly journals A Novel Blended Curriculum for Communication of Informed Consent With Surgical Interns

2021 ◽  
Vol 13 (3) ◽  
pp. 411-416
Author(s):  
Tiffany N. Anderson ◽  
Aboubacar Kaba ◽  
Eniola Gros ◽  
Ingrid S. Schmiederer ◽  
Robert Shi ◽  
...  
Keyword(s):  
Informed Consent ◽  
Curriculum Evaluation ◽  
Patient Simulation ◽  
Preliminary Evidence ◽  
Simulated Patient ◽  
Pass Rate ◽  
Professional Activity ◽  
Training Process ◽  
Cronbach’S Alpha ◽  
Cronbach's Alpha

ABSTRACT Background Interns often conduct procedural informed consent discussions (ICDs), identified as a core entrustable professional activity. Deficiencies in the training process for ICDs span across specialties. Objective We provide evidence for a curriculum and assessment designed to standardize the training process and ensure ICD competency in surgical interns. Methods In March 2019, PowerPoint educational materials were emailed to one academic institution's new surgical interns, who in June participated in an onsite 1-hour role-play “hot seat” group activity (GA) with an untrained simulated patient, and in October completed a single trained simulated patient (real-time raters) verification of proficiency (VOP) assessment. Curriculum evaluation was measured through intern pre-/post-confidence (5-point scale), and the VOP's Cronbach's alpha and test-retest were examined. Data were analyzed with descriptive statistics, paired t tests, and 2-way random effects models. Results Of 44 new interns, 40 (91%) participated in the remote teaching and live GA and were assessed by the VOP. Pre-/post-GA confidence increased a mean difference of 1.3 (SD = 0.63, P &lt; .001). The VOP's Cronbach's alpha was 0.88 and test-retest was 0.84 (95% CI 0.67–0.93, P &lt; .001), with a 95% pass rate. The 2 first-time fail students required remediation. Time commitment included 1 hour maximum for individual training and implementation and 30 minutes for assessment. The use of volunteers and donated space mitigated additional costs. Conclusions Remote asynchronous and group skills teaching for new general surgical interns improved their confidence in conducting procedural ICDs. A patient-simulation verification process appeared feasible with preliminary evidence of retest and internal consistency.

scholarly journals Psychometric evaluation of patient assessment of chronic illness care among Korean cancer survivors

PLoS ONE ◽  
2021 ◽  
Vol 16 (8) ◽  
pp. e0256119
Author(s):  
Soo Hyun Kim ◽  
Bo Gyeong Lee ◽  
Yu Hyeon Choe
Keyword(s):  
Chronic Illness ◽  
Cancer Survivors ◽  
Internal Consistency ◽  
Chronic Care ◽  
Psychometric Evaluation ◽  
Chronic Illness Care ◽  
Validity And Reliability ◽  
Patient Assessment ◽  
Cronbach’S Alpha ◽  
Cronbach's Alpha

Background The Patient Assessment of Chronic Illness Care (PACIC) was developed in the United States to assess the implementation of the Chronic Care Model (CCM)-based intervention from the patient’s perspective. Although the psychometric properties of the PACIC have been reported in other chronically ill patients, it has not been reported in cancer survivors. Our aim was to evaluate the acceptability, validity, and reliability of a Korean version of the PACIC among cancer survivors (K-PACIC-CS). Methods Among 204 cancer survivors at a university-based hospital in South Korea, we performed psychometric evaluation of the K-PACIC-CS according to acceptability (descriptive statistics, missing values, and floor and ceiling effects), validity (confirmative factor analysis [CFA] and convergent validity), and reliability (internal consistency, i.e., Cronbach’s alpha). Results The item response was high (missing rate = 0.5%). The floor effect was 3.9%– 43.6% and the ceiling effect was 6.9%– 41.2%. The CFA revealed good indices of fit and confirmed the five structures predetermined in the original version of PACIC. The K-PACIC-CS scores had significant positive relationships with cancer survivors’ self-efficacy and health-related quality of life. The total K-PACIC-CS showed excellent internal consistency (Cronbach’s alpha = .94) and those of the subscales were acceptable (Cronbach’s alpha = .76 -.86). Conclusions This study suggests that the K-PACIC-CS is a valid and reliable instrument for measuring implementation of CCM-based chronic care from the survivor’s perspective.

Perception of Mothers among Cerebral Palsy Children with Disabilities in Tamil Nadu, India

2020 ◽  
Vol 11 (3) ◽  
pp. 3349-3354
Author(s):  
Elanchezhian Chinnavan ◽  
Swarna kumari P
Keyword(s):  
Cerebral Palsy ◽  
Health Status ◽  
Parental Stress ◽  
Tamil Nadu ◽  
Children With Disabilities ◽  
Community Support ◽  
Well Being ◽  
Study Data ◽  
Cronbach’S Alpha ◽  
Cronbach's Alpha

The purpose of the study is to check the perception of mothers of cerebral palsy children with disabilities in Tamil Nadu. Data, from India, on perceptions about Cerebral palsy disability are scant. This study explored mother’s knowledge, social well-being and awareness of treatment rendered. During the development of the questionnaire, review of the literature has been primarily made; during developing the questionnaire personal and social values were considered. The questionnaire was emerged with 9 themes, Knowledge of disability condition, Parental stress, Community support, Child ability, Mothers Confidence, Improvement, Health status, Benefits & Belief. Data were collected from mothers of both male and female children with cerebral palsy aged between 1 to 18 years. 220 mothers, averaged 33.44 + 6.14years, of children with CP were randomly selected for this study. Data was collected from mothers attending rehabilitation centers from different institution and special schools in Tamil Nadu. Mothers can hold both a fatalistic view of disability and a belief in the course of disability.The raw data was tabulated and analyzed by using SPSS 17 version software. Cronbach’s Alpha was calculated, the results showed that its Cronbach’s Alpha was extremely good (r=0.96). Our results suggest that there is significance difference with in the mother’s perception towards types of disability in Parental stress, child’s ability, mother’s confidence, improvement, health status, benefits and belief.Mothers should be motivated to maximize rehabilitation services in order to improve their children’s functional capacity. The appreciation of this phenomenon could move towards a model for the delivery of rehabilitation that integrates and harmonizes such beliefs.

Using Adanco Software To Examine The Intention To Use Coffee. Evidence From Vietnam

2019 ◽  
Vol 118 (10) ◽  
pp. 216-223
Author(s):  
Nguyen Thi Ngan ◽  
Bui Huy Khoi
Keyword(s):  
Survey Data ◽  
Behavioral Intention ◽  
Reliability And Validity ◽  
Ho Chi Minh City ◽  
Intention To Use ◽  
Research Model ◽  
Cronbach’S Alpha ◽  
Cronbach's Alpha ◽  
Average Variance ◽  
Composite Reliability

The purpose of the paper was to investigate the factors that influenced the intention to use coffee by using Adanco software. Survey data was collected from 284 consumers living in Ho Chi Minh City, Vietnam. The research model was proposed from the studies of the behavioral intention. The reliability and validity of the scale were tested by Cronbach's Alpha, Average Variance Extracted (Pvc) and Composite Reliability (Pc). PLS-SEM showed that intention to use coffee was affected by some components of the intention to use coffee.

Vietnamese consumers attitude on television advertisement of skin care

2020 ◽  
Author(s):  
Ha Nam Khanh Giao
Keyword(s):  
Regression Analysis ◽  
Multiple Regression Analysis ◽  
Multiple Regression ◽  
Skin Care ◽  
Cronbach’S Alpha ◽  
Cronbach's Alpha ◽  
Television Advertisement ◽  
Tv Commercial

The research investigates how the factors affect Vietnamese consumers attitude on television advertisement of skin care, by intervewing 280 consumers. The method of Cronbach’s Alpha analysis, EFA analysis and multiple regression analysis were used with the SPSS program.The result shows that the affects of the factors on Vietnamese buyer’s behavior about TV commercial of skin care increasingly: Entertaiment, Informativeness, Celebrity, In-irritation, Credibility. The research also suggests some solutions to the television advertisers to enhance capability of serving consumers.attitude on television advertisement, Vietnamese consumers, skin care

Aviation

2020 ◽  
Author(s):  
Ha Nam Khanh Giao
Keyword(s):  
Regression Analysis ◽  
Customer Satisfaction ◽  
Service Quality ◽  
Multiple Regression Analysis ◽  
Multiple Regression ◽  
Domestic Service ◽  
Flight Crew ◽  
Cronbach’S Alpha ◽  
Cronbach's Alpha ◽  
Proportional Effect

The paper examines relation between Vietnam Airline Domestic service quality and customer satisfaction by gathering opinions from 402 passengers employing Skytrax scale with some modification along with Cronbach’s alpha, EFA and multiple regression analysis. Results show that Vietnam Airline Domestic service quality can be measured by the following six determinants in order of decreasing importance: (1) boarding/deplaning/baggage; (2) check in; (3) in-flight services; (4) reservation; (5) aircraft; and (6) flight crew. All of them are directly proportional effect to customer satisfaction. The paper also offers some suggestions to improve the service quality thereby enhancing the customer satisfaction.

Sign in / Sign up

Export Citation Format

Share Document