scholarly journals Development and Evaluation of ClientBot: Patient-Like Conversational Agent to Train Basic Counseling Skills (Preprint)

2018 ◽  
Author(s):  
Michael J Tanana ◽  
Christina S Soma ◽  
Vivek Srikumar ◽  
David C Atkins ◽  
Zac E Imel

BACKGROUND Training therapists is both expensive and time-consuming. Degree–based training can require tens of thousands of dollars and hundreds of hours of expert instruction. Counseling skills practice often involves role-plays, standardized patients, or practice with real clients. Performance–based feedback is critical for skill development and expertise, but trainee therapists often receive minimal and subjective feedback, which is distal to their skill practice. OBJECTIVE In this study, we developed and evaluated a patient-like neural conversational agent, which provides real-time feedback to trainees via chat–based interaction. METHODS The text–based conversational agent was trained on an archive of 2354 psychotherapy transcripts and provided specific feedback on the use of basic interviewing and counseling skills (ie, open questions and reflections—summary statements of what a client has said). A total of 151 nontherapists were randomized to either (1) immediate feedback on their use of open questions and reflections during practice session with ClientBot or (2) initial education and encouragement on the skills. RESULTS Participants in the ClientBot condition used 91% (21.4/11.2) more reflections during practice with feedback (P<.001) and 76% (14.1/8) more reflections after feedback was removed (P<.001) relative to the control group. The treatment group used more open questions during training but not after feedback was removed, suggesting that certain skills may not improve with performance–based feedback. Finally, after feedback was removed, the ClientBot group used 31% (32.5/24.7) more listening skills overall (P<.001). CONCLUSIONS This proof-of-concept study demonstrates that practice and feedback can improve trainee use of basic counseling skills.

10.2196/12529 ◽  
2019 ◽  
Vol 21 (7) ◽  
pp. e12529 ◽  
Author(s):  
Michael J Tanana ◽  
Christina S Soma ◽  
Vivek Srikumar ◽  
David C Atkins ◽  
Zac E Imel

2011 ◽  
Vol 26 (S2) ◽  
pp. 2042-2042
Author(s):  
M. Ruggeri

IntroductionIssues of organisational structure and commitment, resource development, and clarity of roles and responsibilities must be addressed before proceeding with any attempt to implement evidence based interventions in a specific service.Evidence suggests that the management of most mental disorders and especially of psychoses is frequently suboptimal. This trend might reflect instances of inadequate resource allocation, but might also reflect the effects of stigma, discrimination, and social exclusion that people with psychosis often experience. It might also indicate poor management of available resources or deficiencies in knowledge or practice.AimsMulti-element psychosocial interventions in the first 5 years from psychosis onset have proved to facilitating recovery and reducing long-term disability. However, most studies often do not test efficacy against a control group and have been conducted in non-epidemiologically representative samples. The presentation will be focussed on process of assessment of acceptability and discrepancies between evidence and clinical practice in the treatment of schizophrenia in community care.Methods and ResultsTrials - such as the GET UP Trial (National Coordinator: Mirella Ruggeri) that is part of the Strategic Research Programs of the Italian Government - that are being conducted in the routine practice and that aim to test the feasibility and cost-effectiveness of evidence-based psychosocial interventions will be presented and discussed.ConclusionsVerify the barriers to application and situations when evidence-based interventions practice might be ineffective or inappropriate, understanding their advantages and limitations is a crucial challenge in the area of early psychosis treatment.


2021 ◽  
Vol 9 (2) ◽  
pp. 198-207
Author(s):  
Habibah Abidin ◽  
Apoina Kartini ◽  
Ani Margawati

Background: A Kader refers to a Village Health Worker (VHW), a volunteer, which becomes one of the sources of community reference. Commonly, they sustain a mother's knowledge regarding adequate complementary feeding. However, there are still some VHW who have not possessed a health education background nor been able to be independent.Objectives: This study aimed to analyze the impact of collaborative models on VHW's competence as in knowledge, self-efficacy, attitudes, and counseling skill on the topic of complementary feeding.Materials and Methods: The design of this research is a quasi-experiment control group pretest-postest, with the retrieval of subjects using purposive sampling. Subjects were selected based on the location of the posyandu. The population in this research was VHWs in the Lembang district were 40 VHWs in each group. The treatment group was given training intervention for 1 month with a collaborative model, combining several methods into a series. The main topic was counseling and complementary feeding. The control group was given booklets and leaflets. VHW's competence was measured using questionnaires. This research was conducted in January-April 2020.Results: Statistical test results before the treatment of both groups showed no difference (p>0,05) in each variable. Two months after the intervention, there were significant differensces in the mean score of knowledge (p=0,001), attitude (p=0,001), and VHWs self-efficacy (p=0,000) in both groups. VHW counseling skills (p=0,149) until the first month there was not a significant difference. Unexpectedly, in the second month, the VHW counseling skills could not be observed due to the global COVID-19 pandemic. The mean score of each group increased significantly, but the score of the treatment group was higher than the control group.Conclusions: A collaborative model is effective when compared to only providing booklets and leaflets in increasing VHW's knowledge, attitudes, and self-efficacy but not effective yet for VHW counseling skills.


2011 ◽  
Vol 2011 ◽  
pp. 1-6 ◽  
Author(s):  
Nicolaas P. Pronk ◽  
A. Lauren Crain ◽  
Jeffrey J. VanWormer ◽  
Brian C. Martinson ◽  
Jackie L. Boucher ◽  
...  

Objective.To determine the accuracy of self-reported body weight prior to and following a weight loss intervention including daily self-weighing among obese employees.Methods.As part of a 6-month randomized controlled trial including a no-treatment control group, an intervention group received a series of coaching calls, daily self-weighing, and interactive telemonitoring. The primary outcome variable was the absolute discrepancy between self-reported and measured body weight at baseline and at 6 months. We used general linear mixed model regression to estimate changes and differences between study groups over time.Results.At baseline, study participants underreported their weight by an average of 2.06 (se=0.33) lbs. The intervention group self-reported a smaller absolute body weight discrepancy at followup than the control group.Conclusions.The discrepancy between self-reported and measured body weight appears to be relatively small, may be improved through daily self-monitoring using immediate-feedback telehealth technology, and negligibly impacts change in body weight.


2019 ◽  
Vol 8 (2) ◽  
pp. 69
Author(s):  
Muhaiminah Akib ◽  
Dian Saputra

The purpose of this study was to investigate the effect of the dictogloss method in teaching listening to students' listening skills. This research was designed as a quasi-experimental. This study aims to investigate whether a material or treatment yields a different outcome for participants. There are two classes in this study, namely the experimental class (which is a sample to be treated with the dictogloss method) and the control class (using a method other than dictogloss). The results of this study are the results of data analysis showing that the results of learning skills in listening to the experimental group obtained the average value for the initial test of 60.33 and 71 for the final test score. While the control group using conventional methods has a mean value for the initial test of 60.1 and 70 for the final test. T test results also indicate that the significance value is 0,000. The significance value states smaller 0.05, it can be stated that Ha is accepted and Ho is rejected, which means that there is an influence of the dictogloss method in improving listening skills in students


2019 ◽  
Vol 144 (7) ◽  
pp. 883-887
Author(s):  
Christine G. Roth ◽  
William Huang ◽  
Navdeep Sekhon ◽  
Andrew Caruso ◽  
Doris Kung ◽  
...  

Context.— Current health care spending is unsustainable, and there is a need to teach high-value care principles to future physicians. Pathology-Teaches is an educational intervention designed to teach laboratory stewardship early in clinical training, at the level of the medical student in their core clinical clerkships. Objective.— To assess the pilot implementation of case-based educational modules in 5 required core clerkships at our institution. Design.— The online cases were developed by using a multidisciplinary approach. In the Pathology-Teaches educational module, students make decisions regarding the ordering or interpretation of laboratory testing within the context of a clinical scenario and receive immediate feedback during the case. The intervention was assessed by using pretest and posttest. Student feedback was also collected from end-of-rotation evaluations. Results.— A total of 203 students completed the Pathology-Teaches pilot, including 72 in Family Medicine, 72 in Emergency Medicine, 24 in Internal Medicine, 24 in Neurology, and 11 in Obstetrics-Gynecology (OB-GYN). Pathology-Teaches utility was demonstrated by significantly increased improvement between pretest and posttest scores (mean, 63.1% versus 83.5%; P &lt; .001; Hedge g effect size = 0.93). Of the 494 students who completed the Pathology-Teaches questions on the end-of-rotation evaluation, 251 provided specific feedback, with 38.6% (97 of 251) rating the activity as “extremely valuable” or “very valuable,” and 41.4% (104 of 251) as “some/moderate value.” Qualitative feedback included 17 positive comments with 6 requests to scale up or include more cases, 16 constructive comments for improvement mainly regarding the technical aspects, and 5 negative comments. Conclusions.— Pathology-Teaches effectively teaches stewardship concepts, and most students perceived value in this educational intervention.


2002 ◽  
Vol 20 (3) ◽  
pp. 765-769 ◽  
Author(s):  
Valerie Jenkins ◽  
Lesley Fallowfield

PURPOSE: To measure the psychosocial attitudes and beliefs of physicians working within oncology in the United Kingdom and to examine whether beliefs alter after communication skills training. Additionally, to investigate whether physicians’ attitudes are reflected in communication behaviors with patients during interviews. METHODS: Ninety-three physicians completed a 32-item Physician Psychosocial Belief (PPSB) questionnaire at baseline (T1) before randomization to attendance at a 3-day residential communication skills course (n = 48) or a control group (n = 45). Three months later (T2), both groups completed another PPSB and a self-assessment questionnaire recording perceived changes in communication with patients. At both time points, physicians’ consultations with two consenting patients were videotaped. Communication behaviors were measured using the Medical Interaction Processing System. RESULTS: Physicians who attended the course showed significantly improved attitudes and beliefs toward psychosocial issues compared with controls (P = .002). This improvement was reflected in the analysis of the videotaped recordings of their communication behaviors with patients. Expressions of empathy were more likely for the course group at T2 than the controls (P = .02), as were open questions (P = .001), appropriate responses to patient cues (P = .005), and psychosocial probing (P = .041). These objective findings were supported by physicians’ self report of changes in communication style during interviews with patients. CONCLUSION: Our results show that a communication skills training intervention using behavioral, cognitive, and affective components not only increases potentially beneficial and more effective interviewing styles but can also alter attitudes and beliefs, thus increasing the likelihood that such skills will be used in the clinical setting.


1993 ◽  
Vol 12 (3) ◽  
pp. 286-300 ◽  
Author(s):  
Mark Byra ◽  
Mary C. Marks

In the reciprocal style of teaching learners are paired, and as one practices the task, the other provides immediate feedback. This study examined the effect of pairing learners in the reciprocal style by ability (high, low, and mixed) and by companionship (friend and nonacquaintance) on provision of feedback and perceived comfort while learning motor skills. Thirty-two students between 9 and 12 years of age practiced soccer juggling during a 25-minute lesson and soccer dribbling during another 25-minute lesson, in both of which they were paired for similar versus different ability and for friend versus nonaquaintance. After each lesson, the students were asked how comfortable they felt giving and receiving feedback. The results showed that the observers gave specific feedback more frequently to friends than nonacquaintances, and that the doers felt more comfortable receiving feedback from friends than nonacquaintances. Learner ability level did not affect the amount of specific feedback provided by the observer or the doer comfort in receiving feedback. This study supports several claims set forth by Mosston and Ashworth (1986) for the reciprocal style of teaching.


2015 ◽  
Vol 8 (12) ◽  
pp. 56 ◽  
Author(s):  
Andi Tenri Ampa

<pre>One of the factors that may affect the success of the learning process is the use of learning media. Therefore, this research aimed to implement and evaluate the interactive multimedia learning materials using Wondershare Quizcreator program and audio materials in teaching 'English listening skills'. The research problem was whether or not there was a significant difference between the results of teaching listening skills through the interactive multimedia learning materials using Wondershare Quizcreator program and the results of teaching listening skills through audio materials. The earlier process used in the research was to produce new products to be implemented. The product had been validated by the experts and tried out to the college students to get their responses towards the validity and the practicality of the products. Furthermore, the products as new materials were implemented to the experimental group and the conventional materials (audio materials) were implemented to the control group. Pretest and posttest had ben conducted before implementation. The results of statistical analysis (SPSS) showed that there was no significant difference between the results of pretest of the two groups, but there was a significant difference between the results of post of experimental and control groups. It was proved that the t-cal. was greater than the t-table (5.583 &gt; 2.000) at df 70 and p.0.05. So, it was concluded that the interactive multimedia learning materials using Wondershare Quizcreator program were effective in teaching 'English listening skills'.</pre>


Sign in / Sign up

Export Citation Format

Share Document