Developing and validating a self-assessment tool for health promotion competencies with training participants in Austria

Author(s):  
Gert Lang

Abstract A key objective of health promotion capacity building and professional development programmes is to enhance competencies in the workforce or training participants. The goal of this study was to investigate and validate the psychometric properties of a recently developed self-assessment tool, based on ‘The CompHP core competencies framework for health promotion’, to establish whether it is suitable for evaluating training. The tool was employed in 2018 to evaluate two different programmes, with 584 participants submitting their assessment and evaluation of 77 different health promotion training courses in a paper and pencil questionnaire. Longitudinal data were available for 148 participants in the programme for workplace health promotion because they completed an online questionnaire beforehand. The reliability and validity of the assessment tool were tested in several confirmatory factor analyses and structural equation models. Structurally, there was a significant increase in health promotion competencies when comparing measurements before and after training. Furthermore, participants were shown to have different levels of competencies due to their prior knowledge, the format of the course or the professional development programme attended but not based on gender, age or sector. The results justify the creation of an overall scale to assess core health promotion competencies that are suitable for evaluating training courses. However, various methodological issues need to be considered in future applications including decisions about the design of the study (e.g. pre–post test, control groups), type of measurements (e.g. general and specific instrument, background information) and depth of analysis (e.g. confirmatory model and invariance testing).

2020 ◽  
Vol 30 (Supplement_5) ◽  
Author(s):  
G Lang

Abstract Background High quality health promotion (HP) depends on a competent workforce for which professional development programmes for practitioners are essential. The “CompHP Core Competencies Framework in HP” defines crucial competency domains but a recent review concluded that the implementation and use of the framework is lacking. The aim was to develop and validate a self-assessment tool for HP competencies, which should help evaluate training courses. Methods A brief self-assessment tool was employed in 2018 in Austria. 584 participants of 77 training courses submitted their post-course assessment (paper-pencil, RR = 78.1%). In addition, longitudinal data are available for 148 participants who filled in a pre-course online questionnaire. Measurement reliability and validity was tested by single factor, bifactor, multigroup, and multilevel CFA. A SEM proved for predictive and concurrent validity, controlling gender and age. Results A bifactor model (X2/df=3.69, RMSEA=.07, CFI=.95, sRMR=.07) showed superior results with a strong general CompHP factor (FL>.65, wH=.90, ECV=.85), configurally invariant for two training programmes. On course level, there was only minimal variance between trainings (ICC<.08). Structurally, there was a significant increase in HP competencies when comparing pre- and post-course measurements (b=.33, p<.01). Participants showed different levels of competencies due to prior knowledge (b=.38, p<.001) and course format (b=.16, p<.06). The total scale had good properties (m = 49.8, sd = 10.3, 95%-CI: 49.0-50.7) and discriminated between groups (eg by training length). Conclusions The results justify the creation of an overall scale to assess core HP competencies. It is recommended to use the scale for evaluating training courses. The work compensates for the lack of empirical studies on the CompHP concept and facilitates a broader empirical application of a uniform competency framework for HP in accordance with international standards in HP and public health. Key messages The self-assessment tool provides a good and compact foundation for assessing HP competencies. It provides a basis for holistic, high quality and sustainable capacity building or development in HP.


2018 ◽  
Vol 8 (3) ◽  
pp. 59
Author(s):  
Malte Gregorzewski ◽  
Michael Schratz ◽  
Christian Wiesner

This paper introduces the innovative model FieldTransFormation360 and its aim to help educational leaders in assessing their personal mastery. Moreover, it presents empirical findings from its first exploratory applicationin an Austrian leadership framework. In a first conceptual part, the theoretical underpinnings and the context of the origin of the model are outlined with reference to similar approaches in the area of school leadership. In the following part, the application of the model is introduced through the explanation of the methodology and how the model is turned into a self-assessment instrument. Insights into the results of its exploratoryapplication in the Austrian Leadership Academy are presented in the empirical part. Its first application serves as the consolidation and validation of FieldTransFormation360 as a meaningful self-assessment tool for the professional development of school leaders. The results of the exploratory approach with participants in the Austrian Leadership Academy suggest that the model and its instrument can be regarded as a robust assessment tool for the development of a deeper understanding about the transformative power through personal and professional development in the lived experience of educational leadership.


2018 ◽  
Vol 72 (11) ◽  
pp. 1059-1063 ◽  
Author(s):  
Brian G Southwell ◽  
Milton Eder ◽  
John Finnegan ◽  
Alan T Hirsch ◽  
Russell V Luepker ◽  
...  

BackgroundLiterature on health promotion evaluation and public understanding of health suggests the importance of investigating behaviour over time in conjunction with information environment trends as a way of understanding programme impact. We analysed population response to online promotion of an educational tool built by the Ask About Aspirin campaign in the USA to inform people about aspirin as a preventive aid.MethodsWe collected 156 weeks of time series data on audience behaviour, namely use of a self-assessment tool. We then used the Autoregressive Integrated Moving Average (ARIMA) modelling to predict that outcome as a function of paid search engine advertising, paid social media promotion and general search interest in aspirin.ResultsThrough ARIMA modelling of tool engagement data adjusted for outcome series autocorrelation, we found a significant effect of online promotional effort on audience behaviour. Total paid search advertising positively predicted weekly total of individuals who started using the self-assessment tool, coefficient=0.023, t=3.28, p=0.001. This effect did not appear to be an artefact of broader secular trends, as Google search data on the topic of aspirin use did not add explanatory power in the final model nor did controlling for general search interest eliminate the significant coefficient for paid search promotion.ConclusionResults hold implications both for educational tool development and for understanding health promotion campaign effects. We witnessed substantial but ephemeral effects on tool use as a function of paid search efforts, suggesting prioritisation of efforts to affect search engine results as a dissemination tactic.


2002 ◽  
Vol 3 (4) ◽  
pp. 16-20
Author(s):  
L Tew ◽  
D King ◽  
L Moore ◽  
D Meyers

T his article aims to provide the reader with an example of using the professional core competencies for infection control nurses, together with the self-assessment tool, to provide a framework for the development of a trainee infection control nurse using the opportunities for work-based learning that present themselves as an integral part of this clinical nurse specialist role. The development of the competencies, the educational context and the practical application of this model are described.


2019 ◽  
Vol 34 (2) ◽  
pp. 142-149
Author(s):  
GracieLee M. Weaver ◽  
Daniel L. Bibeau ◽  
Kelly Rulison ◽  
Jeremy Bray ◽  
William N. Dudley ◽  
...  

Purpose: To examine changes in organizations’ workplace health promotion (WHP) initiatives over time associated with repeated self-assessment using the Well Workplace Checklist (WWC). Design: Well Workplace Checklist data include a convenience sample of US organizations that selected to assess their performance against quality WHP benchmarks. Setting: Workplaces. Subjects: In total, 577 US organizations completed the WWC in 2 or more years from 2008 to 2015. Measures: The WWC is a 100-item organizational assessment that measures performance against the original set of quality benchmarks that were established by the Wellness Council of America (WELCOA). Analysis: This study examined changes in overall WWC scores as well as 7 separate benchmark scores. Multilevel modeling was used to examine changes in scores associated with repeated assessments, controlling for the year of assessment and organizational characteristics. Results: There were significant increases in overall WWC scores (β = 2.93, P < .001) associated with the repeated WWC assessments, after controlling for organizational characteristics. All 7 benchmark scores had significant increases associated with reassessment. Compared to other benchmarks, operating plan (β = 6.18, P < .001) and evaluation (β = 4.91, P < .001) scores increased more with each reassessment. Conclusion: Continued reassessment may represent more commitment to and investment in WHP initiatives which could lead to improved quality. Other factors that may positively influence changes in performance against benchmarks include company size, access to outside resources for WHP, and a history with implementing WHP.


2018 ◽  
Vol 20 (1) ◽  
pp. 75
Author(s):  
Ursula Trummer ◽  
Sonja Novak-Zezula

The current research note describes a process where by applying the qualitative method of expert interviews, researchers got confronted with a new topic in their area of expertise that was not on the radar of their research. In the framework of an evaluation study on health promotion interventions for migrants in an urban setting, researchers applied a mixed methods approach. Quantitative element was a self-assessment tool, where providers of health promotion measures described their clientele and rated the quality of their services along given categories. Qualitative element was a series of semi-structured interviews with management and front line service providers. While the self-assessment tool delivered expected results, the interviews revealed an aspect concerning needs and problems of a migrant group researchers had not thought of before. This is the group of immigrants from the 1960ies, coming mainly from Turkey and Former Yugoslavia, now reaching or having reached retirement age. This group was reported as being extremely vulnerable and at risk of a double discrimination as being “old” and “migrant”. Desk research was conducted in reaction to such data, showing that information on this group is scarce. Given the demographic developments with rising shares of (old) aged immigrants living in Austria, it will be important to improve the respective knowledge base.


2014 ◽  
Vol 2014 ◽  
pp. 1-8 ◽  
Author(s):  
Kari Slåtten ◽  
Ove Hatlevik ◽  
Lisbeth Fagerström

Competence can be seen as a prerequisite for high quality nursing in clinical settings. Few research studies have focused on nurses’ core competencies in clinical palliative care and few measurement tools have been developed to explore these core competencies. The purpose of this study was to test and validate the nurses’ core competence in palliative care (NCPC) instrument. A total of 122 clinical nurse specialists who had completed a postbachelor program in palliative care at two university colleges in Norway answered the questionnaire. The initial analysis, with structural equation modelling, was run in Mplus 7. A modified confirmatory factor analysis revealed the following five domains: knowledge in symptom management, systematic use of the Edmonton symptom assessment system, teamwork skills, interpersonal skills, and life closure skills. The actual instrument needs to be tested in a practice setting with a larger sample to confirm its usefulness. The instrument has the potential to be used to refine clinical competence in palliative care and be used for the training and evaluation of palliative care nurses.


Author(s):  
Ying-Wei Wang ◽  
Shu-Li Chia ◽  
Chien-Ming Chou ◽  
Michael S. Chen ◽  
Jürgen M. Pelikan ◽  
...  

The Health Promotion Administration of Taiwan launched an integrative certification initiative in 2016 to streamline a plural system of certifications of health promotion in hospitals. It endeavored to replace original certifications, thereby establishing the proposal of a self-assessment instrument to aid in this integration. This study aimed to verify the robustness of this self-assessment tool by conducting exploratory factor analyses through stratification, reliability tests, content and construct validity tests, and specialist evaluations, which were convened to judge the comprehensibility, applicability, and importance of the standards and measures of this tool. A stratified random sampling of 46 hospitals was performed to confirm the validity of this tool. The tool rendered a floor effect of 0% and a ceiling effect of 13%. A valid factor structure and internal consistency (α ranged from 0.88 to 0.96) in each standard were verified. Hospitals with previous certificates or with 300+ beds achieved high compliance scores. A majority of experts agreed that the sub-standards were comprehensible (≥80%), applicable (≥70%), and important (≥70%). Finally, we conclude that the self-assessment tool is valid and can serve as a reference for other countries with hospitals committed to health promotion in hospital settings.


Sign in / Sign up

Export Citation Format

Share Document