Research on the impact evaluation of academic journals based on altmetrics and citation indicators

2019 ◽  
Vol 56 (1) ◽  
pp. 336-345 ◽  
Author(s):  
Rongying Zhao ◽  
Xu Wang ◽  
Zhuozhu Liu ◽  
Yongkang Qi ◽  
Zhaoyang Zhang ◽  
...  
Keyword(s):  
Impact Evaluation ◽  
Academic Journals ◽  
The Impact

Research on impact evaluation of academic journals from multidimensional perspective

2019 ◽  
Vol 38 (2) ◽  
pp. 458-478
Author(s):  
Rongying Zhao ◽  
Xu Wang
Keyword(s):  
Impact Evaluation ◽  
Indicator System ◽  
Three Dimensions ◽  
Societal Impact ◽  
Strong Positive Correlation ◽  
Academic Journals ◽  
Academic Impact ◽  
Content Type ◽  
Positive Correlations ◽  
The Impact

Purpose The purpose of this paper is to introduce altmetric indicators and combine with traditional citation indicators to comprehensively evaluate the impact of academic journals from the perspective of multidimensional and multi-indicator fusion. Design/methodology/approach The authors take international multidisciplinary journals as an example, combining 14 traditional citation indicators of academic journals and introducing 14 altmetric indicators to build a comprehensive evaluation model of the impact of academic journals (academic impact and societal impact). At the same time, the authors systematically construct a journal evaluation indicator system from three dimensions. Then, the indicators data of three dimensions are evaluated by normalized processing, correlation analysis, reliability and validity analysis, PCA and factor analysis. Findings Two-dimensional and three-dimensional analyses can exactly provide some useful information for academic journals’ location in the respective coordinate systems. There are strong positive correlations among the measured indicators in the three dimensions, and each indicator has a significant consistency between whole and internal. The correlation coefficient between FD1 and FD2 is 0.888 with a strong positive correlation. It shows that the traditional citation indicators provided by WoS and Scopus database are highly consistent, and they are comparable and alternative in evaluating the academic impact of journals. The correlation coefficients of FD1, FD2 with FD3 are 0.831 and 0.798. There are strong positive correlations among them, which indicate that the evaluation of journals’ societal impact based on altmetrics indicator can be considered as a potential supplement to academic impact evaluation based on citation and to reflect the multidimensional nature of journals impact in an immediate way. Originality/value Multidimensional and multi-indicator perspective evaluation can provide references for the selection of impact evaluation indicators and model optimization of academic journals, and also provide new ideas for improving the status of the impact evaluation of academic journals.

The Impact Evaluation of the Maryland Break the Cycle Initiative

2003 ◽  
Author(s):  
Adele Harrell ◽  
John Roman ◽  
Avinash Bhati ◽  
Barbara Parthasarathy
Keyword(s):  
Impact Evaluation ◽  
The Impact

The Impact of the Public Expenditure Cuts Policy on the Labor Market in Vietnam

2012 ◽  
pp. 22-46
Author(s):  
Huong Nguyen Thi Lan ◽  
Toan Pham Ngoc
Keyword(s):  
Labor Market ◽  
Computable General Equilibrium ◽  
Impact Evaluation ◽  
Public Expenditure ◽  
Computable General Equilibrium Model ◽  
Living Standard ◽  
Input Output ◽  
Policy Makers ◽  
The Public ◽  
The Impact

The purpose of this study is to evaluate the impact of public expenditure cuts on employment and income to support policies for the development of the labor mar- ket. Impact evaluation is of interest for policy makers as well as researchers. This paper presents a method – that is based on a Computable General Equilibrium model – to analyse the impact of the public expenditure cuts policy on employment and income in industries and occupations in Vietnam using macro data, the Input output table, 2006, 2008 and the 2010 Vietnam Household Living Standard Survey.

scholarly journals Implementing a digital health model of care in Australian youth mental health services: protocol for impact evaluation

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Sarah Piper ◽  
Tracey A. Davenport ◽  
Haley LaMonica ◽  
Antonia Ottavio ◽  
Frank Iorfino ◽  
...  
Keyword(s):  
Mental Health ◽  
Mental Health Services ◽  
Health Services ◽  
Impact Evaluation ◽  
Digital Health ◽  
Youth Mental Health ◽  
Model Of Care ◽  
Health Service Provision ◽  
Industrial Grade ◽  
The Impact

Abstract Background The World Economic Forum has recently highlighted substantial problems in mental health service provision and called for the rapid deployment of smarter, digitally-enhanced health services as a means to facilitate effective care coordination and address issues of demand. In mental health, the biggest enabler of digital solutions is the implementation of an effective model of care that is facilitated by integrated health information technologies (HITs); the latter ensuring the solution is easily accessible, scalable and sustainable. The University of Sydney’s Brain and Mind Centre (BMC) has developed an innovative digital health solution – delivered through the Youth Mental Health and Technology Program – which incorporates two components: 1) a highly personalised and measurement-based (data-driven) model of youth mental health care; and 2) an industrial grade HIT registered on the Australian Register of Therapeutic Goods. This paper describes a research protocol to evaluate the impact of implementing the BMC’s digital health solution into youth mental health services (i.e. headspace - a highly accessible, youth-friendly integrated service that responds to the mental health, physical health, alcohol or other substance use, and vocational concerns of young people aged 12 to 25 years) within urban and regional areas of Australia. Methods The digital health solution will be implemented into participating headspace centres using a naturalistic research design. Quantitative and qualitative data will be collected from headspace health professionals, service managers and administrators, as well as from lead agency and local Primary Health Network (PHN) staff, via service audits, Implementation Officer logs, online surveys, and semi-structured interviews, at baseline and then three-monthly intervals over the course of 12 months. Discussion At the time of publication, six headspace centres had been recruited to this study and had commenced implementation and impact evaluation. The first results are expected to be submitted for publication in 2021. This study will focus on the impact of implementing a digital health solution at both a service and staff level, and will evaluate digital readiness of service and staff adoption; quality, usability and acceptability of the solution by staff; staff self-reported clinical competency; overall impact on headspace centres as well as their lead agencies and local PHNs; and social return on investment.

scholarly journals Quantitative methods used to evaluate impact of health promotion interventions to prevent HIV infections: a methodological systematic review protocol

2021 ◽  
Author(s):  
Andrainolo Ravalihasy ◽  
Lidia Kardas-Sloma ◽  
Yazdan Yazdanpanah ◽  
Valéry Ridde
Keyword(s):  
Systematic Review ◽  
Health Promotion ◽  
Impact Evaluation ◽  
Quantitative Methods ◽  
Evaluation Studies ◽  
Complex Interventions ◽  
Hiv Infections ◽  
Combination Prevention ◽  
Health Promotion Interventions ◽  
The Impact

Abstract Background Combination prevention is currently considered the best approach to combat HIV epidemic. It is based upon the combination of structural, behavioral and biomedical interventions. Such interventions are frequently implemented in a health promoting manner due to their aims, the approach that was adopted and their complexity. The impact evaluation of these interventions often relies on methods inherited from the biomedical field. However, these methods have limitations and should be adapted to be relevant for these complex interventions. This systematic review aims to map the evidence-based methods used to quantify the impact of these interventions and analyze how these methods are implemented. Methods Three databases (Web of Science, Scopus, PubMed) will be used to identify impact evaluation studies of health promotion interventions that aimed at reducing the incidence or prevalence of HIV infection. Only studies based on quantitative design assessing intervention impact on HIV prevalence or incidence will be included. Two reviewers will independently screen studies based on titles and abstracts and then on the full text. The information about study characteristics will be extracted to understand the context in which the interventions are implemented. The information specific to quantitative methods of impact evaluation will be extracted using items from the Mixed Methods Appraisal Tool (MMAT), the guidelines for reporting Statistical Analyses and Methods in the Published Literature (SAMPL) and the guidelines for Strengthening The Reporting of Empirical Simulation Studies (STRESS). This review will be conducted according to the Preferred Reporting Items for Systematic Review and Meta-Analyses (PRISMA) statement. Discussion The impact evaluation of HIV prevention interventions is a matter of substantial importance given the growing need for evidence of the effectiveness of these interventions whereas they are increasingly complex. These evaluations allow to identify the most effective strategies to be implemented to fight the epidemic. It is therefore relevant to map the methods to better implement them and adapt them according to the type of intervention to be evaluated. Systematic review registration: PROSPERO CRD42020210825

scholarly journals Impact Evaluation of Raskin Program using Matching Method: Case of IFLS 5

JEJAK ◽  
2018 ◽  
Vol 11 (1) ◽  
pp. 207-223
Author(s):  
Endiarjati Dewandaru Sadono
Keyword(s):  
Propensity Score ◽  
Propensity Score Matching ◽  
Family Life ◽  
Household Income ◽  
Impact Evaluation ◽  
Matching Method ◽  
Indonesia Family Life Survey ◽  
Small Benefit ◽  
Using Data ◽  
The Impact

Beras untuk Keluarga Miskin (RASKIN) program has been applied since 1998 and has been renamed as Beras Sejahtera (RASTRA) in early 2017, but their effectiveness is still debatable. This study tries to evaluate the impact of RASKIN program on household income. Using data from 3,745 households in Indonesia Family Life Survey (IFLS) 5 that has been estimated using propensity score matching, this study has identified precisely that RASKIN program has a negative and significant effect on household income. This happens because the benefits that reveived by Rumah Tangga Sasaran (RTS) are very small. The small benefit is affected by the amount of rice received, frequency and price that have been paid to get RASKIN is not in accordance with the guidelines. The result of this study is along with previous studies, where the amount and price of rice that distributed through RASKIN program is not exactly correct. Therefore, there must be a change in program format, not just renaming from RASKIN to RASTRA only.

scholarly journals Addressing Impact Evaluation Gaps in Belt and Road Initiative Projects in Africa: The Standard Gauge Railway Project in Kenya as a Proof of Concept

2020 ◽  
pp. 1-38
Author(s):  
Keren Zhu ◽  
Rafiq Dossani ◽  
Jennifer Bouey
Keyword(s):  
Impact Evaluation ◽  
Comprehensive Evaluation ◽  
Stakeholder Participation ◽  
Social Benefit ◽  
Evaluation Framework ◽  
Systematic Evaluation ◽  
Belt And Road Initiative ◽  
Proof Of Concept ◽  
Belt And Road ◽  
The Impact

Abstract The impact of the Belt and Road Initiative (BRI) to global development will be unprecedented and significant, and developmental impact evaluation is therefore central to understanding BRI projects and making informed decisions. Compared with evaluations of individual projects and programs, evaluation of large and mega infrastructure projects under the BRI is particularly challenging and complex in integrating stakeholder objectives, accounting for social benefit and costs, and tracking long-term project impact. In this paper, we summarize the key drawbacks of existing BRI evaluation frameworks, propose a systematic evaluation framework elicitation method based on the inputs from BRI subject matter experts and verified through stakeholder participation, and apply an interim evaluation framework in understanding the Mombasa-Nairobi Standard Gauge Railway project in Kenya, as a proof of concept of a comprehensive evaluation framework. In doing so, we seek to provide a tool for BRI decision makers and stakeholders to assess these projects holistically at planning, construction and operation stages.

scholarly journals An Evaluation of Community Outreach Services of Emilio Aguinaldo College – Cavite: Towards a Five-Year Development Plan

2019 ◽  
Vol 2 (4) ◽  
pp. 13-26
Author(s):  
Iaris Alagon ◽  
Ethel Reyes-Chua
Keyword(s):  
Impact Evaluation ◽  
Community Outreach ◽  
Community Services ◽  
Development Plan ◽  
The Sustainable Development ◽  
Outreach Programs ◽  
Evaluation Approach ◽  
Qualitative Descriptive ◽  
To Come ◽  
The Impact

Conducting community services is about building rapport, relationship, and linkages to the community.  Since service is one of the core values of EAC-Cavite, it is very significant that the neighboring community shall benefit from the community outreach programs conducted by its various schools or departments.   This study focuses on the evaluation of the outreach programs of EAC-Cavite in Bgry. San Agustin, Dasmarinas, Cavite. It uses the qualitative-descriptive method of research utilizing the survey questionnaire, observation, and impact evaluation approach.  The results of the study revealed that 48% of the respondents were very satisfied, 33% were satisfied, and 6% were somewhat satisfied in the programs.  On the other hand, there were also some problems encountered by the proponents during the actual conduct of these programs, thus, these inspired the researchers to come up with a 5-year development plan to improve the services and its program of activities. It is therefore recommended to continue to move on and reach out for the sustainable development of the community focusing more on the areas of education, health, environment, and socio-economic development. Finally, every program should be evaluated immediately to find out its strengths and weaknesses and to address all the problems encountered before, during, and after the activity using the impact evaluation approach.

scholarly journals Women's Empowerment in the Philippines: Impact evaluation of the ‘BASIC START’ project

2021 ◽  
Author(s):  
Jaynie Vonk
Keyword(s):  
Impact Evaluation ◽  
Experimental Approach ◽  
Positive Impact ◽  
Women's Empowerment ◽  
The Philippines ◽  
Women’S Empowerment ◽  
Autonomous Region ◽  
Full Report ◽  
Quasi Experimental ◽  
The Impact

This evaluation is presented as part of the Effectiveness Review Series 2018/19 on women’s empowerment. The BASIC START (Building Autonomous and Stable Institutions and Communities through Socially Cohesive, Transparent, Accountable and Responsive Transition) in the Bangsamoro' project was carried out in the Autonomous Region in Muslim Mindanao (ARMM) in the Philippines between April 2015 and August 2017, by Oxfam together with four implementing partners: Al Mujadilah Development Foundation (AMDF), United Youth of the Philippines Women (UnYPhil-Women), Tarbilang Foundation, and Women Engaged in Action on 1325 (WE Act 1325). The project aimed to promote women's empowerment and peacebuilding in the region. A quasi-experimental approach was used to assess the impact of the project activities in strengthening women’s empowerment. The evaluation used Oxfam's Women's Empowerment (WE) index. Overall, the evaluation found that the BASIC START project had a positive impact on Women's Empowerment in all three levels investigated – personal, relational and environmental. Find out more by reading the evaluation brief or the full report.

scholarly journals EFEITOS DO PROGRAMA TERRITÓRIOS DA CIDADANIA SOBRE INDICADORES ECONÔMICOS E SOCIAIS DOS MUNICÍPIOS DE MG: uma abordagem de mensuração com métodos de pareamento

2016 ◽  
Vol 19 (2) ◽  
pp. 551
Author(s):  
Henrique Dantas Neder ◽  
Tiago Camarinha Lopes
Keyword(s):  
Propensity Score ◽  
Propensity Score Matching ◽  
Impact Evaluation ◽  
Minas Gerais ◽  
Territorial Development ◽  
Impact Measurement ◽  
Estimation Model ◽  
Matching Method ◽  
Government Programs ◽  
The Impact

Resumo: O artigo tem o objetivo de medir o efeito do Programa Territórios da Cidadania no Estado de Minas Gerais, com um modelo de estimação com base no método Propensity Score Matching (PSM). Assim, analisa os problemas de medição de impacto do programa, de forma didática, com o propósito de apresentar a metodologia de avaliação de programas governamentais baseada no pareamento de indivíduos com características semelhantes. Conclui que existem evidências de que no período de vigência do programa, os indicadores de aumento do produto da agropecuária foram afetados positivamente, em termos causais, pelo programa Territórios da Cidadania.Palavras-chave: Desenvolvimento territorial, avaliação de políticas públicas, métodos de pareamento, avaliação de impactos. TERRITORIAL PROGRAMS EFFECTS OF CITIZENSHIP ON SOCIAL AND ECONOMIC INDICATORS OF MG CITIES: an measuring approach with pairing methods Abstract: The paper has the objective of measuring the impact of the Brazilian governmental with a program called Territórios da Cidadania in the state of Minas Gerais. An estimation model was constructed on the basis of the Propensity Score Matching method (PSM). Thus, analyzes the program's impact measurement problems in a didactic way, in order to present the methodology for evaluating government programs based on the pairing of individuals with similar characteristics. Concludes there are evidences that for the period analyzed, the indicators of rural product were positively affected by the program.Key words: Territorial development, public policies evaluation, pairing methods, impact evaluation.

Sign in / Sign up

Export Citation Format

Share Document