Tablet-based apps for phonics and phonological awareness: Protocol for an evidence-based appraisal of quality and perceived therapeutic benefit (Preprint)

Mapping Intimacies ◽

10.2196/preprints.23921 ◽

2020 ◽

Author(s):

Lisa Furlong ◽

Tanya Serry ◽

Shane Erickson ◽

Meg Morris

Keyword(s):

Phonological Awareness ◽

Mobile Apps ◽

Data Extraction ◽

Reading Difficulties ◽

Therapeutic Benefit ◽

Evidence Based ◽

Quality Appraisal ◽

App Store ◽

Meta Analyses ◽

Google Play

BACKGROUND The use of mobile applications (apps) to manage and promote health is becoming increasingly popular. Mobile apps are gaining particular popularity in education and intervention settings due to their perceived advantages for supporting and engaging individuals with reading difficulties. In the context of the COVID-19 pandemic, the need for technology-based tools has been even greater. For practitioners and educators wishing to use apps in their practice or recommend apps for use by individuals with reading difficulties, the challenge lies in being able to locate high quality and therapeutically beneficial apps in the app stores. OBJECTIVE This protocol describes a systematic search, selection and appraisal process for mobile apps targeting phonics knowledge and phonological awareness skills. The aims are to: 1) provide a systematic method for identifying mobile apps targeting phonics knowledge and phonological awareness skills in the Google Play Store and App Store and; 2) to describe an evidence-based approach for quality appraisal of mobile apps for phonics knowledge and phonological awareness skills using structured and validated tools. METHODS This protocol describes an evidence-based method drawing on the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) to systematically search, select and appraise mobile apps targeting phonics knowledge and phonological awareness skills in the two largest app stores; Google play and Apple's App store. A systematic and comprehensive search process is described and a two-step process to screening is outlined: 1) broad screening (app titles) and; 2) narrow screening (marketing descriptions). This protocol describes a systematic approach to quality appraisal of mobile apps targeting phonics knowledge and phonological awareness skills using structured and validated quality appraisal tools. RESULTS This search strategy will enable identification of the number of apps available on the iOS and Android platforms targeting phonics knowledge and phonological awareness skills. It describes a process of systematically appraising the quality of these apps including the perceived therapeutic benefit of using these apps in relation to phonics knowledge and phonological awareness skills. Searching of Google Play and the App Store is planned for October 2020 with broad and focussed screening to commence from November 2020. Data extraction and quality appraisal is anticipated to commence in December 2020. CONCLUSIONS This method provides the basis for locating and evaluating mobile apps targeting phonics and phonological awareness skills. Amidst a plethora of available apps, this will support practitioners, educators and families to make informed decisions when purchasing apps for therapeutic use. CLINICALTRIAL N/A

Download Full-text

Tablet-Based Apps for Phonics and Phonological Awareness: Protocol for Evidence-Based Appraisal of Content, Quality, and Usability

JMIR Research Protocols ◽

10.2196/23921 ◽

2021 ◽

Vol 10 (2) ◽

pp. e23921

Author(s):

Lisa Furlong ◽

Tanya Serry ◽

Shane Erickson ◽

Meg E Morris

Keyword(s):

Phonological Awareness ◽

Rating Scale ◽

Mobile Apps ◽

Reading Difficulties ◽

Evidence Based ◽

Quality Appraisal ◽

Content Quality ◽

App Store ◽

Tablet Apps ◽

Google Play

Background The use of mobile apps to manage and promote health is becoming increasingly popular. Mobile apps are gaining popularity particularly in educational and interventional settings owing to their perceived advantages including support for and engagement of individuals with reading difficulties. In the context of COVID-19, the need for technology-based tools has increased. For practitioners and educators who wish to use apps in their practice or recommend apps to individuals with reading difficulties, it is challenging to identify high-quality apps in app stores. Objective This protocol describes a systematic search, selection, and appraisal process for tablet apps targeting phonics knowledge and phonological awareness skills. This protocol aimed to (1) provide a systematic method for identifying tablet apps targeting phonics knowledge and phonological awareness skills in the Google Play Store and Apple’s App Store and (2) describe an evidence-based approach for quality appraisal of these apps by using structured tools. Methods This protocol describes an evidence-based method guided by the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) framework to systematically search, select, and appraise apps targeting phonics knowledge and phonological awareness skills, present in Google Play and the App Store. We intend to perform a systematic and comprehensive search and a 2-step process for screening: (1) broad screening (app titles) and (2) narrow screening (marketing descriptions). Quality appraisal of the included apps will involve two structured appraisal tools: (1) the Mobile Application Rating Scale and (2) the Appraising Apps for Reading Checklist. Results This method will help determine the number of apps targeting phonics knowledge and phonological awareness, present on the Android and iOS platforms. The content, quality, and usability of these apps will be determined using structured appraisal tools. We have planned to conduct searches on Google Play and the App Store in January-March 2021; broad and focused screening, from April 2021; and data extraction and quality appraisal in October 2021. Conclusions This protocol provides a basis for locating and evaluating apps targeting phonics knowledge and phonological awareness skills. This protocol will support practitioners, educators, and families to make informed decisions when purchasing apps for instructional use. International Registered Report Identifier (IRRID) PRR1-10.2196/23921

Download Full-text

Mobile Apps for Speech-Language Therapy in Adults With Communication Disorders: Review of Content and Quality

JMIR mhealth and uhealth ◽

10.2196/18858 ◽

2020 ◽

Vol 8 (10) ◽

pp. e18858

Author(s):

Atiyeh Vaezipour ◽

Jessica Campbell ◽

Deborah Theodoros ◽

Trevor Russell

Keyword(s):

Rating Scale ◽

Mobile Apps ◽

Communication Disorders ◽

Mobile App ◽

Evidence Based ◽

Language Therapy ◽

Eligibility Criteria ◽

App Store ◽

Google Play

Background Worldwide, more than 75% of people with acquired brain injury (ABI) experience communication disorders. Communication disorders are impairments in the ability to communicate effectively, that is, sending, receiving, processing, and comprehending verbal and nonverbal concepts and symbols. Such disorders may have enduring impacts on employment, social participation, and quality of life. Technology-enabled interventions such as mobile apps have the potential to increase the reach of speech-language therapy to treat communication disorders. However, ensuring that apps are evidence-based and of high quality is critical for facilitating safe and effective treatment for adults with communication disorders. Objective The aim of this review is to identify mobile apps that are currently widely available to adults with communication disorders for speech-language therapy and to assess their content and quality using the validated Mobile App Rating Scale (MARS). Methods Google Play Store, Apple App Store, and webpages were searched to identify mobile apps for speech-language therapy. Apps were included in the review if they were designed for the treatment of adult communication disorders after ABI, were in English, and were either free or for purchase. Certified speech-language pathologists used the MARS to assess the quality of the apps. Results From a total of 2680 apps identified from Google Play Store, Apple App Store, and web searches, 2.61% (70/2680) apps met the eligibility criteria for inclusion. Overall, 61% (43/70) were available for download on the iPhone Operating System (iOS) platform, 20% (14/70) on the Android platform, and 19% (13/70) on both iOS and Android platforms. A content analysis of the apps revealed 43 apps for language, 17 apps for speech, 8 apps for cognitive communication, 6 apps for voice, and 5 apps for oromotor function or numeracy. The overall MARS mean score was 3.7 out of 5, SD 0.6, ranging between 2.1 and 4.5, with functionality being the highest-scored subscale (4.3, SD 0.6), followed by aesthetics (3.8, SD 0.8), information (3.4, SD 0.6), and engagement (3.3, SD 0.6). The top 5 apps were Naming Therapy (4.6/5), Speech Flipbook Standard (4.6/5), Number Therapy (4.5/5), Answering Therapy, and Constant Therapy (4.4/5). Conclusions To our knowledge, this is the first study to systematically identify and evaluate a broad range of mobile apps for speech-language therapy for adults with communication disorders after sustaining ABI. We found a lack of interactive and engaging elements in the apps, a critical factor in sustaining self-managed speech-language therapy. More evidence-based apps with a focus on human factors, user experience, and a patient-led design approach are required to enhance effectiveness and long-term use.

Download Full-text

Mobile Apps for Speech-Language Therapy in Adults With Communication Disorders: Review of Content and Quality (Preprint)

10.2196/preprints.18858 ◽

2020 ◽

Author(s):

Atiyeh Vaezipour ◽

Jessica Campbell ◽

Deborah Theodoros ◽

Trevor Russell

Keyword(s):

Rating Scale ◽

Mobile Apps ◽

Communication Disorders ◽

Mobile App ◽

Evidence Based ◽

Language Therapy ◽

Eligibility Criteria ◽

App Store ◽

Google Play

BACKGROUND Worldwide, more than 75% of people with acquired brain injury (ABI) experience communication disorders. Communication disorders are impairments in the ability to communicate effectively, that is, sending, receiving, processing, and comprehending verbal and nonverbal concepts and symbols. Such disorders may have enduring impacts on employment, social participation, and quality of life. Technology-enabled interventions such as mobile apps have the potential to increase the reach of speech-language therapy to treat communication disorders. However, ensuring that apps are evidence-based and of high quality is critical for facilitating safe and effective treatment for adults with communication disorders. OBJECTIVE The aim of this review is to identify mobile apps that are currently widely available to adults with communication disorders for speech-language therapy and to assess their content and quality using the validated Mobile App Rating Scale (MARS). METHODS Google Play Store, Apple App Store, and webpages were searched to identify mobile apps for speech-language therapy. Apps were included in the review if they were designed for the treatment of adult communication disorders after ABI, were in English, and were either free or for purchase. Certified speech-language pathologists used the MARS to assess the quality of the apps. RESULTS From a total of 2680 apps identified from Google Play Store, Apple App Store, and web searches, 2.61% (70/2680) apps met the eligibility criteria for inclusion. Overall, 61% (43/70) were available for download on the iPhone Operating System (iOS) platform, 20% (14/70) on the Android platform, and 19% (13/70) on both iOS and Android platforms. A content analysis of the apps revealed 43 apps for language, 17 apps for speech, 8 apps for cognitive communication, 6 apps for voice, and 5 apps for oromotor function or numeracy. The overall MARS mean score was 3.7 out of 5, SD 0.6, ranging between 2.1 and 4.5, with functionality being the highest-scored subscale (4.3, SD 0.6), followed by aesthetics (3.8, SD 0.8), information (3.4, SD 0.6), and engagement (3.3, SD 0.6). The top 5 apps were Naming Therapy (4.6/5), Speech Flipbook Standard (4.6/5), Number Therapy (4.5/5), Answering Therapy, and Constant Therapy (4.4/5). CONCLUSIONS To our knowledge, this is the first study to systematically identify and evaluate a broad range of mobile apps for speech-language therapy for adults with communication disorders after sustaining ABI. We found a lack of interactive and engaging elements in the apps, a critical factor in sustaining self-managed speech-language therapy. More evidence-based apps with a focus on human factors, user experience, and a patient-led design approach are required to enhance effectiveness and long-term use.

Download Full-text

Correction: Mobile Apps for Speech-Language Therapy in Adults With Communication Disorders: Review of Content and Quality (Preprint)

10.2196/preprints.26309 ◽

2020 ◽

Author(s):

Atiyeh Vaezipour ◽

Jessica Campbell ◽

Deborah Theodoros ◽

Trevor Russell

Keyword(s):

Rating Scale ◽

Mobile Apps ◽

Communication Disorders ◽

Mobile App ◽

Evidence Based ◽

Language Therapy ◽

Eligibility Criteria ◽

App Store ◽

Google Play

UNSTRUCTURED Worldwide, more than 75% of people with acquired brain injury (ABI) experience communication disorders. Communication disorders are impairments in the ability to communicate effectively, that is, sending, receiving, processing, and comprehending verbal and nonverbal concepts and symbols. Such disorders may have enduring impacts on employment, social participation, and quality of life. Technology-enabled interventions such as mobile apps have the potential to increase the reach of speech-language therapy to treat communication disorders. However, ensuring that apps are evidence-based and of high quality is critical for facilitating safe and effective treatment for adults with communication disorders. The aim of this review is to identify mobile apps that are currently widely available to adults with communication disorders for speech-language therapy and to assess their content and quality using the validated Mobile App Rating Scale(MARS). Google Play Store, Apple App Store, and webpages were searched to identify mobile apps for speech-language therapy. Apps were included in the review if they were designed for the treatment of adult communication disorders after ABI, were in English, and were either free or for purchase. Certified speech-language pathologists used the MARS to assess the quality of the apps. From a total of 2680 apps identified from Google Play Store, Apple App Store, and web searches, 2.61% (70/2680) apps met the eligibility criteria for inclusion. Overall, 61% (43/70) were available for download on the iPhone Operating System (iOS) platform, 20% (14/70) on the Android platform, and 19% (13/70) on both iOS and Android platforms. A content analysis of the apps revealed 43 apps for language, 17 apps for speech, 8 apps for cognitive communication, 6 apps for voice, and 5 apps for oromotor function or numeracy. The overall MARS mean score was 3.7 out of 5, SD 0.6, ranging between 2.1 and 4.5, with functionality being the highest-scored subscale (4.3, SD 0.6), followed by aesthetics (3.8, SD 0.8), information (3.4, SD 0.6), and engagement (3.3, SD 0.6). The top 5 apps were Naming Therapy (4.6/5), Speech Flipbook Standard (4.6/5), Number Therapy(4.5/5), Answering Therapy, and Constant Therapy (4.4/5). To our knowledge, this is the first study to systematically identify and evaluate a broad range of mobile apps for speech-language therapy for adults with communication disorders after sustaining ABI. We found a lack of interactive and engaging elements in the apps, a critical factor in sustaining self-managed speech-language therapy. More evidence-based apps with a focus on human factors, user experience, and a patient-led design approach are required to enhance effectiveness and long-term use.

Download Full-text

Mobile Applications for Health Management of Older Adults: A Scoping Review (Preprint)

10.2196/preprints.22823 ◽

2020 ◽

Author(s):

Nurul Asilah Ahmad ◽

Shahrul Azman Mohd Noah ◽

Arimi Fitri Mat Ludin ◽

Suzana Shahar ◽

Noorlaili Mohd Tohit

Keyword(s):

Older Adults ◽

Goal Setting ◽

Mobile Applications ◽

Health Management ◽

Mobile Apps ◽

Personalized Feedback ◽

Self Monitoring ◽

App Store ◽

Evidenced Based ◽

Google Play

BACKGROUND Currently, the use of smartphones to deliver health-related content has experienced a rapid growth, with more than 165,000 mobile health (mHealth) applications currently available in the digital marketplace such as iOS store and Google Play. Among these, there are several mobile applications (mobile apps) that offer tools for disease prevention and management among older generations. These mobile apps could potentially promote health behaviors which will reduce or delay the onset of disease. However, no review to date that has focused on the app marketplace specific for older adults and little is known regarding its evidence-based quality towards the health of older adults. OBJECTIVE The aim of this review was to characterize and critically appraise the content and functionality of mobile apps that focuses on health management and/or healthy lifestyle among older adults. METHODS An electronic search was conducted between May 2019 to December 2019 of the official app store for two major smartphone operating systems: iPhone operating system (iTunes App Store) and Android (Google Play Store). Stores were searched separately using predetermined search terms. Two authors screened apps based on information provided in the app description. Metadata from all included apps were abstracted into a standard assessment criteria form. Evidenced based strategies and health care expert involvement of included apps was assessed. Evidenced based strategies included: self-monitoring, goal setting, physical activity support, healthy eating support, weight and/or health assessment, personalized feedback, motivational strategies, cognitive training and social support. Two authors verified the data with reference to the apps and downloaded app themselves. RESULTS A total of 16 apps met the inclusion criteria. Six out of 16 (37.5%) apps were designed exclusively for the iOS platform while ten out of 16 (62.5%) were designed for Android platform exclusively. Physical activity component was the most common feature offered in all the apps (9/16, 56.3%) and followed by cognitive training (8/16, 50.0%). Diet/nutrition (0/16, 0%) feature, however, was not offered on all reviewed mobile apps. Of reviewed apps, 56.3% (9/16) provide education, 37.5% (6/16) provide self-monitoring features, 18.8% (3/16) provide goal setting features, 18.5% (3/16) provide personalized feedback, 6.3% (1/16) provide social support and none of the reviewed apps offers heart rate monitoring and reminder features to the users. CONCLUSIONS All reviewed mobile apps for older adults in managing health did not focused on diet/nutrition component, lack of functional components and lack of health care professional involvement in their development process. There is also a need to carry out scientific testing prior to the development of the app to ensure cost effective and its health benefits to older adults. Collaborative efforts between developers, researchers, health professionals and patients are needed in developing evidence-based, high quality mobile apps in managing health prior they are made available in the app store.

Download Full-text

Mobile Health Apps for Medical Emergencies: Systematic Review

JMIR mhealth and uhealth ◽

10.2196/18513 ◽

2020 ◽

Vol 8 (12) ◽

pp. e18513

Author(s):

Alejandro Plaza Roncero ◽

Gonçalo Marques ◽

Beatriz Sainz-De-Abajo ◽

Francisco Martín-Rodríguez ◽

Carlos del Pozo Vegas ◽

...

Keyword(s):

Health Care ◽

Mobile Health ◽

Mobile Apps ◽

Current Status ◽

Health Technologies ◽

Health Apps ◽

App Store ◽

Mobile Health Apps ◽

Medical Emergencies ◽

Google Play

Background Mobile health apps are used to improve the quality of health care. These apps are changing the current scenario in health care, and their numbers are increasing. Objective We wanted to perform an analysis of the current status of mobile health technologies and apps for medical emergencies. We aimed to synthesize the existing body of knowledge to provide relevant insights for this topic. Moreover, we wanted to identify common threads and gaps to support new challenging, interesting, and relevant research directions. Methods We reviewed the main relevant papers and apps available in the literature. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) methodology was used in this review. The search criteria were adopted using systematic methods to select papers and apps. On one hand, a bibliographic review was carried out in different search databases to collect papers related to each application in the health emergency field using defined criteria. On the other hand, a review of mobile apps in two virtual storage platforms (Google Play Store and Apple App Store) was carried out. The Google Play Store and Apple App Store are related to the Android and iOS operating systems, respectively. Results In the literature review, 28 papers in the field of medical emergency were included. These studies were collected and selected according to established criteria. Moreover, we proposed a taxonomy using six groups of applications. In total, 324 mobile apps were found, with 192 identified in the Google Play Store and 132 identified in the Apple App Store. Conclusions We found that all apps in the Google Play Store were free, and 73 apps in the Apple App Store were paid, with the price ranging from US $0.89 to US $5.99. Moreover, 39% (11/28) of the included studies were related to warning systems for emergency services and 21% (6/28) were associated with disaster management apps.

Download Full-text

Social Media in Accelerating Mobile Apps

Cognitive Analytics ◽

10.4018/978-1-7998-2460-2.ch077 ◽

2020 ◽

pp. 1513-1526

Author(s):

Asta Bäck ◽

Päivi Jaring

Keyword(s):

Social Media ◽

Qualitative Analysis ◽

Longitudinal Analysis ◽

Mobile Application ◽

Media Use ◽

Mobile Apps ◽

Social Media Use ◽

App Store ◽

Data Points ◽

Google Play

Mobile application stores have become very popular, and the two most popular, Google Play and Apple App Store, both have over a million applications (apps) available. Social media is extensively used for marketing products and services; but, its true potential, in service and product acceleration, has not been researched much. This paper studies the differences in actions between successful and less successful app developers and especially their social media use in accelerating applications and its impact on success. In this study, a longitudinal analysis is performed on 682 applications, from four Google Play categories, at three data points. This study concludes that almost 50% of the analyzed applications use some form of social media to promote their app, and that successful apps use social media more actively than less successful ones. The qualitative analysis of the apps sheds some light as to why some apps succeed without social media use, and why some fail while using it.

Download Full-text

Guidance on conducting systematic reviews/meta-analyses of pharmacoepidemiological studies of safety outcomes: the gap is now filled

Epidemiology and Psychiatric Sciences ◽

10.1017/s2045796016000299 ◽

2016 ◽

Vol 25 (5) ◽

pp. 425-427 ◽

Cited By ~ 2

Author(s):

S. Cortese

Keyword(s):

Systematic Reviews ◽

Data Extraction ◽

European Medicines Agency ◽

Study Quality ◽

European Network ◽

Quality Appraisal ◽

Comprehensive Guidance ◽

Extraction Study ◽

Safety Outcomes ◽

Meta Analyses

Until recently, no comprehensive guidance specifically on the conduction of systematic reviews and meta-analyses of pharmacoepidemiological studies of safety outcomes was available. In December 2015, the European Network of Centres for Pharmacoepidemiology and Pharamacovigilance (ENCePP), a network coordinated by the European Medicines Agency, published their ‘Guidance on conducting systematic reviews and meta-analyses of completed comparative pharmacoepidemiological studies of safety outcomes’, filling an important gap in the field. This paper highlights the ENCePP recommendations in terms of study identification, data extraction, study quality appraisal and analytical plan. Although the ENCePP document should not be considered as definitive, since it will likely be refined following researchers’ feedback, it is expected that it will be highly influential and useful for the field, with the ultimate goal to improve and standardise the conduction and reporting of systematic reviews/meta-analyses of pharmacoepidemiological studies of safety outcomes.

Download Full-text

Vaping-Related Mobile Apps Available in the Google Play Store After the Apple Ban: Content Review

Journal of Medical Internet Research ◽

10.2196/20009 ◽

2020 ◽

Vol 22 (11) ◽

pp. e20009

Author(s):

Meredith C Meacham ◽

Erin A Vogel ◽

Johannes Thrul

Keyword(s):

Rating Scale ◽

Mobile Apps ◽

Mobile App ◽

Sources Of Information ◽

App Store ◽

Quit Smoking ◽

Quitting Smoking ◽

Do It Yourself ◽

Content Review ◽

Google Play

Background In response to health concerns about vaping devices (eg, youth nicotine use, lung injury), Apple removed 181 previously approved vaping-related apps from the App Store in November 2019. This policy change may lessen youth exposure to content that glamorizes vaping; however, it may also block important sources of information and vaping device control for adults seeking to use vaping devices safely. Objective Understanding the types of nicotine and cannabis vaping–related apps still available in the competing Google Play Store can shed light on how digital apps may reflect information available to consumers. Methods In December 2019, we searched the Google Play Store for vaping-related apps using the keywords "vape" and "vaping" and reviewed the first 100 apps presented in the results. We reviewed app titles, descriptions, screenshots, and metadata to categorize the intended substance (nicotine or cannabis/tetrahydrocannabinol) and the app’s purpose. The most installed apps in each purpose category were downloaded and evaluated for quality and usability with the Mobile App Rating Scale. Results Of the first 100 apps, 79 were related to vaping. Of these 79 apps, 43 (54%) were specific to nicotine, 3 (4%) were specific to cannabis, 1 (1%) was intended for either, and for the remaining 31 (39%), the intended substance was unclear. The most common purposes of the apps were making do-it-yourself e-liquids (28/79, 35%) or coils (25/79, 32%), games/entertainment (19/79, 24%), social networking (16/79, 20%), and shopping for vaping products (15/79, 19%). Of the 79 apps, at least 4 apps (5%) paired with vaping devices to control temperature or dose settings, 8 apps (10%) claimed to help people quit smoking using vaping, and 2 apps (3%) had the goal of helping people quit vaping. Conclusions The majority of vaping-related apps in the Google Play Store had features either to help users continue vaping, such as information for modifying devices, or to maintain interest in vaping. Few apps were for controlling device settings or assisting with quitting smoking or vaping. Assuming that these Google Play Store apps were similar in content to the Apple App Store apps that were removed, it appears that Apple’s ban would have a minimal effect on people who vape with the intention of quitting smoking or who are seeking information about safer vaping via mobile apps.

Download Full-text

Systematic review of meta-analyses to assess the impacts of farming practices - A methodological framework

10.31219/osf.io/byuw9 ◽

2021 ◽

Author(s):

David Makowski ◽

Simona Bosco ◽

Mathilde Chen ◽

Ana Montero-Castaño ◽

Marta Pérez-Soba ◽

...

Keyword(s):

Systematic Review ◽

Quality Assessment ◽

Data Extraction ◽

Scientific Evidence ◽

Evidence Based ◽

Methodological Framework ◽

Farming Practices ◽

Policy Makers ◽

Scientific Experts ◽

Meta Analyses

Identifying sustainable agricultural practices to support policy development requires a rigorous synthesis of scientific evidence based on experiments carried out around the world. In agricultural science, meta-analyses (MAs) are now commonly used to assess the impact of farming practices on a variety of outcomes, including crop and livestock productions, biodiversity, greenhouse gas emissions, nitrate leaching, soil organic carbon, based on a large number of experimental data. MA has become a gold standard method for quantitative research synthesis, and the growing number of MAs available can potentially be used to inform decisions of policy makers. However, published MAs are heterogeneous both in content and quality, and a framework is needed to help scientists to report the results and quality levels of MAs in a rigorous and transparent manner. Such a framework must be implementable quickly - within weeks - to be operational and compatible with the time constraints of modern policymaking processes. In this paper, we propose a methodological framework for assessing the impacts of farming practices based on a systematic review of published MAs. The framework includes four main steps: (1) literature search of existing MAs, (2) screening and selection of MAs, (3) data extraction and quality assessment, and (4) reporting. Three types of reports are generated from the extracted data: individual reports summarizing the contents of each MA (MA summary reports), reports summarizing each of the impacts of a given farming practice on a specific environmental, climate mitigation, or production outcome (single-impact reports), and report summarizing all the impacts of a given farming practice on all the outcomes considered (general report). All these reports present the quality levels of the MAs examined on the basis of 16 quality criteria. The proposed framework is semi-automatic in the sense that the skeletons of the reports are generated automatically from the spreadsheet used for the data extraction and quality assessment. This semi-automatic procedure allows scientific experts to reduce the time needed in the reporting step. Since 2020, the proposed framework was successfully applied by a group of scientific experts to support decisions of EU policy makers, and examine a large diversity of single farming practices (e.g. nitrification inhibitors, biochar, liming) and cropping systems (e.g. organic systems, agroforestry) in a relatively short period of time. It provides an operational tool for scientists who want to supply policymakers with scientific evidence based on large numbers of experiments, in a timely and reproducible manner.

Download Full-text