scholarly journals Quality Assessment Methods for Textual Conversational Interfaces: A Multivocal Literature Review

Information ◽  
2021 ◽  
Vol 12 (11) ◽  
pp. 437
Author(s):  
Riccardo Coppola ◽  
Luca Ardito

The evaluation and assessment of conversational interfaces is a complex task since such software products are challenging to validate through traditional testing approaches. We conducted a systematic Multivocal Literature Review (MLR), on five different literature sources, to provide a view on quality attributes, evaluation frameworks, and evaluation datasets proposed to provide aid to the researchers and practitioners of the field. We came up with a final pool of 118 contributions, including grey (35) and white literature (83). We categorized 123 different quality attributes and metrics under ten different categories and four macro-categories: Relational, Conversational, User-Centered and Quantitative attributes. While Relational and Conversational attributes are most commonly explored by the scientific literature, we testified a predominance of User-Centered Attributes in industrial literature. We also identified five different academic frameworks/tools to automatically compute sets of metrics, and 28 datasets (subdivided into seven different categories based on the type of data contained) that can produce conversations for the evaluation of conversational interfaces. Our analysis of literature highlights that a high number of qualitative and quantitative attributes are available in the literature to evaluate the performance of conversational interfaces. Our categorization can serve as a valid entry point for researchers and practitioners to select the proper functional and non-functional aspects to be evaluated for their products.

Author(s):  
Noam Shemtov

This chapter examines the idea-expression dichotomy principle and its application in dealing with software copyright infringement disputes. More specifically, it asks to what extent access to ideas or information embedded in the author’s work, as well as the freedom to utilize them, is justified as a matter of copyright law jurisprudence. The chapter first traces the origins of the idea-expression dichotomy and the key milestones in its development, before discussing the arguments for and against it. It also analyses the application of the idea-expression dichotomy in software-related disputes in the United Kingdom, European Union, and United States, with particular focus on functional aspects of software products and services. Finally, it looks at the public policy considerations that stand at the heart of the idea-expression dichotomy principle and their relevance to the software-industry context.


Author(s):  
Krzysztof Wróbel ◽  
Mateusz Gil ◽  
Przemysław Krata ◽  
Karol Olszewski ◽  
Jakub Montewka

Although the safety of prospective Maritime Autonomous Surface Ships will largely depend on their ability to detect potential hazards and react to them, the contemporary scientific literature lacks the analysis of how to achieve this. This could be achieved through an application of leading safety indicators. The aim of the performed study was to identify the research directions of leading safety indicators in three safety-critical operational aspects of Maritime Autonomous Surface Ships: collision avoidance, intact stability, and communication. To achieve this, literature review is performed, taking into account scientific documents including journal and conference papers. The results indicate that the need for establishing operational leading safety indicators is recognized by numerous scholars, who sometimes make suggestions of what the set of indicators shall consist of. Some leading safety indicators for autonomous vessels are readily identifiable in the scientific literature and used in current practice. However, the research effort is lacking a holistic approach to the issue.


2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Reema Harrison ◽  
Benjamin Jones ◽  
Peter Gardner ◽  
Rebecca Lawton

Abstract Background In the context of the volume of mixed- and multi-methods studies in health services research, the present study sought to develop an appraisal tool to determine the methodological and reporting quality of such studies when included in systematic reviews. Evaluative evidence regarding the design and use of our existing Quality Assessment Tool for Studies with Diverse Designs (QATSDD) was synthesised to enhance and refine it for application across health services research. Methods Secondary data were collected through a literature review of all articles identified using Google Scholar that had cited the QATSDD tool from its inception in 2012 to December 2019. First authors of all papers that had cited the QATSDD (n=197) were also invited to provide further evaluative data via a qualitative online survey. Evaluative findings from the survey and literature review were synthesised narratively and these data used to identify areas requiring refinement. The refined tool was subject to inter-rater reliability, face and content validity analyses. Results Key limitations of the QATSDD tool identified related to a lack of clarity regarding scope of use of the tool and in the ease of application of criteria beyond experimental psychological research. The Quality Appraisal for Diverse Studies (QuADS) tool emerged as a revised tool to address the limitations of the QATSDD. The QuADS tool demonstrated substantial inter-rater reliability (k=0.66), face and content validity for application in systematic reviews with mixed, or multi-methods health services research. Conclusion Our findings highlight the perceived value of appraisal tools to determine the methodological and reporting quality of studies in reviews that include heterogeneous studies. The QuADS tool demonstrates strong reliability and ease of use for application to multi or mixed-methods health services research.


Conservation ◽  
2021 ◽  
Vol 1 (4) ◽  
pp. 270-284
Author(s):  
Vladyslav Zakharovskyi ◽  
Károly Németh

This research presents a literature review of published scientific literature on the Coromandel Peninsula, a well-known region of the northern part of the North Island of New Zealand. It contains many biological, geological, and historical features and is well known for beautiful scenery, resulting from a volcanic rock-dominated terrestrial environment influenced by oceanic factors at the coast. All these factors have combined to make the Coromandel a popular tourism destination for New Zealanders and offshore visitors. In researching the current state of knowledge of the region, we searched three scientific databases to define the main ways of studying the region. The results demonstrated a high interest in biological and environmental factors, reflected in the type and scale of conservation measures applied to flora and fauna of the region. Additionally, specificity of geological evolution was a highly examined subject, in the context of hydrothermal alteration as related to gold and silver mineralization resulting in extensive exploration and mining. Meanwhile, indigenous cultural aspects of the land were not recognizable as expected within Western scientific literature, even though the region contains sites recognized as some of the earliest Māori habitations. Therefore, we suggest future studies to expand our understanding of scientific, cultural, and social aspects of the region as applied to the field of conservation in the region.


Author(s):  
E. V. Kudryavceva ◽  
V. V. Kovalev ◽  
N. N. Bayazitova ◽  
N. M. Milyaeva ◽  
A. V. Kaumova

Introduction. Preeclampsia is a hypertensive disorder of pregnancy that remains one of e leading causes of maternal and perinatal morbidity and mortality. The preventive strategy of prophylaxis with acetylsalicylic acid gives only a relative reduction in risk, and in a significant part of cases is ineffective. At the same time, the issue of preeclampsia prophylaxis is extremely relevant, since there are no effective methods for treating this condition, with the exception of the completion of gestation.Purpose of the study. Based on the scientific literature, to evaluate the effectiveness of aspirin in the prevention of preeclampsia and to determine the possible reasons for the lack of effectiveness of such prevention.Materials and methods. We conducted a search for scientific literature, as a result of which 39 sources were selected for the final scientific review (2010-2020). The PubMed, ResearchGate and Elibrary databases were used to search for scientific literature.Results and discussion. The article presents a literature review of the analysis of the effectiveness of aspirin for the prevention of preeclampsia over the past 5 years, describes the mechanism of action of aspirin, presents studies that confirm or refute the effectiveness of aspirin depending on the dosage and gestational age. Potential alternative agents for the prevention of preeclampsia in cases of aspirin ineffectiveness have been reviewed.Conclusion. Literature review data show that the effectiveness of aspirin for the prevention of preeclampsia depends on the chronobiological effect, compliance, gestational duration and dosage. It is necessary to continue research on the effectiveness of aspirin, and studies carried out on the Russian population will be of particular value for the Russian Federation.


2021 ◽  
Vol 7 (1) ◽  
pp. 1-21
Author(s):  
Relisa Nuris Shifa ◽  
Sulistiawati ◽  
Endyka Erye Frety ◽  
Astika Gita Ningrum

Background: The first six months after birth are part of the first 1000 days, a golden period for child development. In this period, the child needed proper nutrition to support optimal development and as nutrition programming. WHO recommends exclusive breastfeeding (EBF) for the first 6th-month. Adequacy of nutrition and optimal growth can be assessed using the nutritional status.  Aim: This study analyzes the relationship between EBF for the first 6 months with the nutritional status of a full-term infant aged 0-6 months. The nutritional status assessed using anthropometric measurements and child growth standards. Methods: This type of literature review research uses the PRISMA, PICO, and Boolean Operator methods. The research question with PICO standard "What is a relationship between exclusive breastfeeding practice and nutritional status of children aged 0-6 months?". Relevant literature was obtained from 8 databases: Scopus, Portal Garuda, Proquest, Mendeley, Pubmed, Oxford, Science Direct, and Sage. Literature was limited to the last 10 years. There are 6 relevant pieces of literature included for review. The literature quality assessment uses a quantitative study quality assessment tool released by the EPHPP (Effective Public Health Practice Project) and produces 5 pieces of literature worthy of review.  Results: From 5 kinds of literature, there were various indicators of nutritional status such as weight-for-age (WAZ), length-for-age (LAZ), weight-for-length (WLZ), Body Mass Index (BMI)-for-age, and head circumference (HC)-for-age. The results were dominated by insignificant results, except the HC-for-age indicator stated that there were significant results. The author explores the causes of insignificant results. Explores based on the indicators that include in studies, the information based on studies, and the possible consequences that adjusted to the data based on the studies. The Author found that the mother plays an important role in the production and provision of breast milk. The quality of breastmilk depends on the mother, also how she gives it to their infant. It has to be based on the WHO recommendation. Conclusion: The result of these studies affirms that EBF didn't significantly affect the indicators of WAZ, LAZ, WLZ, and BMI-for-age, but significantly affected the head circumference-for-age indicator.


2021 ◽  
Vol 9 (3) ◽  
pp. 52-57
Author(s):  
Yasir Mohamed Hassan Amin ◽  
Mohamed Abdulla Nugdalla Ahmedi

Quality management is considered one of the most important obstacles facing the construction industry in Sudan. The application of a quality assessment system contributes to the development of quality in projects as it is possible to measure the quality in projects. This paper aims to introduce one of the quality assessment systems, which is the system followed and applied in the Singapore (CONQUAS). This system assesses quality based on structural, architectural, mechanical and electrical work. The paper also aims to study the factors affecting the application of the quality assessment system in Sudan. The study is carried out in the region of Khartoum. The study is focusing on the construction projects. The study is carried out by questionnaires and other literature review. The respondents are consultants and contractors. The data has been distributed and analyzed by using the Average Index. From the study it was found that CONQUAS standard is assessed the building based on workmanship standards by the assessors from the BCA on site using standard score sheets. The assessment is done throughout the construction process for structural, mechanical and electrical works, and from questionnaire results the main factors affect construction industry in Sudan is lack of standardization in Sudan. The author recommended that more study shall be conducted to identify factors affecting quality in Sudanese construction industry and how to improve the quality.  


Prawo ◽  
2019 ◽  
Vol 327 ◽  
pp. 219-229
Author(s):  
Rafał Czachor

Constitutional duties in the post-Soviet countriesThe duties, along with rights and freedoms, define the legal status of the person in the state. However, the scientific literature pays more attention to the rights and freedoms, since they are considered as more important. The following paper tackles the issue of constitutional duties in the post-Soviet republics. The investigation has both qualitative and quantitative character and presents results in a comparative way.


2021 ◽  
Vol 3 (1) ◽  
pp. 1-10
Author(s):  
Muhammad Nasrullah ◽  
Nisa Dwi Angresti ◽  
Sayekti Harits Suryawan ◽  
Faizal Mahananto

Seiring perkembangan teknologi, virtual team dapat menjadi solusi untuk sebuah proyek software engineering, karena virtual team tidak terbatas oleh letak geografis dan waktu. Namun, untuk menentukan kebutuhan pengguna dari virtual team ini menemui beberapa kendala, karena para stakeholder yang tidak saling bertatap muka, sehingga sulit untuk saling mendapatkan feeling antara stakeholder. Salah satu teknik yang digunakan untuk penggalian kebutuhan pada virtual team ini adalah teknik kolaborasi. Kolaborasi dilakukan dengan memanfaatkan berbagai media/teknologi. Tujuan literature review ini adalah mengulas cara-cara penggalian kebutuhan pada virtual team dan mengulas tantangan apa saja yang dihadapi untuk penggalian kebutuhan pada virtual team. Metode yang digunakan dalam penulisan makalah adalah studi literatur dari berbagai sumber pustaka yang relevan. Hasil studi litetatur ini adalah sebuah pemaparan tentang cara penentuan kebutuhan terhadap virtual team dan tantangan yang dihadapi dalam penggalian kebutuhan pada virtual team. Penentuan kebutuhan pada virtual team dilakukan dengan cara pendekatan user-centered design dan wawancara online.


Sign in / Sign up

Export Citation Format

Share Document