A comprehensive survey of evaluation metrics in paper-reviewer assignment

2015 ◽  
pp. 295-298
Author(s):  
Jie Gui ◽  
Xiaofeng Cong ◽  
Yuan Cao ◽  
Wenqi Ren ◽  
Jun Zhang ◽  
...  

The presence of haze significantly reduces the quality of images. Researchers have designed a variety of algorithms for image dehazing (ID) to restore the quality of hazy images. However, there are few studies that summarize the deep learning (DL) based dehazing technologies. In this paper, we conduct a comprehensive survey on the recent proposed dehazing methods. Firstly, we conclude the commonly used datasets, loss functions and evaluation metrics. Secondly, we group the existing researches of ID into two major categories: supervised ID and unsupervised ID. The core ideas of various influential dehazing models are introduced. Finally, the open issues for future research on ID are pointed out.


2020 ◽  
Vol 10 (21) ◽  
pp. 7640
Author(s):  
Changchang Zeng ◽  
Shaobo Li ◽  
Qin Li ◽  
Jie Hu ◽  
Jianjun Hu

Machine Reading Comprehension (MRC) is a challenging Natural Language Processing (NLP) research field with wide real-world applications. The great progress of this field in recent years is mainly due to the emergence of large-scale datasets and deep learning. At present, a lot of MRC models have already surpassed human performance on various benchmark datasets despite the obvious giant gap between existing MRC models and genuine human-level reading comprehension. This shows the need for improving existing datasets, evaluation metrics, and models to move current MRC models toward “real” understanding. To address the current lack of comprehensive survey of existing MRC tasks, evaluation metrics, and datasets, herein, (1) we analyze 57 MRC tasks and datasets and propose a more precise classification method of MRC tasks with 4 different attributes; (2) we summarized 9 evaluation metrics of MRC tasks, 7 attributes and 10 characteristics of MRC datasets; (3) We also discuss key open issues in MRC research and highlighted future research directions. In addition, we have collected, organized, and published our data on the companion website where MRC researchers could directly access each MRC dataset, papers, baseline projects, and the leaderboard.


Author(s):  
Ehsan Yaghoubi ◽  
Farhad Khezeli ◽  
Diana Borza ◽  
SV Aruna Kumar ◽  
João Neves ◽  
...  

Over the last decade, the field of Human Attribute Recognition (HAR) has dramatically changed, mainly due to the improvements brought by deep learning solutions. This survey reviews the progress obtained in HAR, considering the transition from the traditional hand-crafted to deep-learning approaches. The most relevant works on the field are analyzed concerning the advances proposed to address the HAR's typical challenges. Furthermore, we outline the applications and typical evaluation metrics used in the HAR context. Finally, we provide a comprehensive review of the publicly available datasets for the development and evaluation of novel HAR approaches.


Author(s):  
Paulo Cesar Fernandes de Oliveira

Summary evaluation is a challenging issue. It is subjective, costly, time consuming, and, if it is human-assisted, can generate some bias. Due to this, several attempts have been made in the last decades in order to avoid all these drawbacks. Those attempts focused on automatic summary evaluation. This chapter provides a comprehensive survey about studies that have dealt with this topic and proposes and describes the development of an automatic summary evaluation method. In addition, it presents some experiments that have been carried out in order to assess the method’s performance.


2016 ◽  
Vol 14 (3) ◽  
pp. 253-274 ◽  
Author(s):  
C. M. Lorkowski

I argue that acknowledging Hume as a doxastic naturalist about belief in a deity allows an elegant, holistic reading of his Dialogues. It supports a reading in which Hume's spokesperson is Philo throughout, and enlightens many of the interpretive difficulties of the work. In arguing this, I perform a comprehensive survey of evidence for and against Philo as Hume's voice, bringing new evidence to bear against the interpretation of Hume as Cleanthes and against the amalgamation view while correcting several standard mistakes. I ultimately isolate the interpretation of Philo's Reversal at the end of the Dialogues as of paramount importance, and show how my naturalistic interpretation makes this, and other notoriously difficult passages, unproblematic.


2010 ◽  
Vol 4 (1-2) ◽  
pp. 75-96
Author(s):  
Mohammed Rustom

This article offers the first comprehensive survey of scholarly literature devoted to the Qur??nic works of the famous Muslim philosopher, Mull? ?adr? (d. 1050/1640). While taking account of the merits and shortcomings of studies on ?adr?’s Qur??nic writings, we will also be concerned with highlighting some of the methodological problems raised by the diverse range of approaches adopted in these studies. Chief amongst them is the tendency to pit ?adr? the philosopher against ?adr? the scriptural exegete. Such a dichotomy is not entirely helpful, both with respect to painting a clearer picture of ?adr?’s religious worldview, and to addressing broader questions pertaining to the intimate relationship shared between the “act” of philosophy and the “act” of reading scripture.


2016 ◽  
Vol 2 (1) ◽  
pp. 45-66 ◽  
Author(s):  
Douglas Scott
Keyword(s):  

This paper outlines the background to earlier studies of the orientation of the OrkneyCromarty (OC) passage cairns and the Clava passage and ring cairns, and details the outcome of a new and comprehensive survey carried out by the author over recent years. The paper sets out evidence of orientations in both sets of cairns to the eight divisions of the year and tests whether the alignments were observable. The results were compared to see if the Clava cairns had been influenced by the older OC cairns. Other solar and/or lunar aligned monuments are also briefly examined, as is relevant folklore.


2021 ◽  
Vol 33 (1) ◽  
pp. 012009
Author(s):  
Aiko Narazaki ◽  
Hideyuki Takada ◽  
Dai Yoshitomi ◽  
Kenji Torizuka ◽  
Yohei Kobayashi

Sign in / Sign up

Export Citation Format

Share Document