Accuracy assessment methods for likelihood ratio-based evidence evaluation

2010 ◽  
Vol 50 (1) ◽  
pp. 31
Author(s):  
D. Ramos ◽  
J. Gonzalez-Rodriguez ◽  
J.-J. Lucena-Molina
Keyword(s):  
Likelihood Ratio ◽  
Accuracy Assessment ◽  
Assessment Methods ◽  
Evidence Evaluation

scholarly journals Thematic Classification Accuracy Assessment with Inherently Uncertain Boundaries: An Argument for Center-Weighted Accuracy Assessment Metrics

2020 ◽  
Vol 12 (12) ◽  
pp. 1905 ◽  
Author(s):  
Aaron E. Maxwell ◽  
Timothy A. Warner
Keyword(s):  
Accuracy Assessment ◽  
Assessment Methods ◽  
Accuracy Class ◽  
Traditional Assessment ◽  
Distance Weighting ◽  
Assessment Approach ◽  
Broad Array ◽  
Assessment Metrics ◽  
Thematic Classification Accuracy ◽  
The Impact

Accuracy assessment is one of the most important components of both applied and research-oriented remote sensing projects. For mapped classes that have sharp and easily identified boundaries, a broad array of accuracy assessment methods has been developed. However, accuracy assessment is in many cases complicated by classes that have fuzzy, indeterminate, or gradational boundaries, a condition which is common in real landscapes; for example, the boundaries of wetlands, many soil map units, and tree crowns. In such circumstances, the conventional approach of treating all reference pixels as equally important, whether located on the map close to the boundary of a class, or in the class center, can lead to misleading results. We therefore propose an accuracy assessment approach that relies on center-weighting map segment area to calculate a variety of common classification metrics including overall accuracy, class user’s and producer’s accuracy, precision, recall, specificity, and the F1 score. This method offers an augmentation of traditional assessment methods, can be used for both binary and multiclass assessment, allows for the calculation of count- and area-based measures, and permits the user to define the impact of distance from map segment edges based on a distance weighting exponent and a saturation threshold distance, after which the weighting ceases to grow. The method is demonstrated using synthetic and real examples, highlighting its use when the accuracy of maps with inherently uncertain class boundaries is evaluated.

scholarly journals Accuracy Assessment of Digital Elevation Models (DEMs): A Critical Review of Practices of the Past Three Decades

2020 ◽  
Vol 12 (16) ◽  
pp. 2630
Author(s):  
José L. Mesa-Mingorance ◽  
Francisco J. Ariza-López
Keyword(s):  
Accuracy Assessment ◽  
Great Majority ◽  
Professional Associations ◽  
Assessment Methods ◽  
Reference Source ◽  
Digital Elevation ◽  
Source Data ◽  
Data Source ◽  
Assessment Standard ◽  
Elevation Model

An analysis of almost 200 references has been carried out in order to obtain knowledge about the DEM (Digital Elevation Model) accuracy assessment methods applied in the last three decades. With regard to grid DEMs, 14 aspects related to the accuracy assessment processes have been analysed (DEM data source, data model, reference source for the evaluation, extension of the evaluation, applied models, etc.). In the references analysed, except in rare cases where an accuracy assessment standard has been followed, accuracy criteria and methods are usually established according to the premises established by the authors. Visual analyses and 3D analyses are few in number. The great majority of cases assess accuracy by means of point-type control elements, with the use of linear and surface elements very rare. Most cases still consider the normal model for errors (discrepancies), but analysis based on the data itself is making headway. Sample size and clear criteria for segmentation are still open issues. Almost 21% of cases analyse the accuracy in some derived parameter(s) or output, but no standardization exists for this purpose. Thus, there has been an improvement in accuracy assessment methods, but there are still many aspects that require the attention of researchers and professional associations or standardization bodies such as a common vocabulary, standardized assessment methods, methods for meta-quality assessment, and indices with an applied quality perspective, among others.

Sign in / Sign up

Export Citation Format

Share Document