scholarly journals Lesion-wise evaluation for effective performance monitoring of small object segmentation

Author(s):  
Irme Groothuis ◽  
Carole Sudre ◽  
Silvia Ingala ◽  
Josephine Barnes ◽  
Juan Domingo Gispert Lopez ◽  
...  
2019 ◽  
Vol 30 (4) ◽  
pp. 707-716 ◽  
Author(s):  
Jinhee Park ◽  
Dokyeong Kwon ◽  
Bo Won Choi ◽  
Ga Young Kim ◽  
Kwang Yong Kim ◽  
...  

2017 ◽  
Author(s):  
Charles Ehler

This guide on performance monitoring and evaluation (evaluation) is intended for practitioners responsible for planning and managing marine areas. Practitioners are the managers and stakeholders who are responsible for designing, planning, implementing, monitoring, and evaluating marine management plans. While its focus is on the performance monitoring and evaluation of MSP, planners and managers should know how to incorporate monitoring and evaluation considerations into the MSP process from its very beginning, and not wait until a plan is completed before thinking about how to measure “success”. Effective performance monitoring and evaluation is only possible when management objectives and expected outcomes are written in a way that is measurable, either quantitatively or qualitatively.


2021 ◽  
Vol 13 (4) ◽  
pp. 555
Author(s):  
Ikhwan Song ◽  
Sungho Kim

Infrared small-object segmentation (ISOS) has a persistent trade-off problem—that is, which came first, recall or precision? Constructing a fine balance between of them is, au fond, of vital importance to obtain the best performance in real applications, such as surveillance, tracking, and many fields related to infrared searching and tracking. F1-score may be a good evaluation metric for this problem. However, since the F1-score only depends upon a specific threshold value, it cannot reflect the user’s requirements according to the various application environment. Therefore, several metrics are commonly used together. Now we introduce F-area, a novel metric for a panoptic evaluation of average precision and F1-score. It can simultaneously consider the performance in terms of real application and the potential capability of a model. Furthermore, we propose a new network, called the Amorphous Variable Inter-located Network (AVILNet), which is of pliable structure based on GridNet, and it is also an ensemble network consisting of the main and its sub-network. Compared with the state-of-the-art ISOS methods, our model achieved an AP of 51.69%, F1-score of 63.03%, and F-area of 32.58% on the International Conference on Computer Vision 2019 ISOS Single dataset by using one generator. In addition, an AP of 53.6%, an F1-score of 60.99%, and F-area of 32.69% by using dual generators, with beating the existing best record (AP, 51.42%; F1-score, 57.04%; and F-area, 29.33%).


Sign in / Sign up

Export Citation Format

Share Document