scholarly journals Combining Multiple Measures into a Single Figure of Merit

2015 ◽  
Vol 69 ◽  
pp. 36-43 ◽  
Author(s):  
Mark Chignell ◽  
Tiffany Tong ◽  
Sachi Mizobuchi ◽  
Tamara Delange ◽  
Wilson Ho ◽  
...  
Keyword(s):  
Figure Of Merit ◽  
Multiple Measures ◽  
Single Figure

A Forward Step in Performance Evaluation

1966 ◽  
Vol 30 (3) ◽  
pp. 26-32
Author(s):  
Allan Easton
Keyword(s):  
Performance Evaluation ◽  
Side Effects ◽  
Figure Of Merit ◽  
Evaluation Methods ◽  
Multiple Criterion ◽  
Multiple Measures ◽  
Evaluation Of Performance ◽  
Single Criterion

Persons responsible for evaluation of performance have found that use of single-criterion measures invariably leads to undesirable side-effects. As a remedy, designers of evaluation methods would like to use multiple in place of single criteria, but are likely to have difficulty in amalgamating their multiple measures into a meaningful whole. Here is a method for combining multiple-criterion scores into a conceptually satisfying, overall figure-of-merit which can be used to rank subjects or projects in order of their excellence.

scholarly journals The Imaging Performance of Diagnostic Ultrasound Scanners Using the Edinburgh Pipe Phantom to Measure the Resolution Integral – 15 Years of Experience

2020 ◽  
Author(s):  
Carmel M. Moran ◽  
Scott Inglis ◽  
Karne McBride ◽  
Christopher Mcleod ◽  
Stephen D. Pye
Keyword(s):  
Clinical Practice ◽  
Ultrasound Imaging ◽  
Figure Of Merit ◽  
Integral Characteristic ◽  
Depth Of Field ◽  
Single Element ◽  
Effective Metric ◽  
Two Parameters ◽  
Imaging Performance ◽  
Single Figure

AbstractThe grayscale imaging performance of a total of 368 different scanner/transducer combinations from 39 scanner manufacturers measured over a period of 15 years is presented. Performance was measured using the resolution integral, a single figure-of-merit to quantify ultrasound imaging performance. The resolution integral was measured using the Edinburgh Pipe Phantom. Transducers included single element, linear, phased, curvilinear and multi-row arrays. Our results demonstrate that the resolution integral clearly differentiates between transducers with varying levels of performance. Two further parameters were also derived from the resolution integral: characteristic resolution and depth of field. We demonstrate that these two parameters can successfully characterize individual transducer performance and differentiate between transducers designed for different clinical and preclinical applications. In conclusion, the resolution integral is an effective metric to quantify and monitor grayscale imaging performance in clinical practice.

scholarly journals Evaluation of the Metrological Performance of a Handheld 3D Laser Scanner Using a Pseudo-3D Ball-Lattice Artifact

Sensors ◽  
2021 ◽  
Vol 21 (6) ◽  
pp. 2137
Author(s):  
Rémi Bonin ◽  
Farbod Khameneifar ◽  
J.R.R. Mayer
Keyword(s):  
Exposure Time ◽  
Figure Of Merit ◽  
Single Point ◽  
Laser Scanner ◽  
Considerable Effect ◽  
Measuring Volume ◽  
Scan Data ◽  
Single Figure ◽  
Metrological Performance ◽  
Independent Parameters

This paper proposes the use of a pseudo-3D ball-lattice artifact to characterize a handheld laser scanner from a metrological standpoint. The artifact allows the computation of local and global errors in measurement by using the reference-frame-independent parameters of size, form, and distance within the measuring volume of the scanner, and in a single point cloud, without the need for registration. A set of tests was performed using the whole measuring volume, and three acquisition parameters, namely the orientation of the sweeps during the scans, the exposure time, and the distance to the scanner were analyzed for their effects on the accuracy of the scan data. A composite error including the errors in measuring size, form, and distance was used as a single figure of merit to characterize the performance of the scanner in relation to the data-acquisition parameters. The orientation of sweeps did not have a considerable effect on the errors. The accuracy of the scan data was strongly affected by exposure time and its interaction with the distance at which the artifact was scanned. The errors followed a quadratic trend with respect to the distance of the artifact to the scanner. The tested scanner performed best at its manufacturer’s recommended stand-off distance.

scholarly journals [OA211] A single phantom, a single statistical method, a single figure of merit for all X-ray equipment

2018 ◽  
Vol 52 ◽  
pp. 80-81
Author(s):  
Nicoletta Paruccini ◽  
Raffaele Villa ◽  
Nadia Oberhofer ◽  
Alessandro Loria ◽  
Michele Signoriello ◽  
...  
Keyword(s):  
Statistical Method ◽  
Figure Of Merit ◽  
X Ray ◽  
Single Figure

Seti Figure of Merit

1997 ◽  
Vol 161 ◽  
pp. 711-717 ◽  
Author(s):  
John W. Dreher ◽  
D. Kent Cullers
Keyword(s):  
Figure Of Merit ◽  
Qualitative Difference ◽  
Current Generation ◽  
Detection Range ◽  
Sky Surveys ◽  
Independent Observations ◽  
Good For

AbstractWe develop a figure of merit for SETI observations which is anexplicitfunction of the EIRP of the transmitters, which allows us to treat sky surveys and targeted searches on the same footing. For each EIRP, we calculate the product of terms measuring the number of stars within detection range, the range of frequencies searched, and the number of independent observations for each star. For a given set of SETI observations, the result is a graph of merit versus transmitter EIRP. We apply this technique to several completed and ongoing SETI programs. The results provide a quantitative confirmation of the expected qualitative difference between sky surveys and targeted searches: the Project Phoenix targeted search is good for finding transmitters in the 109to 1014W range, while the sky surveys do their best at higher powers. Current generation optical SETI is not yet competitive with microwave SETI.

The Measurement of Performance in Probabilistic Diagnosis IV. Utility Considerations in Therapeutics and Prognostics

1981 ◽  
Vol 20 (02) ◽  
pp. 80-96 ◽  
Author(s):  
J. D. F. Habbema ◽  
J. Hilden
Keyword(s):  
Decision Theory ◽  
Figure Of Merit ◽  
Acute Abdominal Pain ◽  
Theory Approach ◽  
Expected Loss ◽  
Patient Benefit ◽  
Evaluation Approach ◽  
Average Loss ◽  
Actual Decision ◽  
Probabilistic Diagnosis

It is argued that it is preferable to evaluate probabilistic diagnosis systems in terms of utility (patient benefit) or loss (negative benefit). We have adopted the provisional strategy of scoring performance as if the system were the actual decision-maker (not just an aid to him) and argue that a rational figure of merit is given by the average loss which patients would incur by having the system decide on treatment, the treatment being selected according to the minimum expected loss principle of decision theory.A similar approach is taken to the problem of evaluating probabilistic prognoses, but the fundamental differences between treatment selection skill and prognostic skill and their implications for the assessment of such skills are stressed. The necessary elements of decision theory are explained by means of simple examples mainly taken from the acute abdomen, and the proposed evaluation tools are applied to Acute Abdominal Pain data analysed in our previous papers by other (not decision-theoretic) means. The main difficulty of the decision theory approach, viz. that of obtaining good medical utility values upon which the analysis can be based, receives due attention, and the evaluation approach is extended to cover more realistic situations in which utility or loss values vary from patient to patient.

Proteins and direct methods

1991 ◽  
Vol 197 (3-4) ◽  
Author(s):  
Fan Hai-fu ◽  
Hao Quan ◽  
M. M. Woolfson
Keyword(s):  
First Principles ◽  
Figure Of Merit ◽  
Direct Methods ◽  
Large Structure ◽  
Low Resolution ◽  
Figures Of Merit ◽  
Large Structures ◽  
Resolution Data

AbstractConventional direct methods, which work so well for small structures, are less successful for macromolecules. Where it has been demonstrated that a solution might be found using direct methods it is then found that the usual figures of merit are unable to distinguish the few good sets of phases from the large number of sets generated. The reasons for the difficulties with very large structures are considered from a first-principles approach taking into account both the factors of having a large number of atoms and low resolution data. A proposal is made for trying to recognize good phase sets by taking a large structure as a sum of a number of smaller structures for each of which a conventional figure of merit can be applied.

Sign in / Sign up

Export Citation Format

Share Document