scholarly journals Ranking Methods for Multicriteria Decision-Making: Application to Benchmarking of Solvers and Problems

2021 ◽  
Vol 2021 ◽  
pp. 1-14
Author(s):  
Joseph Gogodze

Evaluating the performance assessments of solvers (e.g., for computation programs), known as the solver benchmarking problem, has become a topic of intense study, and various approaches have been discussed in the literature. Such a variety of approaches exist because a benchmark problem is essentially a multicriteria problem. In particular, the appropriate multicriteria decision-making problem can correspond naturally to each benchmark problem and vice versa. In this study, to solve the solver benchmarking problem, we apply the ranking-theory method recently proposed for solving multicriteria decision-making problems. The benchmarking problem of differential evolution algorithms was considered for a case study to illustrate the ability of the proposed method. This problem was solved using ranking methods from different areas of origin. The comparisons revealed that the proposed method is competitive and can be successfully used to solve benchmarking problems and obtain relevant engineering decisions. This study can help practitioners and researchers use multicriteria decision-making approaches for benchmarking problems in different areas, particularly software benchmarking.

2010 ◽  
Vol 16 (2) ◽  
pp. 159-172 ◽  
Author(s):  
Edmundas Kazimieras Zavadskas ◽  
Zenonas Turskis

Multicriteria decision‐making (MCDM) methods are used in many areas of human activities. Each alternative in a multicriteria decision‐making problem can be described by a set of criteria. Criteria can be qualitative and quantitative. They usually have different units of measurement and a different optimization direction. The normalization aims at obtaining comparable scales of criteria values. The paper introduces a new Additive Ratio ASsessment (ARAS) method. In order to illustrate the described ARAS method a real case study of evaluation of microclimate in office rooms is presented. The case study aims to determine the inside climate of the premises, where people work, and to define measures to be taken to improve their environment. Based on the analysis, the following criteria for inside climate evaluation are suggested: air turnover inside the premises, air humidity, air temperature, illumination intensity, air flow rate, and dew point. The criteria weights were determined by the method of pairwise comparison based on the estimates of experts. Santrauka Daugiakriteriniai sprendimų metodai taikomi daugelyje žmogaus veiklos sričių. Kiekviena alternatyva, sprendžiant daugiakriterinius uždavinius, gali būti apibūdinta kriteriju aibe. Kriterijai gali būti kokybiniai ir kiekybiniai. Jie paprastai turi skirtingus matavimo vienetus ir įvairią optimizavimo kryptį. Kriterijų vertės yra normalizuojamos lyginamos skalės vertėms gauti. Straipsnyje pateikiamas naujas adityvinis kriterijų santykių įvertinimo metodas (ARAS) daugiakriteriniams uždaviniams spręsti. ARAS metodo taikymui pavaizduoti pateiktas realus mikroklimato biuro patalpose vertinimo tyrimas. Tyrimo tikslas ‐ įvertinti patalpų, kurioje žmonės dirba, mikroklimata ir nustatyti priemones, kurių reikia imtis aplinkai pagerinti. Remiantis uždavinio tikslų analize, siūlomi šie kriterijai vidaus klimatui įvertinti: oro pasikeitimas, patalpų oro santykinė dregmė, oro temperatūra, apšvietimo intensyvumas, oro srautas ir rasos taškas. Kriterijų svoriai nustatomi porinio lyginimo metodu, remiantis ekspertų vertinimais. Kriterijų reikšmės nustatytos sertifikuotu prietaisu.


2019 ◽  
Vol 2019 ◽  
pp. 1-7 ◽  
Author(s):  
Joseph Gogodze

The Pareto optimality is a widely used concept for the multicriteria decision-making problems. However, this concept has a significant drawback—the set of Pareto optimal alternatives usually is large. Correspondingly, the problem of choosing a specific Pareto optimal alternative for the decision implementation is arising. This study proposes a new approach to select an “appropriate” alternative from the set of Pareto optimal alternatives. The proposed approach is based on ranking-theory methods used for ranking participants in sports tournaments. In the framework of the proposed approach, we build a special score matrix for a given multicriteria problem, which allows the use of the mentioned ranking methods and to choose the corresponding best-ranked alternative from the Pareto set as a solution of the problem. The proposed approach is particularly useful when no decision-making authority is available, or when the relative importance of various criteria has not been evaluated previously. The proposed approach is tested on an example of a materials-selection problem for a sailboat mast.


2011 ◽  
Vol 52-54 ◽  
pp. 1868-1872
Author(s):  
Liang Liang ◽  
Ren Yan Jiang ◽  
Yin Liang

It is difficult to obtain the correct criteria weights with uncertain information in the multicriteria decision-making. Many methods depend on the subjective estimate. Therefore, a method is presented to evaluate the samples ranking only need the importance order of criteria. It evaluates firstly the overall ranking scores of samples based on the graphical classification and multicriteria hierarchical integrated methods. Subsequently, the relation model between the criteria scores and overall ranking scores of samples is built by linear regression. Finally, a fincial credit loan decision-making problem is presented to describe the way of the multicriteria decisiion making process. The analysis to compare with the AHP method illustrates the proposed method is objective and effective.


Sign in / Sign up

Export Citation Format

Share Document