Showing 1–13 of 13 results for author: Szybowski, J

My part is bigger than yours -- assessment within a group of peers using the pairwise comparisons method

Authors: Konrad Kułakowski, Jacek Szybowski

Abstract: A project (e.g. writing a collaborative research paper) is often a group effort. At the end, each contributor identifies his or her contribution, often verbally. The reward, however, is quite often financial in nature. This leads to the question of what (percentage) share in the creation of the paper is due to individual authors. Different authors may have various opinions on the matter, and, even… ▽ More A project (e.g. writing a collaborative research paper) is often a group effort. At the end, each contributor identifies his or her contribution, often verbally. The reward, however, is quite often financial in nature. This leads to the question of what (percentage) share in the creation of the paper is due to individual authors. Different authors may have various opinions on the matter, and, even worse, their opinions may have different relevance. In this paper, we present a simple models that allows aggregation of experts' opinions linking the priority of his preference directly to the assessment made by other experts. In this approach, the greater the contribution of a given expert, the greater the importance of his opinion. The presented method can be considered as an attempt to find consensus among a group of peers involved in the same project. Hence, its applications may go beyond the proposed study example of writing a scientific paper. △ Less

Submitted 1 July, 2024; originally announced July 2024.

Comments: 18 pages

Detection of decision-making manipulation in the pairwise comparisons method

Authors: Michał Strada, Sebastian Ernst, Jacek Szybowski, Konrad Kułakowski

Abstract: Most decision-making models, including the pairwise comparison method, assume the decision-makers honesty. However, it is easy to imagine a situation where a decision-maker tries to manipulate the ranking results. This paper presents three simple manipulation methods in the pairwise comparison method. We then try to detect these methods using appropriately constructed neural networks. Experimental… ▽ More Most decision-making models, including the pairwise comparison method, assume the decision-makers honesty. However, it is easy to imagine a situation where a decision-maker tries to manipulate the ranking results. This paper presents three simple manipulation methods in the pairwise comparison method. We then try to detect these methods using appropriately constructed neural networks. Experimental results accompany the proposed solutions on the generated data, showing a considerable manipulation detection level. △ Less

Submitted 26 May, 2024; originally announced May 2024.

Comments: 19 pages, 5 figures, 2 tables

Establishing a leader in a pairwise comparisons method

Authors: Jacek Szybowski, Konrad Kułakowski, Jiri Mazurek, Sebastian Ernst

Abstract: Abstract Like electoral systems, decision-making methods are also vulnerable to manipulation by decision-makers. The ability to effectively defend against such threats can only come from thoroughly understanding the manipulation mechanisms. In the presented article, we show two algorithms that can be used to launch a manipulation attack. They allow for equating the weights of two selected alternat… ▽ More Abstract Like electoral systems, decision-making methods are also vulnerable to manipulation by decision-makers. The ability to effectively defend against such threats can only come from thoroughly understanding the manipulation mechanisms. In the presented article, we show two algorithms that can be used to launch a manipulation attack. They allow for equating the weights of two selected alternatives in the pairwise comparison method and, consequently, choosing a leader. The theoretical considerations are accompanied by a Monte Carlo simulation showing the relationship between the size of the PC matrix, the degree of inconsistency, and the ease of manipulation. This work is a continuation of our previous research published in the paper (Szybowski et al., 2023) △ Less

Submitted 21 March, 2024; originally announced March 2024.

Comments: 9 figures, 19 pages

Almost optimal manipulation of a pair of alternatives

Authors: Jacek Szybowski, Konrad Kułakowski, Sebastian Ernst

Abstract: The role of an expert in the decision-making process is crucial, as the final recommendation depends on his disposition, clarity of mind, experience, and knowledge of the problem. However, the recommendation also depends on their honesty. But what if the expert is dishonest? Then, the answer on how difficult it is to manipulate in a given case becomes essential. In the presented work, we consider… ▽ More The role of an expert in the decision-making process is crucial, as the final recommendation depends on his disposition, clarity of mind, experience, and knowledge of the problem. However, the recommendation also depends on their honesty. But what if the expert is dishonest? Then, the answer on how difficult it is to manipulate in a given case becomes essential. In the presented work, we consider manipulation of a ranking obtained by comparing alternatives in pairs. More specifically, we propose an algorithm for finding an almost optimal way to swap the positions of two selected alternatives. Thanks to this, it is possible to determine how difficult such manipulation is in a given case. Theoretical considerations are illustrated by a practical example. △ Less

Submitted 12 April, 2023; v1 submitted 6 April, 2023; originally announced April 2023.

Comments: 18 pages

Journal ref: Szybowski, J., Kułakowski, K. & Ernst, S. Almost optimal manipulation of pairwise comparisons of alternatives. J Glob Optim (2024)

Towards secure judgments aggregation in AHP

Authors: Konrad Kułakowski, Jacek Szybowski, Jiri Mazurek, Sebastian Ernst

Abstract: In decision-making methods, it is common to assume that the experts are honest and professional. However, this is not the case when one or more experts in the group decision making framework, such as the group analytic hierarchy process (GAHP), try to manipulate results in their favor. The aim of this paper is to introduce two heuristics in the GAHP, setting allowing to detect the manipulators and… ▽ More In decision-making methods, it is common to assume that the experts are honest and professional. However, this is not the case when one or more experts in the group decision making framework, such as the group analytic hierarchy process (GAHP), try to manipulate results in their favor. The aim of this paper is to introduce two heuristics in the GAHP, setting allowing to detect the manipulators and minimize their effect on the group consensus by diminishing their weights. The first heuristic is based on the assumption that manipulators will provide judgments which can be considered outliers with respect to those of the rest of the experts in the group. The second heuristic assumes that dishonest judgments are less consistent than the average consistency of the group. Both approaches are illustrated with numerical examples and simulations. △ Less

Submitted 3 April, 2023; v1 submitted 27 March, 2023; originally announced March 2023.

Comments: 32 pages

On Orthogonal Projections on the Space of Consistent Pairwise Comparisons Matrices

Authors: W. W. Koczkodaj, R. Smarzewski, J. Szybowski

Abstract: In this study, the orthogonalization process for different inner products is applied to pairwise comparisons. Properties of consistent approximations of a given inconsistent pairwise comparisons matrix are examined. A method of a derivation of a priority vector induced by a pairwise comparison matrix for a given inner product has been introduced. The mathematical elegance of orthogonalization and… ▽ More In this study, the orthogonalization process for different inner products is applied to pairwise comparisons. Properties of consistent approximations of a given inconsistent pairwise comparisons matrix are examined. A method of a derivation of a priority vector induced by a pairwise comparison matrix for a given inner product has been introduced. The mathematical elegance of orthogonalization and its universal use in most applied sciences has been the motivating factor for this study. However, the finding of this study that approximations depend on the inner product assumed, is of considerable importance. △ Less

Submitted 16 February, 2020; originally announced February 2020.

Comments: Followup to: Koczkodaj, WW; Orlowski, M, An orthogonal basis for computing a consistent approximation to a pairwise comparisons matrix, Computers and Mathematics with Applications, 34(10): 41-47. 1997

ACM Class: I.2

Journal ref: Fundamenta Informaticae, vol. 172, no. 4, pp. 379-397, 2020

New inconsistency indicators for incomplete pairwise comparisons matrices

Authors: Jacek Szybowski, Konrad Kułakowski, Anna Prusak

Abstract: We introduce two new inconsistency measures for the incomplete pairwise comparisons matrices and show several examples of their calculation. We also carry out a comparative analysis of the new inconsistency indices with the existing ones based on the Monte Carlo simulation. We introduce two new inconsistency measures for the incomplete pairwise comparisons matrices and show several examples of their calculation. We also carry out a comparative analysis of the new inconsistency indices with the existing ones based on the Monte Carlo simulation. △ Less

Submitted 6 December, 2019; v1 submitted 1 December, 2019; originally announced December 2019.

Comments: 20 pages, 10 figures

Towards quantification of incompleteness in the pairwise comparisons method

Authors: Konrad Kułakowski, Anna Prusak, Jacek Szybowski

Abstract: Alongside consistency, completeness of information is one of the key factors influencing data quality. The objective of this paper is to define ways of treating missing entries in pairwise comparisons (PC) method with respect to inconsistency and sensitivity. Two important factors related to the incompleteness of PC matrices have been identified, namely the number of missing pairwise comparisons a… ▽ More Alongside consistency, completeness of information is one of the key factors influencing data quality. The objective of this paper is to define ways of treating missing entries in pairwise comparisons (PC) method with respect to inconsistency and sensitivity. Two important factors related to the incompleteness of PC matrices have been identified, namely the number of missing pairwise comparisons and their arrangements. Accordingly, four incompleteness indices have been developed, simple to calculate, each of them take into account both: the total number of missing data and their distribution in the PC matrix. A numerical study of the properties of these indices has been also conducted using a series of Montecarlo experiments. It demonstrated that both incompleteness and inconsistency of data equally contribute to the sensitivity of the PC matrix. Although incompleteness is only just one of the factors influencing sensitivity, a relative simplicity of the proposed indices may help decision makers to quickly estimate the impact of missing comparisons on the quality of final result. △ Less

Submitted 9 December, 2018; originally announced December 2018.

Comments: 12 pages, 7 figures

Journal ref: Konrad Kułakowski, Jacek Szybowski, Anna Prusak, Towards quantification of incompleteness in the pairwise comparisons methods, International Journal of Approximate Reasoning, Volume 115, 2019, Pages 221-234

On normalization of inconsistency indicators in pairwise comparisons

Authors: W. W. Koczkodaj, J. -P. Magnot, J. Mazurek, J. F. Peters, H. Rakhshani, M. Soltys, D. Strzałka, J. Szybowski, A. Tozzi

Abstract: In this study, we provide mathematical and practice-driven justification for using $[0,1]$ normalization of inconsistency indicators in pairwise comparisons. The need for normalization, as well as problems with the lack of normalization, are presented. A new type of paradox of infinity is described. In this study, we provide mathematical and practice-driven justification for using $[0,1]$ normalization of inconsistency indicators in pairwise comparisons. The need for normalization, as well as problems with the lack of normalization, are presented. A new type of paradox of infinity is described. △ Less

Submitted 25 February, 2017; v1 submitted 23 February, 2017; originally announced February 2017.

Comments: 15 pages, 3 figures

The key properties of inconsistency indicators for a triad in pairwise comparison matrices

Authors: W. W. Koczkodaj, J. Szybowski

Abstract: Processing information, acquired by subjective assessments, involves inconsistency analysis in most (if not all) applications of which some are of considerable importance at a national level (see, Koczkodaj/Kulakowski/Ligenza, Scientometrics, 99(3): 911-926, 2014)A triad inconsistency axiomatization in pairwise comparisons was informally proposed in Koczkodaj/Szwarc, FUNDAMENTA INFORMATICAE, 132(4… ▽ More Processing information, acquired by subjective assessments, involves inconsistency analysis in most (if not all) applications of which some are of considerable importance at a national level (see, Koczkodaj/Kulakowski/Ligenza, Scientometrics, 99(3): 911-926, 2014)A triad inconsistency axiomatization in pairwise comparisons was informally proposed in Koczkodaj/Szwarc, FUNDAMENTA INFORMATICAE, 132(4): 485-500, 2014. This study, rectifies it by the use of the distance and theoretical proofs. Three key properties of the indicator are presented in this study and illustrated by several examples. △ Less

Submitted 5 August, 2015; v1 submitted 19 May, 2015; originally announced May 2015.

Comments: 8 pages, 14 references; creative use of the distance to define inconsistency in pairwise comparisons (project originated in 2014 but submitted for a review in July 2015)

On the Convergence of the Pairwise Comparisons Inconsistency Reduction Process

Authors: Waldemar W. Koczkodaj, Jacek Szybowski

Abstract: This study investigates a powerful model, targeted to subjective assessments, based on pairwise comparisons. It provides a proof that a distance-based inconsistency reduction transforms an inconsistent pairwise comparisons (PC) matrix into a consistent PC matrix which is generated by the geometric means of rows of a given inconsistent PC matrix. The distance-based inconsistency indicator was defin… ▽ More This study investigates a powerful model, targeted to subjective assessments, based on pairwise comparisons. It provides a proof that a distance-based inconsistency reduction transforms an inconsistent pairwise comparisons (PC) matrix into a consistent PC matrix which is generated by the geometric means of rows of a given inconsistent PC matrix. The distance-based inconsistency indicator was defined in 1993 for pairwise comparisons. Its convergence was analyzed in 1996 (regretfully, with an incomplete proof; finally completed in 2010). However, there was no clear interpretation of the convergence limit which is of considerable importance for applications and this study does so. △ Less

Submitted 7 May, 2015; v1 submitted 6 May, 2015; originally announced May 2015.

Comments: 16 page, 1 figure. For pairwise comparisons, the normalized vector o geometric means (GM) is equal to the normalized principal eigenvector (EV) for consistent matrices. For inconsistent matrices, the limit is "make it consistent" process is GM (specifically, not EV). This contribution finally concludes the discussion "GM or EV" originated in 1980s

Report number: 2015-05-05

Inconsistency indicator maps on groups for pairwise comparisons

Authors: W. W. Koczkodaj, J. Szybowski, E. Wajch

Abstract: This study presents an abelian group approach to analyzing inconsistency in pairwise comparisons. However, it wrongly assumes that an inconsistency indicator can take values in any abelian linearly ordered group. The followup publication (On normalization of inconsistency indicators in pairwise comparisons, a collaboration which includes two of three authors of this publication) shows that any inc… ▽ More This study presents an abelian group approach to analyzing inconsistency in pairwise comparisons. However, it wrongly assumes that an inconsistency indicator can take values in any abelian linearly ordered group. The followup publication (On normalization of inconsistency indicators in pairwise comparisons, a collaboration which includes two of three authors of this publication) shows that any inconsistency indicator should be normalized for a number of practical and theoretical reasons. The publication below fails to demonstrate even one example of a non trivial group (other than a group consisting of real numbers. However, some obtained results (under erroneous assumptions) are still valid. △ Less

Submitted 26 December, 2017; v1 submitted 21 February, 2015; originally announced February 2015.

Comments: This paper contains a serious error which was corrected in the followup publication: "On normalization of inconsistency indicators in pairwise comparisons" posted as https://arxiv.org/abs/1702.07205

MSC Class: Primary: 06F15; 54E35; secondary: 00A69; 91E45

Pairwise Comparisons Simplified

Authors: W. W. Koczkodaj, J. Szybowski

Abstract: This study examines the notion of generators of a pairwise comparisons matrix. Such approach decreases the number of pairwise comparisons from $n\cdot (n-1)$ to $n-1$. An algorithm of reconstructing of the PC matrix from its set of generators is presented. This study examines the notion of generators of a pairwise comparisons matrix. Such approach decreases the number of pairwise comparisons from $n\cdot (n-1)$ to $n-1$. An algorithm of reconstructing of the PC matrix from its set of generators is presented. △ Less

Submitted 26 November, 2013; originally announced November 2013.

Comments: 15 pages, two figures

MSC Class: 65F30 ACM Class: C.4; D.2.8; G.1.2; G.1.6; H.1.1; H.4.2