journal article·2024-12-09Open access

REDUCE—A Tool Supporting Inconsistencies Reduction in the Decision-Making Process

Paweł Kuraś, Dominik Strzałka, Bartosz Kowal, Patryk Organiściak, Krzysztof Demidowski, Veronika Vanivska

Applied Sciences· Volume 14· Issue 23

Abstract

This paper presents REDUCE, a free online tool designed to support decision-making processes by addressing inconsistency in multiplicative pairwise comparison (PC) matrices, a key element of many multi-criteria decision-making (MCDM) methods, including the analytic hierarchy process (AHP). AHP relies on pairwise comparisons to assign weights to decision criteria or alternatives, but human-generated PC matrices often exhibit inconsistencies. Consistency is evaluated using Saaty’s consistency ratio (CR), where a value below 0.10 is considered acceptable. Higher inconsistency levels necessitate matrix corrections, which are challenging if the original expert is unavailable or revision constraints exist. REDUCE autonomously reduces inconsistency in PC matrices using two different algorithms that require no expert intervention. The tool accommodates different PC matrices, enabling users to specify the desired CR threshold (e.g., CR≤0.10) and select the algorithm for adjustment. It ensures the resulting matrix is consistent while preserving the original preference structure to the greatest extent possible. Additionally, REDUCE calculates weights for the compared entities, making it a valuable tool for applications of AHP and related methodologies. Quantitative evaluations demonstrate that REDUCE can improve matrices with high inconsistency (e.g., CR=0.25) to acceptable levels (e.g., CR=0.08) while retaining up to 95% of the original preference integrity, depending on the chosen algorithm. By addressing the accessibility gap for small and medium enterprises (SMEs) that lack resources for costly decision-making software or expert consultants, REDUCE facilitates broader adoption of MCDM tools. This work highlights the potential of REDUCE to enhance decision-making reliability and accessibility in resource-constrained environments.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Data Quality and Management · Software System Performance and Reliability · Business Process Modeling and Analysis

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Complex Systems, Rzeszów University of Technology, Al. Powstańców Warszawy 12, 35-959 Rzeszów, Poland

References (100+)

Show source-provided references
1. Decision making with the analytic hierarchy process
2. A review of multi-criteria decision-making techniques
3. Information architecture for supply chain quality management10.1080/00207543.2010.508944 ↗
4. Saaty, T.L., and Vargas, L.G. (2012). Models, Methods, Concepts & Applications of the Analytic Hierarchy Process, Springer.10.1007/978-1-4614-3597-6 ↗
5. A law of comparative judgment10.1037/h0070288 ↗
6. Lee, S., and Li, D. (2019). TTCM: A Tensor-Based Technique for Classifying Multi-Aspect Data. IEEE Trans. Pattern Anal. Mach. Intell., 41.
7. Decision Support System for Product Customization in E-Commerce
8. Burges, C.J.C., Shaked, T., Renshaw, E., Lazier, A., Deeds, M., Hamilton, N., and Hullender, G. (2005, January 7–11). Learning to rank using gradient descent. Proceedings of the 22nd International Conference on Machine Learning (ICML), Bonn, Germany.10.1145/1102351.1102363 ↗
9. A hybrid finite state machine and data mining approach for multi-agent plan recognition
10. Ning, X., and Karypis, G. (2011, January 11–14). SLIM: Sparse linear methods for top-N recommender systems. Proceedings of the 11th IEEE International Conference on Data Mining (ICDM), Vancouver, BC, Canada.10.1109/ICDM.2011.134 ↗
11. Tukey, J.W. (1953). The Problem of Multiple Comparisons, Academic Press.
12. Kim, G., and Hwang, C. (2020). Flexible modification of the Bonferroni method for multiple tests. IEEE Trans. Neural Netw. Learn. Syst., 31.
13. Fisher, R.A. (1935). The Design of Experiments, Oliver & Boyd.
14. Controlling the false discovery rate: A practical and powerful approach to multiple testing10.1111/j.2517-6161.1995.tb02031.x ↗
15. Elo, A.E. (1978). The Rating of Chess Players, Past and Present, Ishi Press.
16. Schaefer, M.W. (2008). Sports Ratings and Rankings, Springer.
17. FIFA (2024, October 29). Revision of the FIFA/Coca-Cola World Ranking. Available online: https://img.fifa.com/image/upload/edbm045h0udbwkqew35a.pdf.
18. Deb, K. (2001). Multi-Objective Optimization Using Evolutionary Algorithms, John Wiley & Sons.
19. Pairwise comparison matrix reduction for large-scale decision making: A graph-based approach
20. Horton, J.J., and Chilton, L.B. (2010, January 7–11). The labor economics of paid crowdsourcing. Proceedings of the 11th ACM Conference on Electronic Commerce (EC), Cambridge, MA, USA.10.1145/1807342.1807376 ↗
21. Crowdsourced pairwise comparisons of social relationships
22. Principles of distributed decision making
23. Preference handling—An introductory tutorial
24. Pearl, J. (1988). Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference, Morgan Kaufmann.10.1016/B978-0-08-051489-5.50008-4 ↗
25. Preference learning from pairwise comparisons: A survey
26. Judgment under uncertainty: Heuristics and biases10.1126/science.185.4157.1124 ↗
27. Kahneman, D. (2011). Thinking, Fast and Slow, Farrar, Straus and Giroux.
28. On the Properties of the Priority Deriving Procedure in the Pairwise Comparisons Method10.3233/FI-2015-1240 ↗
29. Is the best–worst method path dependent? Evidence from an empirical study10.1007/s10288-023-00553-5 ↗
30. How to make a decision: The analytic hierarchy process10.1287/inte.24.6.19 ↗
31. A review of methods supporting supplier selection10.1016/S0969-7012(00)00028-9 ↗
32. Kulakowski, K. (2020). On the Geometric Mean Method for Incomplete Pairwise Comparisons. Mathematics, 8.10.3390/math8111873 ↗
33. An efficient algorithm for large-scale pairwise comparison matrix completion
34. Data-driven approaches for managing consumer behavior in fashion retail: A review
35. Heuristic rating estimation: Geometric approach10.1007/s10898-014-0253-4 ↗
36. Kowal, B., Kuras, P., Strzalka, D., Mazurek, J., and Perzina, R. (2023, January 18–19). REDUCE—An online decision support tool for reduction of inconsistency in multiplicative pairwise comparisons. Proceedings of the 3rd International Conference on Decision Making for Small and Medium-Sized Enterprises, Opava, Czech Republic.
37. (2024, August 19). REDUCE. Available online: https://reduce.prz.edu.pl/.
38. Grinberg, M. (2018). Flask Web Development: Developing Web Applications with Python, O’Reilly Media, Inc.
39. (2024, November 04). REDUCE Module for Generating Pairwise Comparison Matrices. Available online: https://reduce.prz.edu.pl/pc_matrices_generator.
40. Using Inconsistency Reduction Algorithms in Comparison Matrices to Improve the Performance of Generating Random Comparison Matrices with a Given Inconsistency Coefficient Range10.12913/22998624/158019 ↗
41. REDUCE: A Python module for reducing inconsistency in Pairwise Comparison Matrices10.12913/22998624/170187 ↗
42. Bibeault, B., De Rosa, A., and Katz, Y. (2015). jQuery in Action, Simon and Schuster.
43. Eichorn, J. (2006). Understanding AJAX: Using JavaScript to Create Rich Internet Applications, Prentice Hall PTR.
44. Ghimire, D. (2020). Comparative Study on Python Web Frameworks: Flask and Django. [Bachelor’s Thesis, Metropolia University of Applied Science].
45. The role of backend and frontend information systems infrastructure
46. Array programming with NumPy10.1038/s41586-020-2649-2 ↗
47. SciPy 1.0: Fundamental algorithms for scientific computing in Python10.1038/s41592-019-0686-2 ↗
48. SymPy: Symbolic computing in Python10.7717/peerj-cs.103 ↗
49. (2024, August 19). Laboratorium Eksploatacji Systemów Informatycznych i Sieci Komputerowych. Available online: https://zsz.prz.edu.pl/laboratoria/laboratorium-eksploatacji-systemow-informatycznych.
50. LaCroix, J. (2018). Mastering Ubuntu Server: Master the Art of Deploying, Configuring, Managing, and Troubleshooting Ubuntu Server 18.04, Packt Publishing Ltd.
51. Chesneau, B. (2024, August 19). Gunicorn Documentation, 2017. Available online: https://docs.gunicorn.org/en/stable/.
52. Nginx: The high-performance web server and reverse proxy
53. Aas, J., Barnes, R., Case, B., Durumeric, Z., Eckersley, P., Flores-López, A., Halderman, J.A., Hoffman-Andrews, J., Kasten, J., and Rescorla, E. (2019, January 11–15). Let’s Encrypt: An automated certificate authority to encrypt the entire web. Proceedings of the 2019 ACM SIGSAC Conference on Computer and Communications Security, London, UK.10.1145/3319535.3363192 ↗
54. Denney, R. (2024, August 19). Configuring a Cisco ASA 5505 in Basic Interface Configuration (ASA 5505). Available online: https://www.cisco.com/c/en/us/td/docs/security/asa/asa92/configuration/general/asa-general-cli/interface-basic-5505.pdf.
55. Gupta, A., and Sharma, L.S. (2019). Performance evaluation of snort and suricata intrusion detection systems on ubuntu server. Proceedings of the ICRIC 2019: Recent Innovations in Computing, Springer International Publishing.10.1007/978-3-030-29407-6_58 ↗
56. A tool to mitigate denial of service attacks on wired networks
57. (2024, August 19). Usługi Uczelnianej Sieci Komputerowej Przeznaczone dla Pracowników PRz. Available online: https://usk.prz.edu.pl/.
58. A Scaling Method for Priorities in Hierarchical Structures10.1016/0022-2496(77)90033-5 ↗
59. Saaty, T.L. (1980). Analytic Hierarchy Process, McGraw-Hill.
60. A Consistency Improving Method in the Analytic Hierarchy Process10.1016/S0377-2217(98)00109-X ↗
61. The improvement of data in pairwise comparison matrices10.1016/j.procs.2018.08.036 ↗
62. A new definition of consistency of pairwise comparisons10.1016/0895-7177(93)90059-8 ↗
63. Inconsistency of pairwise comparison matrix with fuzzy elements based on geometric mean10.1016/j.fss.2009.10.011 ↗
64. B. Golden, E.W., and Harker, P.T. (1989). An alternate measure of consistency. The Analytic Hierarchy Process, Applications and Studies, Springer.10.1007/978-3-642-50244-6 ↗
65. A new measure of inconsistency for positive reciprocal matrices10.1016/S0898-1221(03)90240-9 ↗
66. Preference Programming through Approximate Ratio Comparisons10.1016/0377-2217(93)E0224-L ↗
67. Consistency measures for pairwise comparison matrices10.1002/(SICI)1099-1360(199805)7:3<123::AID-MCDA181>3.0.CO;2-8 ↗
68. The Harmonic Consistency Index for the Analytic Hierarchy Process10.1016/j.ejor.2005.10.057 ↗
69. (2024, August 19). Hastebin. Available online: https://hastebin.com/share/anidodekur.python.
70. (2024, August 19). Hastebin. Available online: https://hastebin.com/share/afopubusuy.python.
71. (2024, August 19). Hastebin. Available online: https://hastebin.com/share/abiguzudur.less.
72. Take command: Cron: Job scheduler
73. Using cron and crontab
74. Protection of web application against SQL injection attacks
75. Security Testing of Web Applications Using Threat Modeling: A Systematic Review
76. Defeating SQL injection10.1109/MC.2012.283 ↗
77. Cross-Site Scripting (XSS) attacks and defense mechanisms: Classification and state-of-the-art10.1007/s13198-015-0376-0 ↗
78. Current state of research on cross-site scripting (XSS)—A systematic literature review10.1016/j.infsof.2014.07.010 ↗
79. A survey of detection methods for XSS attacks10.1016/j.jnca.2018.06.004 ↗
80. Grossman, J. (2007). XSS Attacks: Cross Site Scripting Exploits and Defense, Syngress.10.1016/B978-159749154-9/50005-6 ↗
81. DOM based cross site scripting or XSS of the third kind
82. Dayanandam, G., Rao, T.V., Babu, D.B., and Durga, S.N. (2019). DDoS attacks—Analysis and prevention. Innovations in Computer Science and Engineering: Proceedings of the Fifth ICICSE 2017, Springer.10.1007/978-981-10-8201-6_1 ↗
83. Bhattacharyya, D.K., and Kalita, J.K. (2016). DDoS Attacks: Evolution, Detection, Prevention, Reaction, and Tolerance, CRC Press.10.1201/b20614 ↗
84. Zhang, B., Zhang, T., and Yu, Z. (2017, January 13–16). DDoS detection and prevention based on artificial intelligence techniques. Proceedings of the 2017 3rd IEEE International Conference on Computer and Communications (ICCC), Chengdu, China.10.1109/CompComm.2017.8322748 ↗
85. SNORT based early DDoS detection system using Opendaylight and open networking operating system in software defined networking10.1007/s10586-020-03133-y ↗
86. Saboor, A., Akhlaq, M., and Aslam, B. (2013, January 11–12). Experimental evaluation of Snort against DDoS attacks under different hardware configurations. Proceedings of the 2013 2nd National Conference on Information Assurance (NCIA), Rawalpindi, Pakistan.10.1109/NCIA.2013.6725321 ↗
87. Mazurek, J. (2023). Advances in Pairwise Comparisons, Springer.10.1007/978-3-031-23884-0 ↗
88. (2024, August 19). BitBar. Available online: https://smartbear.com/product/bitbar/.
89. Madhusudhan, R., and Surashe, S.V. (2022, January 13–15). Privacy and Security Comparison of Web Browsers: A Review. Proceedings of the International Conference on Advanced Information Networking and Applications, Sydney, Australia.10.1007/978-3-030-99619-2_44 ↗
90. Tewari, N., and Datt, G. (2021, January 10–12). A study on the systematic review of security vulnerabilities of popular web browsers. Proceedings of the 2021 International Conference on Technological Advancements and Innovations (ICTAI), Tashkent, Uzbekistan.10.1109/ICTAI53825.2021.9673463 ↗
91. Will HTML 5 restandardize the web?
92. Evaluating the accessibility of public health websites: An exploratory cross-country study10.1007/s10209-020-00788-7 ↗
93. Aronson, L. (2010). HTML Manual of Style: A Clear, Concise Reference for Hypertext Markup Language (Including HTML5), Pearson Education.
94. Batishchev, A.M. (2024, August 19). LOIC (Low Orbit Ion Cannon). Available online: http://sourceforge.net/projects/loic.
95. Cheepborisuttikul, T., and Teng-amnuay, Y. (2013, January 24–27). Using Low Orbit Ion Cannon for Denial of Service Attack Based on CVE. Proceedings of the Second International Conference on Advances in Information Technology-AIT 2013, Chikkamagaluru, India.
96. (2024, August 19). GTmetrix. Available online: https://gtmetrix.com/.
97. Widyani, N.P.K., Sudana, A.K.O., and Piarsa, I.N. (2021). Pengujian Performa Sistem Informasi Perpustakaan Online pada Universitas Hindu Indonesia (Astakali UNHI) Menggunakan Tools GTmetrix. J. Ilm. Teknol. Dan Komput., 545–551.10.24843/JTRTI.2021.v02.i03.p13 ↗
98. (2024, August 19). REDUCE. Available online: https://reduce.prz.edu.pl/pliki/raport_gmetric.pdf.
99. Speed Matters: Measuring Time to First Byte and Other Key Metrics in VueJS Components Frameworks: Array
100. Janssen, K., Pelle, T., De Geus, L., Van Der Gronden, R., Islam, T., and Malavolta, I. (2022, January 13–15). On the impact of the critical css technique on the performance and energy consumption of mobile browsers. Proceedings of the 26th International Conference on Evaluation and Assessment in Software Engineering, Gothenburg, Sweden.10.1145/3530019.3530033 ↗