Outlier Recognition via Linguistic Aggregation of Graph Databases
Source abstract
Abstract
Datasets frequently contain uncertain data that, if not interpreted with care, may affect information analysis negatively. Such rare, strange, or imperfect data, here called “outliers” or “exceptions” can be ignored in further processing or, on the other hand, handled by dedicated algorithms to decide if they contain valuable, though very rare, information. There are different definitions and methods for handling outliers, and here, we are interested, in particular, in those based on linguistic quantification and fuzzy logic. In this paper, for the first time, we apply definitions of outliers and methods for recognizing them based on fuzzy sets and linguistically quantified statements to find outliers in non-relational, here graph-oriented, databases. These methods are proposed and exemplified to identify objects being outliers (e.g., to exclude them from processing). The novelty of this paper are the definitions and recognition algorithms for outliers using fuzzy logic and linguistic quantification, if traditional quantitative and/or measurable information is inaccessible, that frequently takes place in the graph nature of considered datasets.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Anomaly Detection Techniques and Applications · Imbalanced Data Classification Techniques · Network Security and Intrusion Detection
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Institute of Information Technology, Lodz University of Technology, Wólczańska 215, 90-924 Łódź, Poland
References (29)
Show source-provided references
1. Hawkins, D.M. (1980). Identification of Outliers, Springer.10.1007/978-94-015-3994-4 ↗
2. Aggarwal, C.C., and Yu, P.S. (2001, January 21–24). Outlier detection for high dimensional data. Proceedings of the ACM SIGMOD International Conference on Management of Data, Santa Barbara, CA, USA.10.1145/375663.375668 ↗
3. Distance-based outliers: Algorithms and applications10.1007/s007780050006 ↗
4. Knox, E.M., and Ng, R.T. (1998, January 24–27). Algorithms for mining distancebased outliers in large datasets. Proceedings of the International Conference on Very Large Data Bases, New York, NY, USA.
5. Aggarwal, C.C. (2013). Outlier Analysis, Springer.10.1007/978-1-4614-6396-2 ↗
6. Barnett, V., and Lewis, T. (1994). Outliers in Statistical Data, Wiley.
7. Knorr, E.M., and Ng, R.T. A Unified Notion of Outliers: Properties and Computation. Proceedings of the KDD’97: Proceedings of the Third International Conference on Knowledge Discovery and Data Mining.
8. Breunig, M.M., Kriegel, H.P., Ng, R.T., and Sander, J. (2000, January 16–18). LOF: Identifying density-based local outliers. Proceedings of the 2000 ACM SIGMOD International Conference on Management of Data, Dallas, TX, USA.10.1145/342009.335388 ↗
9. Kriegel, H.P., Kröger, P., Schubert, E., and Zimek, A. (2009, January 2–6). LoOP: Local outlier probabilities. Proceedings of the 18th ACM Conference on Information and Knowledge Management, Hong Kong, China.10.1145/1645953.1646195 ↗
10. Ramaswamy, S., Rastogi, R., and Shim, K. (2000, January 16–18). Efficient algorithms for mining outliers from large data sets. Proceedings of the 2000 ACM SIGMOD International Conference on Management of Data, Dallas, TX, USA.10.1145/342009.335437 ↗
11. Initialization of K-modes clustering using outlier detection techniques10.1016/j.ins.2015.11.005 ↗
12. Flanagan, K., Fallon, E., Connolly, P., and Awad, A. (2017, January 12–15). Network anomaly detection in time series using distance based outlier detection with cluster density analysis. Proceedings of the 2017 Internet Technologies and Applications (ITA), Wrexham, UK.10.1109/ITECHA.2017.8101921 ↗
13. Distance-based outlier detection in data streams10.14778/2994509.2994526 ↗
14. Aggarwal, C.C. (2017). Outlier Detection in Categorical, Text, and Mixed Attribute Data. Outlier Analysis, Springer.10.1007/978-3-319-47578-3_8 ↗
15. A survey of outlier detection methodologies10.1023/B:AIRE.0000045502.10941.a9 ↗
16. Duraj, A. (2017, January 3–5). Outlier detection in medical data using linguistic summaries. Proceedings of the 2017 IEEE International Conference on Innovations in Intelligent SysTems and Applications (INISTA), Gdynia, Poland.10.1109/INISTA.2017.8001191 ↗
17. Outlier detection using linguistically quantified statements10.1002/int.21924 ↗
18. Detection of outlier information by the use of linguistic summaries based on classic and interval-valued fuzzy sets10.1002/int.22059 ↗
19. Detecting and Recognizing Outliers in Datasets via Linguistic Information and Type-2 Fuzzy Logic10.1007/s40815-020-00919-5 ↗
20. (2020, June 30). Consumer Complaint Database, Available online: https://catalog.data.gov/dataset/consumer-complaint-database.
21. A computational approach to fuzzy quantifiers in natural languages10.1016/0898-1221(83)90013-5 ↗
22. A definition of the non-probabilistic entropy in the setting of fuzzy sets theory10.1016/S0019-9958(72)90199-4 ↗
23. Niewiadomski, A. (2008). Methods for the Linguistic Summarization of Data: Applications of Fuzzy Sets and Their Extensions, Academic Publishing House EXIT.
24. A Type-2 Fuzzy Approach to Linguistic Summarization of Data10.1109/TFUZZ.2007.902025 ↗
25. (2021, June 30). Neo4j: Graph Database Platform | Graph Database. Available online: https://neo4j.com.
26. Local outlier detection reconsidered: A generalized view on locality with applications to spatial, video, and network outlier detection10.1007/s10618-012-0300-z ↗
27. (2021, July 20). Scikit-Learn: Machine Learning in Python. Available online: https://scikit-learn.org.
28. (2021, July 20). Pandas—Python Data Analysis Library. Available online: https://pandas.pydata.org.
29. Sadeghian, A., and Tahayori, H. (2015). Multi-Subject Type-2 Linguistic Summaries of Relational Databases. Frontiers of Higher Order Fuzzy Sets, Springer.10.1007/978-1-4614-3442-9 ↗