journal article·2016-04-05Open access

Multi-Variable, Multi-Layer Graphical Knowledge Unit for Storing and Representing Density Clusters of Multi-Dimensional Big Data

K. Adikaram, Mohamed Hussein, Mathias Effenberger, Thomas Becker

Applied Sciences· Volume 6· Issue 4

Abstract

A multi-variable visualization technique on a 2D bitmap for big data is introduced. If A and B are two data points that are represented using two similar shapes with m pixels, where each shape is colored with RGB color of (0, 0, k), when A ∩ B ≠ ɸ, adding the color of A ∩ B gives higher color as (0, 0, 2k) and the highlight as a high density cluster, where RGB stands for Red, Green, Blue and k is the blue color. This is the hypothesis behind the single variable graphical knowledge unit (GKU), which uses the entire bit range of a pixel for a single variable. Instead, the available bit range of a pixel is split, and a pixel can be used for representing multiple variables (multi-variables). However, this will limit the bit block for single variables and limit the amount of overlapping. Using the same size k (>1) bitmaps (multi-layers) will increase the number of bits per variable (BPV), where each (x, y) of an individual layer represents the same data point. Then, one pixel in a four-layer GKU is capable of showing more than four billion overlapping ones when BPV = 8 bits (2(BPV × number of layers)) Then, the 32-bit pixel format allows the representation of a maximum of up to four dependent variables against one independent variable. Then, a four-layer GKU of w width and h height has the capacity of representing a maximum of (2(BPV × number of layers)) × m × w × h overlapping occurrences.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Data Visualization and Analytics · Image Retrieval and Classification Techniques · Data Management and Algorithms

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Group Bio-Process Analysis Technology, Technische Universität München, Weihenstephaner Steig 20, Freising 85354, Germany

Bavarian State Research Center for Agriculture, Institute for Agricultural Engineering and Animal Husbandry, Vöttinger Straße 36, Freising 85354, Germany

Computer Unit, Faculty of Agriculture, University of Ruhuna, Mapalana, Kamburupitiy 81100, Sri Lanka

Lehrstuhl für Brau- und Getränketechnologie, Technische Universität München, Weihenstephaner Steig 20, Freising 85354, Germany

Funding

Technische Universität München

References (31)

Show source-provided references
1. Information visualization and visual data mining10.1109/2945.981847 ↗
2. Multidimensional visualization tools for analysis of expression data
3. Using self-similarity to cluster large data sets10.1023/A:1022493416690 ↗
4. Hierarchical data organization, clustering and denoising via localized diffusion folders10.1016/j.acha.2011.09.002 ↗
5. Graph based K-means clustering10.1016/j.sigpro.2011.12.009 ↗
6. Chen, F., Deng, P., Wan, J., Zhang, D., Vasilakos, A.V., and Rong, X. (2015). Data mining for the internet of things: Literature review and challenges. Int. J. Distrib. Sens. Netw., 501.10.1155/2015/431047 ↗
7. Data, information, and knowledge in visualization10.1109/MCG.2009.6 ↗
8. Akerkar, R. (2013). Big Data Computing, CRC Press.10.1201/b16014 ↗
9. Tsai, C.W., Lai, C.F., Chao, H.C., and Vasilakos, A. (2015). Big data analytics: A survey. J. Big Data, 2.10.1186/s40537-015-0030-3 ↗
10. Karimi, H.A. (2014). Big Data: Techniques and Technologies in Geoinformatics, CRC Press.10.1201/b16524 ↗
11. Accelerated PSO swarm search feature selection for data stream mining big data10.1109/TSC.2015.2439695 ↗
12. Chambers, J.M., Cleveland, W.S., Kleiner, B., and Tukey, P.A. (1983). Graphical Methods for Data Analysis, Wadsworth.
13. Inselberg, A., and Dimsdale, B. (1990, January 23–26). Parallel coordinates: A tool for visualizing multi-dimensional geometry. Proceedings of the 1st Conference on Visualization, San Francisco, CA, USA.
14. Andrews, D.F. (1972). Biometrics, International Biometric Society.
15. Bartke, K. 2D, 3D and High-Dimensional Data and Information Visualization. Available online: http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.83.3421&rep=rep1&type=pdf.
16. Hoffman, P., Grinstein, G., Marx, K., Grosse, I., and Stanley, E. (1997, January 24). DNA visual and analytic data mining. Proceedings of the IEEE Visualization, Phoenix, AZ, USA.
17. Visualizing high density clusters in multidimensional data using optimized star coordinates10.1007/s00180-011-0271-3 ↗
18. Hoffman, P., and Grinstein, G. Visualizations for High Dimensional Data Mining-Table Visualizations. Available online: http://web.simmons.edu/~benoit/infovis/MIV-datamining.pdf.
19. Usama, F., Georges, G.G., and Andreas, W. (2002). Information Visualization in Data Mining and Knowledge Discovery, Morgan Kaufmann Publishers Inc.
20. Danyu, L., Sprague, A.P., and Gray, J.G. (2004, January 16–18). PolyCluster: An interactive visualization approach to construct classification rules. Proceedings of the 2004 International Conference on Machine Learning and Applications, Louisville, KY, USA.
21. An introduction to modern missing data analyses10.1016/j.jsp.2009.10.001 ↗
22. Missing data: Our view of the state of the art10.1037/1082-989X.7.2.147 ↗
23. Nurunnabi, A.A.M., Imon, A.H.M.R., Ali, A.B.M.S., and Nasser, M. (2011). Computational Modeling and Simulation of Intellect: Current State and Future Perspectives, IGI Global.
24. Outlier … … … s
25. Adikaram, K.K.L.B., Hussein, M.A., Effenberger, M., and Becker, T. (2016). Continuous learning graphical knowledge unit for cluster identification in high density data sets. IEEE Trans. Vis. Comput. Graph., under review.10.3390/sym8120152 ↗
26. Han, J., Kamber, M., and Pei, J. (2006). Data Mining, Southeast Asia Edition: Concepts and Techniques, Elsevier Science.
27. Data mining: A preprocessing engine10.3844/jcssp.2006.735.739 ↗
28. The potential for online monitoring of short-term process dynamics in anaerobic digestion using near-infrared spectroscopy10.1016/j.biombioe.2012.10.027 ↗
29. Near infrared spectroscopy calibrations for the estimation of process parameters of anaerobic digestion of energy crops and livestock residues10.1255/jnirs.960 ↗
30. Nikiel, S. (2007). Iterated Function Systems for Real-Time Image Synthesis, Springer.
31. Gelphman, D., and Laden, B. (2010). Programming with Quartz: 2D and PDF Graphics in Mac OS X, Elsevier Science.