journal article·2021Open access

A Parallel Approach to Discords Discovery in Massive Time Series Data

Mikhail Zymbler, Alexander Grents, Yana Kraeva, Sachin Kumar

Computers, Materials & Continua· Volume 66· Issue 2

Abstract

A discord is a refinement of the concept of an anomalous subsequence of a time series. Being one of the topical issues of time series mining, discords discovery is applied in a wide range of real-world areas (medicine, astronomy, economics, climate modeling, predictive maintenance, energy consumption, etc.). In this article, we propose a novel parallel algorithm for discords discovery on high-performance cluster with nodes based on many-core accelerators in the case when time series cannot fit in the main memory. We assumed that the time series is partitioned across the cluster nodes and achieved parallelization among the cluster nodes as well as within a single node. Within a cluster node, the algorithm employs a set of matrix data structures to store and index the subsequences of a time series, and to provide an efficient vectorization of computations on the accelerator. At each node, the algorithm processes its own partition and performs in two phases, namely candidate selection and discord refinement, with each phase requiring one linear scan through the partition. Then the local discords found are combined into the global candidate set and transmitted to each cluster node. Next, a node performs refinement of the global candidate set over its own partition resulting in the local true discord set. Finally, the global true discords set is constructed as intersection of the local true discord sets. The experimental evaluation on the real computer cluster with real and synthetic time series shows a high scalability of the proposed algorithm.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Time Series Analysis and Forecasting · Complex Systems and Time Series Analysis · Metabolomics and Mass Spectrometry Studies

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (27)

Show source-provided references
1. HOT SAX: Efficiently finding the most unusual time series subsequence
2. Towards parameter-free data mining
3. Disk aware discord discovery: Finding unusual time series in terabyte sized datasets
4. Disk aware discord discovery: Finding unusual time series in terabyte sized datasets10.1007/s10115-008-0131-9 ↗
5. Time series discord discovery on Intel many-core systems
6. Probabilistic discovery of time series motifs
7. V.Chandola, D.Cheboli and V.Kumar, “Detecting anomalies in a time series database.” Technical Report, Department of Computer Science and Engineering, University of Minnesota, Minneapolis, MN, USA, 2009.
8. A symbolic representation of time series, with implications for streaming algorithms
9. iSAX: Indexing and mining terabyte sized time series
10. Time series discord discovery based on iSAX symbolic representation
11. Finding time series discords based on Haar transform
12. An effective and efficient hash-based algorithm for time series discord discovery
13. Discord detection in streaming time series with the support of R-tree
14. Finding time series discord based on bit representation clustering10.1016/j.knosys.2013.09.015 ↗
15. Distributed discord discovery: Spark based anomaly detection in time series
16. Spark: Cluster computing with working sets
17. The Google file system
18. Parallel discord discovery
19. Time series joins, motifs, discords and shapelets: A unifying view that exploits the matrix profile10.1007/s10618-017-0519-9 ↗
20. Matrix profile XI: SCRIMP++: Time series motif discovery at interactive speeds
21. G.Pfeilschifter, “Time series analysis with matrix profile on HPC systems,” Ph.D. dissertation. Department of Informatics, Technical University of Munich, Munich, Bavaria, Germany, 2019.
22. Compiler transformations for high-performance computing10.1145/197405.197406 ↗
23. SUSU supercomputer resources for industry and fundamental science
24. Intel® Xeon Phi coprocessor (codename Knights Corner)
25. Grama · Introduction to Parallel Computing · 2003
26. PhysioToolkit, and PhysioNet: Components of a new research resource for complex physiologic signals10.1161/01.CIR.101.23.e215 ↗
27. The problem of the random walk10.1038/072294b0 ↗