An information fractal dimensional relative entropy
Source abstract
Abstract
Shannon entropy is used to measure information uncertainty, while the information dimension is used to measure information complexity. Given two probability distributions, the difference can be measured by relative entropy. However, the existing relative entropy does not consider the effect of information dimension. To improve the existing entropy, a new relative entropy is presented in this paper. The information fractal dimension is considered in the proposed relative entropy. The new relative entropy is more generalized than the initial relative entropy. When dimension is not considered, it will degenerate to the initial relative entropy. Another interesting point is that the new relative entropy may have negative values when calculating. The physical meaning is still under exploration. Finally, some application examples are provided to exemplify the utilization of the proposed relative entropy.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Statistical Mechanics and Entropy · Cognitive Science and Education Research
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Institute of Faculty of Mathematical Sciences and Fundamental and Frontier Science, University of Electronic Science and Technology of China , Chengdu 610054, China
Funding
National Natural Science Foundation of China
References (58)
Show source-provided references
1. A mathematical theory of communication10.1145/584091.584093 ↗
2. Dynamic fault tree analysis based on continuous-time Bayesian networks under fuzzy numbers10.1177/1748006X15588446 ↗
3. A new picture fuzzy information measure based on Shannon entropy with applications in opinion polls using extended Vikor–Todim approach10.1007/s40314-020-01228-1 ↗
4. Reliability analysis of multi-state systems with common cause failures based on Bayesian network and fuzzy probability10.1007/s10479-019-03247-6 ↗
5. Belief entropy-of-entropy and its application in the cardiac interbeat interval time series analysis10.1016/j.chaos.2021.111736 ↗
6. Application of entropy for automated detection of neurological disorders with electroencephalogram signals: A review of the last decade10.1109/ACCESS.2023.3294473 ↗
7. The asymptotic distribution of the permutation entropy, Chaos10.1063/5.0171508 ↗
8. Decoding collective communications using information theory tools10.1098/rsif.2019.0563 ↗
9. Data-driven learning of boolean networks and functions by optimal causation entropy principle10.1016/j.patter.2022.100631 ↗
10. A new basic probability assignment generation and combination method for conflict data fusion in the evidence theory10.1038/s41598-023-35195-4 ↗
11. Deng entropy10.1016/j.chaos.2016.07.014 ↗
12. Random permutation set10.15837/ijccc.2022.1.4542 ↗
13. Maximum entropy of random permutation set10.1007/s00500-022-07351-x ↗
14. Entropy of random permutation set10.1080/03610926.2023.2173975 ↗
15. The distance of random permutation set10.1016/j.ins.2023.01.105 ↗
16. Marginalization in random permutation set theory: From the cooperative game perspective10.1007/s11071–023–08506–7 ↗
17. CSCIM_FS: Cosine similarity coefficient and information measurement criterion-based feature selection method for high-dimensional data10.1016/j.neucom.2023.126564 ↗
18. Matrix operations in random permutation set10.1016/j.ins.2023.119419 ↗
19. Analysis of the information entropy on traffic flows10.1109/tits.2022.3155933 ↗
20. Permutation Jensen–Shannon divergence for random permutation set, engineering applications of artificial intelligence10.1016/j.engappai.2022.105701 ↗
21. An evidential network approach to reliability assessment by aggregating system-level imprecise knowledge10.1002/qre.3319 ↗
22. On the dimension and entropy of probability distributions10.1007/bf02063299 ↗
23. Estimating fractal dimensions: A comparative review and open source implementations10.1063/5.0160394 ↗
24. Estimating fractal dimension10.1364/josaa.7.001055 ↗
25. Fractal and multifractal analysis: A review10.1016/j.media.2009.05.003 ↗
26. On the construction, properties and Hausdorff dimension of random Cantor one pth set10.3934/math.2020202 ↗
27. 2013
28. 2014
29. Rényi information dimension: Fundamental limits of almost lossless analog compression10.1109/tit.2010.2050803 ↗
30. Fractals with optimal information dimension10.1007/s00034-021-01726-5 ↗
31. Information fractal dimension of mass function10.1142/s0218348x22501109 ↗
32. Information fractal dimension of random permutation set10.1016/j.chaos.2023.113883 ↗
33. Information dimension, information overload and decision quality10.1177/016555159902500305 ↗
34. Fractal dimensions in dynamics
35. Informative fractal dimension associated with nonmetricity in information geometry10.1016/j.physa.2023.129017 ↗
36. Engagement with social media and social media advertising: The differentiating role of platform type10.1080/00913367.2017.1405754 ↗
37. Using fractals to describe ecologically relevant patterns in distributions of large rocks in streams10.1029/2021wr029796 ↗
38. A novel dimension reduction method with information entropy to evaluate network resilience10.1016/j.physa.2023.128727 ↗
39. Two-parameter fractional Tsallis information dimensions of complex networks10.1016/j.chaos.2021.111113 ↗
40. Information dimension based on deng entropy10.1016/j.physa.2022.127584 ↗
41. An information-theoretic definition of similarity
42. A similarity model for representing soil spatial information10.1016/s0016-7061(97)00023-2 ↗
43. Measurement of text similarity: A survey10.3390/info11090421 ↗
44. An improved failure mode and effects analysis method using belief Jensen–Shannon divergence and entropy measure in the evidence theory10.1007/s13369-022-07560-4 ↗
45. On the relative entropy10.1007/bf01212339 ↗
46. The role of relative entropy in quantum information theory10.1103/revmodphys.74.197 ↗
47. Matrix trace inequalities on Tsallis relative entropy of negative order10.1016/j.jmaa.2018.12.005 ↗
48. Node similarity measuring in complex networks with relative entropy10.1016/j.cnsns.2019.104867 ↗
49. Relative entropy of z-numbers10.1016/j.ins.2021.08.077 ↗
50. A relative entropy-based approach to image thresholding10.1016/0031-3203(94)90011-6 ↗
51. Relative entropy optimization and its applications10.1007/s10107-016-0998-2 ↗
52. Conflicting evidence fusion using a correlation coefficient-based approach in complex network10.1016/j.chaos.2023.114087 ↗
53. On measures of entropy and information
54. Smooth Rényi entropy and applications
55. M. Nechba and M.Ouyaaz, “Understanding the Hausdorff measure and dimension: Fundamentals and examples,” arXiv:2304.11500.
56. Harmonic Sierpinski gasket and applications10.3390/e20090714 ↗
57. A distributionally robust optimization model for unit commitment based on Kullback–Leibler divergence10.1109/tpwrs.2018.2797069 ↗
58. Estimating the spectrum in computed tomography via Kullback–Leibler divergence constrained optimization10.1002/mp.13257 ↗