journal article·2025-05-27Open access

View-Aware Contrastive Learning for Incomplete Tabular Data with Low-Label Regimes

Yingqiu Yang, Qianye Lin, Zeyue Li, Yakui Wang, Siyu Liang, Siyuan Zhang, Yiyan Wang, Chunli Lv

Applied Sciences· Volume 15· Issue 11

Abstract

To address the challenges of label sparsity and feature incompleteness in structured data, a self-supervised representation learning method based on multi-view consistency constraints is proposed in this paper. Robust modeling of high-dimensional sparse tabular data is achieved through integration of a view-disentangled encoder, intra- and cross-view contrastive mechanisms, and a joint loss optimization module. The proposed method incorporates feature clustering-based view partitioning, multi-view consistency alignment, and masked reconstruction mechanisms, thereby enhancing the model’s representational capacity and generalization performance under weak supervision. Across multiple experiments conducted on four types of datasets, including user rating data, platform activity logs, and financial transactions, the proposed approach maintains superior performance even under extreme conditions of up to 40% feature missingness and only 10% label availability. The model achieves an accuracy of 0.87, F1-score of 0.83, and AUC of 0.90 while reducing the normalized mean squared error to 0.066. These results significantly outperform mainstream baseline models such as XGBoost, TabTransformer, and VIME, demonstrating the proposed method’s robustness and broad applicability across diverse real-world tasks. The findings suggest that the proposed method offers an efficient and reliable paradigm for modeling sparse structured data.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Machine Learning and Data Classification · Data Stream Mining Techniques · Machine Learning and Algorithms

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

China Agricultural University, Beijing 100083, China

School of Statistics, University of International Business and Economics, Beijing 100029, China

School of Accountancy, Central University of Finance and Economics, Beijing 100081, China

School of English and International Studies, Beijing Foreign Studies University, Beijing 100089, China

School of Statistics and Mathematics, Central University of Finance and Economics, Beijing 100081, China

National Security Academy, University of International Relations, Beijing 100091, China

Funding

National Natural Science Foundation of China

References (58)

Show source-provided references
1. Ruan, Y., Lan, X., Ma, J., Dong, Y., He, K., and Feng, M. (2024). Language modeling on tabular data: A survey of foundations, techniques and evolution. arXiv.
2. Data science and analytics: An overview from data-driven smart computing, decision-making and applications perspective10.1007/s42979-021-00765-8 ↗
3. Big data in finance10.1093/rfs/hhab038 ↗
4. Development of an intelligent information system for financial analysis depend on supervised machine learning algorithms10.1016/j.ipm.2022.103036 ↗
5. Supervised machine learning method for ontology-based financial decisions in the stock market
6. Qu, L., Liu, S., Liu, X., Wang, M., and Song, Z. (2022). Towards label-efficient automatic diagnosis and analysis: A comprehensive survey of advanced deep learning-based weakly-supervised, semi-supervised and self-supervised techniques in histopathological image analysis. Phys. Med. Biol., 67.10.1088/1361-6560/ac910a ↗
7. Learning sparse features can lead to overfitting in neural networks
8. Optimization strategies for self-supervised learning in the use of unlabeled data10.53469/jtpes.2024.04(05).05 ↗
9. Ndifon, V.B. (2023). The Reliability and Efficiency of Replacing Missing Data in Sparse Data Sets. [Ph.D. Thesis, Northcentral University].
10. Artificial neural network, support vector machine, decision tree, random forest, and committee machine intelligent system help to improve performance prediction of low salinity water injection in carbonate oil reservoirs10.1016/j.petrol.2022.111046 ↗
11. Comparison between common statistical modeling techniques used in research, including: Discriminant analysis vs logistic regression, ridge regression vs LASSO, and decision tree vs. random forest
12. Teegavarapu, R.S. (2024). Imputation Methods: An Overview. Imputation Methods for Missing Hydrometeorological Data Estimation, Springer.10.1007/978-3-031-60946-6 ↗
13. Missing data imputation with high-dimensional data10.1080/00031305.2023.2259962 ↗
14. Zhang, Y., Wa, S., Liu, Y., Zhou, X., Sun, P., and Ma, Q. (2021). High-accuracy detection of maize leaf diseases CNN based on multi-pathway activation function module. Remote Sens., 13.10.3390/rs13214218 ↗
15. A comparison of full information maximum likelihood and multiple imputation in structural equation modeling with missing data10.1037/met0000381 ↗
16. Deep neural networks and tabular data: A survey10.1109/TNNLS.2022.3229161 ↗
17. Zhang, L., Zhang, Y., and Ma, X. (2021, January 17–19). A New Strategy for Tuning ReLUs: Self-Adaptive Linear Units (SALUs). Proceedings of the ICMLCA 2021 2nd International Conference on Machine Learning and Computer Application, Shenyang, China.
18. Shakir, W.A. (2024, January 25–26). Benchmarking TabLM: Evaluating the Performance of Language Models Against Traditional Machine Learning in Structured Data Tasks. Proceedings of the 2024 1st International Conference on Emerging Technologies for Dependable Internet of Things (ICETI), Sana’a, Yemen.10.1109/ICETI63946.2024.10777155 ↗
19. Deep learning in insurance: Accuracy and model interpretability using TabNet10.1016/j.eswa.2023.119543 ↗
20. Li, Q., and Zhang, Y. (2024, January 5–7). Confidential Federated Learning for Heterogeneous Platforms against Client-Side Privacy Leakages. Proceedings of the ACM Turing Award Celebration Conference-China 2024, Changsha China.10.1145/3674399.3674484 ↗
21. Vyas, T.K. (2024). Deep learning with tabular data: A self-supervised approach. arXiv.
22. Li, Q., Zhang, Y., Ren, J., Li, Q., and Zhang, Y. (2024). You Can Use But Cannot Recognize: Preserving Visual Privacy in Deep Neural Networks. arXiv.10.14722/ndss.2024.241361 ↗
23. Deep learning versus conventional methods for missing data imputation: A review and comparative study10.1016/j.eswa.2023.120201 ↗
24. Li, Q., Ren, J., Zhang, Y., Song, C., Liao, Y., and Zhang, Y. (2023, January 9–13). Privacy-Preserving DNN Training with Prefetched Meta-Keys on Heterogeneous Neural Network Accelerators. Proceedings of the 2023 60th ACM/IEEE Design Automation Conference (DAC), San Francisco, CA, USA.10.1109/DAC56929.2023.10247964 ↗
25. Wei, Y., Zhao, L., Zheng, W., Zhu, Z., Rao, Y., Huang, G., Lu, J., and Zhou, J. (2023, January 6–9). Surrounddepth: Entangling surrounding views for self-supervised multi-camera depth estimation. Proceedings of the Conference on Robot Learning, PMLR, Atlanta, GA, USA.
26. Wandt, B., Rudolph, M., Zell, P., Rhodin, H., and Rosenhahn, B. (2021, January 19–25). Canonpose: Self-supervised monocular 3d human pose estimation in the wild. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.01309 ↗
27. Sc-depthv3: Robust self-supervised monocular depth estimation for dynamic scenes10.1109/TPAMI.2023.3322549 ↗
28. Chen, K., Hong, L., Xu, H., Li, Z., and Yeung, D.Y. (2021, January 11–17). Multisiam: Self-supervised multi-instance siamese representation learning for autonomous driving. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, BC, Canada.10.1109/ICCV48922.2021.00745 ↗
29. Koo, H., and Kim, T.E. (2023). A comprehensive survey on generative diffusion models for structured data. arXiv.
30. Improving Penalized Logistic Regression Model with Missing Values in High-Dimensional Data
31. Interpretable machine learning with an ensemble of gradient boosting machines10.1016/j.knosys.2021.106993 ↗
32. A review of data mining, big data analytics, and machine learning approaches10.53759/181X/JCNS202303016 ↗
33. Deep learning modelling techniques: Current progress, applications, advantages, and challenges10.1007/s10462-023-10466-8 ↗
34. Somvanshi, S., Das, S., Javed, S.A., Antariksa, G., and Hossain, A. (2024). A survey on deep tabular learning. arXiv.
35. Learning from noisy labels with deep neural networks: A survey10.1109/TNNLS.2022.3152527 ↗
36. A survey: Deep learning for hyperspectral image classification with few labeled samples10.1016/j.neucom.2021.03.035 ↗
37. A survey on self-supervised learning: Algorithms, applications, and future trends10.1109/TPAMI.2024.3415112 ↗
38. Predictive intelligence in harmful news identification by BERT-based ensemble learning model with text sentiment analysis10.1016/j.ipm.2022.102872 ↗
39. The performance of BERT as data representation of text clustering10.1186/s40537-022-00564-9 ↗
40. Self-supervised learning: A succinct review10.1007/s11831-023-09884-2 ↗
41. Self-supervised learning: Generative or contrastive
42. Xie, Z., Zhang, Z., Cao, Y., Lin, Y., Bao, J., Yao, Z., Dai, Q., and Hu, H. (2022, January 18–24). Simmim: A simple framework for masked image modeling. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.00943 ↗
43. Hua, T., Wang, W., Xue, Z., Ren, S., Wang, Y., and Zhao, H. (2021, January 11–17). On feature decorrelation in self-supervised learning. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, BC, Canada.10.1109/ICCV48922.2021.00946 ↗
44. Deep multi-view learning methods: A review10.1016/j.neucom.2021.03.090 ↗
45. Yu, Z., Dong, Z., Yu, C., Yang, K., Fan, Z., and Chen, C.P. (2025). A review on multi-view learning. Front. Comput. Sci., 19.10.1007/s11704-024-40004-w ↗
46. A review of feature set partitioning methods for multi-view ensemble learning10.1016/j.inffus.2023.101959 ↗
47. Consensus graph learning for multi-view clustering10.1109/TMM.2021.3081930 ↗
48. Partial multi-label learning based on sparse asymmetric label correlations10.1016/j.knosys.2022.108601 ↗
49. Heterogeneous data fusion and loss function design for tooth point cloud segmentation10.1007/s00521-022-07379-y ↗
50. Tan, Z., Li, D., Wang, S., Beigi, A., Jiang, B., Bhattacharjee, A., Karami, M., Li, J., Cheng, L., and Liu, H. (2024). Large language models for data annotation and synthesis: A survey. arXiv.10.18653/v1/2024.emnlp-main.54 ↗
51. A proxy learning curve for the Bayes classifier10.1016/j.patcog.2022.109240 ↗
52. Generative Adversarial Networks and Markov Random Fields for oversampling very small training sets10.1016/j.eswa.2020.113819 ↗
53. Kleinbaum, D.G., Dietz, K., Gail, M., Klein, M., and Klein, M. (2002). Logistic Regression, Springer.
54. Chen, T., and Guestrin, C. (2016, January 13–17). Xgboost: A scalable tree boosting system. Proceedings of the 22nd ACM Sigkdd International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA.10.1145/2939672.2939785 ↗
55. Arik, S.Ö., and Pfister, T. (2021, January 2–9). Tabnet: Attentive interpretable tabular learning. Proceedings of the AAAI Conference on Artificial Intelligence, Virtual.10.1609/aaai.v35i8.16826 ↗
56. Huang, X., Khetan, A., Cvitkovic, M., and Karnin, Z. (2020). Tabtransformer: Tabular data modeling using contextual embeddings. arXiv.
57. Vime: Extending the success of self-and semi-supervised learning to tabular domain
58. Koroteev, M.V. (2021). BERT: A review of applications in natural language processing and understanding. arXiv.