journal article·2026-07-09Open access

StackingNet: Collective Inference Across Independent AI Foundation Models

Siyang Li, Chenhao Liu, Dongrui Wu, Zhigang Zeng, Lieyun Ding

Abstract

ABSTRACT Artificial intelligence (AI) built on large foundation models has transformed language understanding, computer vision, and reasoning, yet these systems remain isolated and cannot readily share their capabilities. Coordinating the complementary strengths of independently developed, black‐box foundation models is essential for trustworthy intelligent systems, yet no established method exists. Here we show that such coordination can be achieved through a meta‐ensemble framework termed StackingNet, which aggregates the output predictions of independent models at inference. StackingNet improves accuracy, reduces individual‐model error and group‐wise disparities, ranks model reliability, and identifies or prunes models that degrade performance, all without access to internal parameters or training data. Across language comprehension, visual attribute estimation, and academic paper rating, it consistently outperforms individual models and classic ensembles, with gains that persist when the base models are uniformly strong. These gains stem from variance reduction and consensus alignment among independent models rather than from any emergent group cognition, and they widen as the model pool grows more diverse. By turning model diversity from a source of inconsistency into a resource for cooperation, StackingNet offers a practical path toward coordinated AI, where progress emerges not only from larger single models but from principled cooperation among many specialized ones.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Explainable Artificial Intelligence (XAI) · Multimodal Machine Learning Applications · Domain Adaptation and Few-Shot Learning

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan China

School of Civil and Hydraulic Engineering Huazhong University of Science and Technology Wuhan China

Funding

National Natural Science Foundation of China

References (62)

Show source-provided references
1. W. X.Zhao K.Zhou J.Li et al. “A Survey of Large Language Models ” (2023) preprint arXiv.
2. 10.1109/TPAMI.2024.336969910.1109/TPAMI.2024.3369699 ↗
3. D.Hendrycks C.Burns S.Basart et al. “Measuring Massive Multitask Language Understanding ” inInternational Conference on Learning Representations(ICLR 2021).
4. S.Antol A.Agrawal J.Lu et al. “VQA: Visual Question Answering ” inProceedings of the IEEE International Conference on Computer Vision(IEEE 2015) 2425–2433.10.1109/ICCV.2015.279 ↗
5. M.Chen J.Tworek H.Jun et al. “Evaluating Large Language Models Trained on Code ” (2021) preprint arXiv.
6. J.Liu C. S.Xia Y.Wang andL.Zhang “Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation ” inAdvances in Neural Information Processing Systems(NeurIPS 2023).10.52202/075280-0943 ↗
7. 10.1038/s42256-023-00644-210.1038/s42256-023-00644-2 ↗
8. Z.Tan D.Li S.Wang et al. “Large Language Models for Data Annotation and Synthesis: A Survey ” inProceedings of the Conference on Empirical Methods in Natural Language Processing(ACL 2024) 930–957.10.18653/v1/2024.emnlp-main.54 ↗
9. 10.1016/j.inffus.2025.10333210.1016/j.inffus.2025.103332 ↗
10. 10.1056/AIoa240019610.1056/AIoa2400196 ↗
11. 10.1145/363937210.1145/3639372 ↗
12. 10.1038/s42256-022-00516-110.1038/s42256-022-00516-1 ↗
13. 10.1038/s42256-019-0088-210.1038/s42256-019-0088-2 ↗
14. 10.1162/coli_a_0052410.1162/coli_a_00524 ↗
15. P. P.Liang C.Wu L.‐P.Morency andR.Salakhutdinov “Towards Understanding and Mitigating Social Biases in Language Models ” inProceedings of the International Conference on Machine Learning(PMLR 2021) 6565–6576.
16. L.Ouyang J.Wu X.Jiang et al. “Training Language Models to Follow Instructions with Human Feedback ” inAdvances in Neural Information Processing Systems(NeurIPS 2022) 27730–27744.10.52202/068431-2011 ↗
17. J.Ji T.Qiu B.Chen et al. “AI Alignment: A Comprehensive Survey ” (2023) preprint arXiv.
18. 10.1093/nsr/nwad04010.1093/nsr/nwad040 ↗
19. X.Ren P.Zhou X.Meng et al. “PanGu‐σ$\sigma$: Towards Trillion Parameter Language Model with Sparse Heterogeneous Computing ” (2023) preprint arXiv.
20. 10.1038/s42256-020-0217-y10.1038/s42256-020-0217-y ↗
21. 10.1109/TKDE.2016.253524210.1109/TKDE.2016.2535242 ↗
22. 10.2307/234680610.2307/2346806 ↗
23. 10.1016/S0893-6080(05)80023-110.1016/S0893-6080(05)80023-1 ↗
24. D.Li B.Jiang L.Huang et al. “From Generation to Judgment: Opportunities and Challenges of LLM‐as‐a‐Judge ” inProceedings of the Conference on Empirical Methods in Natural Language Processing(ACL 2025) 2757–2791.10.18653/v1/2025.emnlp-main.138 ↗
25. 10.1126/science.aal423010.1126/science.aal4230 ↗
26. 10.3758/s13428-014-0532-510.3758/s13428-014-0532-5 ↗
27. 10.1145/361686510.1145/3616865 ↗
28. 10.1038/s41598-022-07939-110.1038/s41598-022-07939-1 ↗
29. J.Chi Y.Tian G. J.Gordon andH.Zhao “Understanding and Mitigating Accuracy Disparity in Regression ” inProceedings of the International Conference on Machine Learning(PMLR 2021) 1866–1876.
30. A.Agarwal M.Dudík andZ. S.Wu “Fair Regression: Quantitative Definitions and Reduction‐Based Algorithms ” inProceedings of the International Conference on Machine Learning(PMLR 2019) 120–129.
31. E.Diana W.Gill M.Kearns K.Kenthapadi andA.Roth “Minimax Group Fairness: Algorithms and Experiments ” inProceedings of the AAAI/ACM Conference on AI Ethics and Society(ACM 2021) 66–76.10.1145/3461702.3462523 ↗
32. E.Chzhen C.Denis M.Hebiri L.Oneto andM.Pontil “Fair Regression with Wasserstein Barycenters ” inAdvances in Neural Information Processing Systems(NeurIPS 2020) 7321–7331.
33. 10.1073/pnas.080566410510.1073/pnas.0805664105 ↗
34. 10.1146/annurev-psych-113011-14383110.1146/annurev-psych-113011-143831 ↗
35. Holistic Evaluation of Language Models
36. G.Hinton O.Vinyals andJ.Dean “Distilling the Knowledge in a Neural Network ” (2015) preprint arXiv.
37. X.Xu M.Li C.Tao et al. “A Survey on Knowledge Distillation of Large Language Models ” (2024) preprint arXiv.
38. 10.1023/A:102285900300610.1023/A:1022859003006 ↗
39. 10.1145/364128910.1145/3641289 ↗
40. H.Touvron L.Martin K.Stone et al. “Llama 2: Open Foundation and Fine‐Tuned Chat Models ” (2023) preprint arXiv.
41. J.Achiam S.Adler S.Agarwal et al. “GPT‐4 Technical Report ” (2023) preprint arXiv.
42. I.Ong A.Almahairi V.Wu et al. “RouteLLM: Learning to Route LLMs from Preference Data ” inInternational Conference on Learning Representations(ICLR 2025).
43. W.Zhao V.Khazanchi H.Xing X.He Q.Xu andN. D.Lane “Attacks on Third‐Party APIs of Large Language Models ” inInternational Conference on Learning Representations Workshop on Secure and Trustworthy Large Language Models(ICLR 2024).
44. 10.1023/B:MACH.0000015881.36452.6e10.1023/B:MACH.0000015881.36452.6e ↗
45. 10.1109/MCI.2025.362419410.1109/MCI.2025.3624194 ↗
46. 10.1145/362472510.1145/3624725 ↗
47. 10.1201/b1220710.1201/b12207 ↗
48. 10.1023/A:101805431435010.1023/A:1018054314350 ↗
49. Perrone M. P. · 1995 · 342
50. 10.1109/3468.61825510.1109/3468.618255 ↗
51. 10.1007/BF0011894010.1007/BF00118940 ↗
52. 10.1073/pnas.121909711110.1073/pnas.1219097111 ↗
53. J.Whitehill T.‐F.Wu J.Bergsma J.Movellan andP.Ruvolo “Whose Vote Should Count More: Optimal Integration of Labels from Labelers of Unknown Expertise ” inAdvances in Neural Information Processing Systems(NeurIPS 2009) 2035–2043.
54. D.Hovy T.Berg‐Kirkpatrick A.Vaswani andE.Hovy “Learning Whom to Trust with MACE ” inProceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies(ACL 2013) 1120–1130.
55. Q.MaandA.Olshevsky “Adversarial Crowdsourcing Through Robust Rank‐One Matrix Completion ” inAdvances in Neural Information Processing Systems(NeurIPS 2020) 21841–21852.
56. D.Karger S.Oh andD.Shah “Iterative Learning for Reliable Crowdsourcing Systems ” inAdvances in Neural Information Processing Systems(NeurIPS 2011) 1953–1961.
57. G.Demartini D. E.Difallah andP.Cudré‐Mauroux “ZenCrowd: Leveraging Probabilistic Reasoning and Crowdsourcing Techniques for Large‐Scale Entity Linking ” inProceedings of the International Conference on World Wide Web(ACM 2012) 469–478.10.1145/2187836.2187900 ↗
58. B.Aydin Y. S.Yilmaz Y.Li Q.Li J.Gao andM.Demirbas “Crowdsourcing for Multiple‐Choice Question Answering ” inProceedings of the AAAI Conference on Artificial Intelligence(AAAI Press 2014) 2946–2953.10.1609/aaai.v28i2.19016 ↗
59. Q.Li Y.Li J.Gao B.Zhao W.Fan andJ.Han “Resolving Conflicts in Heterogeneous Data by Truth Discovery and Source Reliability Estimation ” inProceedings of the ACM SIGMOD International Conference on Management of Data(ACM 2014) 1187–1198.10.1145/2588555.2610509 ↗
60. 10.1145/363010210.1145/3630102 ↗
61. L.Yin J.Han W.Zhang andY.Yu “Aggregating Crowd Wisdoms with Label‐Aware Autoencoders ” inProceedings of the International Joint Conference on Artificial Intelligence(IJCAI 2017) 1325–1331.10.24963/ijcai.2017/184 ↗
62. Y.Li B.Rubinstein andT.Cohn “Exploiting Worker Correlation for Label Aggregation in Crowdsourcing ” inProceedings of the International Conference on Machine Learning(PMLR 2019) 3886–3895.