Generative Adversarial Network Based on Self-Attention Mechanism for Automatic Page Layout Generation
Source abstract
Abstract
Automatic page layout generation is a challenging and promising research task, which improves the design efficiency and quality of various documents, web pages, etc. However, the current generation of layouts that are both reasonable and aesthetically pleasing still faces many difficulties, such as the shortcomings of existing methods in terms of structural rationality, element alignment, text and image relationship processing, and insufficient consideration of element details and mutual influence within the page. To address these issues, this article proposes a Transformer-based Generative Adversarial Network (TGAN). Generative Adversarial Networks (GANs) innovatively introduce the self-attention mechanism into the network, enabling the model to focus more on key local information that affects page layout. By introducing conditional variables in the generator and discriminator, more accurate sample generation and discrimination can be achieved. The experimental results show that the TGAN outperforms other methods in both subjective and objective ratings when generating page layouts. The generated layouts perform better in element alignment, avoiding overlap, and exhibit higher layout quality and stability, providing a more effective solution for automatic page layout generation.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Generative Adversarial Networks and Image Synthesis · Image Processing and 3D Reconstruction · Computer Graphics and Visualization Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
China Electric Power Research Institute Co., Ltd., Nanjing 210000, China
Jiangsu Key Laboratory of Big Data Analysis Technology, Nanjing University of Information Science and Technology, Nanjing 210044, China
Department of Computer Science, University of Reading, Whiteknights, Reading RG6 6DH, UK
Funding
Science and Technology Project of SGCC · Research on Key Technologies of Human–Machine Intelligent Cloud Configuration
References (38)
Show source-provided references
1. FTA-Net: Frequency-Temporal-Aware Network for Remote Sensing Change Detection10.1109/JSTARS.2025.3525595 ↗
2. Chen, Y., Wang, K., Liao, X., Qian, Y., Wang, Q., Yuan, Z., and Heng, P.A. (2019). Channel-Unet: A spatial channel-wise convolutional neural network for liver and tumors segmentation. Front. Genet., 10.10.3389/fgene.2019.01110 ↗
3. Zhan, Z., Ren, H., Xia, M., Lin, H., Wang, X., and Li, X. (2024). AMFNet: Attention-Guided Multi-Scale Fusion Network for Bi-Temporal Change Detection in Remote Sensing Images. Remote Sens., 16.10.3390/rs16101765 ↗
4. Bitemporal Attention Sharing Network for Remote Sensing Image Change Detection10.1109/JSTARS.2024.3400925 ↗
5. A conditional deep framework for automatic layout generation10.1109/ACCESS.2022.3198686 ↗
6. Gupta, K., Lazarow, J., Achille, A., Davis, L.S., Mahadevan, V., and Shrivastava, A. (2021, January 10–17). Layouttransformer: Layout generation and completion with self-attention. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, QC, Canada.10.1109/ICCV48922.2021.00104 ↗
7. Arroyo, D.M., Postels, J., and Tombari, F. (2021, January 10–17). Variational transformer networks for layout generation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Montreal, QC, Canada.10.1109/CVPR46437.2021.01343 ↗
8. Cheng, C.Y., Huang, F., Li, G., and Li, Y. (2023). Play: Parametrically conditioned layout generation using latent diffusion. arXiv.
9. A comprehensive review of synthetic data generation in smart farming by using variational autoencoder and generative adversarial network10.1016/j.engappai.2024.107881 ↗
10. Generative adversarial network: An overview of theory and applications
11. Generative adversarial networks10.1145/3422622 ↗
12. Radford, A., Metz, L., and Chintala, S. (2015). Unsupervised representation learning with deep convolutional generative adversarial networks. arXiv.
13. Virtual generation of pavement crack images based on improved deep convolutional generative adversarial network10.1016/j.engappai.2021.104376 ↗
14. Odena, A. (2016). Semi-supervised learning with generative adversarial networks. arXiv.
15. Sajun, A.R., and Zualkernan, I. (2022). Survey on implementations of generative adversarial networks for semi-supervised learning. Appl. Sci., 12.10.3390/app12031718 ↗
16. Yang, H., Hu, Y., He, S., Xu, T., Yuan, J., and Gu, X. (2024, January 26–28). Applying Conditional Generative Adversarial Networks for Imaging Diagnosis. Proceedings of the 2024 IEEE 6th International Conference on Power, Intelligent Computing and Systems (ICPICS), Shenyang, China.10.1109/ICPICS62053.2024.10796196 ↗
17. Infrared and visible image fusion via texture conditional generative adversarial network10.1109/TCSVT.2021.3054584 ↗
18. Deep generative image models usinga laplacian pyramid of adversarial networks
19. Laplacian pyramid generative adversarial network for infrared and visible image fusion10.1109/LSP.2022.3207621 ↗
20. Berthelot, D., Schumm, T., and Metz, L. (2017). Began: Boundary equilibrium generative adversarial networks. arXiv.
21. A refined equilibrium generative adversarial network for retinal vessel segmentation10.1016/j.neucom.2020.06.143 ↗
22. Cortes, C., Lawarence, N., Lee, D., Sugiyama, M., and Garnett, R. (2015, January 7–12). Advances in neural information processing systems 28. Proceedings of the 29th Annual Conference on Neural Information Processing Systems, Montreal, QC, Canada.
23. Improved training of wasserstein gans
24. Diffusion-based Wasserstein generative adversarial network for blood cell image augmentation10.1016/j.engappai.2024.108221 ↗
25. f-gan: Training generative neural samplers using variational divergence minimization
26. Mao, X., Li, Q., Xie, H., Lau, R.Y., Wang, Z., and Paul Smolley, S. (2017, January 22–29). Least squares generative adversarial networks. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.304 ↗
27. Intelligent layout generation based on deep generative models: A comprehensive survey10.1016/j.inffus.2023.101940 ↗
28. Zhang, H., Xu, T., Li, H., Zhang, S., Wang, X., Huang, X., and Metaxas, D.N. (2017, January 21–26). Stackgan: Text to photo-realistic image synthesis with stacked generative adversarial networks. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/ICCV.2017.629 ↗
29. Xu, T., Zhang, P., Huang, Q., Zhang, H., Gan, Z., Huang, X., and He, X. (2018, January 18–22). Attngan: Fine-grained text to image generation with attentional generative adversarial networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00143 ↗
30. Chai, S., Zhuang, L., and Yan, F. (2023, January 17–24). Layoutdm: Transformer-based diffusion model for layout generation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.10.1109/CVPR52729.2023.01760 ↗
31. Building layout generation using site-embedded GAN model10.1016/j.autcon.2023.104888 ↗
32. Element-conditioned GAN for graphic layout generation10.1016/j.neucom.2024.127730 ↗
33. Banerjee, R.H., Rajagopal, A., Jha, N., Patro, A., and Rajan, A. (2018, January 2–6). Let AI clothe you: Diversified fashion generation. Proceedings of the Computer Vision—ACCV 2018 Workshops: 14th Asian Conference on Computer Vision, Perth, Australia. Revised Selected Papers 14.
34. Attention is all you need
35. Transformer in transformer
36. Jiang, S., Lin, H., Ren, H., Hu, Z., Weng, L., and Xia, M. (2024). MDANet: A High-Resolution City Change Detection Network Based on Difference and Attention Mechanisms under Multi-Scale Feature Fusion. Remote Sens., 16.10.3390/rs16081387 ↗
37. Zhao, W., Xia, M., Weng, L., Hu, K., Lin, H., Zhang, Y., and Liu, Z. (2024). SPNet: Dual-Branch Network with Spatial Supplementary Information for Building and Water Segmentation of Remote Sensing Images. Remote Sens., 16.10.3390/rs16173161 ↗
38. Deka, B., Huang, Z., Franzen, C., Hibschman, J., Afergan, D., Li, Y., Nichols, J., and Kumar, R. (2017, January 22–25). Rico: A mobile app dataset for building data-driven design applications. Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology, Québec City, QC, Canada.10.1145/3126594.3126651 ↗