Automated Extraction and Time-Cost Prediction of Contractual Reporting Requirements in Construction Using Natural Language Processing and Simulation
Source abstract
Abstract
Due to a lack of suitable methods, extraction of reporting requirements from lengthy construction contracts is often completed manually. Because of this, the time and costs associated with completing reporting requirements are often informally approximated, resulting in underestimations. Without a clear understanding of requirements, contractors are prevented from implementing improvements to reporting workflows prior to project execution. This study developed an automated reporting requirement identification and time–cost prediction framework to overcome this challenge. Reporting requirements are extracted using Natural Language Processing (NLP) and Machine Learning (ML), and stochastic simulations are used to predict overhead costs and durations associated with report preparation. Functionality and validity of the framework were demonstrated using real contracts, and an accuracy of over 95% was observed. This framework provides a tool to rapidly and efficiently retrieve requirements and quantify the time and costs associated with reporting, in turn providing necessary insights to streamline reporting workflows.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Software Engineering Research · BIM and Construction Integration · Software Engineering Techniques and Practices
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
5-080 NREF, Department of Civil and Environmental Engineering, University of Alberta, Edmonton, AB T6G 2W2, Canada
Funding
Natural Sciences and Engineering Research Council of Canada
References (44)
Show source-provided references
1. Construction Contract Conversion: An Approach to Resolve Disputes
2. Barlow, G., Dew, C., Woolley, P., and Dempsey, H. (2014). Effective Reporting for Construction Projects: Increasing the Likelihood of Project Success, KPMG New Zealand.
3. Integrating automated data acquisition technologies for progress reporting of construction projects10.1016/j.autcon.2010.12.001 ↗
4. Automated Requirements Identification from Construction Contract Documents Using Natural Language Processing10.1061/(ASCE)LA.1943-4170.0000379 ↗
5. Development of Automatic-Extraction Model of Poisonous Clauses in International Construction Contracts Using Rule-Based NLP10.1061/(ASCE)CP.1943-5487.0000807 ↗
6. Jeong, H.D., Gransberg, D., and Shrestha, K.J. (2015). Framework for Advanced Daily Work Report System, Institute for Transportation, Iowa State University.
7. Automated Classification of Construction Project Documents10.1061/(ASCE)0887-3801(2002)16:4(234) ↗
8. Application of Lean Construction Concepts to Manage the Submittal Process in AEC Projects10.1061/(ASCE)ME.1943-5479.0000215 ↗
9. Levin, P. (1998). Construction Contract Claims, Changes & Dispute Resolution, American Society of Civil Engineers (ASCE).10.1061/9780784402764 ↗
10. Jeon, K., Lee, G., and Jeong, H.D. (2020). Classification of the Requirement Sentences of the US DOT Standard Specification Using Deep Learning Algorithms, Springer.10.1007/978-3-030-51295-8_8 ↗
11. El Gindi, M. (2017). User Friendly Progress Reporting System for Construction Projects, The American University in Cairo.
12. A Neural Network Model for Construction Projects Site Overhead Cost Estimating in Egypt
13. An enterprise architecture framework for electronic requirements information management10.1016/j.ijinfomgt.2017.04.005 ↗
14. Morgan, A. (2010). Does Poor Project Governance Cause Delays?, Pricewaterhouse Coopers LLP.
15. Social network analysis of change management processes for communication assessment10.1016/j.autcon.2020.103292 ↗
16. Lee, G., Cho, J., Song, T., Roh, H., Jung, J., Chung, J., Yong, G., and Jeong, D. (2020). Construction Field Management Using a Popular Text Messenger, Springer.10.1007/978-3-030-51295-8_67 ↗
17. Computational algorithm to automate as-built schedule development using digital daily work reports10.1016/j.autcon.2017.09.008 ↗
18. Computerized Daily Site Reporting10.1061/(ASCE)0733-9364(1993)119:2(385) ↗
19. Maas, G., and Van Gassel, F. (2003, January 21–24). Daily Report Module for Construction Management Information System. Proceedings of the 20th International Symposium on Automation and Robotics in Construction ISARC 2003—The Future Site, Budapest, The Netherlands.
20. Data acquisition technologies for construction progress tracking10.1016/j.autcon.2016.06.016 ↗
21. Manning, C., and Schutze, H. (1999). Foundations of Statistical Natural Language Processing, MIT Press.
22. Automated content analysis for construction safety: A natural language processing system to extract precursors and outcomes from unstructured injury reports10.1016/j.autcon.2015.11.001 ↗
23. Retrieving similar cases for alternative dispute resolution in construction accidents using text mining techniques10.1016/j.autcon.2012.10.014 ↗
24. Zhang, J., Zi, L., Hou, Y., Deng, D., Jiang, W., and Wang, M. (2020). A C-BiLSTM Approach to Classify Construction Accident Reports. Appl. Sci., 10.10.3390/app10175754 ↗
25. Automatic Classification of Project Documents on the Basis of Text Content10.1061/(ASCE)CP.1943-5487.0000338 ↗
26. Manning, C.D., Raghavan, P., and Schutze, H. (2008). Introduction to Information Retrieval, Cambridge University Press.10.1017/CBO9780511809071 ↗
27. Russell, S., and Norvig, P. (2020). Artificial Intelligence: A Modern Approach, Pearson.10.1093/oso/9780190905033.003.0012 ↗
28. Semantic Text Classification for Supporting Automated Compliance Checking in Construction10.1061/(ASCE)CP.1943-5487.0000301 ↗
29. Deep learning and network analysis: Classifying and visualizing accident narratives in construction10.1016/j.autcon.2020.103089 ↗
30. Ontology-Based Multilabel Text Classification of Construction Regulatory Documents10.1061/(ASCE)CP.1943-5487.0000530 ↗
31. Monte Carlo sampling methods using Markov chains and their applications
32. Python (2018). Python 3.7.0, Python Software Foundation.
33. Classification Model to Determine the Polarity of Movie Review Using Logistic Regression
34. Grefenstette, G., and Tapanainen, P. (1994, January 7–10). What Is a Word, What Is a Sentence? Problems of Tokenisation. Proceedings of the 3rd International Conference on Computational Lexicography, Budapest, Hungary.
35. An algorithm for suffix stripping10.1108/eb046814 ↗
36. The Relationship between Recall and Precision10.1002/(SICI)1097-4571(199401)45:1<12::AID-ASI2>3.0.CO;2-L ↗
37. An Extensive Empirical Study of Feature Selection Metrics for Text Classification
38. Machine learning in automated text categorization10.1145/505282.505283 ↗
39. Multiple Machine Learning Algorithms Comparison for Modulation Type Classification Based on Instantaneous Values of the Time Domain Signal and Time Series Statistics Derived from Wavelet Transform10.25046/aj060172 ↗
40. Witten, I., Frank, E., and Mark, A. (2011). Hall Data Mining: Practical Machine Learning, Elsevier.
41. Random Forests10.1023/A:1010933404324 ↗
42. Chen, T., and Guestrin, C. (2016, January 13–17). Xgboost: A Scalable Tree Boosting System. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, New York, NY, USA.10.1145/2939672.2939785 ↗
43. Random Search for Hyper-Parameter Optimization
44. Statistical Properties of Construction Duration Data10.1061/(ASCE)0733-9364(1992)118:3(525) ↗