Development of a Framework to Understand Tables in Engineering Specification Documents
Source abstract
Abstract
Several works have been done in the last decades for understanding tables in documents, but most of them were not specifically designed to understand tables in engineering specification documents. Tables in engineering specifications have characteristics such as various table structures with restricted terms. A framework is developed to address the issues in understanding tables in engineering specification documents. The framework consists of three steps: (1) Identifying minimal tables, (2) classifying cells, and (3) extending a domain knowledge map. A modified XY-tree algorithm was developed to find minimal tables, and a neural network algorithm was adopted to classify cells into labels and data. Then, specific domain rules were developed to discover concepts and relationships from terms in the classified cells. It is assumed a domain ontology is given, and it is extended with new concepts and relationships extracted from tables. We illustrated how each step performed with engineering table examples. The proposed framework could be used for searching product specification and for discovering hidden knowledge from tables in engineering specification documents.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Semantic Web and Ontologies · Data Quality and Management · Web Data Mining and Analysis
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Industrial Engineering, Daegu University, 201 Daegudae-ro, Jinryang-eup, Kyongsan-si, Kyongbuk 712-714, Korea
Department of Industrial and System Engineering, KAIST, 291 Daehak-ro, Yuseong-gu, Daejeon 34141, Korea
Division of Interdisciplinary Industrial Studies, Hanyang University, 222 Wangsimni-ro, Seongdong-gu, Seoul 04763, Korea
Funding
Ministry of Trade, Industry and Energy
References (24)
Show source-provided references
1. Table-processing paradigms: A research survey10.1007/s10032-006-0017-x ↗
2. Layout and language: An efficient algorithm for detecting text blocks based on spatial and linguistic evidence
3. On methods and tools of table detection, extraction and annotation in PDF documents10.1177/0165551514551903 ↗
4. Itonori, K. (1993, January 20–22). Table structure recognition based on textblock arrangement and ruled line position. Proceedings of the 2nd International Conference on Document Analysis and Recognition (ICDAR’93), Tsukuba Science City, Japan.
5. Table understanding using a rule engine10.1016/j.eswa.2014.08.045 ↗
6. Rule-based spreadsheet data transformation from arbitrary to relational tables10.1016/j.is.2017.08.004 ↗
7. Evaluating the performance of table processing algorithms10.1007/s100320200074 ↗
8. Schreiber, S., Agne, S., Wolf, I., Dengel, A., and Ahmed, S. (2017, January 9–15). Deepdesrt: Deep learning for detection and structure recognition of tables in document images. Proceedings of the 2017 14th IAPR International Conference on Document Analysis and Recognition (ICDAR), Kyoto, Japan.10.1109/ICDAR.2017.192 ↗
9. Douglas, S., Hurst, M., and Quinn, D. (1995, January 24–26). Using natural language processing for identifying and interpreting tables in plain text. Proceedings of the Fourth Annual Symposium on Document Analysis and Information Retrieval, Las Vegas, NV, USA.
10. Towards ontology generation from tables10.1007/s11280-005-0360-8 ↗
11. Hu, J., Kashi, R.S., Lopresti, D.P., and Wilfong, G. (1999, January 22). Medium-independent table detection. Proceedings of the Document Recognition and Retrieval VII, San Jose, CA, USA.
12. Hu, J., Kashi, R.S., Lopresti, D.P., and Wilfong, G. (2000, January 21). Table structure recognition and its evaluation. Proceedings of the Document Recognition and Retrieval VIII, San Jose, CA, USA.
13. Design of an end-to-end method to extract information from tables10.1007/s10032-005-0001-x ↗
14. Extracting logical structures from HTML tables10.1016/j.csi.2007.08.006 ↗
15. Automating the extraction of data from HTML tables with unknown structure10.1016/j.datak.2004.10.004 ↗
16. Wang, J., Wang, H., Wang, Z., and Zhu, K.Q. (2012, January 15–18). Understanding tables on the web. Proceedings of the International Conference on Conceptual Modeling, Florence, Italy.10.1007/978-3-642-34002-4_11 ↗
17. Chen, Z., and Cafarella, M. (2013, January 30). Automatic web spreadsheet data extraction. Proceedings of the 3rd International Workshop on Semantic Search over the Web, Riva del Garda, Italy.10.1145/2509908.2509909 ↗
18. Texus: A unified framework for extracting and understanding tables in pdf documents10.1016/j.ipm.2019.01.008 ↗
19. Nishida, K., Sadamitsu, K., Higashinaka, R., and Matsuo, Y. (2017, January 4–9). Understanding the semantic structures of tables with a hybrid deep neural network architecture. Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, San Francisco, CA, USA.10.1609/aaai.v31i1.10484 ↗
20. Chen, J., Jiménez-Ruiz, E., Horrocks, I., and Sutton, C. (February, January 27). Colnet: Embedding the semantics of web tables for column type prediction. Proceedings of the AAAI Conference on Artificial Intelligence, Honolulu, HI, USA.
21. Cesarini, F., Gori, M., Marinai, S., and Soda, G. (1999, January 22). Structured document segmentation and representation by the modified XY tree. Proceedings of the Fifth International Conference on Document Analysis and Recognition. ICDAR’99 (Cat. No. PR00318), Bangalore, India.10.1109/ICDAR.1999.791850 ↗
22. Toutanova, K., Klein, D., Manning, C.D., and Singer, Y. (June, January 27). Feature-rich part-of-speech tagging with a cyclic dependency network. Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology, Edmonton, AB, Canada.10.3115/1073445.1073478 ↗
23. Moving metadata from ad hoc files to database tables for robust, highly available, and scalable HDFS10.1007/s11227-016-1949-7 ↗
24. The percentage cube10.1016/j.is.2018.01.005 ↗