journal article·2021Open access

Using Semantic Web Technologies to Improve the Extract Transform Load Model

Amena Mahmoud, Mahmoud Y. Shams, O. M. Elzeki, Nancy Awadallah Awad

Computers, Materials & Continua· Volume 68· Issue 2

Abstract

Semantic Web (SW) provides new opportunities for the study and application of big data, massive ranges of data sets in varied formats from multiple sources. Related studies focus on potential SW technologies for resolving big data problems, such as structurally and semantically heterogeneous data that result from the variety of data formats (structured, semi-structured, numeric, unstructured text data, email, video, audio, stock ticker). SW offers information semantically both for people and machines to retain the vast volume of data and provide a meaningful output of unstructured data. In the current research, we implement a new semantic Extract Transform Load (ETL) model that uses SW technologies for aggregating, integrating, and representing data as linked data. First, geospatial data resources are aggregated from the internet, and then a semantic ETL model is used to store the aggregated data in a semantic model after converting it to Resource Description Framework (RDF) format for successful integration and representation. The principal contribution of this research is the synthesis, aggregation, and semantic representation of geospatial data to solve problems. A case study of city data is used to illustrate the semantic ETL model’s functionalities. The results show that the proposed model solves the structural and semantic heterogeneity problems in diverse data sources for successful data aggregation, integration, and representation.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Semantic Web and Ontologies · Data Quality and Management · Data Management and Algorithms

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (39)

Show source-provided references
1. Research on construction methods of big data semantic model
2. Towards a semantic extract-transform-load (ETL) framework for big data integration Big Data (BigData Congress)
3. The meaningful use of big data: Four perspectives-four challenges10.1145/2094114.2094129 ↗
4. BPMN-based conceptual modeling of ETL processes
5. A review on big data integration
6. Improve performance of extract, transform and load (ETL) in data warehouse
7. Big data—opportunities and challenges
8. Semantics-empowered approaches to big data processing for physical-cyber-social applications
9. Prediction of chemical toxicity for drug design using AIRS algorithms and hybrid classifiers
10. Semantic web technologies for the big data in life sciences10.5582/bst.2014.01048 ↗
11. Z. Ahmed and G. Detlef, “Web to semantic web & role of ontology,” arXiv preprint arXiv, pp. 1008–1031, 2010.
12. Ontology-based information retrieval in semantic web: A survey10.5815/ijitcs.2013.10.06 ↗
13. A semantic model for business process patterns to support cloud deployment10.1007/s00450-016-0333-4 ↗
14. Improving reconstructed image quality via hybrid compression techniques10.32604/cmc.2021.014426 ↗
15. Integrating big data: A semantic extract-transform-load framework
16. A semantic approach to ETL technologies10.1016/j.datak.2011.03.003 ↗
17. A domain ontology approach in the ETL process of data warehousing, e-Business Engineering (ICEBE)
18. An approach for extracting chemical data from molecular representations10.19101/IJACR.2019.940105 ↗
19. Mei · IEEE Electrical & Electronics Engineering, Symp. on · 2012 · 11
20. Semantic extraction of geographic data from web tables for big data integration
21. Managing semantic big data for intelligence
22. Semantic integration of heterogeneous web data for tourism domain using ontology-based resource description language
23. Semantic tool for analyzing unstructured data
24. A semantic approach to retrieving, linking, and integrating heterogeneous geospatial data
25. Ontology-based integration and sharing of big data educational resources
26. Aggregating financial services data without assumptions: A semantic data reference architecture
27. mOntage: Building domain ontologies from linked open data
28. Data integration under integrity constraints10.1016/S0306-4379(03)00050-4 ↗
29. A semantic approach to ETL technologies10.1016/j.datak.2011.03.003 ↗
30. Data integration: The teenage years
31. Data for all: A systems approach to accelerate the path from data to insight
32. SETL: A programmable semantic extract-transform-load framework for semantic data warehouses10.1016/j.is.2017.01.005 ↗
33. Seddiqui · Information and Communication Technologies (WICT), World Congress on IEEE · 2011 · 139010.1109/WICT.2011.6141452 ↗
34. Graph-based modeling of ETL activities with multi-level transformations and updates
35. Euzenat · International Semantic Web Conf. · 2004 · 698
36. A UML based approach for modeling ETL processes in data warehouses
37. Pygrametl: A powerful programming framework for extract-transform-load programmers
38. Building data warehouses with semantic web data10.1016/j.dss.2011.11.009 ↗
39. An ontological approach to handle multidimensional schema evolution for data warehouse10.5121/ijdms.2014.6303 ↗