%0 Journal Article
%@ 21945357
%A Kumar, G.
%A Basri, S.
%A Imam, A.A.
%A Balogun, A.O.
%D 2020
%F scholars:13652
%I Springer Science and Business Media Deutschland GmbH
%J Advances in Intelligent Systems and Computing
%K Computational methods; Intelligent systems; Natural language processing systems; Recurrent neural networks; Software engineering; Syntactics, Conceptual model; Data harmonization; Heterogeneous datasets; Information format; NAtural language processing; Parts of speech; Training and testing; Unstructured data, Large dataset
%P 723-734
%R 10.1007/978-3-030-63322-6₆₁
%T Data Harmonization for Heterogeneous Datasets in Big Data - A Conceptual Model
%U https://khub.utp.edu.my/scholars/13652/
%V 1294
%X Data comes from machines, transactions, and social media, which is gigantic and disparate in nature. About 80 of today�s data is unstructured, while the remaining percentage is semistructured and structured. It is a big challenge for management to make efficient decisions on run time and also to store heterogeneous nature of data by existing tools. Data Harmonization can be used to solve the heterogeneity problem; the idea of data harmonization is to provide a uniform representation and remove all forms of heterogeneity from the heterogeneous datasets. In recent studies, various models have been developed for integrating, mapping, and fusion of structured and semistructured datasets, but no such model has been developed for structured, semistructured, and unstructured datasets. Information extraction is used as a vital component to extract data from different textual datasets that information formats may comprise in different file formats, i.e., Excel, JSON, and text. For developing textual data harmonization model for heterogeneous datasets, comprises of structured, semistructured, and unstructured data based on phrases similarity techniques, it needs to be first preprocessed using Natural Language Processing and its techniques like Bag of Phrases, Parts of Speech and so on. Therefore this paper focuses on the conceptual data harmonization model based on text similarity technique, which will help to blend structured, semistructured, and unstructured data. The selected phrases from heterogeneous datasets will go through training and testing using Recurrent Neural Network. © 2020, The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Switzerland AG.
%Z cited By 4; Conference of 4th Computational Methods in Systems and Software, CoMeSySo 2020 ; Conference Date: 14 October 2020 Through 17 October 2020; Conference Code:253159