Performance Analysis of Duplicate Record Detection Techniques

Adil, S.H. and Ali, S.S.A. and Raza, K. and Ebrahim, M. (2019) Performance Analysis of Duplicate Record Detection Techniques. Engineering, Technology and Applied Science Research, 9 (5). pp. 4755-4758. ISSN 22414487

Full text not available from this repository.
Official URL: https://www.scopus.com/inward/record.uri?eid=2-s2....

Abstract

In this paper, a comprehensive performance analysis of duplicate data detection techniques for relational databases has been performed. The research focuses on traditional SQL based and modern bloom filter techniques to find and eliminate records which already exist in the database while performing bulk insertion operation (i.e. bulk insertion involved in the loading phase of the Extract, Transform, and Load (ETL) process and data synchronization in multisite database synchronization). The comprehensive performance analysis was performed on several data sizes using SQL, bloom filter, and parallel bloom filter. The results show that the parallel bloom filter is highly suitable for duplicate detection in the database. © 2019, Dr D. Pylarinos. All rights reserved.

Item Type: Article
Additional Information: cited By 2
Depositing User: Mr Ahmad Suhairi UTP
Date Deposited: 10 Nov 2023 03:25
Last Modified: 10 Nov 2023 03:25
URI: https://khub.utp.edu.my/scholars/id/eprint/11226

Actions (login required)

View Item
View Item