Indian Journal of Science and Technology
Year: 2013, Volume: 6, Issue: 4, Pages: 1-6
M. Karthigha1* and S. Krishna Anand2
1 PG Student, School of Computing (CSE), SASTRA University, [email protected]
2 Senior Assistant Prof, School of Computing (CSE), SASTRA University, [email protected]
*Author for correspondence
PG Student, School of Computing (CSE), SASTRA University,
Email: [email protected]
Deduplication is a task of identifying one or more records in repository that represents same object or entity. The problem is that the same data may be represented in different way in every database. While merging the databases, duplicates occur despite different schemas, writing styles or misspellings. They are called as replicas. Removing replicas from the repositories provides high quality information and saves processing time. This paper presents a thorough analysis of similarity metrics to identify similar fields in records and a set of algorithms and duplicate detection tools to detect and remove the replicas from the database.
Keywords: Similarity Metrics, Database, Indexing, Deduplication
Subscribe now for latest articles and news.