×

You are using an outdated browser Internet Explorer. It does not support some functions of the site.

Recommend that you install one of the following browsers: Firefox, Opera or Chrome.

Contacts:

+7 961 270-60-01
ivdon3@bk.ru

Optimizing the database-based deduplication process

Abstract

Optimizing the database-based deduplication process

Plotnikova N.P., Kevbrin V.A.

Incoming article date: 30.12.2023

It is impossible to imagine the present time without software. Huge flows of information pass through computer computing systems. It is absolutely impossible to process unstructured, endlessly incoming data, so it is necessary to identify specific tasks and prepare information for processing. One such action is deduplication. This article discusses possible optimizations for the method of removing duplicates using databases.

Keywords: deduplication, database, field, string, text data, query, software, unstructured data