Duplicated Data


Duplicated data is data that is repeated within the same data set.

  • no inherent problem with duplicated data
    • as long as it is expected
  • can cause a report to be invalid
  • one of the very first actions a data analyst should take when working with data is to look through the data sets for any duplicated records or fields
  • data tools often have built-in tools to identify duplicate records
    • e.g., Excel Remove Duplicates command, conditional formatting for highlighting duplicate values, can use distinct key word to pull only distinct values in queries