Duplicate Values

Identify duplicate entries in a column to maintain data integrity.

Validator Overview

The Duplicate Values validator works similar to the Volume validator configured for the Duplicate Count or Duplicate Percentage metrics. For more information, see Volume validators.

You can configure volume validators to monitor the following metrics:

Metric OptionsDescription
Duplicate CountValidates the number of duplicates.
Unique PercentageValidates the percentage of duplicates.

Field selection

For the duplicate value metrics, you have to specify one or several fields. Specifying several fields means field values are concatenated before being counted, which is useful when validating uniqueness of composite keys.

📘

Null values: Validio includes NULL values in the counts, unless you apply a NULL filter to remove them.

Metric Configuration Parameters

ParametersDescription
MetricSelect the metric to calculate. See the Metric Options table.
FieldSelect a source field from a list of available fields with numeric data type.
Filter(Optional) Select from a list of filters or create a new filter to specify which records to include.
WindowSelect from a list of windows or create a new window to specify how to aggregate the data.
Segmentation(Optional) Apply segmentation to analyze data in separate groups. Default is Unsegmented.