Duplicate Values
Identify duplicate entries in a column to maintain data integrity.
Validator Overview
The Duplicate Values validator works similar to the Volume validator configured for the Duplicate Count or Duplicate Percentage metrics. For more information, see Volume validators.
You can configure volume validators to monitor the following metrics:
| Metric Options | Description |
|---|---|
| Duplicate Count | Validates the number of duplicates. |
| Unique Percentage | Validates the percentage of duplicates. |
Field selection
For the duplicate value metrics, you have to specify one or several fields. Specifying several fields means field values are concatenated before being counted, which is useful when validating uniqueness of composite keys.
Null values: Validio includes
NULLvalues in the counts, unless you apply aNULL filterto remove them.
Metric Configuration Parameters
| Parameters | Description |
|---|---|
| Metric | Select the metric to calculate. See the Metric Options table. |
| Field | Select a source field from a list of available fields with numeric data type. |
| Filter | (Optional) Select from a list of filters or create a new filter to specify which records to include. |
| Window | Select from a list of windows or create a new window to specify how to aggregate the data. |
| Segmentation | (Optional) Apply segmentation to analyze data in separate groups. Default is Unsegmented. |
Updated 19 days ago