Volume
Monitor number of records, non-NULL values, duplicates, unique values, and so on.
Validator Overview
You can configure volume validators to monitor the following metrics:
| Metric Options | Description |
|---|---|
| Count | Validates the number of total rows. |
| Percentage | Validates the percentage of rows passing certain filter criteria. |
| Duplicate Count | Validates the number of duplicates. |
| Duplicate Percentage | Validates the percentage of duplicates. |
| Unique Count | Validates the number of unique rows. |
| Unique Percentage | Validates the percentage of unique rows. |
Field selection
For metrics Duplicates count, Duplicates percentage, Unique count and Unique percentage you have to specify one or several fields. Specifying several fields means field values are concatenated before being counted, which is, for example, useful when validating uniqueness of composite keys.
For metrics Count and Percentage you can pick No field (use record) to count entire records. You can also pick a specific field to count non-NULL values in that field.
Note
For duplicate and unique metrics, Validio includes
NULLvalues in the counts, unless you apply aNULL filterto remove them.
Metric Configuration Parameters
Parameters | Description | Options |
|---|---|---|
Metric | Select the metric to calculate. | Count |
Field | Select a source field to use for the calculation. | List of available fields with numeric data types. |
Filter | (Optional) Use filters to specify which records to include in the calculation. | List of existing filters or create a new filter. |
Window | Use windows to define the time-range over which the data is aggregated. | List of existing windows or create a new window. |
Segmentation | Use segmentation to break the data into separate groups for analysis. | List of existing segmentations, Unsegmented (default), or create a new segmentation. |
Initialize using historic data | Start the validator with historical data to prime the anomaly detection algorithms. |
Updated 29 days ago