Relative Time
Validating the difference between two timestamp fields. Calculates either the mean time difference, minimum time difference, or maximum time difference.
Configuration
| Step | Required | Parameters | Options |
|---|---|---|---|
| Validator type | ✅ | Relative time | - |
| Config | ✅ | Source field | Any timestamp field |
| Config | ✅ | Field to subtract | Any timestamp field |
| Config | ✅ | Metric | Minimum difference Maximum difference Mean difference |
| Config | Backfill | Initialize with backfill (checkbox) | |
| Source config | ✅ | Segmentation | 1. Select a configured Segmentation Or 2. Unsegmented (default) |
| Source config | ✅ | Window | Select a configured Window |
| Source config | Filter | No filter (default) Boolean Enum Null (*1) String Threshold filter | |
| Threshold | ✅ | Threshold type | Fixed threshold Dynamic threshold |
| Threshold | ✅(*2) | Operator | Less than Less than or equal Equal Not equal Greater than Greater than or equal |
| Threshold | ✅(*3) | Value | Specify numeric value to validate threshold on |
| Threshold | ✅(*4) | Sensitivity | Enter a numeric value |
| Threshold | ✅(*4) | Decision bounds type | Upper Lower Upper and lower (default) |
*1 Only applicable for
nullable columns*2 Only applicable for
Fixed thresholds*3 Only applicable for
Fixed thresholds*4 Only applicable for
Dynamic thresholds
Configuration details
The relative time validator calculates the time difference on two fields for each record:
Time Difference = Source field - Field to subtract
The computed metric is then either max, min, or mean of the time difference within a window. The calculated fields must be valid timestamps.
The difference can be negative if the timestamp in the target field lies in the future, relative to data time field timestamp.
Sensitivity
Higher sensitivity means that the accepted range of values is narrower, which identifies more anomalies. Conversely, lower sensitivity values imply a wider range of accepted values, which identifies fewer anomalies.
Updated 4 months ago