Relative time

Validating the difference between two timestamp fields. Calculates either the mean time difference, minimum time difference, or maximum time difference.

Configuration

StepRequiredParametersOptions
Validator typeRelative time-
ConfigSource fieldAny timestamp field
ConfigField to subtractAny timestamp field
ConfigMetricMinimum difference
Maximum difference
Mean difference
ConfigBackfillInitialize with backfill (checkbox)
Source configSegmentation1. Select a configured Segmentation

Or

2. Unsegmented (default)
Source configWindowSelect a configured Window
Source configFilterNo filter (default)
Boolean
Enum
Null (*1)
String
Threshold filter
ThresholdThreshold typeFixed threshold
Dynamic threshold
Threshold✅(*2)OperatorLess than
Less than or equal
Equal
Not equal
Greater than
Greater than or equal
Threshold✅(*3)ValueSpecify numeric value to validate threshold on
Threshold✅(*4)SensitivityEnter a numeric value
Threshold✅(*4)Decision bounds typeUpper
Lower
Upper and lower (default)

*1 Only applicable for nullable columns

*2 Only applicable for Fixed thresholds

*3 Only applicable for Fixed thresholds

*4 Only applicable for Dynamic thresholds

Configuration details

The relative time validator calculates the time difference on two fields for each record:

Time Difference = Source field - Field to subtract

The computed metric is then either max, min, or mean of the time difference within a window. The calculated fields must be valid timestamps.

📘

The difference can be negative if the timestamp in the target field lies in the future, relative to data time field timestamp.

Sensitivity

Higher sensitivity means that the accepted range of values is narrower, which identifies more anomalies. Conversely, lower sensitivity values imply a wider range of accepted values, which identifies fewer anomalies.