HomeDocumentationChangelog
HomeRequest DemoContact
HomeRequest DemoContact

Freshness

Monitors the time elapsed since the data was last updated.

πŸ“˜

Limitations

The Freshness Validator type can only be configured on a Tumbling window.

Configuration

StepRequiredParameters Options
Validator typeβœ…Freshness-
Source configβœ…Segmentation1. Select a configured Segmentation

Or

2. Unsegmented (default)
Source configβœ…WindowSelect a configured Window
Source configFilterNo filter (default)
Boolean
Enum
Null (*1)
String
Threshold filter
ConfigBackfillInitialize with backfill (checkbox)

*1 Only applicable for nullable columns.

Configuration details

When a calculation triggers depends on the polling interval configured for the source, by using presets or a cron expression. During polling, the freshness Validator checks if any new datapoints have been added to the Source.

The resulting graph displays the time difference between latest data-time and real-world time, in the specified time resolution.

If your tumbling window is shorter than the polling interval, then the Validator doesn't calculate the Freshness metric for every window. In this case, the Freshness graph might show irregular gaps.