Freshness validators monitor the time elapsed since the data was last updated on the source.

📘

Note

You can only configure the Freshness validator to use a Global window or Tumbling window. For more information, see About Windows.

Freshness calculations occur during polling, when the freshness validator checks if any new data points have been added to the source. The resulting graph displays the time difference between the latest data time and the end of the window for every window.

📘

Note

The time axis used in the graph is not based on clock time but always data time of the timestamp used in the tumbling window.

The graphs for freshness validators displays data points up to the last datapoint seen, but then continues to update as time passes even when no data arrives. If no new data is seen, the graph will be updated after a time period equivalent to the window size has passed, increasing the value of the freshness.

📘

Note

If the tumbling window is shorter than the polling interval, the freshness validator does not calculate the metric for every window. In this case, the freshness graph might show gaps.

Add a Freshness Validator

To add a Freshness Validator,

1. Navigate to the Source where you will add the validator, and click + New Validator.
2. Under Validator Type, select Freshness.
3. Under Segmentation, select an existing segmentation or create one. Default is Unsegmented.
4. Under Window, select an existing Tumbling or Global window or create one.
5. Under Source Config, select a Filter Type. You can choose from: No Filter (Default), Boolean, Enum, Null, String, and Threshold. For more information, see Filters.
6. Under Config, the Initialize with backfill option is checked.
7. Under Threshold, select the Threshold Type and fill in the settings for Preset, Sensitivity, and Decision Bounds. For more information, see About Thresholds.
8. Click Continue to create the Freshness validator.