About Windows

Windows define the batch size of data used for calculating and validating metrics in Validio. Choose between global windows and tumbling windows based on your source type.

Windows define the batch size of data used for calculating and validating metrics in Validio, with support for global windows and tumbling windows depending on your source type.

Windows configured on the gold__sales_summary source

A window defines the batch size of the dataset to use for calculating and validating metrics on your source. For example, to validate an aggregate calculation (such as mean, max, or min) you must define a window to specify how much and which datapoints to include. You can then select the configured window when you create new validators or segmentations on the source.

Window Types

All window types are not valid for every source:

Window TypeSupported Source Type
Global windowData warehouse, Query engine
Tumbling windowData warehouse, Data stream, Query Engine

Global Window

Global windows perform a full load during every polling cycle and computes all validator metrics for the entire Source, rather than for a sequence of windows (such as for tumbling windows). Validators using a global window are evaluated based on clock-time, rather than data-time. For more information, see Configuring Global Windows.

Tumbling Window

Tumbling windows are a series of fixed-sized, non-overlapping, and contiguous time intervals. For example, hourly or weekly. For more information, see Configuring Tumbling Windows.

Updating a Window

You can update an existing window from the Windows tab on the source details page. Click the menu on the window and select Update. Because validators and segmentations reference the window rather than copying its settings, an update applies to everything already using that window.

Some settings are fixed when the window is created and cannot be changed afterwards, because changing them would invalidate the metrics already calculated on the validators using that window.

SettingCan be updated after creation
NameYes
Historic data (maximum)Yes, depending on source type
Partition field and lookbackYes, depending on source type
Segment retention period (days)Yes
Disable window timeoutYes
Window sizeNo
Data-time fieldNo

Global windows have only a name and a segment retention period, both of which can be updated at any time.

To change the window size or the data-time field, create a new window with the settings you want. Click the menu and select Duplicate to start from a copy of an existing window instead of configuring one from scratch.

Creating a new window does not move existing validators onto it. A validator keeps the window it was created with, so you also need to recreate any validator that should use the new window. For more information, see Duplicating a Validator.

Segment Retention Policy

Segment retention period (days) is an optional setting on validator windows that sets a threshold to remove segments that may have become stale. The segment is considered stale when the last time data was processed on the segment exceeds the retention period.

The segment retention threshold is relative to the most recent segment that was processed. When not set, Validio does not clean or remove stale segments.


Did this page help you?