Configuring Tumbling Windows

Tumbling windows are a series of fixed-sized, non-overlapping, and contiguous time intervals. For example, hourly or weekly. Tumbling windows are supported on all sources. To add a Tumbling window to a source,

1. Navigate to the source’s details page and click the Windows tab.
2. Click + New window.
3. Under Select Type, choose the Tumbling window.
4. Under Configuration,
   1. Complete the required fields: Data-time field, Window size, and Historic data (maximum). For more information, refer to the Configuration Parameters table.
   2. Enter a Name for the window, or click Generate name to automatically create one based on your configuration.
   3. (Optional) Under Advanced, you can configure partition filtering, segment retention, and disable window timeout.
5. Click Create window.

After creating a window, you can add validators and segmentations to use the new window. For more information, see Configuring a Validator and Configuring Segmentation. The Window size and Data-time field cannot be changed once the window is created. For which settings you can change later, see Updating a window.

​

Configuration parameters

​

Minimum window size

The smallest allowed size for a tumbling window is:

• Data Warehouses and Query Engines: 30 minutes
• Data Streams: 10 minutes

​

Partition filter

For a partitioned table, this provides configuration to add a qualifying filter on the value of the partitioning column. When the configured data-time field of the tumbling window is not the same as the partitioning column of the table, a partition filter helps prune out irrelevant partitions in queries.

​

Tumbling windows and time formats

Validators with a Tumbling window always follow data time, which means that the time used in graphs and metrics represents the time of the dataset (such as, the time of the data in the warehouse). For tumbling windows, the time is also truncated depending on the window size. For example,

• Daily windows will always be from 00:00 UTC to 24:00 UTC.
• 12 hour windows will be 00:00 UTC to 12:00 UTC and 12:00 to 24:00 UTC.
• Hourly windows will always start on the hour: 00:00 UTC, 01:00 UTC, 02:00 UTC, and so on.
• 30 minute windows will truncate to every whole and half hour: 02:00 UTC, 02:30 UTC, 03:00 UTC, and so on.

Validio polls for new data on a schedule defined by the polling interval configured on the source. A tumbling window closes (finishes the computation and updates the graph) as soon as all the data for that window has arrived. Validio determines that all the data has arrived in two ways:

• New data arrives with a timestamp that is after the window end time. For example, if the window is from 13:00 to 14:00 and there is new data at 14:30, Validio assumes all data between 13:00 - 14:00 has arrived.
• When Disable window timeout is selected and data exists within a window. For example, if the window is from 13:00 to 14:00, and a poll for new data found a data point with a time 13:30, that window will close.

In general, the graphs for validators will display data points until the last datapoint, and then stick at whenever the last window closes because the graphs do not have new data points to show unless new data arrives.

​

Tumbling windows and sliding windows

For Numeric Statistic and Volume validators that use a tumbling window, you have the option to configure a sliding window aggregation. Unlike tumbling windows, sliding windows can overlap (if the slide is smaller than the window size), and the aggregate value is updated incrementally as old data points drop out and new ones enter the window, providing a continuous summary of recent data trends. For more information, see Configuring a Validator.