Overview
A Window (batch) is required to calculate and validate metrics on a dataset in your Source. For example, for an aggregate calculation you need to define a Window and what datapoints to include to calculate and validate the mean, max, or min.
You must configure at least one Window on your source to create Validators. You can create several Windows on the same Source, according to your business requirements.
Window types
Depending on your Source type, you can configure the following Window types:
Fixed batch window
Fixed batch windows are defined by a specified number of datapoints, from a certain data-time field.
Sessionized
Sessionized windows consist of group events that all arrive within a specified time after one another. For example, all events within 5 minutes of each other, a new window is created as soon as the difference between two read datapoints data time is greater than five minutes. This Window type is only available for Data streams and Object storage source types.
Tumbling
Tumbling windows are a series of fixed-sized, non-overlapping, and contiguous time intervals. For example, hourly or weekly.
File window
File windows consist of logical batches by file/BLOB. For example, one CSV file is a logical batch. This Window type is only available for Object storage Source types.
Updated 16 days ago