Configuration
Use the Window configuration wizard to define a Window in which data is validated in your Source.
1. Select source
Navigate to the Windows tab on the Source you want to configure a Window for.
2. Create Window
Click + New window.
Start the window configuration wizard.
3. Select Window type
Select the Window type that you want to create:
Window configuration wizard - Select Window type.
Unavailable Window types?
File Windows are only supported for Object storage Source types.
4. Config
Specify the required config options for your Window type:
4.1 Fixed batch window
| Field | Value | Description |
|---|---|---|
| Data-time field | Field name | Identifier for the index field used to configure the Window. |
| Batch size | Numeric | Number of datapoints (rows) of the Window. For example, 256. |
| Segmented batching | True, False | If True, each segment gets a separate Window of batch size length. |
Window configuration wizard - Fixed batch window config.
4.2 Global window
Global window requires no configuration.
Window configuration wizard - Global window.
4.3 Tumbling window
| Field | Value | Description |
|---|---|---|
| Data-time field | Field name | Identifier for the field used to configure the Window. |
| Window size | Numeric | Length of the Window in the selected time unit. For example, 1 |
| Unit | Minute, Hour, Day | Unit of time to define Window size. |
| Disable window timeout | True, False | Set to true if the window should be automatically closed without considering the most recent data-time. |
Window configuration wizard - Tumbling window config.
4.4 File window
| Field | Value | Description |
|---|---|---|
| Data-time field | Field name | Identifier for the field used to configure the Window. |
File window datasets in distribution shift validation
File window datasets are often used in ML use cases to monitor data drifts.
If you use a production training dataset as reference dataset, as new data is collected, you can monitor distribution shift metrics between the reference dataset and the newly collected dataset.
For information on numeric reference metrics, such as relative entropy, refer to the Numeric distribution or Categorical distribution Validator types.
Window configuration wizard - File window config.
4. Create validators
Use the Validator configuration wizard to create Validators with your configured Window.
Updated 11 months ago