Filters
Use filters to only include datapoints which fulfills a specified filter in the metric calculation.
Filters | Description |
---|---|
No Filter | No filter applied to data. Process all available datapoint in a Window. |
Boolean filter | Ensures that a Boolean value is either true or false. |
Enum | Ensures that a string only contains values from a fixed set of specified values. |
Null | Ensures that a field value is NULL. |
String | Ensures that a string adheres to certain criteria. |
Threshold filter | Ensures that a numeric value is either under or over a certain threshold. |
Example
Want to count only the
NULL
values for a certain field? Then you can use a Volume Validator and apply aNULL
filter.
Boolean filter
Filter Boolean datapoints as either true
or false
for a specified field.
Configuration parameters
Parameter name | Parameter values |
---|---|
Filter type | Boolean filter |
Field | List of source fields with Boolean data types |
Operator | Is true Is false |
Enum
Filter string datapoints based on a set of specified values.
Configuration parameters
Parameter name | Parameter values |
---|---|
Field | List of source fields with string data types |
Operator | Is in Is not in |
Value | List of strings |
Null
Filters datapoints that are Null for a specified field.
Configuration parameters
Parameter name | Parameter value |
---|---|
Field | List of source fields |
Operator | Is Is not |
String
Filter string datapoints to match specific criteria.
Configuration parameters
Parameter name | Parameter values |
---|---|
Field | List of source fields with string data types |
Operator | Is empty Is not empty Contains Does not contain Starts with Ends with Is exactly Regex |
Value | String |
Regex filter syntax
Depending on source system, Validio leverages different regex syntaxes:
- For Data Warehouses and Query Engines, regex filters are applied in the source system. For more information on that syntax, refer to the regex syntax of your specific source system.
- For Object Storages and Data Streams, the regex syntax is compatible with the
Rust regex library
. For information on that syntax, refer to Rust - regex crate syntax.
Threshold Filter
Filter individual datapoints based on a set value.
Configuration parameters
Parameter name | Parameter values |
---|---|
Field | List of source fields with numeric data types |
Operator (*) | Equal to Not equal to Greater than Greater than or equal to Less than Less than or equal to |
Value | Float number |
* Specifies the 'allowed region'. For example, Greater than or equal than 5
specifies the allowed region, and all values strictly less than five are be filtered.
Updated 12 days ago