HomeDocumentationChangelog
HomeDemoContact
HomeDemoContact

Filters

Use filters to only include datapoints which fulfills a specified filter in the metric calculation.

FiltersDescription
No FilterNo filter applied to data. Process all available datapoint in a Window.
Boolean filterEnsures that a Boolean value is either true or false.
EnumEnsures that a string only contains values from a fixed set of specified values.
NullEnsures that a field value is NULL.
StringEnsures that a string adheres to certain criteria.
Threshold filterEnsures that a numeric value is either under or over a certain threshold.

👍

Example

Want to count only the NULL values for a certain field? Then you can use a Volume Validator and apply a NULL filter.

Boolean filter

Filter Boolean datapoints as either true or false for a specified field.

Configuration parameters

Parameter nameParameter values
Filter typeBoolean filter
FieldList of source fields with Boolean data types
OperatorIs true

Is false

Enum

Filter string datapoints based on a set of specified values.

Configuration parameters

Parameter nameParameter values
Field List of source fields with string data types
OperatorIs in

Is not in
ValueList of strings

Null

Filters datapoints that are Null for a specified field.

Configuration parameters

Parameter nameParameter value
FieldList of source fields
OperatorIs
Is not

String

Filter string datapoints to match specific criteria.

Configuration parameters

Parameter nameParameter values
FieldList of source fields with string data types
OperatorIs empty
Is not empty
Contains
Does not contain
Starts with
Ends with
Is exactly
Regex
ValueString

🚧

Regex filter syntax

Depending on source system, Validio leverages different regex syntaxes:

  • For Data Warehouses and Query Engines, regex filters are applied in the source system. For more information on that syntax, refer to the regex syntax of your specific source system.
  • For Object Storages and Data Streams, the regex syntax is compatible with the Rust regex library. For information on that syntax, refer to Rust - regex crate syntax.

Threshold Filter

Filter individual datapoints based on a set value.

Configuration parameters

Parameter nameParameter values
FieldList of source fields with numeric data types
Operator (*)Equal to
Not equal to
Greater than
Greater than or equal to
Less than
Less than or equal to
ValueFloat number

* Specifies the 'allowed region'. For example, Greater than or equal than 5 specifies the allowed region, and all values strictly less than five are be filtered.