Supported query engines
Cost and performance
Validio minimizes query costs through several optimizations:- Incremental processing: Only reads new or changed data since the last poll
- Query pushdown: Performs aggregations and filtering at the query engine rather than transferring raw data. For how this affects what Validio receives and stores, see Data Handling and Retention.
- Query consolidation: Combines related validations into fewer queries
Recommendations
To further reduce resource usage:- Optimize your underlying data: Use compression, partitioning, and columnar formats (such as Parquet) for better scan performance
- Consider field size: Large text fields are more resource-intensive to validate than smaller data types