Connect Validio to query engines to monitor data stored in object storage or data lakes without requiring a traditional data warehouse.

Supported Query Engines

• Amazon Athena

Cost and Performance

Validio minimizes query costs through several optimizations:

• Incremental processing: Only reads new or changed data since the last poll
• Query pushdown: Performs aggregations and filtering at the query engine rather than transferring raw data
• Query consolidation: Combines related validations into fewer queries

Recommendations

To further reduce resource usage:

• Optimize your underlying data: Use compression, partitioning, and columnar formats (such as Parquet) for better scan performance
• Consider field size: Large text fields are more resource-intensive to validate than smaller data types