Lineage (BETA)

Validio now offers field-level data lineage support, simplifying discovery, triaging, and troubleshooting of data quality issues, across an entire data stack.

Validio automatically infers lineage from Data Warehouses, Query Engines, and dbt. Additionally, you can create lineage connections between fields or datasets within and across any supported data sources.

Avro and Protobuf in Streams

Validio now supports Avro and Protobuf for all Data Streams.

Polling sources on-demand

Validio now supports on-demand polling of sources, using API endpoint sourcePoll.

Deprecated features

The following functionality is deprecated:

• Destinations
• Sessionized windows

API changes and additions

• Added new API endpoint sourcePoll, enabling on-demand polling of sources. Note that this does not interfere with the normal polling schedule. (UI-2386)
• Changed the schedule: CronExpression field on SourceConfigs, SourceCreateInputs, and SourceUpdateInputs from required to optional. (UI-2386)
• New field messageFormat on Stream sourceConfigs and createInputs. This field can be used to specify Protobuf and Avro schemas for messages in a stream. (UI-2304)
• Added optional fields warehouse and role on SnowflakeCredential (UI-2276)

Other improvements & fixes

• Change: Default to same field as source on reference (UI-2307)
• Bug Fix: Improved dynamic threshold preview (VR-2330)