HomeRequest DemoContact
Back to All

Changelog 2.1

April 2nd, 2024 by Sophy Ting

This release introduces new integrations (dbt, Tableau, and Apache Airflow), new tumbling window options, support for calendric seasonality detection, and improved catalog search.

New Integrations

Validio 2.1 adds support for the following integrations:

  • dbt--Connect Validio to your dbt Cloud or dbt Core accounts, and add sources to monitor test results and model runs. For more information, see dbt Cloud and dbt Core in the product documentation.
  • Tableau--Enable Validio to discover your Tableau assets (such as sheets, workbooks, datasources, and dashboards) and track their lineage relationships. For more information, see Tableau in the product documentation.
  • Airflow--Incorporate Validio into your Apache Airflow environment. This integration provides configuration for connecting to Validio with a hook and examples of custom operators. You can use these examples as a template to customize operators to suit your needs. For more information, see Validio for Airflow in the product documentation.

New Tumbling Window Options

You can now configure Tumbling Windows for weekly and monthly intervals. For more information, see Configuring Windows in the product documentation.

Calendric Seasonality

Dynamic Thresholds now includes observation of irregular seasonality, such as calendric seasonality, in your data. Calendric seasonality is often related to business cycles, where work is planned and reviewed on monthly, quarterly, and yearly cycles. With Dynamic Thresholds, Validio will track these trends and changes in your data over time and trigger a notification when it finds enough evidence.

You do not need to configure or enable this feature. For more information, see About Thresholds in the product documentation.

Improved Catalog Search

This release adds improved search functionality for catalog assets, sources, and validators. For more information, see Using Catalog.

2.1.4

Validio 2.1.4 was released on Friday, April 12, 2024.

Platform Changes

Enhancements

  • Added support for new Tableau asset types, Tableau Custom SQL Table and Tableau Flow(VR-3020, UI-3361)
  • Added support for restarting pipelines (VR-3171)
  • Updated the color of icons on active tabs (UI-3344)
  • Field selection is now optional for Count and Percentage metrics on Volume validators with Global Windows (UI-3376)

Fixed Issues

  • The Validator backfill banner was not always visible (UI-3370)
  • Prevent duplicate windows in the Custom SQL validator (VR-2958)
  • Instead of logging individual dbt artifact warnings, log each warning type once at the end of processing and include a summary and count of each warning (VR-3174)
  • Remove quotes from status filter in dbt source recommendations (VR-3178)
  • Attempt to retry when dbt Cloud API requests fail (VR-3179)

2.1.1

Validio 2.1.1 was released on Thursday, April 4, 2024.

Platform Changes

Fixed Issues

  • Match embedded Tableau datasources with published ones (VR-3118)
  • Updated justfile to use the correct ports (VR-3136)
  • Run the health check for Sources on a cron schedule (VR-3081)

2.1.0

Validio 2.1.0 was released on Wednesday, April 3, 2024.

API Changes

Enhancements

  • Added dbtArtifactMultipartUpload API methods (UI-3333)
  • Added dbt Core Credential APIs and UI (UI-3095)
  • Added X-Validio-Version header to the all endpoints (UI-3148, UI-3148)
  • Added missing credentialSecretChanged APIs (UI-3199, UI-3199)

Removed

  • Removed credential stats from API (UI-3338)
  • Removed validatorsById API (UI-3209)

Platform Changes

Enhancements

  • Added support for week/month calendar based windowing (UI-3180)
  • Added search capabilities using search engine (UI-2882)
  • Added support for Tableau in lineage and catalog (UI-3271, UI-3342)
  • Added support for creating new window and segments directly in validator wizard flow (UI-3068)
  • Added support for writing custom descriptions (UI-3256)
  • Added support for multiple description origins (UI-3238, UI-3306)
  • Added dbt Model Run and dbt Test result sources (UI-3095, VR-2971, VR-2949)
  • Added labels to indicate which assets in the lineage graph come from dbt models (UI-3173)
  • Added better information about lineage field edges (UI-3221)
  • Added field to show "Last used" for API keys in UI (UI-3219)
  • Added optional database field to both Azure Synapse credentials (UI-3213, UI-3213)
  • Added support for two decimals in sensitivity (UI-3140)
  • Added support for creating unsegmented segmentation in validator wizard (UI-3273)
  • Added multipart upload for dbt artifact (VR-3085)
  • Added support for full refresh on catalog refresh (VR-3067)
  • Added support Tableau Wookbook in lineage (VR-3106)
  • Added related incident groups support (VR-2991)
  • Added \_PARTITIONDATE to BigQuery schema
  • Added optional database field to Azure credentials (VR-3038)
  • Added lookback to freshness pushdown logic (VR-2934)
  • Added support for custom asset descriptions (VR-3016)
  • Added support to set limit to number of artifacts ingested (VR-2966)
  • Added dbt specific validator recommendations (VR-2954)
  • Added support for using the same dbt manifest for multiple credentials (VR-3022)
  • Added top query to pushdown
  • Added more service metrics (VR-2965)
  • Improved information shown on the dbt tab (UI-3208)
  • Extended catalog job failure message (UI-3120)
  • Improved UI for setting sensitivity of dynamic threshold (UI-3007)
  • Improved UI wizards for segmentation, window, identity provider, and notification rules (UI-3160, UI-3176, UI-3233, UI-3202)
  • Changed role requirement from Admin to Viewer in listing API keys (UI-3259)
  • Made max lineage assets configurable through environment variable (UI-3316, UI-3316)
  • Made max request body configurable (UI-3281, UI-3281)
  • Limited the number of assets returned for the Lineage graph (UI-3311, UI-3311)
  • Increased the timeout for dbtArtifactUpload (UI-3295)
  • Changed the default secure_cookie config to true (UI-3234)
  • Increased the timeouts for listing APIs (UI-3225, UI-3225)
  • Ignore queries coming from Validio in query history (VR-3065)
  • Improved SQL parser (VR-3098)
  • Write artifacts aggregate from memory (VR-2959)
  • Delete stale catalog assets immediately (VR-3108)
  • Infer DATETIMEOFFSET as a timestamp (VR-3051)
  • List view definitions from Redshift
  • Fetch view definitions from Azure Synapse, BigQuery, Databricks (VR-3003, VR-3024)

Fixed Issues

  • Allow warehouse sources to setup up schema without timestamp field (UI-3226)
  • Prevent sidebar from open when clicking on a link in a cell (UI-3218)
  • Polling schema fix when updating source schema (UI-3216)
  • Migration for severity for historical incidents (UI-3137)
  • Time range control buttons not including full day (UI-3162)
  • Fix lineage for non fully qualified identifiers in views (VR-3092)
  • Improve deletion of stale view edges (VR-3054)
  • Handle large queries in query parser (VR-3097
  • Handle query history entries longer than 4k for Synapse Dedicated Pool (VR-3112)
  • Fix reference source reset (VR-3117)
  • Update pushdown window closing logic (VR-3021)
  • Fix missing nested fields schema change (VR-3116)
  • Improve SQL filter where clause (VR-3071)
  • Allow max request size to be configured in helm (VR-3076)
  • Improve dbt query text handling (VR-3070)
  • Fix Tableau JWT token expiration (VR-3056)
  • Accept dbt core credential during manifest upload (VR-3062)
  • Skip Synapse health check if pool is paused
  • Escape values in pushdown validator filters (VR-3041)
  • Fix listing Azure Synapse tables when credentials don't have a database
  • Handle NULL definitions gracefully when fetching Synapse views (VR-3048)
  • Change Athena inference to set fields as nullable
  • Include optionalProperties when building lineage
  • Don't trigger force poll after backfill on global window (VR-3037)
  • Fetch Azure Synapse view definition for dedicated pool
  • Fixed numeric relative entropy query for Azure Synapse

Removed

  • Removed jtd payload validation (VR-3009)