Changelog 3.0
Validio 3.0 introduces Root Cause Analysis for incident management and updates to the global lineage user interface.
New Root Cause Analysis
Validio root cause analysis combines data lineage with data quality monitoring to provide explanations that help you understand where incidents occur, what causes them, and how they relate to upstream and downstream assets. If there are multiple fields affected, Validio groups them together so you can understand how they correlate, while minimizing the number of notifications being sent out. With these insights, you can resolve your data quality issues faster.
For more information, see Root Cause Analysis and Managing Incidents in the product documentation.
Updates to Global Lineage Interface
We've updated global lineage to better handle displaying large volumes of catalog assets. Now when you navigate to the Lineage page, you can select a specific catalog asset and field to use as an entry point, or anchor, for the graph. You can also change this anchor. Other updates include:
- Improved controls for navigating the lineage graph.
- Dynamic title and legend to summarize the lineage graph.
- Option to display a metric (Number of Reads, Number of Writes, Utilization) over assets on the graph.
For more information, see Using Lineage in the product documentation.
3.0.1
Validio 3.0.1 was released on Monday, June 3, 2024.
Platform Changes
Enhancements
- Added a functionality to dynamic thresholds which estimates the support of the metric. For more information, see Configuring Dynamic Thresholds in the product documentation. (AL-213, AL-216)
- Added a limit to prevent infinite recursion when querying lineage edges. (UI-3553)
Fixed Issues
- Fixed an issue with missing root cause due to case sensitivity in validator field names. (VR-3389)
- Fixed catalog refresh failure due to tables concurrently being delted from a warehouse. (VR-3282)
- Fixed UTF-8 handling when processing SQL queries. (VR-3377)
- Fixed field-level lineage edges to use jsonpath syntax. (VR-3323)
- Fixed the sorting on source incident groups list. (UI-3541)
3.0.0
Validio 3.0.0 was released on Tuesday, May 14, 2024.
API Changes
Enhancements
- Added
incidentGroups(filter: IncidentGroupsFilter pagination: PaginationInput sort: IncidentGroupsSort): IncidentGroupsResult!
to Source types. - Added
metricValueFormat: MetricValueFormat!
to Validators. - Added new types for
IncidentGroup
andIncident
. - Added the following APIs for RCA (UI-3346):
incidentGroupOwnerUpdate(input: IncidentGroupOwnerUpdateInput!)
incidentGroupStatusUpdate(input: IncidentGroupStatusUpdateInput!)
incidentStatusUpdate(input: IncidentStatusUpdateInput!)
- Added the following APIs for Lineage (UI-3355):
lineageEdgeCreate(input: LineageEdgeCreateInput!): LineageEdgeCreateResult!
lineageEdgesDelete(ids: [LineageEdgeId!]!): LineageEdgesDeleteResult!
lineageEdge(id: LineageEdgeId!): LineageEdge
lineageGraph(input: LineageGraphInput!): LineageGraph!
- Added
translateIncidentV1(oldId: ID!): IncidentV1Translation
to translate incidents IDs from before v3.0.0 to newIncidentGroupId
. - Updated
IncidentStatus
to remove valuesRESOLVED_EXPECTED
,RESOLVED_NOT_AN_ANOMALY
, andRESOLVED_UNEXPECTED
, and addNOT_AN_ANOMALY
andRESOLVED
. - Updated return type of
incidents(range: TimeRangeInput segmentId: SegmentId)
from[ValidatorIncident!]! to [Incident!]!
.
Deprecations
- Deprecated
resourceNamespace
arguments and fields in favor ofnamespaceId
. (UI-3412)
Removed
- Removed
incidents(range: TimeRangeInput): [ValidatorIncident!]!
on Source types. (UI-3346)
Platform Changes
Enhancements
- Added root cause analysis. (UI-3346)
- Improved the metric calculation for schema coverage. (UI-3386)
- Improved the user experience when configuring custom SQL filters. (UI-3254)
- Added support for custom lookback range. (UI-3362)
- Improved memory usage when fetching dashboards from Looker. (VR-3302)
- Improved lineage metadata collection on Snowflake warehouses. (VR-3270)
Fixed Issues
- Show correct boundary for UPPER and LOWER bound thresholds. (UI-3301)
Removed
- Removed backfilling support on Pub/Sub source. (VR-2014)