About Validator Incidents
An incident is a data quality issue captured by a Validator. Incidents can have a severity of Low, Medium, or High.
You can review, triage, and troubleshoot data quality issues on the Incidents page. The Incidents page aggregates all incidents from all sources. For more information, see Reviewing Incident Groups.
You can configure Validio to send notifications when incidents occur. For more information, see About Notifications.
Using the link in a Notification, you can navigate straight to the incident details pages, where you can troubleshoot the incident directly. For more information, see Managing Incidents.
Incident Severity
Incidents are classified by their severity: Low, Medium, or High.
When an incident is detected, its severity score is calculated based on its distance to the closest bound or threshold. The severity class is determined by grouping the severity score distribution, so that 30% of the severity scores are assigned Low, 40% are assigned Medium, and 30% are assigned High.
Incidents should be rare, which means that on a fresh start (when their is little data) all new incidents might end up as one severity class. Over time, the incident's severity distribution will match the expected percentages. As your data changes or shifts over time, these percentage distributions may not be perfectly reflected across the entire Source lookback period but will more closely align with the latest data.
There are a few exceptions:
- A Freshness validator will always produce High severity incidents.
- A Fixed or Difference threshold will always product High severity incidents.
Troubleshooting
When troubleshooting an Incident, it is very helpful to visit:
- The Debug tab for detailed information about underlying data assets and logic.
- The Lineage tab for understanding which assets are related to, and dependent on, the data where the Incident occurred.
- The Validator details page page, to get more contextual information about the Incident, such as information about Threshold types, Segmentations and viewing the behavior of adjacent datapoints in the graph.
In addition to the Incidents page, it is also possible to overview, triage and troubleshoot Incidents from other pages, such as:
- Incident detail - View and manage a specific Incident.
- Sources - Overview all Incidents for all Sources.
- Validators - Overview all Incidents for a specific Source.
- Validator details - Overview all Incidents for a specific Validator.
Updated 2 months ago