Setting up comprehensive data monitoring can be time-consuming when configuring validators individually. Recommendations streamline this process by automatically analyzing your data source and suggesting appropriate validators tailored to your schema and data patterns.

Validio offers two recommendation modes:

• AI recommendations: Uses LLM-powered analysis for context-aware suggestions (requires LLM credentials).
• ML recommendations: Uses statistical machine learning and heuristics

Both modes allow you to profile your data and review existing resources to suggest pre-configured windows, filters, and segmentations alongside validators. You can then select which recommendations to apply, creating multiple validators and resources at once.

Prerequisites for AI Recommendations

To generate recommendations using LLMs, ensure that you have the following:

• Enabled the Allow LLM credentials setting in your Validio Workspace. See Configuring Global Settings.
• Appropriate permissions to create credentials (requires WRITE permissions for the Namespace). See Managing Roles.
• At least one LLM credential configured in your environment. See LLM Credentials.

Generating Recommendations

On the Validators tab for a configured Source,

1. Click AI recommendations (or New recommendations if you do not have an LLM credential).

   

2. (Optional) In the dialog window, toggle Use data profiling and use the slider to adjust the percentage of data you want to sample for profiling. A higher percentage results in more accurate results, but reads more data and takes longer to complete.

3. (Optional) Add Guidance notes to provide domain knowledge or business context, such as key metrics to monitor, data quality priorities, or specific fields to focus on.

4. Choose an LLM credential or Use Statistical ML (if you do not have an LLM credential).

5. Click Run. You can view a progress checklist as the system and model gathers information and generates recommendations. The process runs in the background, so you can navigate away while it completes.

   

6. Click View recommendations to see the list of pre-configured Validators as well as relevant Windows, Filters, and Segmentations. The Requires column indicates dependencies between the resources.

   

7. Check each of the resources that you want to apply to your source. If you uncheck one resource (such as a segmentation), it will automatically uncheck all validators that require that resource.

8. Click Apply selected to create the recommended validators. If you are creating many validators at once, this may take a few minutes to process.

   Once they are created, the validators will automatically backfill with historical data. It may take a few minutes for the data to populate while this initial sync completes.