dbt Cloud

Validio supports integrating with dbt Cloud and dbt Core to validate metadata for test results and model runs. To integrate with dbt Cloud,

  1. Add a warehouse credential for the warehouse where your dbt output is stored.
  2. Add a dbt Cloud credential which will automatically fetch your data from your dbt Cloud account.
  3. Add dbt sources for monitoring model runs and test results.

Prerequisites for Integrating with dbt Cloud

Integrating with dbt Cloud requires a dbt Cloud API token and account ID. The token should have read-only access. For more information, see dbt Cloud’s API documentation.

Add a Warehouse Credential

Before creating a dbt Cloud credential, you must create a valid credential for the warehouse where your dbt output is stored. You will reference this warehouse credential when you configure the dbt Cloud credential. For specific credential setup instructions, see Data Warehouse Sources and select the relevant warehouse (for example, BigQuery or PostgreSQL).

Add a dbt Cloud Credential

To add a credential for monitoring dbt sources,

  1. Navigate to Observability > Credentials and click + Add Credential.
  2. Under Credential type, select dbt Cloud Credential.
  3. Fill in the configuration parameters. For more information, see dbt Cloud Credential Parameters.
  4. Click Create.

Validio will validate that the dbt Cloud account can be successfully accessed. If validation passes, Validio will automatically start fetching the metadata for the runs and tests. If validation fails, check that you provided the correct parameter values and try again.

Once the credential is created, you can add sources to track dbt Model Runs and dbt Test Results.

dbt Cloud Credential Parameters

ParameterDescription
Credential Typedbt Cloud Credential
NameIdentifier for the credential. This name will be referenced when creating a source.
Warehouse CredentialCredential for the table where your dbt output is stored.
Account IDdbt Cloud Account ID.
AI Base URLdbt Cloud base URL.
dbt Cloud Tokendbt Cloud API token.

Add a dbt Source

Validio provides two types of dbt sources that you can add for monitoring dbt runs and tests: dbt Model Runs and dbt Test Results.

To add a dbt source:

  1. Navigate to Observability > Sources and click + New Source.
  2. Under Source type, select either dbt Model Runs or dbt Test Results.
  3. Under Credentials,
    1. Select Use existing Credential.
    2. Select the valid credential from the list.
  4. Under Config,
    1. Enter a Name for the source.
    2. Select a Project Name and Job Name.
    3. Select a Cron preset to specify the polling frequency for the data.
  5. Under Window, select the Window type, which should be either Tumbling Window or Global Window. For more information, see Configuring Windows.
  6. Click Continue to create the source.

You can view the summary of the source configuration.

📘

Note

Validio automatically infers the schema and defines default segmentation.

  • For dbt Model Runs, the default segment is model_id.
  • For dbt Test Results, the default segments are model_id and test_name.