dbt Core

1. Add a warehouse credential for the warehouse where your dbt output is stored.
2. Add a dbt Core credential which will be used when uploading your dbt files.
3. Upload your dbt manifest and run results files to Validio.
4. Add dbt sources for monitoring model runs and test results.

​

Prerequisites for integrating with dbt Core

​

Add a warehouse credential

​

Add a dbt Core credential

1. Navigate to Credentials and click + New credential.
2. Under Namespace, select a namespace where the resources will be created.
3. For Credential Type, select dbt Core.
4. Fill in the Configuration parameter fields. Refer to the dbt Core Credential Parameters table.
5. (Optional) Click Test credential to validate the connection. If validation fails, check that you provided the correct parameter values.
6. Click Create credential.

​

dbt Core credential parameters

​

Upload dbt files to Validio

​

Upload with Validio CLI

DBT_CREDENTIAL_ID="my-dbtCore-credential_12345"

validio dbt upload --target-path ./target --job-name local-test --credential-id $DBT_CREDENTIAL_ID

​

Upload with Validio SDK

import asyncio
from pathlib import Path

from validio_sdk import dbt, util
from validio_sdk.client import Client


async def main():
    client = Client()
    await dbt.upload_artifacts(
        client=client,
        credential_id="my-dbtCore-credential_12345",
        job_name="local-test",
        manifest=util.read_json_file(Path("./target/manifest.json")),
        run_results=util.read_json_file(Path("./target/run_results.json")),
    )


asyncio.run(main())

​

Add a dbt source

1. Navigate to Sources and click + New source.
2. Under Source type, click Data transformation to select dbt Model Run or dbt Test Result.
3. Under Config,
   1. Select the valid Credential, or create a new credential to authenticate your connection.
   2. Select a Project name and Job name. These correspond to the data you uploaded with validio dbt upload (the --job-name you specified).
   3. Set the Polling schedule (cron expression in UTC), which is how frequently Validio checks for new dbt metadata.
4. Under Source details,
   1. Enter a Name for the source.
   2. (Optional) Add a Description.
   3. Add Tags to help group related sources or to use for routing notifications.
5. Click Continue to create the source.