Prepare credentials and permissions in Snowflake
Certain credentials and permissions are required for Validio to validate your data as well as generate catalog and lineage relationships. For detailed information about permissions in Snowflake, refer to Overview of Access Control in Snowflake documentation. You can use the following SQL script to set up a User, Role, and Warehouse, and grant the necessary permissions for the Source in Validio:- Copy this script to a SQL worksheet.
- Follow the steps described in the script.
SQL
Required usage permissions
TheUSAGE permissions are required for tracking users and their queries. This information makes it possible to track which users ran the most queries against catalog assets, as well as connect these users to internal users in Validio.
Shared database permissions
Validio uses certain schemas and tables in theSNOWFLAKE database (for example, ACCOUNT_USAGE and INFORMATION_SCHEMA) for features such as lineage and catalog. Because this is a shared database, you need to use the ACCOUNTADMIN role to grant imported privileges, which allows you to import the required permissions for sharing. For more information, refer to Granting Privileges on an Imported Database in Snowflake documentation.
Key-pair and basic authentication
Snowflake supports key-pair authentication, basic authentication with username and password, or programmatic access tokens. You can configure your Validio credential for Snowflake with any of these authentication types. Key-pair authentication provides a more secure alternative to basic authentication. You should follow the steps provided by Snowflake to configure key-pair authentication. For more information, see Key-pair authentication and rotation in Snowflake documentation.Add a Snowflake credential
To add a credential for Snowflake,- Navigate to Credentials and click + New credential.
- Under Namespace, select a namespace where the resources will be created.
- For Credential Type, select Snowflake Credential.
- Fill in the Configuration parameter fields. Refer to the Snowflake Credential Parameters table.
- (Optional) Click Test credential to validate that Validio can successfully access the Snowflake account. If validation fails, check that you provided the correct parameter values.
- (Optional) Check Use for catalog and schema checks to automatically discover assets from this credential and add them to the Catalog page.
- Click Create credential.
Snowflake credential parameters
Key-pair authentication
For Key-pair authentication, configure the following parameters:User and password authentication
For User and password authentication, configure the following parameters:Programmatic access token authentication
For authentication with a programmatic access token, configure the following parameters:Add a Snowflake source
To add a source for Snowflake,- Navigate to Sources and click + New source.
- Under Source type, select Snowflake.
- Under Config,
- Select the valid Credential or create a new credential to authenticate your connection to the data warehouse.
- You have two options for specifying the dataset and tables to monitor:
- Select an existing table — Enter the Role, Warehouse, Database, Schema, and Tableto specify where the data comes from. Selecting more than one table will create a new source for each table. Refer to the Source Configuration Parameters table.
- Use Custom SQL — Write a valid SQL query to specify the tables to monitor.
- Set the Polling schedule, which is how frequently the validators on the source will check for changes.
- Under Schema, click Continue to automatically infer the schema fields from the tables you selected. If you select many tables, this operation can take a few minutes to complete.
- Under Source details,
- Add Tags to help group related sources or to use for routing notifications.
- Add an Owner who will be the contact for incident notifications.
- Assign a Priority, which indicates the importance of incidents detected on this source.
- (Optional) Under Validators, check each of the recommended metadata validators that you want to add to your source.
- Click Continue to create the source. Source names are generated automatically and will be displayed when the source creation completes. If there are more than 5 sources, you will see the names for the first five and a count of the remaining sources.
Source configuration parameters
Remove credentials and permissions
You can use this SQL script to remove configured permissions for the Source in Validio:- Copy the following script to a SQL worksheet.
- Follow the steps described in the script.
SQL