BigQuery
Prerequisite credentials
You need the following to configure BigQuery credentials in the Validio platform:
- A service account with permissions to access the specified dataset and table.
- A base64 encoded service account key in JSON format.
Permissions for destinations
Certain permissions and roles are required for the service account.
For more information, refer to GCP - Introduction to IAM.
Service account for destination config
We recommend that you create a service account with write access for the Validio platform to egress data into your BigQuery table.
The following role must be assigned to the service account:
- BigQuery Data Editor
roles/bigquery.dataEditor
Service account key
- Obtain a service account key in JSON file format for your service account.
For details, refer to Create and delete service account keys. - Encode the service account key JSON file in base64
Note: You must encode the entire JSON file configured for your service account.
Credential parameters
Field | Required | Description | Example |
---|---|---|---|
Name | โ | Identifier for the credentials. Used when accessing sources. | service_acount_product_staging |
Credentials | โ | Service account key encoded in base64 from JSON file. |
Service account
We recommend that you create a service account with write-only access for the Validio platform to egress data to your BigQuery table.
Configuration parameters
Field | Required | Description | Example |
---|---|---|---|
Name | โ | Identifier for the destination in Validio. | East coast weather forecast - validated |
Project id | โ | Name of Google Cloud project. | weather-forecast |
Dataset | โ | Name of the BigQuery dataset where the table is included. | east-coat-validated |
Table | โ | Name of the table created when initializing the destination connector. | train-data-validated |
Updated 4 days ago