HomeDocumentationChangelog
HomeRequest DemoContact
HomeRequest DemoContact

BigQuery

Create a BigQuery Destination

Prepare credentials and permission in BigQuery

Certain credentials and permission are required for Validio to egress data to your Destination:

For detailed information about permissions in BigQuery, refer to Introduction to IAM.

Create a service account and assign roles

  1. Create a new service account for Validio in the project you want to egress data into. Alternatively, you can use an existing service account.
  2. Navigate to the dataset where you want to create Destination tables.
  3. Share the dataset with the service account
  4. Assign the following role to the service account:
    1. BigQuery Data Editor - We use this to create Destination tables.

Create the Destination in Validio

Credential parameters

FieldRequiredDescriptionExample
NameIdentifier for the credentials. Used when accessing Sources.service_acount_product_staging
Service accountUpload the JSON file, or paste the content of the JSON file containing the service account key.
For details, refer to Create and delete service account keys.

Configuration parameters

FieldRequiredDescriptionExample
NameIdentifier for the Destination. Used when setting up egress in Validators.East coast weather forecast - validated
Project idName of BigQuery project.weather-forecast
DatasetName of the BigQuery dataset where the table is included.east-coat-validated
TableName of the table created when initializing the Destination connector.train-data-validated

Remove Destination permissions

  1. Remove any Destination tables created by Validio from BigQuery.
  2. Remove the service account used for the Validio Destination.

Note: Before you remove the service account, verify it isn't used elsewhere.