Athena

Create an Athena Source

Prepare credentials and permissions in AWS Management Console

Certain credentials and permission are required for Validio to validate your data:

  • An IAM user with access and permissions to query data using Athena.
  • Credentials for the IAM user.

Access key

You must supply an Access key and Secret key to authenticate to AWS.

πŸ“˜

For more information, refer to Managing access keys for IAM users.

Permissions

The following permissions must be assigned to your IAM user:

Athena

  • athena:ListDataCatalogs
  • athena:ListDatabases
  • athena:ListTableMetadata
  • athena:ListQueryExecutions
  • athena:GetDataCatalog
  • athena:StartQueryExecution
  • athena:StopQueryExecution
  • athena:GetQueryExecution
  • athena:GetQueryResults

Glue

  • glue:GetTables
  • glue:GetTable
  • glue:BatchGetPartition
  • glue:GetDatabase
  • glue:GetDatabases
  • glue:GetPartition
  • glue:GetPartition

S3: Read permissions on both data source bucket and query results bucket

  • s3:GetBucketLocation
  • s3:GetObject
  • s3:ListBucket
  • s3:ListBucketMultipartUploads
  • s3:ListMultipartUploadParts

S3: Write permissions to query result bucket

  • s3:PutObject
  • s3:AbortMultipartUpload

πŸ“˜

For more information, refer to Identity and access management in Athena.

Credential parameters

FieldRequiredDescriptionExample
Nameβœ…Identifier for the credentials. Used when accessing Sources.service_acount_product_staging
Access keyβœ…Access key for AWS authenticationAKIAIOSFODNN7EXAMPLE
Secret keyβœ…Secret key for the specified access key.wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY
AWS regionβœ…Region from which Athena should run querieseu-central-1
Query result locationβœ…Location where to store query resultss3://myathenabucket/results

Configuration parameters

FieldRequiredDescription
Nameβœ…Identifier for the Source. Used when setting up Validators.
Catalogβœ…Name of the catalog. This is sometimes called Data source.
Databaseβœ…Name of the database. This is sometimes called schema.
Tableβœ…Name of the table with data to validate.