Kinesis

Prerequisites for Integrating with Kinesis

Prepare credentials and permission in the AWS Management Console for Validio to validate your data:

IAM user for Source config

We recommend that you create an IAM user where the Validio platform is granted access to the Kinesis stream you want to read data from.

The following permissions must be assigned to your IAM user:

ActionsAccess levelRequired resource type
SubscribeToShardReadconsumer
ListShardsListstream
DescribeStreamConsumerReadconsumer
ListStreamConsumersReadstream
RegisterStreamConsumerWritestream
ListStreamsList
EnableEnhancedMonitoringWrite
DescribeLimitsRead
DisableEnhancedMonitoingWrite

Access key

You must supply an Access key and secret key to authenticate to the Kinesis stream.
For more information, refer to Managing access keys for IAM users.

Credential parameters

FieldDescription
NameIdentifier for the credentials. Used when accessing Sources.
Access keyAccess key with permissions to access the Kinesis stream.
Secret keySecret key for the specified access key.

Configuration parameters

Field

Description

Name

Identifier for the Source. Used when setting up Validators.

AWS region

The AWS region that the Kinesis stream is available in.

Stream name

Name of the stream to read data from.

Message format

JSON, AVRO or PROTOBUF

Message Schema

For JSON, Validio automatically infers the schema.
For AVRO and PROTOBUF, you can upload schemas. For more information, see Data Stream Sources.