> ## Documentation Index
> Fetch the complete documentation index at: https://docs.validio.io/llms.txt
> Use this file to discover all available pages before exploring further.

# Kinesis

> Connect Validio to Amazon Kinesis for real-time data quality monitoring on streaming data.

The Amazon Kinesis integration enables real-time data quality monitoring on streaming data in Validio. To integrate with Kinesis, you will need to add a credential and add a source for the data stream.

## Prerequisites for integrating with Kinesis

Prepare credentials and permission in the AWS Management Console for Validio to validate your data:

* An [IAM user](https://docs.aws.amazon.com/IAM/latest/UserGuide/id_users.html) with access and permissions to the specified Kinesis stream.
* Credentials for the IAM user. For more information, refer to [Actions, resources, and condition keys for Amazon Kinesis Data Streams](https://docs.aws.amazon.com/service-authorization/latest/reference/list_amazonkinesisdatastreams.html).

### IAM user for Source config

We recommend that you create an IAM user where the Validio platform is granted access to the Kinesis stream you want to read data from.

The following permissions must be assigned to your IAM user:

| Actions | Access level | Required resource type |
| :- | :- | :- |
| `SubscribeToShard` | `Read` | `consumer` |
| `ListShards` | `List` | `stream` |
| `DescribeStreamConsumer` | `Read` | `consumer` |
| `ListStreamConsumers` | `Read` | `stream` |
| `RegisterStreamConsumer` | `Write` | `stream` |
| `ListStreams` | `List` | |
| `EnableEnhancedMonitoring` | `Write` | |
| `DescribeLimits` | `Read` | |
| `DisableEnhancedMonitoring` | `Write` | |

### Access key

You must supply an **Access key** and **secret key** to authenticate to the Kinesis stream. For more information, refer to [Managing access keys for IAM users](https://docs.aws.amazon.com/IAM/latest/UserGuide/id_credentials_access-keys.html).

## Add a Kinesis credential

To add a Kinesis credential in Validio,

1. Navigate to **Credentials** and click **+ New credential**.
2. Under **Namespace**, select a namespace where the resources will be created.
3. For **Credential Type**, select **Amazon Kinesis**.
4. Fill in the **Configuration** parameter fields. Refer to the [Kinesis Credential Parameters](#kinesis-credential-parameters) section.
5. (Optional) Click **Test credential** to validate that Validio can successfully access the Kinesis stream. If validation fails, check that you provided the correct parameter values.
6. Click **Create**.

### Kinesis credential parameters

| Field | Description |
| :- | :- |
| Name | Identifier for the credentials. Used when accessing Sources. |
| Access key | Access key with permissions to access the Kinesis stream. |
| Secret key | Secret key for the specified access key. |

## Add a Kinesis source

To add a source for Kinesis,

1. Navigate to **Sources** and click **+ New source**.
2. Under **Source type**, select **Amazon Kinesis**.
3. Fill in the configuration parameters. For more information, see [Kinesis Configuration Parameters](#kinesis-configuration-parameters).
4. Click **Continue** to create the source.

### Kinesis configuration parameters

| Field | Description |
| :- | :- |
| Name | Identifier for the Source. Used when setting up Validators. |
| AWS region | The AWS region that the Kinesis stream is available in. |
| Stream name | Name of the stream to read data from. |
| Message format | JSON, AVRO or PROTOBUF |
| Message Schema | For JSON, Validio automatically infers the schema. For AVRO and PROTOBUF, you can upload schemas. For more information, see [Data Stream Sources](https://docs.validio.io/v11.1/docs/integrations/data-streams.md). |