Validio currently supports datapoint egress to a Kinesis record in JSON format.

Pre-requisite

You will need:

  • An IAM user with permissions to access the specified Kinesis stream
  • Credentials for the IAM user. Either:
    • Access key and secret key
    • Temporary security credentials token

IAM user

It is recommended you create an IAM user with access of writing records into a stream for the Validio platform to egress data to your Kinesis stream. Details of these permissions can be found on Kinesis here.

The following permissions are required:

  • Action PutRecords; access level Write; resource type stream

Credentials

You must supply either an access key and secret key or a temporary security credentials token.

  • Information on obtaining an access key and secret key can be found here
  • Information on how to obtain a temporary security credentials token can be found here

Kinesis destination configuration parameters

Field Required Description Examples
Name Identifier for the connector. Used when setting up pipelines. East coast weather forecast - validated
Region Region that the Kinesis stream is available in. eu-north-1
Access key ✅* Required if not using temporary security credentials token. The access key used in combination with the secret key for the Validio platform to access the stream with. AKUEBNDJHA7BJSHJVA6F
Secret Key ✅* Required if not using temporary security credentials token. The secret key used in combination with the access key for the Validio platform to access the stream with. aslk/KOJHJKBuibhj

2jq3csaVGHYTFgvhc

ascuyg

Token ✅* Required if not using access/private key. The token for the Validio platform to access the stream with.
Endpoint Endpoint of AWS service. It is useful for testing with Amazon Localstack
Stream name Name of the stream to egress data to. You can find it in AWS console. east-coast-weather-validated
Partition key Determines which shard in the stream the data record is assigned to. 0c643477-1815-404d-9572-c7ebfa106523

[*] Depending on which method of credentials are used.

Kinesis destination event structure

Column Data type Description
time timestamp A time of egress data
is_anomaly bool A flag if a data point is filtered out as anomaly.
applied_filters string A list of id of applied filters and flags of anomaly in JSON format.
datapoint string Original data point in JSON format.