HomeDocumentationRecipesChangelog
HomeRequest DemoContact
Documentation
HomeRequest DemoContact

Kafka

Prepare credentials and permission in Kafka

Certain credentials and permission are required for Validio to validate your data:

Authentication methods for Source config

You can select either Kafka SSL Certificate or SASL Plain Credential as authentication method for your Kafka clusters.

Field

Description

Options

Credential type

Select an authentication method.

Kafka SSL Certificate
SASL Plain Credential

Kafka SSL certificate

The Kafka SSL Credentials credential type requires the following parameters and certificates:

FieldRequiredDescription
Nameโœ…Identifier for the credentials. Used when accessing Sources.
Bootstrap serverโœ…The address of Kafka load balancer or Kafka cluster address. Use a comma to separate multiple addresses.
CA certificateโœ…A certificate of Certificate authority (CA) in CRT format.
Client certificateโœ…Client SSL certificate in PEM format.
Client private keyโœ…Private keys of client certificate in PEM format.
Client private key passwordโœ…Password or passphrase of private keys for the client certificate.

You can either provide the certificates and client private key as plain text or upload the files.

Kafka SASL Plain Credential

The Kafka SASL Plain Credential credential type, which uses TLS/SSL as transport layer, requires the following parameters and certificates:

FieldRequiredDescription
Nameโœ…Identifier for the credentials. Used when accessing Sources.
Bootstrap serverโœ…The address of Kafka load balancer or Kafka cluster address. Use a comma to separate multiple addresses.
Usernameโœ…Username for the SASL Plain Credential.
Passwordโœ…Password for the SASL Plain Credential.

Configuration parameters

Field

Required

Description

Name

โœ…

Identifier for the Source. Used when setting up Validators.

Cluster

โœ…

Name of the Kafka cluster to read data from.

Message format

โœ…

JSON, AVRO, or PROTOBUF

Message schema

โœ…

For JSON, Validio automatically infers the schema.
For AVRO and PROTOBUF, you can upload schemas. For more information, see Data Stream Sources.