Data stream

Validio supports major data streams that modern data teams work with today.

General considerations

Consider the following when you ingest and validate records from a data stream:

  • In each stream, all messages must be consistent with the declared schema:
    1. Fields added after creating the connector are ignored.
    2. Missing fields are interpreted as empty fields, which have consequences on the analytics involving those fields.