Teradata

Teradata is a scalable cloud and on-premises data warehouse platform designed to manage large volumes of data and support advanced analytics. With Validio, you can monitor and validate your Teradata data to ensure data quality and freshness.

Prerequisites for Teradata

In Teradata, create a dedicated read-only service account for Validio and grant it permission to the necessary datasets and tables.

The following SQL script provides steps for creating a read-only service account and granting access to metadata tables. Copy the script into a SQL worksheet and follow the steps:

-- Create a user.
CREATE USER validio_user AS
PASSWORD = <password>
PERMANENT = 0 BYTES
SPOOL = 1000000000 BYTES;

-- Grant read access to the following system tables
-- These permissions are required for Validio catalog functionality.
GRANT SELECT ON DBC.DatabasesV TO validio_user;
GRANT SELECT ON DBC.TablesV TO validio_user;
GRANT SELECT ON DBC.ColumnsV TO validio_user;
GRANT SELECT ON DBC.ColumnsQV TO validio_user;
GRANT SELECT ON DBC.QryLogV TO validio_user;
GRANT SELECT ON DBC.QryLogSqlV TO validio_user;

-- For data monitoring and profiling, grant read access to all relevant tables and views.
-- The following grants read access to all existing and future tables and
-- views in a database. Run this command on each database containing relevant tables.
GRANT SELECT ON <DATABASE> TO validio_user;

Add a Teradata Credential

To connect Validio to your Teradata database, you need to configure a credential and specify connection details.

To add a credential for Teradata,

  1. Navigate to Credentials and click + New Credential.
  2. Under Namespace, select a namespace where the resources will be created.
  3. For Credential Type, select Teradata Credential.
  4. Fill in the Configuration parameter fields. Refer to the Teradata Credential Parameters table.
  5. (Optional) Click Test credential to validate that Validio can successfully access the Teradata account. If validation fails, check that you provided the correct parameter values.
  6. (Optional) Check Use for catalog and schema checks to automatically discover assets from this credential and add them to the Catalog page.
  7. Click Create credential.

Validio will automatically start fetching data and you will be able to view Teradata assets and their relationships in the Catalog (if selected) and Lineage pages.

Once the credential is created, you can add a source to monitor Teradata tables.

Teradata Credential Parameters

Parameter

Description

Host

The Teradata server's hostname or IP address, for example teradata.company.com

TDMST port

Port number to use to access the Teradata server via non-SSL connection. Defaults to 1025.

HTTPS port

Port number to use to access the Teradata server via SSL connection. Defaults to 443.

SSL mode

Specify which SSL encryption mode to use when connecting to Teradata. Options include:

  • Allow - Attempt to create a non-SSL connection, otherwise fall back to SSL connection upon failure.
  • Prefer - Attempt to create an SSL connection, otherwise fall back to non-SSL connection upon failure.
  • Disable - Only attempt to create a non-SSL connection.
  • Require - Only attempt to create an SSL connection.

Add a Teradata Source

To add a source for Teradata,

  1. Navigate to Sources and click + New source.
  2. Under Source type, select Teradata.
  3. Under Config,
    1. Select the valid Credential or create a new credential to authenticate your connection to the data warehouse.
    2. You have two options for specifying the dataset and tables to monitor:
      1. Select an existing table -- Enter the Database, Schema, and Table to specify where the data comes from. Selecting more than one table will create a new source for each table. Refer to the Source Configuration Parameters table.
      2. Use Custom SQL -- Write a valid SQL query to select the precise dataset to monitor. For details, see About Custom SQL Sources.
    3. Set the Polling schedule, using a cron expression to specify how frequently the validators on the source will check for changes.
  4. Under Schema, click Continue to automatically infer the schema fields from the tables you selected. If you select many tables, this operation can take a few minutes to complete.
  5. Under Source details,
    1. Add Tags to help group related sources or to use for routing notifications.
    2. Add an Owner who will be the contact for incident notifications.
    3. Assign a Priority, which indicates the importance of any incidents or issues triggered by data quality validation.
  6. Click Continue to create the source. Source names are generated automatically and will be displayed when the source creation completes. If there are more than 5 sources, you will see the names for the first five and a count of the remaining sources.

Source Configuration Parameters

ParameterDescription
CredentialTeradata credential
DatabaseName of the Teradata database
SchemaName of the schema that contains the database
TableName of the table to read data from

Supported Data Types

Validio supports validation of all standard Teradata data types, including:

  • Numeric types (INTEGER, FLOAT, etc.)
  • Text types (VARCHAR, CHAR)
  • Dates and times (DATE, TIMESTAMP)
  • Arrays and complex types (if present)

For semi-structured data types or special fields, see Semi-structured and Complex Data Types.