PostgreSQL

Pre-requisites

The PostgreSQL connector requires access to read rows from the configured table. The following shows an example of setting up a dedicated user in PostgreSQL with read-only access to a table.

Create a user

# Assign a user name and password
CREATE USER validio_user WITH password 'password'

# Create a group for the user
CREATE GROUP validio_group;

# Add the user to the created group.
ALTER GROUP validio_group ADD USER validio_user;

Grant the user read only access to the configured table.

# Grant access to the configured <schema>.
GRANT USAGE ON SCHEMA "<schema>" TO GROUP validio_group;

# Grant read only access to the configured <table> and <schema>.
GRANT SELECT ON <schema>.<table> TO validio_group;

PostgreSQL configuration parameters

Field Required Description
Name Identifier for the connector. Used when setting up pipelines
Host DNS hostname or IP address at which to reach the database server
Port Port number of the database server
Username Username of a Postgres user that has access to read the desired table in the database
Password Password of the specified Postgres user
Database name Name of the database where the table to read from resides.
Schema Name of the schema containing the table to read from. This can be left empty if the table resides in the default public schema
Table name Name of the table from which to fetch data
Polling interval value How often to query the database for new data. This value is combined with the unit in order to create a polling interval (e.g. a polling interval value of 2 with a unit of “hours” will poll every two hours)
Unit The time unit used for the polling interval value
Incrementing column name The name of the column that will help the Validio platform identify and determine what records have not been read already. This can be an auto-incrementing column of type integer or a datetime/timestamp
Date Since If you have specified a column of datatype Timestamp as Incrementing column, you can specify a point in time to read data from. You may want to do this if you are only interested in data beginning from given date. Only records with a timestamp after this given time will be processed