Prerequisites#

Version Compatibility#

  • Teradata server versions: 16.10 - 20.0

  • Spark versions: 2.3.x - 3.5.x

  • Java versions: 8 - 20

See official documentation.

Installing PySpark#

To use Teradata connector you should have PySpark installed (or injected to sys.path) BEFORE creating the connector instance.

See Spark installation instruction for more details.

Connecting to Teradata#

Connection host#

It is possible to connect to Teradata by using either DNS name Parsing Engine (PE) host, or it’s IP address.

Connection port#

Connection is usually performed to port 1025. Port may differ for different Teradata instances. Please ask your Teradata administrator to provide required information.

Required grants#

Ask your Teradata cluster administrator to set following grants for a user, used for creating a connection:

-- allow creating tables in the target schema
GRANT CREATE TABLE ON database TO username;

-- allow read & write access to specific table
GRANT SELECT, INSERT ON database.mytable TO username;
See: