Parquet

class onetl.file.format.parquet.Parquet(**kwargs)

Parquet file format.

Based on Spark Parquet Files file format.

Supports reading/writing files with .parquet extension.

Note

You can pass any option to the constructor, even if it is not mentioned in this documentation. Option names should be in camelCase!

The set of supported options depends on Spark version. See link above.

Examples

Describe options how to read from/write to Parquet file with specific options:

parquet = Parquet(compression="snappy")

__init__(**kwargs)