Paimon

Paimon source connector

Read data from Apache Paimon.

Key featuresarrow-up-right

name
type
required
default value

warehouse

String

Yes

-

catalog_type

String

No

filesystem

catalog_uri

String

No

-

database

String

Yes

-

table

String

Yes

-

hdfs_site_path

String

No

-

query

String

No

-

paimon.hadoop.conf

Map

No

-

paimon.hadoop.conf-path

String

No

-

warehouse [string]arrow-up-right

Paimon warehouse path

catalog_type [string]arrow-up-right

Catalog type of Paimon, support filesystem and hive

catalog_uri [string]arrow-up-right

Catalog uri of Paimon, only needed when catalog_type is hive

database [string]arrow-up-right

The database you want to access

table [string]arrow-up-right

The table you want to access

hdfs_site_path [string]arrow-up-right

The file path of hdfs-site.xml

query [string]arrow-up-right

The filter condition of the table read. For example: select * from st_test where id > 100. If not specified, all rows are read. Currently, where conditions only support <, <=, >, >=, =, !=, or, and,is null, is not null, and others are not supported. The Having, Group By, Order By clauses are currently unsupported, because these clauses are not supported by Paimon. The projection and limit will be supported in the future.

Note: When the field after the where condition is a string or boolean value, its value must be enclosed in single quotes, otherwise an error will be reported. For example: name='abc' or tag='true' The field data types currently supported by where conditions are as follows:

  • string

  • boolean

  • tinyint

  • smallint

  • int

  • bigint

  • float

  • double

  • date

  • timestamp

paimon.hadoop.conf [string]arrow-up-right

Properties in hadoop conf

paimon.hadoop.conf-path [string]arrow-up-right

The specified loading path for the 'core-site.xml', 'hdfs-site.xml', 'hive-site.xml' files

Simple examplearrow-up-right

Filter examplearrow-up-right

Hadoop conf examplearrow-up-right

Hive catalog examplearrow-up-right

Last updated