Sink Common Options
Common parameters of sink connectors
Name
Type
Required
Default
Description
source_table_name
String
No
-
When source_table_name
is not specified, the current plug-in processes the data set dataset
output by the previous plugin in the configuration file
When source_table_name
is specified, the current plug-in is processing the data set corresponding to this parameter.
Important note
When the job configuration source_table_name
you must set the result_table_name
parameter
Task Example
Simple:
This is the process of passing a data source through two transforms and returning two different pipiles to different sinks
source {
FakeSourceStream {
parallelism = 2
result_table_name = "fake"
field_name = "name,age"
}
}
transform {
Filter {
source_table_name = "fake"
fields = [name]
result_table_name = "fake_name"
}
Filter {
source_table_name = "fake"
fields = [age]
result_table_name = "fake_age"
}
}
sink {
Console {
source_table_name = "fake_name"
}
Console {
source_table_name = "fake_age"
}
}
Last updated