Sink Common Options

Common parameters of sink connectors

Name
Type
Required
Default
Description

source_table_name

String

No

-

When source_table_name is not specified, the current plug-in processes the data set dataset output by the previous plugin in the configuration file When source_table_name is specified, the current plug-in is processing the data set corresponding to this parameter.

Important note

When the job configuration source_table_name you must set the result_table_name parameter

Task Example

Simple:

This is the process of passing a data source through two transforms and returning two different pipiles to different sinks

source {
    FakeSourceStream {
      parallelism = 2
      result_table_name = "fake"
      field_name = "name,age"
    }
}

transform {
    Filter {
      source_table_name = "fake"
      fields = [name]
      result_table_name = "fake_name"
    }
    Filter {
      source_table_name = "fake"
      fields = [age]
      result_table_name = "fake_age"
    }
}

sink {
    Console {
      source_table_name = "fake_name"
    }
    Console {
      source_table_name = "fake_age"
    }
}

Last updated