Replace
Replace transform plugin
Description​
Examines string value in a given field and replaces substring of the string value that matches the given string literal or regexes with the given replacement.
Options​
replace_field
string
yes
pattern
string
yes
-
replacement
string
yes
-
is_regex
boolean
no
false
replace_first
boolean
no
false
replace_field [string]​
The field you want to replace
pattern [string]​
The old string that will be replaced
replacement [string]​
The new string for replace
is_regex [boolean]​
Use regex for string match
replace_first [boolean]​
Whether replace the first match string. Only used when is_regex = true
.
common options [string]​
Transform plugin common parameters, please refer to Transform Plugin for details
Example​
The data read from source is a table like this:
Joy Ding
20
123
May Ding
20
123
Kin Dom
20
123
Joy Dom
20
123
We want to replace the char to _
at the name
field. Then we can add a Replace
Transform like this:
transform {
Replace {
source_table_name = "fake"
result_table_name = "fake1"
replace_field = "name"
pattern = " "
replacement = "_"
is_regex = true
}
}
Then the data in result table fake1
will update to
Joy_Ding
20
123
May_Ding
20
123
Kin_Dom
20
123
Joy_Dom
20
123
Job Config Example​
env {
job.mode = "BATCH"
}
source {
FakeSource {
result_table_name = "fake"
row.num = 100
schema = {
fields {
id = "int"
name = "string"
}
}
}
}
transform {
Replace {
source_table_name = "fake"
result_table_name = "fake1"
replace_field = "name"
pattern = ".+"
replacement = "b"
is_regex = true
}
}
sink {
Console {
source_table_name = "fake1"
}
}
Last updated