Speed Control

Nexus offers a robust speed control feature that allows you to manage the rate at which data is synchronized. This is crucial for ensuring efficient and controlled data transfer between systems. The speed control functionality is primarily managed through two key parameters: read_limit.rows_per_second and read_limit.bytes_per_second. This guide will walk you through using these parameters and how to use them effectively.

Configuration

To utilize the speed control feature, configure the read_limit.rows_per_second or read_limit.bytes_per_second parameters in your job configuration.

Example env config in your config file:

env {
    job.mode=STREAMING
    job.name=Nexus_Job
    read_limit.bytes_per_second=7000000
    read_limit.rows_per_second=400
}
source {
    MySQL-CDC {
      // ignore...
    }
}
transform {
}
sink {
    Console {
    }
}

In Nexus, speed control is configured using the parameters read_limit.bytes_per_second and read_limit.rows_per_second, which should be placed within the env parameters of your configuration file. You can configure both parameters simultaneously or choose to set only one. Each parameter value specifies the maximum rate at which each thread is restricted. Thus, when configuring these values, it's important to consider the parallelism of your tasks to ensure optimal performance.