Kafka Sink

Step 4 - Connection and Security Settings

Kafka Servers List

Indicates a list of Kafka servers the Kafka sink should connect to. This list should be provided as comma-separated values

e.g. localhost:9092, localhost:9093

Step 5 - Worker and Connection Management

Topic List

Indicates the list of topics the sink should subscribe to. This list should be provided as comma-separated values.

e.g. topic_one, topic_two

Partition Number

Indicates the partition number within the specified topic. If no value is provided, events will be published to the default partition.

Unique Message Identifier

A unique identifier for messages published by the sink, allowing receivers to identify the source of a specific message.

Message Key

The key contains the values that are used to maintain ordering within a Kafka partition.

Step 6 - Request and Header Validation

Binary Message Flag

A flag that is set ON to send binary events via the Kafka sink.

Step 7 - Advanced SSL/TLS Configurations

Additional Kafka Configurations

Contains any other configurations for the consumer in key-value format. Some supported configurations can be exemplified as

e.g. Keystore Type: 'producer.type' as key and 'async' as value.

e.g. Batch Size: 'batch.size' as key and '200' as value.

Step 8 - Preview

In Preview Step, you're provided with a concise summary of all the changes you've made to the Kafka Sink Node. This step is pivotal for reviewing and ensuring that your configurations are as intended before completing node setup.

• Viewing Configurations: Preview Step presents a consolidated view of your node setup.

• Saving and Exiting: Use the Complete button to save your changes and exit the node and return back to Canvas.

• Revisions: Use the Back button to return to any Step of modify node setup.

The Preview Step offers a user-friendly summary to manage and finalize node settings in Cortex.