Data Subscription Kafka Edition uses Protobuf for data serialization. You can click here to download the Protobuf file. A demo project also contains the Protobuf file. For more information, see the “Key Demo Logic Description” section of Data Consumption Demo.
See the figure below:
Please first set the
enable_auto_commit parameter of Kafka as
false to disable auto commit. The producer inserts a checkpoint message at an appropriate position in the message sequence. After the checkpoint message is consumed, the Kafka client will commit feedback indicating the consumption is completed, so as to ensure message integrity.
Messages in the Kafka client are retained for 1 day. You can set the
auto_offset_reset parameter of Kafka as
latest as needed. If you need to consume data from a specific offset, you can reset the consumer offset with the seek feature of the Kafka client.