This document explains how to start using Kafka APIs after you purchase the CKafka service. After setting up a CKafka environment on an CVM instance, you need to download and decompress the Kafka installation file and perform simple testing on Kafka APIs.
Open a terminal window and run this command:
java -version
If the output of the command is a Java version number, then Java is already installed in your system. If you have not installed Java yet, download and install a Java Development Kit (JDK)
Set the JAVA_HOME
environment variable and point it to the Java installation directory on your machine.
For example, if you use Java JDK 1.8.0_20, the outputs on different operating systems are as follows:
OS | Output |
---|---|
Windows | Set the environment variable JAVA_HOME to C:\Program Files\Java\jdkjdk1.8.0_20 |
Linux | export JAVA_HOME=/usr/local/java-current |
macOS | export JAVA_HOME=/Library/Java/Home |
Add the Java compiler path to the system path:
OS | Output |
---|---|
Windows | Add ;C:\Program Files\Java\jdk1.8.0_20\bin to the end of the system variable PATH . |
Linux | export PATH=$PATH:$JAVA_HOME/bin/ |
macOS | not required |
Use the java -version
command to check your Java installation.
Download and decompress the Kafka installation file.
Currently, CKafka is fully compatible with Kafka 0.9, 0.10, 1.1, and 2.4. We recommend that you download one of these versions. This document uses kafka_2.12-1.1.1 as an example.
Configure an ACL policy locally.
In the ./config
directory of the installation file, add the following content at the end of producer.properties
and consumer.properties
.
security.protocol=SASL_PLAINTEXT
sasl.mechanism=PLAIN
Create a file named ckafka_client_jaas.conf
, and add the following content.
KafkaClient {
org.apache.kafka.common.security.plain.PlainLoginModule required
username="yourinstance#yourusername"
password="yourpassword";
};
Note:
username
is in the format of "instance ID#entered username", andpassword
is the password set.
In the ./bin
directory of the installation file, add the statement of the full path of the JAAS file at the beginning of kafka-console-producer.sh
and kafka-console-consumer.sh
.
export KAFKA_OPTS="-Djava.security.auth.login.config=****/config/ckafka_client_jaas.conf"
Go to the ./bin
directory, and produce and consume a message via CLI commands.
Open a terminal window to start a consumer.
bash kafka-console-consumer.sh --bootstrap-server XXXX:port --topic test --consumer.config ../config/consumer.properties
Note:
Replace
XXXX:port
with the domain name and port for public network access.
Open another terminal window to start a producer.
bash kafka-console-producer.sh --broker-list XXXX:port --topic test --producer.config ../config/producer.properties
Note:
Replace
XXXX:port
with the domain name and port for public network access.
Enter the content of the message and press Enter.
Producing a message:
Consuming a message:
In the message querying page of the CKafka console, query the message sent.
The details of the message are as follows:
Was this page helpful?