tencent cloud

Elastic MapReduce

DokumentasiElastic MapReduceEMR Development GuideSpark Development GuideSpark Integration with Kafka

Spark Integration with Kafka

PDF
Mode fokus
Ukuran font
Terakhir diperbarui: 2025-01-03 14:50:17

Dependencies

Starting from v2.3, Spark no longer supports Kafka 0.8.2. As Spark 2.4.3 and later are integrated into EMR in the production environment, you need to integrate Kafka 0.10.0 and later.

How to view

1. Enter the version number in the following URL and open it:
https://spark.apache.org/docs/{spark.version}/streaming-kafka-integration.html
Replace {spark.version} with the actual Spark version. For example, to view the dependencies of v3.2.2, the URL should be as follows:
https://spark.apache.org/docs/3.2.2/streaming-kafka-integration.html
2. Click the appropriate link to view detailed integration instructions.

Topik sebelumnya: Practices on Dynamic Scheduling of Spark ResourcesTopik selanjutnya: Spark Dependencies in Each EMR Version

Bantuan dan Dukungan

Apakah halaman ini membantu?

masukan