tencent cloud

Elastic MapReduce

ドキュメントElastic MapReduceEMR Development GuideSpark Development GuideSpark Integration with Kafka

Spark Integration with Kafka

Download
フォーカスモード
フォントサイズ
最終更新日: 2025-01-03 14:50:17

Dependencies

Starting from v2.3, Spark no longer supports Kafka 0.8.2. As Spark 2.4.3 and later are integrated into EMR in the production environment, you need to integrate Kafka 0.10.0 and later.

How to view

1. Enter the version number in the following URL and open it:
https://spark.apache.org/docs/{spark.version}/streaming-kafka-integration.html
Replace {spark.version} with the actual Spark version. For example, to view the dependencies of v3.2.2, the URL should be as follows:
https://spark.apache.org/docs/3.2.2/streaming-kafka-integration.html
2. Click the appropriate link to view detailed integration instructions.

前の記事へ: Practices on Dynamic Scheduling of Spark Resources次の記事へ: Spark Dependencies in Each EMR Version

ヘルプとサポート

この記事はお役に立ちましたか？

フィードバック