Elastic MapReduce (EMR) consists of a series of open-source applications in the big data ecosystem. EMR supports five types of clusters: Hadoop, Druid, ClickHouse, Kafka, and Doris. Each EMR version contains a specific set of open-source applications. When you create a cluster, you can choose the most appropriate EMR version based on your actual needs.

EMR comes with two component editions. One is the Standard edition, which is based on the stable open source community component edition to provide services. To keep your EMR clusters consistent with the evolution of the community, you are advised to choose the Standard edition. The other one is the TianQiong edition, which has incorporated Tencent Cloud's proprietary, mature, and stable features on the basis of the stable open source community component edition for better performance and stability. Please choose an edition that suits your business when you purchase a cluster. It is not recommended to switch between the two editions after the cluster is launched.

EMR version numbers are in the format of EMR va.b.c as detailed below:

• The meanings of a for different clusters are as follows:
  • For Hadoop clusters, a indicates the Hadoop versions supported by the current version. When a is 1 or 2, Hadoop v2.X is supported; when a is 3, Hadoop v3.X is supported.
  • For Druid clusters, a indicates the Druid versions supported by the current version. When a is 1, Druid v0.17.X is supported.
  • For ClickHouse clusters, a indicates the ClickHouse versions supported by the current version. When a is 1, ClickHouse v19.X and v20.X are supported.
  • For Kafka clusters, a indicates the Kafka versions supported by the current version. When a is 1, Kafka v1.X is supported.
  • For Doris clusters, a indicates the Doris versions supported by the current version. When a is 1, Doris v0.13X is supported.
• b indicates that the version has new components or supports component version upgrade.
• c indicates feature optimization.

Note：

• The components and their versions bundled with each EMR version are fixed. Currently, neither selecting multiple versions of a component nor changing a component version in one EMR version is supported. For example, Hadoop v2.7.3 and Spark v2.2.1 are built into EMR v2.0.1.
• Once a version of EMR is selected for cluster creation, the EMR and component version used by the cluster will not be automatically upgraded. For example, if EMR v2.0.1 is selected, then Hadoop will always be v2.7.3, and Spark will always be v2.2.1. Even if EMR is upgraded to v2.1.0, Hadoop is upgraded to v2.8.4, and Spark is upgraded to v2.3.2 afterward, the previously created cluster will not be affected, and only new clusters will use the new versions.
• When you upgrade the cluster through data migration, for example, from EMR v2.0.1 to EMR v2.1.0, in order to avoid issues such as version incompatibility or environment changes, be sure to test the tasks to be migrated and ensure that they can work properly in the new software environment.

Hadoop cluster is available in Standard Edition and TianQiong Edition. For more information on the differences between the two editions, please see EMR TianQiong Introduction.

EMR Standard

Currently, EMR Standard supports the Hadoop, Druid, ClickHouse, Kafka, and Doris clusters.

Hadoop v2.X Standard supports the component versions listed in the following table:

Hadoop v3.X Standard supports the component versions listed in the following table:

Druid clusters support the component versions listed in the following table:

ClickHouse clusters support the component versions listed in the following table:

Kafka clusters support the component versions listed in the following table:

Doris clusters support the component versions listed in the following table:

EMR TianQiong

Currently, EMR TianQiong supports Hadoop clusters only. It has integrated the enhanced edition of Spark and Tencent's proprietary JDK Kona.

Hadoop v2.X TianQiong supports the component versions listed in the following table: