Spark Dependencies in Each EMR Version | Tencent Cloud

search by keyword

Recent Pages

Spark Dependencies in Each EMR Version

Last updated: 2020-02-28 20:02:31

Dependencies

EMR Version	Spark Version	Scala Version	Python Version	R Version	Java Version
v1.3.1	2.0.2	2.11.x	2.6+/3.4+	3.1+	7+
v2.0.1	2.2.1	2.11.x	2.7+/3.4+	3.1+	8+
v2.1.0	2.3.2	2.11.x	2.7+/3.4+	3.1+	8+
v3.0.0	2.4.3	2.12.x	2.7+/3.4+	3.1+	8+

Query Method

Access the official website URL and enter the version number link template:
```
https://spark.apache.org/docs/{spark.version}/index.html
```
Replace {spark.version} with the corresponding Spark version. For example, if you want to query the dependencies of Spark 2.0.2, the access link will be as follows:
```
https://spark.apache.org/docs/2.0.2/index.html
```
View the dependencies.