Help & DocumentationElastic MapReduceEMR Development GuideSpark Development GuideSpark Dependencies in Each EMR Version

Spark Dependencies in Each EMR Version

Last updated: 2020-02-28 20:02:31

PDF

Contents：

Dependencies

EMR Version Spark Version Scala Version Python Version R Version Java Version
v1.3.1 2.0.2 2.11.x 2.6+/3.4+ 3.1+ 7+
v2.0.1 2.2.1 2.11.x 2.7+/3.4+ 3.1+ 8+
v2.1.0 2.3.2 2.11.x 2.7+/3.4+ 3.1+ 8+
v3.0.0 2.4.3 2.12.x 2.7+/3.4+ 3.1+ 8+

Query Method

  1. Access the official website URL and enter the version number link template: 
    https://spark.apache.org/docs/{spark.version}/index.html
    Replace {spark.version} with the corresponding Spark version. For example, if you want to query the dependencies of Spark 2.0.2, the access link will be as follows:
    https://spark.apache.org/docs/2.0.2/index.html
  2. View the dependencies.