Spark Dependencies in Each EMR Version

Last updated: 2020-02-28 20:02:31

    Dependencies

    EMR Version Spark Version Scala Version Python Version R Version Java Version
    v1.3.1 2.0.2 2.11.x 2.6+/3.4+ 3.1+ 7+
    v2.0.1 2.2.1 2.11.x 2.7+/3.4+ 3.1+ 8+
    v2.1.0 2.3.2 2.11.x 2.7+/3.4+ 3.1+ 8+
    v3.0.0 2.4.3 2.12.x 2.7+/3.4+ 3.1+ 8+

    Query Method

    1. Access the official website URL and enter the version number link template:
      https://spark.apache.org/docs/{spark.version}/index.html
      Replace {spark.version} with the corresponding Spark version. For example, if you want to query the dependencies of Spark 2.0.2, the access link will be as follows:
      https://spark.apache.org/docs/2.0.2/index.html
    2. View the dependencies.

    Was this page helpful?

    Was this page helpful?

    • Not at all
    • Not very helpful
    • Somewhat helpful
    • Very helpful
    • Extremely helpful
    Send Feedback
    Help