Spark Dependencies in Each EMR Version
Dependencies
Spark | Scala | Python | R | Java |
2.4.3 | 2.12.x | 2.7+/3.4+ | 3.1+ | 8+ |
3.0.0 | 2.12.x | 2.7+/3.4+ | 3.1+ | 8/11 |
3.0.2 | 2.12.x | 2.7+/3.4+ | 3.5+ | 8/11 |
3.2.1 | 2.12.x/2.13.x | 3.6+ | 3.5+ | 8/11 |
3.2.2 | 2.12.x/2.13.x | 3.6+ | 3.5+ | 8/11 |
How to view
1. Enter the version number in the following URL and open it:
https://spark.apache.org/docs/{spark.version}/index.html
Replace
{spark.version} with the actual Spark version. For example, to view the dependencies of v3.2.2, the URL should be as follows:https://spark.apache.org/docs/3.2.2/index.html
2. View the dependencies.
文档反馈