Currently, the Spark component in EMR supports Spark 2.0.2, 2.2.1, and 2.3.2. The software environment is as follows:
su hadoop
command then you can switch to the Hadoop user./usr/local/service/spark
./data/emr
.For more information, please see the community documentation. Here is mainly about how to access COS through Spark.
Was this page helpful?