You can share the components of an existing cluster with other clusters without deploying such components again. This makes it easier to manage multiple clusters with the same component configurations.
Currently supported components include Ranger, ZooKeeper, and Kerberos.
Currently supported versions include all EMR versions containing the above components.
- Dependent: The current cluster is using components of other existing clusters.
- Shared: One or more components of the current cluster are added to other newly created clusters.
Kerberos and Ranger can be shared with other EMR clusters, so they don't need to be deployed for new clusters again. This increases the Ops configuration efficiency. Dependencies cannot be canceled once configured; therefore, proceed with caution based on your business conditions.
- Your account must have the management permissions of one existing cluster.
- When Kerberos is enabled, other clusters under the current account must have Kerberos deployed before you can enable the dependency.
- If a dependent component involves user identity management, you need to manually sync the users in the sharing cluster to the new cluster after creating it or adding a user. Note that as the current cluster doesn't have Kerberos deployed, krb5 users cannot be created.
- Go to the purchase page and select multiple components under Hadoop.
- Click Enable and select the sharing cluster.
- After the new cluster is successfully purchased, relevant components will automatically depend on the selected cluster.
- Select Cluster Service > Add Component on the cluster details page in the console
- Select the components to be added.
- Click Enable and select the dependent components and cluster.
- Click OK and wait for the components to be successfully added to the cluster.
If a cluster has dependent or shared components, the component information is displayed in Instance Information.
The management features of dependent components can be used only on the Component Management page of the depended-on cluster.
User accounts need to be created in both the dependent and depended-on clusters.
- Log in to the depended-on cluster and click Create User to create an account.
- Log in to the dependent cluster and click Create User to create an account with the same username, user group, and password.
- The dependent cluster will automatically sync the permission and usage information of the account.