Configuration Management

Last updated: 2021-10-08 15:07:23

    Feature Overview

    Configuration management allows you to modify key configuration parameters of common open-source components such as HDFS, YARN, Hive, and Spark. You can modify the service configurations at the cluster, node, or configuration group level as needed. This document describes how to configure service parameters in the console.


    1. Log in to the EMR Console, select the target cluster in Cluster List, and click Service to enter the cluster service list.
    2. In the cluster service list, select Operation > Configuration Management in the top-right corner of the target service block. After entering the "Configuration Management" page, click Modify Configuration to add, modify, or delete parameters. You can also click Create Configuration File to add a custom configuration file and set its parameters.
      • To configure the parameters of all nodes of the selected service in the cluster, select cluster level.
      • To configure the parameters of a specified node of the selected service, select node level.
      • To configure the parameters of multiple specified nodes of the selected service, you can create a configuration group and use it as the level.
    3. Click Modify Configuration and enter the new parameter value for the target parameter. If needed, you can click Recover to recover a parameter to its original value. You can also click Default Value to recover the parameter to the default value recommended by the system. Delete next to a parameter indicates that this parameter can be deleted. To delete a parameter, select Delete > Confirm.
    4. If the parameter you want to configure does not exist, you can click Add a configuration item on the right to enter the "Add parameter" page. Enter the new parameter name and value and click Confirm.
    5. If the configuration file you want to configure does not exist, you can click Create Configuration File on the bottom-left corner to enter the configuration file configuration page, configure the configuration file, and click Save configuration. The parameters will be delivered, and the configuration file name will be updated in the configuration file list.

      After the custom configuration file is delivered and takes effect, it can be modified and deleted:

      Save the configuration:
    6. After completing parameter modification, click Save configuration and confirm the changes. We recommend you enter a reason of change for future reference. After confirming that all values are correct, click Save and Deliver. After the configurations are successfully delivered, click Restart Service to make the parameters take effect.

      If you modify the service parameters on the Shell command line, and then modify them again in the EMR Console, the previous modifications made on the command line will be overridden.