Elastic MapReduce upgraded its server and component service monitoring items on September 10, 2019. A new policy type "Elastic MapReduce" has been added, which covers hundreds of monitoring metrics. You can configure alarm policies under the Elastic MapReduce policy type in Cloud Monitor. The original policy type "EMR" will be deprecated at 23:00 on March 30, 2021, and all the configured "EMR" alarm policies will be invalidated. To add new alarm policies, please configure under the "Elastic MapReduce" policy type.
Comparison of "EMR" and "Elastic MapReduce" policy types:
Policy Type | Metric Coverage | Support and Maintenance |
---|---|---|
EMR | It will be deprecated at 23:00 on April 9, 2021 and no longer maintained. | |
Elastic MapReduce | It was released on September 10, 2019 and will be maintained. |
Note:
The "Elastic MapReduce" policy type covers all the metrics of the "EMR" policy type. For details, please see Comparison of New and Original Metrics.
After the "EMR" policy type is deprecated, the system will automatically migrate existing alarm policies under the "EMR" policy type to the "Elastic MapReduce" policy type. Please see further notifications for specific rules and verification methods.
Note:
A few users might need to migrate them manually.
Steps for manual migration are as follows:
memory zone percentage\_SO
as an example: when the statistical period is five minutes, and the percentage is greater than or equal to 1% and lasts for five minutes, an alarm will be triggered once every five minutes.
Original Policy Type | Metric/Event Alarm | Original Metric/Event Name | New Policy Type | New Metric/Event Name |
---|---|---|---|---|
EMR-cluster alarm | Metric alarm | Used HDFS storage space | Elastic MapReduce-HDFS-overview | Cluster storage capacity_CapacityUsed |
Metric alarm | HDFS storage utilization | Elastic MapReduce-HDFS-overview | HDFS storage space utilization_capacityused | |
Metric alarm | YARN app blocks | Elastic MapReduce-YARN-overview | Applications_pending | |
Metric alarm | Failed YARN apps | Elastic MapReduce-YARN-overview | Applications_failed | |
Metric alarm | Assigned cluster CPU cores | Elastic MapReduce-YARN-overview | Cores_allocatedVirtualCores | |
Metric alarm | Cluster CPU utilization | Elastic MapReduce-YARN-overview | CPU utilization_usageRatio | |
Metric alarm | Available cluster memory | Elastic MapReduce-YARN-overview | Memory_availableMB | |
Metric alarm | Cluster memory utilization | Elastic MapReduce-YARN-overview | Memory utilization_usageRatio | |
Metric alarm | Cluster container blocks | Elastic MapReduce-YARN-overview | Containers_containersPending | |
Metric alarm | HBase requests | Elastic MapReduce-HBASE-overview | Total cluster requests_clusterRequests | |
Metric alarm | Time taken for HBase sync | No longer maintained | - | |
Metric alarm | HBase sync log length | No longer maintained | - | |
Event alarm | Node monitoring heartbeat missing | Elastic MapReduce-server monitoring-network | Node monitoring heartbeat missing | |
Event alarm | Process restart | Elastic MapReduce-server monitoring-process | Process OOM | |
EMR-node alarm | Metric alarm | Disk utilization | Elastic MapReduce-server monitoring-disk | Disk capacity utilization_used_all |
Metric alarm | Memory usage | Elastic MapReduce-server monitoring-memory | Memory usage_MemFree | |
Metric alarm | Server restart | No longer maintained | Server restart | |
Metric alarm | Memory utilization | Elastic MapReduce-server monitoring-memory | Memory utilization_used_percent | |
Metric alarm | CPU utilization | Elastic MapReduce-server monitoring-CPU | CPU utilization_idle | |
Metric alarm | Inbound packets over private networks | No longer maintained | - | |
Metric alarm | Outbound packets over private networks | No longer maintained | - | |
Metric alarm | TCP connections | Elastic MapReduce-server monitoring-network | TCP connections |
Was this page helpful?