Service Monitoring

Last updated: 2021-07-13 11:07:44

    Feature Overview

    Service status provides detailed monitoring for main services installed in the cluster, including HDFS, Yarn, Hive, ZooKeeper, Spark, HBase, and Presto. This document describes how to view cluster service status in the console.

    Directions

    1. Log in to the EMR console and click a cluster ID/name on the Cluster List page to go to the cluster details page.
    2. On the cluster details page, select Cluster Service and click Operation > Service Status in the top right corner of the target component. The following uses HDFS as an example:
    3. The service status page provides monitoring views of three service dimensions, namely, service overview, service summary, and role list. As different service components have different services, the dimensions of display vary.
    4. Service Overview displays six metrics of service components by default and their statistical rules during a specified time period. You can click Set Metric to customize the displayed metrics.

    5. Service Summary displays the current overall status of the service.
    6. Role List displays the service deployment status of each role of the current service component. You can click a node IP to view the monitoring metrics and their statistical rules of the current node. Six metrics are displayed by default.
    7. After entering a node page, you can click Set Metric to customize the displayed metrics.
      Note:

      • Service Monitoring displays the HDFS service component by default. You can manually adjust to view other service components.
      • Service monitoring dimensions vary by service component due to different service types. For example, HBase supports table-level monitoring.

    HBase Table Load

    Feature description

    HBase Table Load enables you to monitor the number of read/write requests and storage of each table in HBase.

    Viewing HBase table load

    1. Log in to the EMR console and click a cluster ID/name on the Cluster List page to go to the cluster details page.
    2. On the cluster details page, select Cluster Service and click Operation -> Service Status -> HBase Table Load of the HBase component.
    3. HBase Table Load displays real-time information of HBase tables in four dimensions: number of read requests, number of write requests, size of MemStore, and size of storeFile. You can click the table header to sort tables by corresponding dimension. In addition, you can enter a table name in the search box in the top left corner and click to search.

    Viewing table details

    Click a table name to pop up the table details. The details page can display the number of read/write requests and size of store (including MemStore and storeFile) of the selected table in the dimension of the entire table or node. You can switch between nodes by using the Node Filter in the top right corner.