Service Monitoring

Last updated: 2020-07-29 15:33:57

    Feature Overview

    Service status provides detailed monitoring for main services installed in the cluster, including HDFS, YARN, Hive, ZooKeeper, Spark, HBase, and Presto. This document describes how to view cluster service status in the console.

    Directions

    1. Log in to the EMR Console, select Cluster List, and click the ID/Name of the target cluster to enter the cluster details page.
    2. On the cluster details page, select Cluster Service and then click Operation > Service Status in the top-right corner of the target component. The following uses HDFS as an example:
    3. The service status page provides monitoring views of three service dimensions, namely, service overview, service summary, and role list. As different service components have different services, the dimensions of display vary.
    4. The Service Monitoring page intuitively displays up to 6 default metrics and their statistical rules of service components during the specified time period. You can click "Set Metric" on the right to display custom metrics.
    5. Service Summary displays the current overall status of the service.
    6. Role List displays the service deployment status of each role of the current service component. Click Node IP to view the monitoring metrics and their statistical rules of the current node. 6 metrics are displayed by default, and up to 12 metrics can be displayed.
    7. Enter a node page and click Set Metric to customize the displayed metrics.
      • Service monitoring displays the HDFS service component by default. You can manually adjust to view other service components.
      • The service monitoring dimensions vary by service component due to different service types. For example, HBase supports table-level monitoring.

    HBase Table Load

    Feature description

    HBase table load enables you to monitor the number of read/write requests and storage of each table in HBase.

    Viewing HBase table load

    1. Log in to the EMR Console, select Cluster List, and click the ID/Name of the target cluster to enter the cluster details page.
    2. On the cluster details page, select Cluster Service and click Operation -> Service Status ->Table Load in the top-right corner of the target HBase component.
    3. HBase table load displays information of HBase tables in four dimensions: number of real-time read requests, number of real-time write requests, size of MemStore, and size of storeFile. You can click the table header to sort tables by corresponding dimension. In addition, you can enter a table name in the search box in the top-left corner and click to search for the table.

    Viewing table details

    Click a table name to pop up the table details. The details page can display the number of read/write requests and size of store (including MemStore and storeFile) of the selected table in the dimension of entire table or node. You can switch between nodes by using the Node Filter in the top-right corner.

    Was this page helpful?

    Was this page helpful?

    • Not at all
    • Not very helpful
    • Somewhat helpful
    • Very helpful
    • Extremely helpful
    Send Feedback
    Help