- Product Introduction
- Purchase Guide
- Quick Start
- Operation Guide
- Cloud Monitoring Overview
- Monitoring View
- Dashboard
- Event Center
- Alarm Service
- CVM Agents
- Cloud Access Management (CAM)
- CM Connection to Grafana
- Best Practice
- Troubleshooting
- API Documentation
- History
- API Category
- Making API Requests
- Monitoring Data Query APIs
- Alarm APIs
- DescribeAlarmHistories
- CreateAlarmPolicy
- DeleteAlarmPolicy
- DescribeAlarmPolicies
- DescribeAlarmPolicy
- ModifyAlarmPolicyStatus
- SetDefaultAlarmPolicy
- BindingPolicyObject
- UnBindingPolicyObject
- UnBindingAllPolicyObject
- ModifyAlarmPolicyCondition
- ModifyAlarmPolicyNotice
- ModifyAlarmPolicyTasks
- DescribeMonitorTypes
- DescribeAllNamespaces
- DescribeAlarmMetrics
- DescribeAlarmEvents
- PutMonitorData
- DescribePolicyGroupInfo
- DescribeBindingPolicyObjectList
- DescribePolicyConditionList
- SendCustomAlarmMsg
- ModifyAlarmPolicyInfo
- DescribeConditionsTemplateList
- Legacy Alarm APIs
- Notification Template APIs
- Event Center APIs
- Data Types
- Error Codes
- FAQs
- Tencent Cloud Service Metrics
- CVM
- CBS
- TencentDB
- TencentDB for SQL Server Monitoring Metrics
- TencentDB for MySQL Monitoring Metrics
- TencentDB for Redis Monitoring Metrics
- TencentDB for MongoDB Monitoring Metrics
- TencentDB for PostgreSQL Monitoring Metrics
- TencentDB for CYNOSDB_MYSQL Monitoring Metrics
- TencentDB for TcaplusDB Monitoring Metrics
- TencentDB for MariaDB Monitoring Metrics
- TDSQL for MySQL Monitoring Metrics (Legacy)
- TDSQL for MySQL Monitoring Metrics
- TencentDB for TcaplusDB Monitoring Metrics
- SCF
- CKafka
- VPC
- NAT Gateway Monitoring Metrics
- VPN Gateway Monitoring Metrics
- VPN Tunnel Monitoring Metrics
- Direct Connect Gateway Monitoring Metrics
- CCN Monitoring Metrics
- Peering Connection Monitoring Metrics
- Bandwidth Packet Monitoring Metrics
- EIP Monitoring Metrics
- Anycast EIP Monitoring Metrics
- Network Detection Monitoring Metrics
- CLB
- COS
- CFS
- CPM
- ECM
- EMR
- CDN
- Direct Connect
- TKE
- GAAP
- CMQ
- API Gateway
- Elasticsearch
- WAF
- CLS
- Documentation Guide
- Notice
- Glossary
- Product Introduction
- Purchase Guide
- Quick Start
- Operation Guide
- Cloud Monitoring Overview
- Monitoring View
- Dashboard
- Event Center
- Alarm Service
- CVM Agents
- Cloud Access Management (CAM)
- CM Connection to Grafana
- Best Practice
- Troubleshooting
- API Documentation
- History
- API Category
- Making API Requests
- Monitoring Data Query APIs
- Alarm APIs
- DescribeAlarmHistories
- CreateAlarmPolicy
- DeleteAlarmPolicy
- DescribeAlarmPolicies
- DescribeAlarmPolicy
- ModifyAlarmPolicyStatus
- SetDefaultAlarmPolicy
- BindingPolicyObject
- UnBindingPolicyObject
- UnBindingAllPolicyObject
- ModifyAlarmPolicyCondition
- ModifyAlarmPolicyNotice
- ModifyAlarmPolicyTasks
- DescribeMonitorTypes
- DescribeAllNamespaces
- DescribeAlarmMetrics
- DescribeAlarmEvents
- PutMonitorData
- DescribePolicyGroupInfo
- DescribeBindingPolicyObjectList
- DescribePolicyConditionList
- SendCustomAlarmMsg
- ModifyAlarmPolicyInfo
- DescribeConditionsTemplateList
- Legacy Alarm APIs
- Notification Template APIs
- Event Center APIs
- Data Types
- Error Codes
- FAQs
- Tencent Cloud Service Metrics
- CVM
- CBS
- TencentDB
- TencentDB for SQL Server Monitoring Metrics
- TencentDB for MySQL Monitoring Metrics
- TencentDB for Redis Monitoring Metrics
- TencentDB for MongoDB Monitoring Metrics
- TencentDB for PostgreSQL Monitoring Metrics
- TencentDB for CYNOSDB_MYSQL Monitoring Metrics
- TencentDB for TcaplusDB Monitoring Metrics
- TencentDB for MariaDB Monitoring Metrics
- TDSQL for MySQL Monitoring Metrics (Legacy)
- TDSQL for MySQL Monitoring Metrics
- TencentDB for TcaplusDB Monitoring Metrics
- SCF
- CKafka
- VPC
- NAT Gateway Monitoring Metrics
- VPN Gateway Monitoring Metrics
- VPN Tunnel Monitoring Metrics
- Direct Connect Gateway Monitoring Metrics
- CCN Monitoring Metrics
- Peering Connection Monitoring Metrics
- Bandwidth Packet Monitoring Metrics
- EIP Monitoring Metrics
- Anycast EIP Monitoring Metrics
- Network Detection Monitoring Metrics
- CLB
- COS
- CFS
- CPM
- ECM
- EMR
- CDN
- Direct Connect
- TKE
- GAAP
- CMQ
- API Gateway
- Elasticsearch
- WAF
- CLS
- Documentation Guide
- Notice
- Glossary
Namespace
Namespace=QCE/TXMR_YARN
Monitoring Metrics
YARN - Overview
| Parameter | Metric | Unit | Description | Dimension |
|---|---|---|---|---|
| EmrHdfsOverview YarnRmNumsNumactivenms |
Number of nodes_NumActiveNMs | - | Number of nodes | host4yarnoverview, id4yarnoverview |
| EmrHdfsOverview YarnRmNumsNumde commissionednms |
Number of nodes_NumDecommissionedNMs | - | Number of nodes | host4yarnoverview, id4yarnoverview |
| EmrHdfsOverviewYarn RmNumsNumlostnms |
Number of nodes_NumLostNMs | - | Number of nodes | host4yarnoverview, id4yarnoverview |
| EmrHdfsOverview YarnRmNumsNumun healthynms |
Number of nodes_NumUnhealthyNMs | - | Number of nodes | host4yarnoverview, id4yarnoverview |
YARN - OverviewAggregation
| Parameter | Metric | Unit | Description | Dimension |
|---|---|---|---|---|
| EmrHdfsOverviewAggregation YarnRmNumsNumactivenms |
Number of nodes_NumActiveNMs | - | Number of nodes | id4yarnoverview |
| EmrHdfsOverviewAggregation YarnRmNumsNumde commissionednms |
Number of nodes_NumDecommissionedNMs | - | Number of nodes | id4yarnoverview |
| EmrHdfsOverviewAggregation RmNumsNumlostnms |
Number of nodes_NumLostNMs | - | Number of nodes | id4yarnoverview |
| EmrHdfsOverviewAggregation YarnRmNumsNumun healthynms |
Number of nodes_NumUnhealthyNMs | - | Number of nodes | id4yarnoverview |
YARN - Cluster
| Parameter | Metric | Unit | Description | Dimension |
|---|---|---|---|---|
| YarnClusterResAppFailed | Applications_failed | - | Total number of applications | host4yarnoverview, id4yarnoverview |
| YarnClusterResAppKilled | Applications_killed | - | Total number of applications | host4yarnoverview, id4yarnoverview |
| YarnClusterResAppPending | Applications_pending | - | Total number of applications | host4yarnoverview, id4yarnoverview |
| YarnClusterResAppRunning | Applications_running | - | Total number of applications | host4yarnoverview, id4yarnoverview |
| YarnClusterRes AppSubmitted |
Applications_submitted | - | Total number of applications | host4yarnoverview, id4yarnoverview |
| YarnClusterResContainer Containersallocated |
Containers_containersAllocated | - | Total number of released containers | host4yarnoverview, id4yarnoverview |
| YarnClusterResContainer Containerspending |
Containers_containersPending | - | Total number of released containers | host4yarnoverview, id4yarnoverview |
| YarnClusterResContainer Containersreserved |
Containers_containersReserved | - | Total number of released containers | host4yarnoverview, id4yarnoverview |
| YarnClusterResCpu Allocatedvirtualcores |
Cores_allocatedVirtualCores | - | Number of CPU cores | host4yarnoverview, id4yarnoverview |
| YarnClusterResCpu Availablevirtualcores |
Cores_availableVirtualCores | - | Number of CPU cores | host4yarnoverview, id4yarnoverview |
| YarnClusterResCpu Reservedvirtualcores |
Cores_reservedVirtualCores | - | Number of CPU cores | host4yarnoverview, id4yarnoverview |
| YarnClusterResCpu Totalvirtualcores |
Cores_totalVirtualCores | - | Number of CPU cores | host4yarnoverview, id4yarnoverview |
| YarnClusterResCpu UsageRatioUsageratio |
CPU utilization_usageRatio | % | Memory size | host4yarnoverview, id4yarnoverview |
| YarnClusterResMem Allocatedmb |
Memory_allocatedMB | MB | Memory size | host4yarnoverview, id4yarnoverview |
| YarnClusterResMem Availablemb |
Memory_availableMB | MB | Memory size | host4yarnoverview, id4yarnoverview |
| YarnClusterResMem Reservedmb |
Memory_reservedMB | MB | Memory size | host4yarnoverview, id4yarnoverview |
| YarnClusterRes MemTotalmb |
Memory_totalMB | MB | Memory size | host4yarnoverview, id4yarnoverview |
| YarnClusterResMem UsageRatioUsageratio |
Memory utilization_usageRatio | % | Memory size | host4yarnoverview, id4yarnoverview |
YARN - ResourceManager
| Parameter | Metric | Unit | Description | Dimension |
|---|---|---|---|---|
| YarnRmRpcAuth5000 Rpcauthenticationfailures |
Number of RPC authentication authorizations_RpcAuthenticationFailures | - | Number of RPC authentication authorizations | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmRpcAuth5000 Rpcauthenticationsuccesses |
Number of RPC authentication authorizations_RpcAuthorizationSuccesses | - | Number of RPC authentication authorizations | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmRpcAuth5000 Rpcauthorizationfailures |
Number of RPC authentication authorizations_RpcAuthorizationFailures | - | Number of RPC authentication authorizations | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmRpcAuth5000 Rpcauthorizationsuccesses |
Number of RPC authentication authorizations_RpcAuthenticationSuccesses | - | Number of RPC authentication authorizations | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmRpcBytes5000 Receivedbytes |
Volume of data received/sent by RPC_ReceivedBytes | bytes/s | Volume of data received/sent by RPC | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmRpcBytes5000 Sentbytes |
Volume of data received/sent by RPC_SentBytes | bytes/s | Volume of data received/sent by RPC | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmRpc Connections5000 Numopenconnections |
Number of RPC connections_NumOpenConnections | - | Number of RPC connections | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmRpcOps5000 Rpcprocessingtimenumops |
Number of RPC requests_RpcProcessingTimeNumOps | - | Number of RPC requests | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmRpcOps5000 Rpcqueuetimenumops |
Number of RPC requests_RpcQueueTimeNumOps | - | Number of RPC requests | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmRpcQueueLen5000 Callqueuelength |
RPC queue length_CallQueueLength | - | RPC queue length | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmRpcTime5000 Rpcprocessingtimeavgtime |
Average RPC processing time_RpcProcessingTimeAvgTime | s | Average RPC processing time | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmRpcTime5000 Rpcqueuetimeavgtime |
Average RPC processing time_RpcQueueTimeAvgTime | s | Average RPC processing time | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmRpcAuth5000 Rpcauthenticationfailures |
Number of RPC authentication authorizations_RpcAuthenticationFailures | - | Number of RPC authentication authorizations | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmRpcAuth5000 Rpcauthenticationsuccesses |
Number of RPC authentication authorizations_RpcAuthenticationSuccesses | - | Number of RPC authentication authorizations | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmRpcAuth5000 Rpcauthorizationfailures |
Number of RPC authentication authorizations_RpcAuthorizationFailures | - | Number of RPC authentication authorizations | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmRpcAuth5000 Rpcauthorizationsuccesses |
Number of RPC authentication authorizations_RpcAuthorizationSuccesses | - | Number of RPC authentication authorizations | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmRpcBytes5000 Receivedbytes |
Volume of data received/sent by RPC_ReceivedBytes | bytes/s | Volume of data received/sent by RPC | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmRpcBytes5000 Sentbytes |
Volume of data received/sent by RPC_SentBytes | bytes/s | Volume of data received/sent by RPC | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmRpcConnections5000 Numopenconnections |
Number of RPC connections_NumOpenConnections | - | Number of RPC connections | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmRpcOps5000 Rpcprocessingtimenumops |
Number of RPC requests_RpcProcessingTimeNumOps | - | Number of RPC requests | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmRpcOps5000 Rpcqueuetimenumops |
Number of RPC requests_RpcQueueTimeNumOps | - | Number of RPC requests | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmRpcQueueLen5000 Callqueuelength |
RPC queue length_CallQueueLength | - | RPC queue length | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmRpcTime5000 Rpcprocessingtimeavgtime |
Average RPC processing time_RpcProcessingTimeAvgTime | s | Average RPC processing time | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmRpcTime5000 Rpcqueuetimeavgtime |
Average RPC processing time_RpcQueueTimeAvgTime | s | Average RPC processing time | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmRpcAuth5000 Rpcauthenticationfailures |
Number of RPC authentication authorizations_RpcAuthenticationSuccesses | - | Number of RPC authentication authorizations | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmRpcAuth5000 Rpcauthenticationsuccesses |
Number of RPC authentication authorizations_RpcAuthenticationSuccesses | - | Number of RPC authentication authorizations | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmRpcAuth5000 Rpcauthorizationfailures |
Number of RPC authentication authorizations_RpcAuthorizationFailures | - | Number of RPC authentication authorizations | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmRpcAuth5000 Rpcauthorizationsuccesses |
Number of RPC authentication authorizations_RpcAuthorizationSuccesses | - | Number of RPC authentication authorizations | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmRpcBytes5000 Receivedbytes |
Volume of data received/sent by RPC_ReceivedBytes | bytes/s | Volume of data received/sent by RPC | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmRpcBytes5000 Sentbytes |
Volume of data received/sent by RPC_SentBytes | bytes/s | Volume of data received/sent by RPC | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmRpcConnections5000 Numopenconnections |
Number of RPC connections_NumOpenConnections | - | Number of RPC connections | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmRpcOps5000 Rpcprocessingtimenumops |
Number of RPC requests_RpcProcessingTimeNumOps | - | Number of RPC requests | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmRpcOps5000 Rpcqueuetimenumops |
Number of RPC requests_RpcQueueTimeNumOps | - | Number of RPC requests | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmRpcQueueLen5000 Callqueuelength |
RPC queue length_CallQueueLength | - | RPC queue length | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmRpcTime5000 Rpcprocessingtimeavgtime |
Average RPC processing time_RpcProcessingTimeAvgTime | s | Average RPC processing time | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmRpcTime5000 Rpcqueuetimeavgtime |
Average RPC processing time_RpcQueueTimeAvgTime | s | Average RPC processing time | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmRpcAuth5000 Rpcauthenticationfailures |
Number of RPC authentication authorizations_RpcAuthenticationFailures | - | Number of RPC authentication authorizations | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmRpcAuth5000 Rpcauthenticationsuccesses |
Number of RPC authentication authorizations_RpcAuthenticationSuccesses | - | Number of RPC authentication authorizations | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmRpcAuth5000 Rpcauthorizationfailures |
Number of RPC authentication authorizations_RpcAuthorizationFailures | - | Number of RPC authentication authorizations | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmRpcAuth5000 Rpcauthorizationsuccesses |
Number of RPC authentication authorizations_RpcAuthorizationSuccesses | - | Number of RPC authentication authorizations | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmRpcBytes5000 Receivedbytes |
Volume of data received/sent by RPC_ReceivedBytes | bytes/s | Volume of data received/sent by RPC | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmRpcBytes5000 Sentbytes |
Volume of data received/sent by RPC_SentBytes | bytes/s | Volume of data received/sent by RPC | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmRpc Connections5000 Numopenconnections |
Number of RPC connections_NumOpenConnections | - | Number of RPC connections | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmRpcOps5000 Rpcprocessingtimenumops |
Number of RPC requests_RpcProcessingTimeNumOps | - | Number of RPC requests | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmRpcOps5000 Rpcqueuetimenumops |
Number of RPC requests_RpcQueueTimeNumOps | - | Number of RPC requests | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmRpc QueueLen5000 Callqueuelength |
RPC queue length_CallQueueLength | - | RPC queue length | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmRpcTime5000 Rpcprocessingtimeavgtime |
Average RPC processing time_RpcProcessingTimeAvgTime | s | Average RPC processing time | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmRpcTime5000 Rpcqueuetimeavgtime |
GC count_YGC | s | Average RPC processing time | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmGcUtilGcCountYgc | GC count_FGC | - | GC count | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmGcUtilGcCountFgc | GC time_FGCT | - | GC count | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmGcUtilGcTimeFgct | GC time_FGCT | s | GC time | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmGcUtilGcTimeGct | GC time_YGCT | s | GC time | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmGcUtilGcTimeYgct | Memory space percentage_S0 | s | GC time | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmGcUtilMemoryS0 | Memory space percentage_E | % | Memory space percentage | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmGcUtilMemoryE | Memory space percentage_CCS | % | Memory space percentage | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmGcUtilMemoryCcs | Memory space percentage_S1 | % | Memory space percentage | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmGcUtilMemoryS1 | Memory space percentage_O | % | Memory space percentage | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmGcUtilMemoryO | Memory space percentage_M | % | Memory space percentage | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmGcUtilMemoryM | Number of JVM threads_ThreadsNew | % | Memory space percentage | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmJvmJava ThreadsThreadsnew |
Number of JVM threads_ThreadsRunnable | - | Number of JVM threads | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmJvmJavaThreads Threadsrunnable |
Number of JVM threads_ThreadsBlocked | - | Number of JVM threads | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmJvmJavaThreads Threadsblocked |
Number of JVM threads_ThreadsWaiting | - | Number of JVM threads | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmJvmJavaThreads Threadswaiting |
Number of JVM threads_ThreadsTimedWaiting | - | Number of JVM threads | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmJvmJavaThreads Threadstimedwaiting |
Number of JVM threads_ThreadsTerminated | - | Number of JVM threads | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmJvmJavaThreads Threadsterminated |
Number of JVM logs_LogFatal | - | Number of JVM threads | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmJvmLogTotalLogfatal | Number of JVM logs_LogError | - | Number of JVM logs | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmJvmLogTotalLogerror | Number of JVM logs_LogWarn | - | Number of JVM logs | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmJvmLogTotalLogwarn | Number of JVM logs_LogInfo | - | Number of JVM logs | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmJvmLogTotalLoginfo | JVM memory_MemNonHeapUsedM | - | Number of JVM logs | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmJvmMem Memnonheapusedm |
JVM memory_MemNonHeapCommittedM | MB | JVM memory | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmJvmMemMem nonheapcommittedm |
JVM memory_MemHeapUsedM | MB | JVM memory | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmJvmMemMem heapusedm |
JVM memory_MemHeapCommittedM | MB | JVM memory | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmJvmMemMem heapcommittedm |
JVM memory_MemHeapMaxM | MB | JVM memory | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmJvmMem Memheapmaxm |
JVM memory_MemMaxM | MB | JVM memory | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmJvmMemMemmaxm | CPU utilization_ProcessCpuLoad | MB | JVM memory | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmOsCpuLoad Processcpuload |
Cumulative CPU usage time_ProcessCpuTime | % | CPU utilization | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmOsCpuTime Processcputime |
Number of file descriptors_MaxFileDescriptorCount | ms | Cumulative CPU usage time | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmOsFdCount Maxfiledescriptorcount |
Number of file descriptors_OpenFileDescriptorCount | - | Number of file descriptors | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmOsFdCount Openfiledescriptorcount |
Process run time_Uptime | - | Number of file descriptors | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmRtUptimeUptime | Process run time_Uptime | s | Process run time | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmThreadCount Daemonthreadcount |
Number of worker threads_DaemonThreadCount | - | Number of worker threads | host4yarnresourcemanager, id4yarnresourcemanager |
| YarnRmThreadCount Threadcount |
Number of worker threads_ThreadCount | - | Number of worker threads | host4yarnresourcemanager, id4yarnresourcemanager |
YARN - JobHistoryServer
| Parameter | Metric | Unit | Description | Dimension |
|---|---|---|---|---|
| YarnJhJvmJava ThreadsThreadsnew |
Number of JVM threads_ThreadsNew | - | Number of JVM threads | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
| YarnJhJvmJava ThreadsThreadsrunnable |
Number of JVM threads_ThreadsRunnable | - | Number of JVM threads | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
| YarnJhJvmJava ThreadsThreadsblocked |
Number of JVM threads_ThreadsBlocked | - | Number of JVM threads | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
| YarnJhJvmJava ThreadsThreadswaiting |
Number of JVM threads_ThreadsWaiting | - | Number of JVM threads | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
| YarnJhJvmJava ThreadsThreadstimedwaiting |
Number of JVM threads_ThreadsTimedWaiting | - | Number of JVM threads | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
| YarnJhJvmJava ThreadsThreadsterminated |
Number of JVM threads_ThreadsTerminated | - | Number of JVM threads | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
| YarnJhJvmLogTotalLogfatal | Number of JVM logs_LogFatal | - | Number of JVM logs | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
| YarnJhJvmLogTotalLogerror | Number of JVM logs_LogError | - | Number of JVM logs | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
| YarnJhJvmLogTotalLogwarn | Number of JVM logs_LogWarn | - | Number of JVM logs | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
| YarnJhJvmLogTotalLoginfo | Number of JVM logs_LogInfo | - | Number of JVM logs | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
| YarnJhJvmMemMem nonheapusedm |
JVM memory_MemNonHeapUsedM | MB | JVM memory | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
| YarnJhJvmMemMem nonheapcommittedm |
JVM memory_MemNonHeapCommittedM | MB | JVM memory | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
| YarnJhJvmMemMem heapusedm |
JVM memory_MemHeapUsedM | MB | JVM memory | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
| YarnJhJvmMemMem heapcommittedm |
JVM memory_MemHeapCommittedM | MB | JVM memory | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
| YarnJhJvmMemMem heapmaxm |
JVM memory_MemHeapMaxM | MB | JVM memory | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
| YarnJhJvmMemMem maxm |
JVM memory_MemMaxM | MB | JVM memory | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
| YarnJhsGcUtilGcCountYgc | GC count_YGC | - | GC count | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
| YarnJhsGcUtilGcCountFgc | GC count_FGC | - | GC count | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
| YarnJhsGcUtilGcTimeFgct | GC time_FGCT | s | GC time | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
| YarnJhsGcUtilGcTimeGct | GC time_FGCT | s | GC time | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
| YarnJhsGcUtilGcTimeYgct | GC time_YGCT | s | GC time | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
| YarnJhsGcUtilMemoryS0 | Memory space percentage_S0 | % | Memory space percentage | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
| YarnJhsGcUtilMemoryE | Memory space percentage_E | % | Memory space percentage | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
| YarnJhsGcUtilMemoryCcs | Memory space percentage_CCS | % | Memory space percentage | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
| YarnJhsGcUtilMemoryS1 | Memory space percentage_S1 | % | Memory space percentage | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
| YarnJhsGcUtilMemoryO | Memory space percentage_O | % | Memory space percentage | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
| YarnJhsGcUtilMemoryM | Memory space percentage_M | % | Memory space percentage | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
| YarnJhOsCpuLoad Processcpuload |
CPU utilization_ProcessCpuLoad | % | CPU utilization | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
| YarnJhOsCpuTime Processcputime |
Cumulative CPU usage time_ProcessCpuTime | ms | Cumulative CPU usage time | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
| YarnJhOsFdCountMax filedescriptorcount |
Number of file descriptors_MaxFileDescriptorCount | - | Number of file descriptors | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
| YarnJhOsFdCountOpen filedescriptorcount |
Number of file descriptors_OpenFileDescriptorCount | - | Number of file descriptors | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
| YarnJhRtUptimeUptime | Process run time_Uptime | s | Process run time | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
| YarnJhThreadCount Daemonthreadcount |
Number of worker threads_DaemonThreadCount | - | Number of worker threads | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
| YarnJhThreadCount Threadcount |
Number of worker threads_ThreadCount | - | Number of worker threads | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
YARN - NodeManager
| Parameter | Metric | Unit | Description | Dimension |
|---|---|---|---|---|
| YarnNmGcUtilGcCountYgc | GC count_YGC | - | GC count | id4yarnnodemanager, host4yarnnodemanager |
| YarnNmGcUtilGcCountFgc | GC count_FGC | - | GC count | id4yarnnodemanager, host4yarnnodemanager |
| YarnNmGcUtilGcTimeFgct | GC time_FGCT | s | GC time | id4yarnnodemanager, host4yarnnodemanager |
| YarnNmGcUtilGcTimeGct | GC time_FGCT | s | GC time | id4yarnnodemanager, host4yarnnodemanager |
| YarnNmGcUtilGcTimeYgct | GC time_YGCT | s | GC time | id4yarnnodemanager, host4yarnnodemanager |
| YarnNmGcUtilMemoryS0 | Memory space percentage_S0 | % | Memory space percentage | id4yarnnodemanager, host4yarnnodemanager |
| YarnNmGcUtilMemoryE | Memory space percentage_E | % | Memory space percentage | id4yarnnodemanager, host4yarnnodemanager |
| YarnNmGcUtilMemoryCcs | Memory space percentage_CCS | % | Memory space percentage | id4yarnnodemanager, host4yarnnodemanager |
| YarnNmGcUtilMemoryS1 | Memory space percentage_S1 | % | Memory space percentage | id4yarnnodemanager, host4yarnnodemanager |
| YarnNmGcUtilMemoryO | Memory space percentage_O | % | Memory space percentage | id4yarnnodemanager, host4yarnnodemanager |
| YarnNmGcUtilMemoryM | Memory space percentage_M | % | Memory space percentage | id4yarnnodemanager, host4yarnnodemanager |
| YarnNmJvmJavaThreads Threadsnew |
Number of JVM threads_ThreadsNew | - | Number of JVM threads | id4yarnnodemanager, host4yarnnodemanager |
| YarnNmJvmJavaThreads Threadsrunnable |
Number of JVM threads_ThreadsRunnable | - | Number of JVM threads | id4yarnnodemanager, host4yarnnodemanager |
| YarnNmJvmJavaThreads Threadsblocked |
Number of JVM threads_ThreadsBlocked | - | Number of JVM threads | id4yarnnodemanager, host4yarnnodemanager |
| YarnNmJvmJavaThreads Threadswaiting |
Number of JVM threads_ThreadsWaiting | - | Number of JVM threads | id4yarnnodemanager, host4yarnnodemanager |
| YarnNmJvmJavaThreads Threadstimedwaiting |
Number of JVM threads_ThreadsTimedWaiting | - | Number of JVM threads | id4yarnnodemanager, host4yarnnodemanager |
| YarnNmJvmJavaThreads Threadsterminated |
Number of JVM threads_ThreadsTerminated | - | Number of JVM threads | id4yarnnodemanager, host4yarnnodemanager |
| YarnNmJvmLog TotalLogfatal |
Number of JVM logs_LogFatal | - | Number of JVM logs | id4yarnnodemanager, host4yarnnodemanager |
| YarnNmJvmLog TotalLogerror |
Number of JVM logs_LogError | - | Number of JVM logs | id4yarnnodemanager, host4yarnnodemanager |
| YarnNmJvmLog TotalLogwarn |
Number of JVM logs_LogWarn | - | Number of JVM logs | id4yarnnodemanager, host4yarnnodemanager |
| YarnNmJvmLog TotalLoginfo |
Number of JVM logs_LogInfo | - | Number of JVM logs | id4yarnnodemanager, host4yarnnodemanager |
| YarnNmJvmMem Memnonheapusedm |
JVM memory_MemNonHeapUsedM | MB | JVM memory | id4yarnnodemanager, host4yarnnodemanager |
| YarnNmJvmMem Memnonheapcommittedm |
JVM memory_MemNonHeapCommittedM | MB | JVM memory | id4yarnnodemanager, host4yarnnodemanager |
| YarnNmJvmMemMem heapusedm |
JVM memory_MemHeapUsedM | MB | JVM memory | id4yarnnodemanager, host118yarnnodemanager |
| YarnNmJvmMemMem heapcommittedm |
JVM memory_MemHeapCommittedM | MB | JVM memory | id4yarnnodemanager, host4yarnnodemanager |
| YarnNmJvmMem Memheapmaxm |
JVM memory_MemHeapMaxM | MB | JVM memory | id4yarnnodemanager, host4yarnnodemanager |
| YarnNmJvmMem Memmaxm |
JVM memory_MemMaxM | MB | JVM memory | id4yarnnodemanager, host4yarnnodemanager |
| YarnNmVcores Availablevcores |
Number of CPU cores_AvailableVCores | - | Number of CPU cores | id4yarnnodemanager, host4yarnnodemanager |
| YarnNmVcores Allocatedvcores |
Number of CPU cores_AllocatedVCores | - | Number of CPU cores | id4yarnnodemanager, host4yarnnodemanager |
| YarnNmMemAllocatedgb | Memory size_AllocatedGB | GB | Memory size | id4yarnnodemanager, host4yarnnodemanager |
| YarnNmMemAvailablegb | Memory size_AvailableGB | GB | Memory size | id4yarnnodemanager, host4yarnnodemanager |
| YarnNmOsCpuLoad Processcpuload |
CPU utilization_ProcessCpuLoad | % | CPU utilization | id4yarnnodemanager, host4yarnnodemanager |
| YarnNmOsCpuTime Processcputime |
Cumulative CPU usage time_ProcessCpuTime | ms | Cumulative CPU usage time | id4yarnnodemanager, host4yarnnodemanager |
| YarnNmOsFdCount Maxfiledescriptorcount |
Number of file descriptors_MaxFileDescriptorCount | - | Number of file descriptors | id4yarnnodemanager, host4yarnnodemanager |
| YarnNmOsFdCount Openfiledescriptorcount |
Number of file descriptors_OpenFileDescriptorCount | - | Number of file descriptors | id4yarnnodemanager, host4yarnnodemanager |
| YarnNmRtUptimeUptime | Process run time_Uptime | s | Process run time | id4yarnnodemanager, host4yarnnodemanager |
| YarnNmThreadCount Daemonthreadcount |
Number of worker threads_DaemonThreadCount | - | Number of worker threads | id4yarnnodemanager, host4yarnnodemanager |
| YarnNmThread CountThreadcount |
Number of worker threads_ThreadCount | - | Number of worker threads | id4yarnnodemanager, host4yarnnodemanager |
Dimension and Parameters
| Parameter | Dimension | Dimension Description | Format |
|---|---|---|---|
| Instances.N.Dimensions.0.Name | id4yarnoverview | Dimension name of the EMR instance ID | String-type dimension name, such as id4yarnoverview |
| Instances.N.Dimensions.0.Value | id4yarnoverview | Specific EMR instance ID | Specific EMR instance ID, such as emr-mm8bs222 |
| Instances.N.Dimensions.1.Name | host4yarnoverview | Dimension name of the node IP in the EMR instance | String-type dimension name, such as host4yarnoverview |
| Instances.N.Dimensions.1.Value | host4yarnoverview | Specific node IP in the EMR instance | Specific node IP, which can be obtained by clicking Instance > Cluster Resources > Resource Management > Node Private IP in the EMR console or calling the DescribeClusterNodes API. |
| Instances.N.Dimensions.0.Name | id4yarnresourcemanager | Dimension name of the EMR instance ID | String-type dimension name, such as id4yarnresourcemanager |
| Instances.N.Dimensions.0.Value | id4yarnresourcemanager | Specific EMR instance ID | Specific EMR instance ID, such as emr-mm8bs222 |
| Instances.N.Dimensions.1.Name | host4yarnresourcemanager | Dimension name of the node IP in the EMR instance | String-type dimension name, such as host4yarnresourcemanager |
| Instances.N.Dimensions.1.Value | host4yarnresourcemanager | Specific node IP in the EMR instance | Specific node IP, which can be obtained by clicking Instance > Cluster Resources > Resource Management > Node Private IP in the EMR console or calling the DescribeClusterNodes API. |
| Instances.N.Dimensions.0.Name | id4yarnjobhistoryserver | Dimension name of the EMR instance ID | String-type dimension name, such as id4yarnjobhistoryserver |
| Instances.N.Dimensions.0.Value | id4yarnjobhistoryserver | Specific EMR instance ID | Specific EMR instance ID, such as emr-mm8bs222 |
| Instances.N.Dimensions.1.Name | host4yarnjobhistoryserver | Dimension name of the node IP in the EMR instance | String-type dimension name, such as host4yarnjobhistoryserver |
| Instances.N.Dimensions.1.Value | host4yarnjobhistoryserver | Specific node IP in the EMR instance | Specific node IP, which can be obtained by clicking Instance > Cluster Resources > Resource Management > Node Private IP in the EMR console or calling the DescribeClusterNodes API. |
| Instances.N.Dimensions.0.Name | id4yarnnodemanager | Dimension name of the EMR instance ID | String-type dimension name, such as id4yarnnodemanager |
| Instances.N.Dimensions.0.Value | id4yarnnodemanager | Specific EMR instance ID | Specific EMR instance ID, such as emr-mm8bs222 |
| Instances.N.Dimensions.1.Name | host4yarnnodemanager | Dimension name of the node IP in the EMR instance | String-type dimension name, such as host4yarnnodemanager |
| Instances.N.Dimensions.1.Value | host4yarnnodemanager | Specific node IP in the EMR instance | Specific node IP, which can be obtained by clicking Instance > Cluster Resources > Resource Management > Node Private IP in the EMR console or calling the DescribeClusterNodes API. |
Input Parameter Description
EMR (YARN) supports querying monitoring data based on the following five combinations of dimensions. The values for the input parameters are as follows:
1. To query the metric monitoring data of Yarn - Overview Aggregation or YARN - Cluster, use the following input parameters: &Namespace=QCE/TXMR_YARN
&Instances.N.Dimensions.0.Name=id4yarnoverview
&Instances.N.Dimensions.0.Value=EMR instance ID
2. To query the metric monitoring data of Yarn - Overview, use the following input parameters:
&Namespace=QCE/TXMR_YARN
&Instances.N.Dimensions.0.Name=id4yarnoverview
&Instances.N.Dimensions.0.Value=EMR instance ID
&Instances.N.Dimensions.1.Name=host4yarnoverview
&Instances.N.Dimensions.1.Value=Specific node IP in the EMR instance
3. To query the metric monitoring data of YARN - ResourceManager, use the following input parameters:
&Namespace=QCE/TXMR_YARN
&Instances.N.Dimensions.0.Name=id4yarnresourcemanager
&Instances.N.Dimensions.0.Value=EMR instance ID
&Instances.N.Dimensions.1.Name=host4yarnresourcemanager
&Instances.N.Dimensions.1.Value=Specific node IP in the EMR instance
4. To query the metric monitoring data of YARN - JobHistoryServer, use the following input parameters:
&Namespace=QCE/TXMR_YARN
&Instances.N.Dimensions.0.Name=id4yarnjobhistoryserver
&Instances.N.Dimensions.0.Value=EMR instance ID
&Instances.N.Dimensions.1.Name=host4yarnjobhistoryserver
&Instances.N.Dimensions.1.Value=Specific node IP in the EMR instance
5. To query the metric monitoring data of YARN - NodeManager, use the following input parameters:
&Namespace=QCE/TXMR_YARN
&Instances.N.Dimensions.0.Name=id4yarnnodemanager
&Instances.N.Dimensions.0.Value=EMR instance ID
&Instances.N.Dimensions.1.Name=host4yarnnodemanager
&Instances.N.Dimensions.1.Value=Specific node IP in the EMR instance
Yes
No
Was this page helpful?