tencent cloud

PrevNext

Feedback

search by keyword

Recent Pages

Documentation
Tencent Cloud Observability Platform
    Documentation
    Download PDF

    EMR (YARN)

    Last updated: 2024-01-27 17:52:39
    Download PDF

      Namespace

      Namespace=QCE/TXMR_YARN

      Monitoring Metrics

      YARN - Overview

      Parameter
      Metric
      Unit
      Description
      Dimension
      EmrHdfsOverview
      YarnRmNumsNumactivenms
      Number of nodes_NumActiveNMs
      -
      Number of nodes
      host4yarnoverview,
      id4yarnoverview
      EmrHdfsOverview
      YarnRmNumsNumde
      commissionednms
      Number of nodes_NumDecommissionedNMs
      -
      Number of nodes
      host4yarnoverview,
      id4yarnoverview
      EmrHdfsOverviewYarn
      RmNumsNumlostnms
      Number of nodes_NumLostNMs
      -
      Number of nodes
      host4yarnoverview,
      id4yarnoverview
      EmrHdfsOverview
      YarnRmNumsNumun
      healthynms
      Number of nodes_NumUnhealthyNMs
      -
      Number of nodes
      host4yarnoverview,
      id4yarnoverview

      YARN - OverviewAggregation

      Parameter
      Metric
      Unit
      Description
      Dimension
      EmrHdfsOverviewAggregation
      YarnRmNumsNumactivenms
      Number of nodes_NumActiveNMs
      -
      Number of nodes
      id4yarnoverview
      EmrHdfsOverviewAggregation
      YarnRmNumsNumde
      commissionednms
      Number of nodes_NumDecommissionedNMs
      -
      Number of nodes
      id4yarnoverview
      EmrHdfsOverviewAggregation
      RmNumsNumlostnms
      Number of nodes_NumLostNMs
      -
      Number of nodes
      id4yarnoverview
      EmrHdfsOverviewAggregation
      YarnRmNumsNumun healthynms
      Number of nodes_NumUnhealthyNMs
      -
      Number of nodes
      id4yarnoverview

      YARN - Cluster

      Parameter
      Metric
      Unit
      Description
      Dimension
      YarnClusterResAppFailed
      Applications_failed
      -
      Total number of applications
      host4yarnoverview, id4yarnoverview
      YarnClusterResAppKilled
      Applications_killed
      -
      Total number of applications
      host4yarnoverview, id4yarnoverview
      YarnClusterResAppPending
      Applications_pending
      -
      Total number of applications
      host4yarnoverview, id4yarnoverview
      YarnClusterResAppRunning
      Applications_running
      -
      Total number of applications
      host4yarnoverview, id4yarnoverview
      YarnClusterRes
      AppSubmitted
      Applications_submitted
      -
      Total number of applications
      host4yarnoverview, id4yarnoverview
      YarnClusterResContainer
      Containersallocated
      Containers_containersAllocated
      -
      Total number of released containers
      host4yarnoverview, id4yarnoverview
      YarnClusterResContainer
      Containerspending
      Containers_containersPending
      -
      Total number of released containers
      host4yarnoverview, id4yarnoverview
      YarnClusterResContainer
      Containersreserved
      Containers_containersReserved
      -
      Total number of released containers
      host4yarnoverview, id4yarnoverview
      YarnClusterResCpu
      Allocatedvirtualcores
      Cores_allocatedVirtualCores
      -
      Number of CPU cores
      host4yarnoverview, id4yarnoverview
      YarnClusterResCpu
      Availablevirtualcores
      Cores_availableVirtualCores
      -
      Number of CPU cores
      host4yarnoverview, id4yarnoverview
      YarnClusterResCpu
      Reservedvirtualcores
      Cores_reservedVirtualCores
      -
      Number of CPU cores
      host4yarnoverview, id4yarnoverview
      YarnClusterResCpu
      Totalvirtualcores
      Cores_totalVirtualCores
      -
      Number of CPU cores
      host4yarnoverview, id4yarnoverview
      YarnClusterResCpu
      UsageRatioUsageratio
      CPU utilization_usageRatio
      %
      Memory size
      host4yarnoverview, id4yarnoverview
      YarnClusterResMem
      Allocatedmb
      Memory_allocatedMB
      MB
      Memory size
      host4yarnoverview, id4yarnoverview
      YarnClusterResMem
      Availablemb
      Memory_availableMB
      MB
      Memory size
      host4yarnoverview, id4yarnoverview
      YarnClusterResMem
      Reservedmb
      Memory_reservedMB
      MB
      Memory size
      host4yarnoverview, id4yarnoverview
      YarnClusterRes
      MemTotalmb
      Memory_totalMB
      MB
      Memory size
      host4yarnoverview, id4yarnoverview
      YarnClusterResMem
      UsageRatioUsageratio
      Memory utilization_usageRatio
      %
      Memory size
      host4yarnoverview, id4yarnoverview

      YARN - ResourceManager

      Parameter
      Metric
      Unit
      Description
      Dimension
      YarnRmRpcAuth5000
      Rpcauthenticationfailures
      Number of RPC authentication authorizations_RpcAuthenticationFailures
      -
      Number of RPC authentication authorizations
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmRpcAuth5000
      Rpcauthenticationsuccesses
      Number of RPC authentication authorizations_RpcAuthorizationSuccesses
      -
      Number of RPC authentication authorizations
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmRpcAuth5000
      Rpcauthorizationfailures
      Number of RPC authentication authorizations_RpcAuthorizationFailures
      -
      Number of RPC authentication authorizations
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmRpcAuth5000
      Rpcauthorizationsuccesses
      Number of RPC authentication authorizations_RpcAuthenticationSuccesses
      -
      Number of RPC authentication authorizations
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmRpcBytes5000
      Receivedbytes
      Volume of data received/sent by RPC_ReceivedBytes
      bytes/s
      Volume of data received/sent by RPC
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmRpcBytes5000
      Sentbytes
      Volume of data received/sent by RPC_SentBytes
      bytes/s
      Volume of data received/sent by RPC
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmRpc
      Connections5000
      Numopenconnections
      Number of RPC connections_NumOpenConnections
      -
      Number of RPC connections
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmRpcOps5000
      Rpcprocessingtimenumops
      Number of RPC requests_RpcProcessingTimeNumOps
      -
      Number of RPC requests
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmRpcOps5000
      Rpcqueuetimenumops
      Number of RPC requests_RpcQueueTimeNumOps
      -
      Number of RPC requests
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmRpcQueueLen5000
      Callqueuelength
      RPC queue length_CallQueueLength
      -
      RPC queue length
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmRpcTime5000
      Rpcprocessingtimeavgtime
      Average RPC processing time_RpcProcessingTimeAvgTime
      s
      Average RPC processing time
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmRpcTime5000
      Rpcqueuetimeavgtime
      Average RPC processing time_RpcQueueTimeAvgTime
      s
      Average RPC processing time
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmRpcAuth5000
      Rpcauthenticationfailures
      Number of RPC authentication authorizations_RpcAuthenticationFailures
      -
      Number of RPC authentication authorizations
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmRpcAuth5000
      Rpcauthenticationsuccesses
      Number of RPC authentication authorizations_RpcAuthenticationSuccesses
      -
      Number of RPC authentication authorizations
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmRpcAuth5000
      Rpcauthorizationfailures
      Number of RPC authentication authorizations_RpcAuthorizationFailures
      -
      Number of RPC authentication authorizations
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmRpcAuth5000
      Rpcauthorizationsuccesses
      Number of RPC authentication authorizations_RpcAuthorizationSuccesses
      -
      Number of RPC authentication authorizations
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmRpcBytes5000
      Receivedbytes
      Volume of data received/sent by RPC_ReceivedBytes
      bytes/s
      Volume of data received/sent by RPC
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmRpcBytes5000
      Sentbytes
      Volume of data received/sent by RPC_SentBytes
      bytes/s
      Volume of data received/sent by RPC
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmRpcConnections5000
      Numopenconnections
      Number of RPC connections_NumOpenConnections
      -
      Number of RPC connections
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmRpcOps5000
      Rpcprocessingtimenumops
      Number of RPC requests_RpcProcessingTimeNumOps
      -
      Number of RPC requests
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmRpcOps5000
      Rpcqueuetimenumops
      Number of RPC requests_RpcQueueTimeNumOps
      -
      Number of RPC requests
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmRpcQueueLen5000
      Callqueuelength
      RPC queue length_CallQueueLength
      -
      RPC queue length
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmRpcTime5000
      Rpcprocessingtimeavgtime
      Average RPC processing time_RpcProcessingTimeAvgTime
      s
      Average RPC processing time
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmRpcTime5000
      Rpcqueuetimeavgtime
      Average RPC processing time_RpcQueueTimeAvgTime
      s
      Average RPC processing time
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmRpcAuth5000
      Rpcauthenticationfailures
      Number of RPC authentication authorizations_RpcAuthenticationSuccesses
      -
      Number of RPC authentication authorizations
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmRpcAuth5000
      Rpcauthenticationsuccesses
      Number of RPC authentication authorizations_RpcAuthenticationSuccesses
      -
      Number of RPC authentication authorizations
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmRpcAuth5000
      Rpcauthorizationfailures
      Number of RPC authentication authorizations_RpcAuthorizationFailures
      -
      Number of RPC authentication authorizations
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmRpcAuth5000
      Rpcauthorizationsuccesses
      Number of RPC authentication authorizations_RpcAuthorizationSuccesses
      -
      Number of RPC authentication authorizations
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmRpcBytes5000
      Receivedbytes
      Volume of data received/sent by RPC_ReceivedBytes
      bytes/s
      Volume of data received/sent by RPC
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmRpcBytes5000
      Sentbytes
      Volume of data received/sent by RPC_SentBytes
      bytes/s
      Volume of data received/sent by RPC
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmRpcConnections5000
      Numopenconnections
      Number of RPC connections_NumOpenConnections
      -
      Number of RPC connections
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmRpcOps5000
      Rpcprocessingtimenumops
      Number of RPC requests_RpcProcessingTimeNumOps
      -
      Number of RPC requests
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmRpcOps5000
      Rpcqueuetimenumops
      Number of RPC requests_RpcQueueTimeNumOps
      -
      Number of RPC requests
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmRpcQueueLen5000
      Callqueuelength
      RPC queue length_CallQueueLength
      -
      RPC queue length
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmRpcTime5000
      Rpcprocessingtimeavgtime
      Average RPC processing time_RpcProcessingTimeAvgTime
      s
      Average RPC processing time
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmRpcTime5000
      Rpcqueuetimeavgtime
      Average RPC processing time_RpcQueueTimeAvgTime
      s
      Average RPC processing time
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmRpcAuth5000
      Rpcauthenticationfailures
      Number of RPC authentication authorizations_RpcAuthenticationFailures
      -
      Number of RPC authentication authorizations
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmRpcAuth5000
      Rpcauthenticationsuccesses
      Number of RPC authentication authorizations_RpcAuthenticationSuccesses
      -
      Number of RPC authentication authorizations
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmRpcAuth5000
      Rpcauthorizationfailures
      Number of RPC authentication authorizations_RpcAuthorizationFailures
      -
      Number of RPC authentication authorizations
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmRpcAuth5000
      Rpcauthorizationsuccesses
      Number of RPC authentication authorizations_RpcAuthorizationSuccesses
      -
      Number of RPC authentication authorizations
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmRpcBytes5000
      Receivedbytes
      Volume of data received/sent by RPC_ReceivedBytes
      bytes/s
      Volume of data received/sent by RPC
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmRpcBytes5000
      Sentbytes
      Volume of data received/sent by RPC_SentBytes
      bytes/s
      Volume of data received/sent by RPC
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmRpc
      Connections5000
      Numopenconnections
      Number of RPC connections_NumOpenConnections
      -
      Number of RPC connections
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmRpcOps5000
      Rpcprocessingtimenumops
      Number of RPC requests_RpcProcessingTimeNumOps
      -
      Number of RPC requests
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmRpcOps5000
      Rpcqueuetimenumops
      Number of RPC requests_RpcQueueTimeNumOps
      -
      Number of RPC requests
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmRpc
      QueueLen5000
      Callqueuelength
      RPC queue length_CallQueueLength
      -
      RPC queue length
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmRpcTime5000
      Rpcprocessingtimeavgtime
      Average RPC processing time_RpcProcessingTimeAvgTime
      s
      Average RPC processing time
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmRpcTime5000
      Rpcqueuetimeavgtime
      GC count_YGC
      s
      Average RPC processing time
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmGcUtilGcCountYgc
      GC count_FGC
      -
      GC count
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmGcUtilGcCountFgc
      GC time_FGCT
      -
      GC count
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmGcUtilGcTimeFgct
      GC time_FGCT
      s
      GC time
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmGcUtilGcTimeGct
      GC time_YGCT
      s
      GC time
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmGcUtilGcTimeYgct
      Memory space percentage_S0
      s
      GC time
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmGcUtilMemoryS0
      Memory space percentage_E
      %
      Memory space percentage
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmGcUtilMemoryE
      Memory space percentage_CCS
      %
      Memory space percentage
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmGcUtilMemoryCcs
      Memory space percentage_S1
      %
      Memory space percentage
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmGcUtilMemoryS1
      Memory space percentage_O
      %
      Memory space percentage
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmGcUtilMemoryO
      Memory space percentage_M
      %
      Memory space percentage
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmGcUtilMemoryM
      Number of JVM threads_ThreadsNew
      %
      Memory space percentage
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmJvmJava
      ThreadsThreadsnew
      Number of JVM threads_ThreadsRunnable
      -
      Number of JVM threads
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmJvmJavaThreads
      Threadsrunnable
      Number of JVM threads_ThreadsBlocked
      -
      Number of JVM threads
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmJvmJavaThreads
      Threadsblocked
      Number of JVM threads_ThreadsWaiting
      -
      Number of JVM threads
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmJvmJavaThreads
      Threadswaiting
      Number of JVM threads_ThreadsTimedWaiting
      -
      Number of JVM threads
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmJvmJavaThreads
      Threadstimedwaiting
      Number of JVM threads_ThreadsTerminated
      -
      Number of JVM threads
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmJvmJavaThreads
      Threadsterminated
      Number of JVM logs_LogFatal
      -
      Number of JVM threads
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmJvmLogTotalLogfatal
      Number of JVM logs_LogError
      -
      Number of JVM logs
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmJvmLogTotalLogerror
      Number of JVM logs_LogWarn
      -
      Number of JVM logs
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmJvmLogTotalLogwarn
      Number of JVM logs_LogInfo
      -
      Number of JVM logs
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmJvmLogTotalLoginfo
      JVM memory_MemNonHeapUsedM
      -
      Number of JVM logs
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmJvmMem
      Memnonheapusedm
      JVM memory_MemNonHeapCommittedM
      MB
      JVM memory
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmJvmMemMem
      nonheapcommittedm
      JVM memory_MemHeapUsedM
      MB
      JVM memory
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmJvmMemMem
      heapusedm
      JVM memory_MemHeapCommittedM
      MB
      JVM memory
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmJvmMemMem
      heapcommittedm
      JVM memory_MemHeapMaxM
      MB
      JVM memory
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmJvmMem
      Memheapmaxm
      JVM memory_MemMaxM
      MB
      JVM memory
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmJvmMemMemmaxm
      CPU utilization_ProcessCpuLoad
      MB
      JVM memory
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmOsCpuLoad
      Processcpuload
      Cumulative CPU usage time_ProcessCpuTime
      %
      CPU utilization
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmOsCpuTime
      Processcputime
      Number of file descriptors_MaxFileDescriptorCount
      ms
      Cumulative CPU usage time
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmOsFdCount
      Maxfiledescriptorcount
      Number of file descriptors_OpenFileDescriptorCount
      -
      Number of file descriptors
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmOsFdCount
      Openfiledescriptorcount
      Process run time_Uptime
      -
      Number of file descriptors
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmRtUptimeUptime
      Process run time_Uptime
      s
      Process run time
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmThreadCount
      Daemonthreadcount
      Number of worker threads_DaemonThreadCount
      -
      Number of worker threads
      host4yarnresourcemanager,
      id4yarnresourcemanager
      YarnRmThreadCount
      Threadcount
      Number of worker threads_ThreadCount
      -
      Number of worker threads
      host4yarnresourcemanager,
      id4yarnresourcemanager

      YARN - JobHistoryServer

      Parameter
      Metric
      Unit
      Description
      Dimension
      YarnJhJvmJava
      ThreadsThreadsnew
      Number of JVM threads_ThreadsNew
      -
      Number of JVM threads
      host4yarnjobhistoryserver,
      id4yarnjobhistoryserver
      YarnJhJvmJava
      ThreadsThreadsrunnable
      Number of JVM threads_ThreadsRunnable
      -
      Number of JVM threads
      host4yarnjobhistoryserver,
      id4yarnjobhistoryserver
      YarnJhJvmJava
      ThreadsThreadsblocked
      Number of JVM threads_ThreadsBlocked
      -
      Number of JVM threads
      host4yarnjobhistoryserver,
      id4yarnjobhistoryserver
      YarnJhJvmJava
      ThreadsThreadswaiting
      Number of JVM threads_ThreadsWaiting
      -
      Number of JVM threads
      host4yarnjobhistoryserver,
      id4yarnjobhistoryserver
      YarnJhJvmJava
      ThreadsThreadstimedwaiting
      Number of JVM threads_ThreadsTimedWaiting
      -
      Number of JVM threads
      host4yarnjobhistoryserver,
      id4yarnjobhistoryserver
      YarnJhJvmJava
      ThreadsThreadsterminated
      Number of JVM threads_ThreadsTerminated
      -
      Number of JVM threads
      host4yarnjobhistoryserver,
      id4yarnjobhistoryserver
      YarnJhJvmLogTotalLogfatal
      Number of JVM logs_LogFatal
      -
      Number of JVM logs
      host4yarnjobhistoryserver,
      id4yarnjobhistoryserver
      YarnJhJvmLogTotalLogerror
      Number of JVM logs_LogError
      -
      Number of JVM logs
      host4yarnjobhistoryserver,
      id4yarnjobhistoryserver
      YarnJhJvmLogTotalLogwarn
      Number of JVM logs_LogWarn
      -
      Number of JVM logs
      host4yarnjobhistoryserver,
      id4yarnjobhistoryserver
      YarnJhJvmLogTotalLoginfo
      Number of JVM logs_LogInfo
      -
      Number of JVM logs
      host4yarnjobhistoryserver,
      id4yarnjobhistoryserver
      YarnJhJvmMemMem
      nonheapusedm
      JVM memory_MemNonHeapUsedM
      MB
      JVM memory
      host4yarnjobhistoryserver,
      id4yarnjobhistoryserver
      YarnJhJvmMemMem
      nonheapcommittedm
      JVM memory_MemNonHeapCommittedM
      MB
      JVM memory
      host4yarnjobhistoryserver,
      id4yarnjobhistoryserver
      YarnJhJvmMemMem
      heapusedm
      JVM memory_MemHeapUsedM
      MB
      JVM memory
      host4yarnjobhistoryserver,
      id4yarnjobhistoryserver
      YarnJhJvmMemMem
      heapcommittedm
      JVM memory_MemHeapCommittedM
      MB
      JVM memory
      host4yarnjobhistoryserver,
      id4yarnjobhistoryserver
      YarnJhJvmMemMem
      heapmaxm
      JVM memory_MemHeapMaxM
      MB
      JVM memory
      host4yarnjobhistoryserver,
      id4yarnjobhistoryserver
      YarnJhJvmMemMem
      maxm
      JVM memory_MemMaxM
      MB
      JVM memory
      host4yarnjobhistoryserver,
      id4yarnjobhistoryserver
      YarnJhsGcUtilGcCountYgc
      GC count_YGC
      -
      GC count
      host4yarnjobhistoryserver,
      id4yarnjobhistoryserver
      YarnJhsGcUtilGcCountFgc
      GC count_FGC
      -
      GC count
      host4yarnjobhistoryserver,
      id4yarnjobhistoryserver
      YarnJhsGcUtilGcTimeFgct
      GC time_FGCT
      s
      GC time
      host4yarnjobhistoryserver,
      id4yarnjobhistoryserver
      YarnJhsGcUtilGcTimeGct
      GC time_FGCT
      s
      GC time
      host4yarnjobhistoryserver,
      id4yarnjobhistoryserver
      YarnJhsGcUtilGcTimeYgct
      GC time_YGCT
      s
      GC time
      host4yarnjobhistoryserver,
      id4yarnjobhistoryserver
      YarnJhsGcUtilMemoryS0
      Memory space percentage_S0
      %
      Memory space percentage
      host4yarnjobhistoryserver,
      id4yarnjobhistoryserver
      YarnJhsGcUtilMemoryE
      Memory space percentage_E
      %
      Memory space percentage
      host4yarnjobhistoryserver,
      id4yarnjobhistoryserver
      YarnJhsGcUtilMemoryCcs
      Memory space percentage_CCS
      %
      Memory space percentage
      host4yarnjobhistoryserver,
      id4yarnjobhistoryserver
      YarnJhsGcUtilMemoryS1
      Memory space percentage_S1
      %
      Memory space percentage
      host4yarnjobhistoryserver,
      id4yarnjobhistoryserver
      YarnJhsGcUtilMemoryO
      Memory space percentage_O
      %
      Memory space percentage
      host4yarnjobhistoryserver,
      id4yarnjobhistoryserver
      YarnJhsGcUtilMemoryM
      Memory space percentage_M
      %
      Memory space percentage
      host4yarnjobhistoryserver,
      id4yarnjobhistoryserver
      YarnJhOsCpuLoad
      Processcpuload
      CPU utilization_ProcessCpuLoad
      %
      CPU utilization
      host4yarnjobhistoryserver,
      id4yarnjobhistoryserver
      YarnJhOsCpuTime
      Processcputime
      Cumulative CPU usage time_ProcessCpuTime
      ms
      Cumulative CPU usage time
      host4yarnjobhistoryserver,
      id4yarnjobhistoryserver
      YarnJhOsFdCountMax
      filedescriptorcount
      Number of file descriptors_MaxFileDescriptorCount
      -
      Number of file descriptors
      host4yarnjobhistoryserver,
      id4yarnjobhistoryserver
      YarnJhOsFdCountOpen
      filedescriptorcount
      Number of file descriptors_OpenFileDescriptorCount
      -
      Number of file descriptors
      host4yarnjobhistoryserver,
      id4yarnjobhistoryserver
      YarnJhRtUptimeUptime
      Process run time_Uptime
      s
      Process run time
      host4yarnjobhistoryserver,
      id4yarnjobhistoryserver
      YarnJhThreadCount
      Daemonthreadcount
      Number of worker threads_DaemonThreadCount
      -
      Number of worker threads
      host4yarnjobhistoryserver,
      id4yarnjobhistoryserver
      YarnJhThreadCount
      Threadcount
      Number of worker threads_ThreadCount
      -
      Number of worker threads
      host4yarnjobhistoryserver,
      id4yarnjobhistoryserver

      YARN - NodeManager

      Parameter
      Metric
      Unit
      Description
      Dimension
      YarnNmGcUtilGcCountYgc
      GC count_YGC
      -
      GC count
      id4yarnnodemanager,
      host4yarnnodemanager
      YarnNmGcUtilGcCountFgc
      GC count_FGC
      -
      GC count
      id4yarnnodemanager,
      host4yarnnodemanager
      YarnNmGcUtilGcTimeFgct
      GC time_FGCT
      s
      GC time
      id4yarnnodemanager,
      host4yarnnodemanager
      YarnNmGcUtilGcTimeGct
      GC time_FGCT
      s
      GC time
      id4yarnnodemanager,
      host4yarnnodemanager
      YarnNmGcUtilGcTimeYgct
      GC time_YGCT
      s
      GC time
      id4yarnnodemanager,
      host4yarnnodemanager
      YarnNmGcUtilMemoryS0
      Memory space percentage_S0
      %
      Memory space percentage
      id4yarnnodemanager,
      host4yarnnodemanager
      YarnNmGcUtilMemoryE
      Memory space percentage_E
      %
      Memory space percentage
      id4yarnnodemanager,
      host4yarnnodemanager
      YarnNmGcUtilMemoryCcs
      Memory space percentage_CCS
      %
      Memory space percentage
      id4yarnnodemanager,
      host4yarnnodemanager
      YarnNmGcUtilMemoryS1
      Memory space percentage_S1
      %
      Memory space percentage
      id4yarnnodemanager,
      host4yarnnodemanager
      YarnNmGcUtilMemoryO
      Memory space percentage_O
      %
      Memory space percentage
      id4yarnnodemanager,
      host4yarnnodemanager
      YarnNmGcUtilMemoryM
      Memory space percentage_M
      %
      Memory space percentage
      id4yarnnodemanager,
      host4yarnnodemanager
      YarnNmJvmJavaThreads
      Threadsnew
      Number of JVM threads_ThreadsNew
      -
      Number of JVM threads
      id4yarnnodemanager,
      host4yarnnodemanager
      YarnNmJvmJavaThreads
      Threadsrunnable
      Number of JVM threads_ThreadsRunnable
      -
      Number of JVM threads
      id4yarnnodemanager,
      host4yarnnodemanager
      YarnNmJvmJavaThreads
      Threadsblocked
      Number of JVM threads_ThreadsBlocked
      -
      Number of JVM threads
      id4yarnnodemanager,
      host4yarnnodemanager
      YarnNmJvmJavaThreads
      Threadswaiting
      Number of JVM threads_ThreadsWaiting
      -
      Number of JVM threads
      id4yarnnodemanager,
      host4yarnnodemanager
      YarnNmJvmJavaThreads
      Threadstimedwaiting
      Number of JVM threads_ThreadsTimedWaiting
      -
      Number of JVM threads
      id4yarnnodemanager,
      host4yarnnodemanager
      YarnNmJvmJavaThreads
      Threadsterminated
      Number of JVM threads_ThreadsTerminated
      -
      Number of JVM threads
      id4yarnnodemanager,
      host4yarnnodemanager
      YarnNmJvmLog
      TotalLogfatal
      Number of JVM logs_LogFatal
      -
      Number of JVM logs
      id4yarnnodemanager,
      host4yarnnodemanager
      YarnNmJvmLog
      TotalLogerror
      Number of JVM logs_LogError
      -
      Number of JVM logs
      id4yarnnodemanager,
      host4yarnnodemanager
      YarnNmJvmLog
      TotalLogwarn
      Number of JVM logs_LogWarn
      -
      Number of JVM logs
      id4yarnnodemanager,
      host4yarnnodemanager
      YarnNmJvmLog
      TotalLoginfo
      Number of JVM logs_LogInfo
      -
      Number of JVM logs
      id4yarnnodemanager,
      host4yarnnodemanager
      YarnNmJvmMem
      Memnonheapusedm
      JVM memory_MemNonHeapUsedM
      MB
      JVM memory
      id4yarnnodemanager,
      host4yarnnodemanager
      YarnNmJvmMem
      Memnonheapcommittedm
      JVM memory_MemNonHeapCommittedM
      MB
      JVM memory
      id4yarnnodemanager,
      host4yarnnodemanager
      YarnNmJvmMemMem
      heapusedm
      JVM memory_MemHeapUsedM
      MB
      JVM memory
      id4yarnnodemanager,
      host4yarnnodemanager
      YarnNmJvmMemMem
      heapcommittedm
      JVM memory_MemHeapCommittedM
      MB
      JVM memory
      id4yarnnodemanager,
      host4yarnnodemanager
      YarnNmJvmMem
      Memheapmaxm
      JVM memory_MemHeapMaxM
      MB
      JVM memory
      id4yarnnodemanager,
      host4yarnnodemanager
      YarnNmJvmMem
      Memmaxm
      JVM memory_MemMaxM
      MB
      JVM memory
      id4yarnnodemanager,
      host4yarnnodemanager
      YarnNmVcores
      Availablevcores
      Number of CPU cores_AvailableVCores
      -
      Number of CPU cores
      id4yarnnodemanager,
      host4yarnnodemanager
      YarnNmVcores
      Allocatedvcores
      Number of CPU cores_AllocatedVCores
      -
      Number of CPU cores
      id4yarnnodemanager,
      host4yarnnodemanager
      YarnNmMemAllocatedgb
      Memory size_AllocatedGB
      GB
      Memory size
      id4yarnnodemanager,
      host4yarnnodemanager
      YarnNmMemAvailablegb
      Memory size_AvailableGB
      GB
      Memory size
      id4yarnnodemanager,
      host4yarnnodemanager
      YarnNmOsCpuLoad
      Processcpuload
      CPU utilization_ProcessCpuLoad
      %
      CPU utilization
      id4yarnnodemanager,
      host4yarnnodemanager
      YarnNmOsCpuTime
      Processcputime
      Cumulative CPU usage time_ProcessCpuTime
      ms
      Cumulative CPU usage time
      id4yarnnodemanager,
      host4yarnnodemanager
      YarnNmOsFdCount
      Maxfiledescriptorcount
      Number of file descriptors_MaxFileDescriptorCount
      -
      Number of file descriptors
      id4yarnnodemanager,
      host4yarnnodemanager
      YarnNmOsFdCount
      Openfiledescriptorcount
      Number of file descriptors_OpenFileDescriptorCount
      -
      Number of file descriptors
      id4yarnnodemanager,
      host4yarnnodemanager
      YarnNmRtUptimeUptime
      Process run time_Uptime
      s
      Process run time
      id4yarnnodemanager,
      host4yarnnodemanager
      YarnNmThreadCount
      Daemonthreadcount
      Number of worker threads_DaemonThreadCount
      -
      Number of worker threads
      id4yarnnodemanager,
      host4yarnnodemanager
      YarnNmThread
      CountThreadcount
      Number of worker threads_ThreadCount
      -
      Number of worker threads
      id4yarnnodemanager,
      host4yarnnodemanager

      Dimension and Parameters

      Parameter
      Dimension
      Dimension Description
      Format
      Instances.N.Dimensions.0.Name
      id4yarnoverview
      Dimension name of the EMR instance ID
      String-type dimension name, such as id4yarnoverview
      Instances.N.Dimensions.0.Value
      id4yarnoverview
      Specific EMR instance ID
      Specific EMR instance ID, such as emr-mm8bs222
      Instances.N.Dimensions.1.Name
      host4yarnoverview
      Dimension name of the node IP in the EMR instance
      String-type dimension name, such as host4yarnoverview
      Instances.N.Dimensions.1.Value
      host4yarnoverview
      Specific node IP in the EMR instance
      Specific node IP, which can be obtained by clicking Instance > Cluster Resources > Resource Management > Node Private IP in the EMR console or calling the DescribeClusterNodes API.
      Instances.N.Dimensions.0.Name
      id4yarnresourcemanager
      Dimension name of the EMR instance ID
      String-type dimension name, such as id4yarnresourcemanager
      Instances.N.Dimensions.0.Value
      id4yarnresourcemanager
      Specific EMR instance ID
      Specific EMR instance ID, such as emr-mm8bs222
      Instances.N.Dimensions.1.Name
      host4yarnresourcemanager
      Dimension name of the node IP in the EMR instance
      String-type dimension name, such as host4yarnresourcemanager
      Instances.N.Dimensions.1.Value
      host4yarnresourcemanager
      Specific node IP in the EMR instance
      Specific node IP, which can be obtained by clicking Instance > Cluster Resources > Resource Management > Node Private IP in the EMR console or calling the DescribeClusterNodes API.
      Instances.N.Dimensions.0.Name
      id4yarnjobhistoryserver
      Dimension name of the EMR instance ID
      String-type dimension name, such as id4yarnjobhistoryserver
      Instances.N.Dimensions.0.Value
      id4yarnjobhistoryserver
      Specific EMR instance ID
      Specific EMR instance ID, such as emr-mm8bs222
      Instances.N.Dimensions.1.Name
      host4yarnjobhistoryserver
      Dimension name of the node IP in the EMR instance
      String-type dimension name, such as host4yarnjobhistoryserver
      Instances.N.Dimensions.1.Value
      host4yarnjobhistoryserver
      Specific node IP in the EMR instance
      Specific node IP, which can be obtained by clicking Instance > Cluster Resources > Resource Management > Node Private IP in the EMR console or calling the DescribeClusterNodes API.
      Instances.N.Dimensions.0.Name
      id4yarnnodemanager
      Dimension name of the EMR instance ID
      String-type dimension name, such as id4yarnnodemanager
      Instances.N.Dimensions.0.Value
      id4yarnnodemanager
      Specific EMR instance ID
      Specific EMR instance ID, such as emr-mm8bs222
      Instances.N.Dimensions.1.Name
      host4yarnnodemanager
      Dimension name of the node IP in the EMR instance
      String-type dimension name, such as host4yarnnodemanager
      Instances.N.Dimensions.1.Value
      host4yarnnodemanager
      Specific node IP in the EMR instance
      Specific node IP, which can be obtained by clicking Instance > Cluster Resources > Resource Management > Node Private IP in the EMR console or calling the DescribeClusterNodes API.

      Input Parameter Description

      EMR (YARN) supports querying monitoring data based on the following five combinations of dimensions. The values for the input parameters are as follows:
      1. To query the metric monitoring data of Yarn - Overview Aggregation or YARN - Cluster, use the following input parameters: &Namespace=QCE/TXMR_YARN &Instances.N.Dimensions.0.Name=id4yarnoverview &Instances.N.Dimensions.0.Value=EMR instance ID
      2. To query the metric monitoring data of Yarn - Overview, use the following input parameters: &Namespace=QCE/TXMR_YARN &Instances.N.Dimensions.0.Name=id4yarnoverview &Instances.N.Dimensions.0.Value=EMR instance ID &Instances.N.Dimensions.1.Name=host4yarnoverview &Instances.N.Dimensions.1.Value=Specific node IP in the EMR instance
      3. To query the metric monitoring data of YARN - ResourceManager, use the following input parameters: &Namespace=QCE/TXMR_YARN &Instances.N.Dimensions.0.Name=id4yarnresourcemanager &Instances.N.Dimensions.0.Value=EMR instance ID &Instances.N.Dimensions.1.Name=host4yarnresourcemanager &Instances.N.Dimensions.1.Value=Specific node IP in the EMR instance
      4. To query the metric monitoring data of YARN - JobHistoryServer, use the following input parameters: &Namespace=QCE/TXMR_YARN &Instances.N.Dimensions.0.Name=id4yarnjobhistoryserver &Instances.N.Dimensions.0.Value=EMR instance ID &Instances.N.Dimensions.1.Name=host4yarnjobhistoryserver &Instances.N.Dimensions.1.Value=Specific node IP in the EMR instance
      5. To query the metric monitoring data of YARN - NodeManager, use the following input parameters: &Namespace=QCE/TXMR_YARN &Instances.N.Dimensions.0.Name=id4yarnnodemanager &Instances.N.Dimensions.0.Value=EMR instance ID &Instances.N.Dimensions.1.Name=host4yarnnodemanager &Instances.N.Dimensions.1.Value=Specific node IP in the EMR instance
      Contact Us

      Contact our sales team or business advisors to help your business.

      Contact Us
      Technical Support

      Open a ticket if you're looking for further assistance. Our Ticket is 7x24 avaliable.

      Submit a Ticket
      7x24 Phone Support
      Copyright © 2013-2024 Tencent Cloud. All Rights Reserved.
      Privacy PolicyLegalCookie Policy