tencent cloud

Feedback

EMR (YARN)

Last updated: 2021-12-22 15:12:54

    Namespace

    Namespace=QCE/TXMR_YARN

    Monitoring Metrics

    YARN - Overview

    Parameter Metric Unit Description Dimension
    EmrHdfsOverview
    YarnRmNumsNumactivenms
    Number of nodes_NumActiveNMs - Number of nodes host4yarnoverview,
    id4yarnoverview
    EmrHdfsOverview
    YarnRmNumsNumde
    commissionednms
    Number of nodes_NumDecommissionedNMs - Number of nodes host4yarnoverview,
    id4yarnoverview
    EmrHdfsOverviewYarn
    RmNumsNumlostnms
    Number of nodes_NumLostNMs - Number of nodes host4yarnoverview,
    id4yarnoverview
    EmrHdfsOverview
    YarnRmNumsNumun
    healthynms
    Number of nodes_NumUnhealthyNMs - Number of nodes host4yarnoverview,
    id4yarnoverview

    YARN - OverviewAggregation

    Parameter Metric Unit Description Dimension
    EmrHdfsOverviewAggregation
    YarnRmNumsNumactivenms
    Number of nodes_NumActiveNMs - Number of nodes id4yarnoverview
    EmrHdfsOverviewAggregation
    YarnRmNumsNumde
    commissionednms
    Number of nodes_NumDecommissionedNMs - Number of nodes id4yarnoverview
    EmrHdfsOverviewAggregation
    RmNumsNumlostnms
    Number of nodes_NumLostNMs - Number of nodes id4yarnoverview
    EmrHdfsOverviewAggregation
    YarnRmNumsNumun healthynms
    Number of nodes_NumUnhealthyNMs - Number of nodes id4yarnoverview

    YARN - Cluster

    Parameter Metric Unit Description Dimension
    YarnClusterResAppFailed Applications_failed - Total number of applications host4yarnoverview,
    id4yarnoverview
    YarnClusterResAppKilled Applications_killed - Total number of applications host4yarnoverview,
    id4yarnoverview
    YarnClusterResAppPending Applications_pending - Total number of applications host4yarnoverview,
    id4yarnoverview
    YarnClusterResAppRunning Applications_running - Total number of applications host4yarnoverview,
    id4yarnoverview
    YarnClusterRes
    AppSubmitted
    Applications_submitted - Total number of applications host4yarnoverview,
    id4yarnoverview
    YarnClusterResContainer
    Containersallocated
    Containers_containersAllocated - Total number of released containers host4yarnoverview,
    id4yarnoverview
    YarnClusterResContainer
    Containerspending
    Containers_containersPending - Total number of released containers host4yarnoverview,
    id4yarnoverview
    YarnClusterResContainer
    Containersreserved
    Containers_containersReserved - Total number of released containers host4yarnoverview,
    id4yarnoverview
    YarnClusterResCpu
    Allocatedvirtualcores
    Cores_allocatedVirtualCores - Number of CPU cores host4yarnoverview,
    id4yarnoverview
    YarnClusterResCpu
    Availablevirtualcores
    Cores_availableVirtualCores - Number of CPU cores host4yarnoverview,
    id4yarnoverview
    YarnClusterResCpu
    Reservedvirtualcores
    Cores_reservedVirtualCores - Number of CPU cores host4yarnoverview,
    id4yarnoverview
    YarnClusterResCpu
    Totalvirtualcores
    Cores_totalVirtualCores - Number of CPU cores host4yarnoverview,
    id4yarnoverview
    YarnClusterResCpu
    UsageRatioUsageratio
    CPU utilization_usageRatio % Memory size host4yarnoverview,
    id4yarnoverview
    YarnClusterResMem
    Allocatedmb
    Memory_allocatedMB MB Memory size host4yarnoverview,
    id4yarnoverview
    YarnClusterResMem
    Availablemb
    Memory_availableMB MB Memory size host4yarnoverview,
    id4yarnoverview
    YarnClusterResMem
    Reservedmb
    Memory_reservedMB MB Memory size host4yarnoverview,
    id4yarnoverview
    YarnClusterRes
    MemTotalmb
    Memory_totalMB MB Memory size host4yarnoverview,
    id4yarnoverview
    YarnClusterResMem
    UsageRatioUsageratio
    Memory utilization_usageRatio % Memory size host4yarnoverview,
    id4yarnoverview

    YARN - ResourceManager

    Parameter Metric Unit Description Dimension
    YarnRmRpcAuth5000
    Rpcauthenticationfailures
    Number of RPC authentication authorizations_RpcAuthenticationFailures - Number of RPC authentication authorizations host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmRpcAuth5000
    Rpcauthenticationsuccesses
    Number of RPC authentication authorizations_RpcAuthorizationSuccesses - Number of RPC authentication authorizations host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmRpcAuth5000
    Rpcauthorizationfailures
    Number of RPC authentication authorizations_RpcAuthorizationFailures - Number of RPC authentication authorizations host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmRpcAuth5000
    Rpcauthorizationsuccesses
    Number of RPC authentication authorizations_RpcAuthenticationSuccesses - Number of RPC authentication authorizations host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmRpcBytes5000
    Receivedbytes
    Volume of data received/sent by RPC_ReceivedBytes bytes/s Volume of data received/sent by RPC host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmRpcBytes5000
    Sentbytes
    Volume of data received/sent by RPC_SentBytes bytes/s Volume of data received/sent by RPC host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmRpc
    Connections5000
    Numopenconnections
    Number of RPC connections_NumOpenConnections - Number of RPC connections host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmRpcOps5000
    Rpcprocessingtimenumops
    Number of RPC requests_RpcProcessingTimeNumOps - Number of RPC requests host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmRpcOps5000
    Rpcqueuetimenumops
    Number of RPC requests_RpcQueueTimeNumOps - Number of RPC requests host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmRpcQueueLen5000
    Callqueuelength
    RPC queue length_CallQueueLength - RPC queue length host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmRpcTime5000
    Rpcprocessingtimeavgtime
    Average RPC processing time_RpcProcessingTimeAvgTime s Average RPC processing time host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmRpcTime5000
    Rpcqueuetimeavgtime
    Average RPC processing time_RpcQueueTimeAvgTime s Average RPC processing time host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmRpcAuth5000
    Rpcauthenticationfailures
    Number of RPC authentication authorizations_RpcAuthenticationFailures - Number of RPC authentication authorizations host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmRpcAuth5000
    Rpcauthenticationsuccesses
    Number of RPC authentication authorizations_RpcAuthenticationSuccesses - Number of RPC authentication authorizations host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmRpcAuth5000
    Rpcauthorizationfailures
    Number of RPC authentication authorizations_RpcAuthorizationFailures - Number of RPC authentication authorizations host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmRpcAuth5000
    Rpcauthorizationsuccesses
    Number of RPC authentication authorizations_RpcAuthorizationSuccesses - Number of RPC authentication authorizations host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmRpcBytes5000
    Receivedbytes
    Volume of data received/sent by RPC_ReceivedBytes bytes/s Volume of data received/sent by RPC host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmRpcBytes5000
    Sentbytes
    Volume of data received/sent by RPC_SentBytes bytes/s Volume of data received/sent by RPC host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmRpcConnections5000
    Numopenconnections
    Number of RPC connections_NumOpenConnections - Number of RPC connections host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmRpcOps5000
    Rpcprocessingtimenumops
    Number of RPC requests_RpcProcessingTimeNumOps - Number of RPC requests host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmRpcOps5000
    Rpcqueuetimenumops
    Number of RPC requests_RpcQueueTimeNumOps - Number of RPC requests host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmRpcQueueLen5000
    Callqueuelength
    RPC queue length_CallQueueLength - RPC queue length host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmRpcTime5000
    Rpcprocessingtimeavgtime
    Average RPC processing time_RpcProcessingTimeAvgTime s Average RPC processing time host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmRpcTime5000
    Rpcqueuetimeavgtime
    Average RPC processing time_RpcQueueTimeAvgTime s Average RPC processing time host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmRpcAuth5000
    Rpcauthenticationfailures
    Number of RPC authentication authorizations_RpcAuthenticationSuccesses - Number of RPC authentication authorizations host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmRpcAuth5000
    Rpcauthenticationsuccesses
    Number of RPC authentication authorizations_RpcAuthenticationSuccesses - Number of RPC authentication authorizations host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmRpcAuth5000
    Rpcauthorizationfailures
    Number of RPC authentication authorizations_RpcAuthorizationFailures - Number of RPC authentication authorizations host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmRpcAuth5000
    Rpcauthorizationsuccesses
    Number of RPC authentication authorizations_RpcAuthorizationSuccesses - Number of RPC authentication authorizations host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmRpcBytes5000
    Receivedbytes
    Volume of data received/sent by RPC_ReceivedBytes bytes/s Volume of data received/sent by RPC host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmRpcBytes5000
    Sentbytes
    Volume of data received/sent by RPC_SentBytes bytes/s Volume of data received/sent by RPC host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmRpcConnections5000
    Numopenconnections
    Number of RPC connections_NumOpenConnections - Number of RPC connections host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmRpcOps5000
    Rpcprocessingtimenumops
    Number of RPC requests_RpcProcessingTimeNumOps - Number of RPC requests host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmRpcOps5000
    Rpcqueuetimenumops
    Number of RPC requests_RpcQueueTimeNumOps - Number of RPC requests host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmRpcQueueLen5000
    Callqueuelength
    RPC queue length_CallQueueLength - RPC queue length host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmRpcTime5000
    Rpcprocessingtimeavgtime
    Average RPC processing time_RpcProcessingTimeAvgTime s Average RPC processing time host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmRpcTime5000
    Rpcqueuetimeavgtime
    Average RPC processing time_RpcQueueTimeAvgTime s Average RPC processing time host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmRpcAuth5000
    Rpcauthenticationfailures
    Number of RPC authentication authorizations_RpcAuthenticationFailures - Number of RPC authentication authorizations host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmRpcAuth5000
    Rpcauthenticationsuccesses
    Number of RPC authentication authorizations_RpcAuthenticationSuccesses - Number of RPC authentication authorizations host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmRpcAuth5000
    Rpcauthorizationfailures
    Number of RPC authentication authorizations_RpcAuthorizationFailures - Number of RPC authentication authorizations host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmRpcAuth5000
    Rpcauthorizationsuccesses
    Number of RPC authentication authorizations_RpcAuthorizationSuccesses - Number of RPC authentication authorizations host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmRpcBytes5000
    Receivedbytes
    Volume of data received/sent by RPC_ReceivedBytes bytes/s Volume of data received/sent by RPC host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmRpcBytes5000
    Sentbytes
    Volume of data received/sent by RPC_SentBytes bytes/s Volume of data received/sent by RPC host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmRpc
    Connections5000
    Numopenconnections
    Number of RPC connections_NumOpenConnections - Number of RPC connections host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmRpcOps5000
    Rpcprocessingtimenumops
    Number of RPC requests_RpcProcessingTimeNumOps - Number of RPC requests host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmRpcOps5000
    Rpcqueuetimenumops
    Number of RPC requests_RpcQueueTimeNumOps - Number of RPC requests host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmRpc
    QueueLen5000
    Callqueuelength
    RPC queue length_CallQueueLength - RPC queue length host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmRpcTime5000
    Rpcprocessingtimeavgtime
    Average RPC processing time_RpcProcessingTimeAvgTime s Average RPC processing time host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmRpcTime5000
    Rpcqueuetimeavgtime
    GC count_YGC s Average RPC processing time host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmGcUtilGcCountYgc GC count_FGC - GC count host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmGcUtilGcCountFgc GC time_FGCT - GC count host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmGcUtilGcTimeFgct GC time_FGCT s GC time host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmGcUtilGcTimeGct GC time_YGCT s GC time host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmGcUtilGcTimeYgct Memory space percentage_S0 s GC time host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmGcUtilMemoryS0 Memory space percentage_E % Memory space percentage host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmGcUtilMemoryE Memory space percentage_CCS % Memory space percentage host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmGcUtilMemoryCcs Memory space percentage_S1 % Memory space percentage host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmGcUtilMemoryS1 Memory space percentage_O % Memory space percentage host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmGcUtilMemoryO Memory space percentage_M % Memory space percentage host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmGcUtilMemoryM Number of JVM threads_ThreadsNew % Memory space percentage host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmJvmJava
    ThreadsThreadsnew
    Number of JVM threads_ThreadsRunnable - Number of JVM threads host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmJvmJavaThreads
    Threadsrunnable
    Number of JVM threads_ThreadsBlocked - Number of JVM threads host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmJvmJavaThreads
    Threadsblocked
    Number of JVM threads_ThreadsWaiting - Number of JVM threads host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmJvmJavaThreads
    Threadswaiting
    Number of JVM threads_ThreadsTimedWaiting - Number of JVM threads host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmJvmJavaThreads
    Threadstimedwaiting
    Number of JVM threads_ThreadsTerminated - Number of JVM threads host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmJvmJavaThreads
    Threadsterminated
    Number of JVM logs_LogFatal - Number of JVM threads host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmJvmLogTotalLogfatal Number of JVM logs_LogError - Number of JVM logs host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmJvmLogTotalLogerror Number of JVM logs_LogWarn - Number of JVM logs host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmJvmLogTotalLogwarn Number of JVM logs_LogInfo - Number of JVM logs host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmJvmLogTotalLoginfo JVM memory_MemNonHeapUsedM - Number of JVM logs host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmJvmMem
    Memnonheapusedm
    JVM memory_MemNonHeapCommittedM MB JVM memory host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmJvmMemMem
    nonheapcommittedm
    JVM memory_MemHeapUsedM MB JVM memory host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmJvmMemMem
    heapusedm
    JVM memory_MemHeapCommittedM MB JVM memory host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmJvmMemMem
    heapcommittedm
    JVM memory_MemHeapMaxM MB JVM memory host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmJvmMem
    Memheapmaxm
    JVM memory_MemMaxM MB JVM memory host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmJvmMemMemmaxm CPU utilization_ProcessCpuLoad MB JVM memory host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmOsCpuLoad
    Processcpuload
    Cumulative CPU usage time_ProcessCpuTime % CPU utilization host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmOsCpuTime
    Processcputime
    Number of file descriptors_MaxFileDescriptorCount ms Cumulative CPU usage time host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmOsFdCount
    Maxfiledescriptorcount
    Number of file descriptors_OpenFileDescriptorCount - Number of file descriptors host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmOsFdCount
    Openfiledescriptorcount
    Process run time_Uptime - Number of file descriptors host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmRtUptimeUptime Process run time_Uptime s Process run time host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmThreadCount
    Daemonthreadcount
    Number of worker threads_DaemonThreadCount - Number of worker threads host4yarnresourcemanager,
    id4yarnresourcemanager
    YarnRmThreadCount
    Threadcount
    Number of worker threads_ThreadCount - Number of worker threads host4yarnresourcemanager,
    id4yarnresourcemanager

    YARN - JobHistoryServer

    Parameter Metric Unit Description Dimension
    YarnJhJvmJava

    ThreadsThreadsnew
    Number of JVM threads_ThreadsNew - Number of JVM threads host4yarnjobhistoryserver,
    id4yarnjobhistoryserver
    YarnJhJvmJava
    ThreadsThreadsrunnable
    Number of JVM threads_ThreadsRunnable - Number of JVM threads host4yarnjobhistoryserver,
    id4yarnjobhistoryserver
    YarnJhJvmJava
    ThreadsThreadsblocked
    Number of JVM threads_ThreadsBlocked - Number of JVM threads host4yarnjobhistoryserver,
    id4yarnjobhistoryserver
    YarnJhJvmJava
    ThreadsThreadswaiting
    Number of JVM threads_ThreadsWaiting - Number of JVM threads host4yarnjobhistoryserver,
    id4yarnjobhistoryserver
    YarnJhJvmJava
    ThreadsThreadstimedwaiting
    Number of JVM threads_ThreadsTimedWaiting - Number of JVM threads host4yarnjobhistoryserver,
    id4yarnjobhistoryserver
    YarnJhJvmJava
    ThreadsThreadsterminated
    Number of JVM threads_ThreadsTerminated - Number of JVM threads host4yarnjobhistoryserver,
    id4yarnjobhistoryserver
    YarnJhJvmLogTotalLogfatal Number of JVM logs_LogFatal - Number of JVM logs host4yarnjobhistoryserver,
    id4yarnjobhistoryserver
    YarnJhJvmLogTotalLogerror Number of JVM logs_LogError - Number of JVM logs host4yarnjobhistoryserver,
    id4yarnjobhistoryserver
    YarnJhJvmLogTotalLogwarn Number of JVM logs_LogWarn - Number of JVM logs host4yarnjobhistoryserver,
    id4yarnjobhistoryserver
    YarnJhJvmLogTotalLoginfo Number of JVM logs_LogInfo - Number of JVM logs host4yarnjobhistoryserver,
    id4yarnjobhistoryserver
    YarnJhJvmMemMem
    nonheapusedm
    JVM memory_MemNonHeapUsedM MB JVM memory host4yarnjobhistoryserver,
    id4yarnjobhistoryserver
    YarnJhJvmMemMem
    nonheapcommittedm
    JVM memory_MemNonHeapCommittedM MB JVM memory host4yarnjobhistoryserver,
    id4yarnjobhistoryserver
    YarnJhJvmMemMem
    heapusedm
    JVM memory_MemHeapUsedM MB JVM memory host4yarnjobhistoryserver,
    id4yarnjobhistoryserver
    YarnJhJvmMemMem
    heapcommittedm
    JVM memory_MemHeapCommittedM MB JVM memory host4yarnjobhistoryserver,
    id4yarnjobhistoryserver
    YarnJhJvmMemMem
    heapmaxm
    JVM memory_MemHeapMaxM MB JVM memory host4yarnjobhistoryserver,
    id4yarnjobhistoryserver
    YarnJhJvmMemMem
    maxm
    JVM memory_MemMaxM MB JVM memory host4yarnjobhistoryserver,
    id4yarnjobhistoryserver
    YarnJhsGcUtilGcCountYgc GC count_YGC - GC count host4yarnjobhistoryserver,
    id4yarnjobhistoryserver
    YarnJhsGcUtilGcCountFgc GC count_FGC - GC count host4yarnjobhistoryserver,
    id4yarnjobhistoryserver
    YarnJhsGcUtilGcTimeFgct GC time_FGCT s GC time host4yarnjobhistoryserver,
    id4yarnjobhistoryserver
    YarnJhsGcUtilGcTimeGct GC time_FGCT s GC time host4yarnjobhistoryserver,
    id4yarnjobhistoryserver
    YarnJhsGcUtilGcTimeYgct GC time_YGCT s GC time host4yarnjobhistoryserver,
    id4yarnjobhistoryserver
    YarnJhsGcUtilMemoryS0 Memory space percentage_S0 % Memory space percentage host4yarnjobhistoryserver,
    id4yarnjobhistoryserver
    YarnJhsGcUtilMemoryE Memory space percentage_E % Memory space percentage host4yarnjobhistoryserver,
    id4yarnjobhistoryserver
    YarnJhsGcUtilMemoryCcs Memory space percentage_CCS % Memory space percentage host4yarnjobhistoryserver,
    id4yarnjobhistoryserver
    YarnJhsGcUtilMemoryS1 Memory space percentage_S1 % Memory space percentage host4yarnjobhistoryserver,
    id4yarnjobhistoryserver
    YarnJhsGcUtilMemoryO Memory space percentage_O % Memory space percentage host4yarnjobhistoryserver,
    id4yarnjobhistoryserver
    YarnJhsGcUtilMemoryM Memory space percentage_M % Memory space percentage host4yarnjobhistoryserver,
    id4yarnjobhistoryserver
    YarnJhOsCpuLoad
    Processcpuload
    CPU utilization_ProcessCpuLoad % CPU utilization host4yarnjobhistoryserver,
    id4yarnjobhistoryserver
    YarnJhOsCpuTime
    Processcputime
    Cumulative CPU usage time_ProcessCpuTime ms Cumulative CPU usage time host4yarnjobhistoryserver,
    id4yarnjobhistoryserver
    YarnJhOsFdCountMax
    filedescriptorcount
    Number of file descriptors_MaxFileDescriptorCount - Number of file descriptors host4yarnjobhistoryserver,
    id4yarnjobhistoryserver
    YarnJhOsFdCountOpen
    filedescriptorcount
    Number of file descriptors_OpenFileDescriptorCount - Number of file descriptors host4yarnjobhistoryserver,
    id4yarnjobhistoryserver
    YarnJhRtUptimeUptime Process run time_Uptime s Process run time host4yarnjobhistoryserver,
    id4yarnjobhistoryserver
    YarnJhThreadCount
    Daemonthreadcount
    Number of worker threads_DaemonThreadCount - Number of worker threads host4yarnjobhistoryserver,
    id4yarnjobhistoryserver
    YarnJhThreadCount
    Threadcount
    Number of worker threads_ThreadCount - Number of worker threads host4yarnjobhistoryserver,
    id4yarnjobhistoryserver

    YARN - NodeManager

    Parameter Metric Unit Description Dimension
    YarnNmGcUtilGcCountYgc GC count_YGC - GC count id4yarnnodemanager,
    host4yarnnodemanager
    YarnNmGcUtilGcCountFgc GC count_FGC - GC count id4yarnnodemanager,
    host4yarnnodemanager
    YarnNmGcUtilGcTimeFgct GC time_FGCT s GC time id4yarnnodemanager,
    host4yarnnodemanager
    YarnNmGcUtilGcTimeGct GC time_FGCT s GC time id4yarnnodemanager,
    host4yarnnodemanager
    YarnNmGcUtilGcTimeYgct GC time_YGCT s GC time id4yarnnodemanager,
    host4yarnnodemanager
    YarnNmGcUtilMemoryS0 Memory space percentage_S0 % Memory space percentage id4yarnnodemanager,
    host4yarnnodemanager
    YarnNmGcUtilMemoryE Memory space percentage_E % Memory space percentage id4yarnnodemanager,
    host4yarnnodemanager
    YarnNmGcUtilMemoryCcs Memory space percentage_CCS % Memory space percentage id4yarnnodemanager,
    host4yarnnodemanager
    YarnNmGcUtilMemoryS1 Memory space percentage_S1 % Memory space percentage id4yarnnodemanager,
    host4yarnnodemanager
    YarnNmGcUtilMemoryO Memory space percentage_O % Memory space percentage id4yarnnodemanager,
    host4yarnnodemanager
    YarnNmGcUtilMemoryM Memory space percentage_M % Memory space percentage id4yarnnodemanager,
    host4yarnnodemanager
    YarnNmJvmJavaThreads

    Threadsnew
    Number of JVM threads_ThreadsNew - Number of JVM threads id4yarnnodemanager,
    host4yarnnodemanager
    YarnNmJvmJavaThreads
    Threadsrunnable
    Number of JVM threads_ThreadsRunnable - Number of JVM threads id4yarnnodemanager,
    host4yarnnodemanager
    YarnNmJvmJavaThreads
    Threadsblocked
    Number of JVM threads_ThreadsBlocked - Number of JVM threads id4yarnnodemanager,
    host4yarnnodemanager
    YarnNmJvmJavaThreads
    Threadswaiting
    Number of JVM threads_ThreadsWaiting - Number of JVM threads id4yarnnodemanager,
    host4yarnnodemanager
    YarnNmJvmJavaThreads

    Threadstimedwaiting
    Number of JVM threads_ThreadsTimedWaiting - Number of JVM threads id4yarnnodemanager,
    host4yarnnodemanager
    YarnNmJvmJavaThreads

    Threadsterminated
    Number of JVM threads_ThreadsTerminated - Number of JVM threads id4yarnnodemanager,
    host4yarnnodemanager
    YarnNmJvmLog
    TotalLogfatal
    Number of JVM logs_LogFatal - Number of JVM logs id4yarnnodemanager,
    host4yarnnodemanager
    YarnNmJvmLog
    TotalLogerror
    Number of JVM logs_LogError - Number of JVM logs id4yarnnodemanager,
    host4yarnnodemanager
    YarnNmJvmLog
    TotalLogwarn
    Number of JVM logs_LogWarn - Number of JVM logs id4yarnnodemanager,
    host4yarnnodemanager
    YarnNmJvmLog
    TotalLoginfo
    Number of JVM logs_LogInfo - Number of JVM logs id4yarnnodemanager,
    host4yarnnodemanager
    YarnNmJvmMem
    Memnonheapusedm
    JVM memory_MemNonHeapUsedM MB JVM memory id4yarnnodemanager,
    host4yarnnodemanager
    YarnNmJvmMem
    Memnonheapcommittedm
    JVM memory_MemNonHeapCommittedM MB JVM memory id4yarnnodemanager,
    host4yarnnodemanager
    YarnNmJvmMemMem
    heapusedm
    JVM memory_MemHeapUsedM MB JVM memory id4yarnnodemanager,
    host118yarnnodemanager
    YarnNmJvmMemMem
    heapcommittedm
    JVM memory_MemHeapCommittedM MB JVM memory id4yarnnodemanager,
    host4yarnnodemanager
    YarnNmJvmMem
    Memheapmaxm
    JVM memory_MemHeapMaxM MB JVM memory id4yarnnodemanager,
    host4yarnnodemanager
    YarnNmJvmMem
    Memmaxm
    JVM memory_MemMaxM MB JVM memory id4yarnnodemanager,
    host4yarnnodemanager
    YarnNmVcores
    Availablevcores
    Number of CPU cores_AvailableVCores - Number of CPU cores id4yarnnodemanager,
    host4yarnnodemanager
    YarnNmVcores
    Allocatedvcores
    Number of CPU cores_AllocatedVCores - Number of CPU cores id4yarnnodemanager,
    host4yarnnodemanager
    YarnNmMemAllocatedgb Memory size_AllocatedGB GB Memory size id4yarnnodemanager,
    host4yarnnodemanager
    YarnNmMemAvailablegb Memory size_AvailableGB GB Memory size id4yarnnodemanager,
    host4yarnnodemanager
    YarnNmOsCpuLoad
    Processcpuload
    CPU utilization_ProcessCpuLoad % CPU utilization id4yarnnodemanager,
    host4yarnnodemanager
    YarnNmOsCpuTime
    Processcputime
    Cumulative CPU usage time_ProcessCpuTime ms Cumulative CPU usage time id4yarnnodemanager,
    host4yarnnodemanager
    YarnNmOsFdCount
    Maxfiledescriptorcount
    Number of file descriptors_MaxFileDescriptorCount - Number of file descriptors id4yarnnodemanager,
    host4yarnnodemanager
    YarnNmOsFdCount
    Openfiledescriptorcount
    Number of file descriptors_OpenFileDescriptorCount - Number of file descriptors id4yarnnodemanager,
    host4yarnnodemanager
    YarnNmRtUptimeUptime Process run time_Uptime s Process run time id4yarnnodemanager,
    host4yarnnodemanager
    YarnNmThreadCount
    Daemonthreadcount
    Number of worker threads_DaemonThreadCount - Number of worker threads id4yarnnodemanager,
    host4yarnnodemanager
    YarnNmThread
    CountThreadcount
    Number of worker threads_ThreadCount - Number of worker threads id4yarnnodemanager,
    host4yarnnodemanager

    Dimension and Parameters

    Parameter Dimension Dimension Description Format
    Instances.N.Dimensions.0.Name id4yarnoverview Dimension name of the EMR instance ID String-type dimension name, such as id4yarnoverview
    Instances.N.Dimensions.0.Value id4yarnoverview Specific EMR instance ID Specific EMR instance ID, such as emr-mm8bs222
    Instances.N.Dimensions.1.Name host4yarnoverview Dimension name of the node IP in the EMR instance String-type dimension name, such as host4yarnoverview
    Instances.N.Dimensions.1.Value host4yarnoverview Specific node IP in the EMR instance Specific node IP, which can be obtained by clicking Instance > Cluster Resources > Resource Management > Node Private IP in the EMR console or calling the DescribeClusterNodes API.
    Instances.N.Dimensions.0.Name id4yarnresourcemanager Dimension name of the EMR instance ID String-type dimension name, such as id4yarnresourcemanager
    Instances.N.Dimensions.0.Value id4yarnresourcemanager Specific EMR instance ID Specific EMR instance ID, such as emr-mm8bs222
    Instances.N.Dimensions.1.Name host4yarnresourcemanager Dimension name of the node IP in the EMR instance String-type dimension name, such as host4yarnresourcemanager
    Instances.N.Dimensions.1.Value host4yarnresourcemanager Specific node IP in the EMR instance Specific node IP, which can be obtained by clicking Instance > Cluster Resources > Resource Management > Node Private IP in the EMR console or calling the DescribeClusterNodes API.
    Instances.N.Dimensions.0.Name id4yarnjobhistoryserver Dimension name of the EMR instance ID String-type dimension name, such as id4yarnjobhistoryserver
    Instances.N.Dimensions.0.Value id4yarnjobhistoryserver Specific EMR instance ID Specific EMR instance ID, such as emr-mm8bs222
    Instances.N.Dimensions.1.Name host4yarnjobhistoryserver Dimension name of the node IP in the EMR instance String-type dimension name, such as host4yarnjobhistoryserver
    Instances.N.Dimensions.1.Value host4yarnjobhistoryserver Specific node IP in the EMR instance Specific node IP, which can be obtained by clicking Instance > Cluster Resources > Resource Management > Node Private IP in the EMR console or calling the DescribeClusterNodes API.
    Instances.N.Dimensions.0.Name id4yarnnodemanager Dimension name of the EMR instance ID String-type dimension name, such as id4yarnnodemanager
    Instances.N.Dimensions.0.Value id4yarnnodemanager Specific EMR instance ID Specific EMR instance ID, such as emr-mm8bs222
    Instances.N.Dimensions.1.Name host4yarnnodemanager Dimension name of the node IP in the EMR instance String-type dimension name, such as host4yarnnodemanager
    Instances.N.Dimensions.1.Value host4yarnnodemanager Specific node IP in the EMR instance Specific node IP, which can be obtained by clicking Instance > Cluster Resources > Resource Management > Node Private IP in the EMR console or calling the DescribeClusterNodes API.

    Input Parameter Description

    EMR (YARN) supports querying monitoring data based on the following five combinations of dimensions. The values for the input parameters are as follows:

    1. To query the metric monitoring data of Yarn - Overview Aggregation or YARN - Cluster, use the following input parameters: &Namespace=QCE/TXMR_YARN
    &Instances.N.Dimensions.0.Name=id4yarnoverview
    &Instances.N.Dimensions.0.Value=EMR instance ID

    2. To query the metric monitoring data of Yarn - Overview, use the following input parameters:
    &Namespace=QCE/TXMR_YARN
    &Instances.N.Dimensions.0.Name=id4yarnoverview
    &Instances.N.Dimensions.0.Value=EMR instance ID
    &Instances.N.Dimensions.1.Name=host4yarnoverview
    &Instances.N.Dimensions.1.Value=Specific node IP in the EMR instance

    3. To query the metric monitoring data of YARN - ResourceManager, use the following input parameters:
    &Namespace=QCE/TXMR_YARN
    &Instances.N.Dimensions.0.Name=id4yarnresourcemanager
    &Instances.N.Dimensions.0.Value=EMR instance ID
    &Instances.N.Dimensions.1.Name=host4yarnresourcemanager
    &Instances.N.Dimensions.1.Value=Specific node IP in the EMR instance

    4. To query the metric monitoring data of YARN - JobHistoryServer, use the following input parameters:
    &Namespace=QCE/TXMR_YARN
    &Instances.N.Dimensions.0.Name=id4yarnjobhistoryserver
    &Instances.N.Dimensions.0.Value=EMR instance ID
    &Instances.N.Dimensions.1.Name=host4yarnjobhistoryserver
    &Instances.N.Dimensions.1.Value=Specific node IP in the EMR instance

    5. To query the metric monitoring data of YARN - NodeManager, use the following input parameters:
    &Namespace=QCE/TXMR_YARN
    &Instances.N.Dimensions.0.Name=id4yarnnodemanager
    &Instances.N.Dimensions.0.Value=EMR instance ID
    &Instances.N.Dimensions.1.Name=host4yarnnodemanager
    &Instances.N.Dimensions.1.Value=Specific node IP in the EMR instance

    Contact Us

    Contact our sales team or business advisors to help your business.

    Technical Support

    Open a ticket if you're looking for further assistance. Our Ticket is 7x24 avaliable.

    7x24 Phone Support