Alluxio Monitoring Metrics

Last updated: 2021-09-28 15:50:28

    Alluxio - Overview

    Metric Name Unit Description
    Total amount of data read/written_BytesReadAlluxio Bytes Total number of bytes read from Alluxio storage reported by all workers
    Total amount of data read/written_BytesReadUfsAll Bytes Total number of bytes read from Alluxio UFSes by all workers
    Total amount of data read/written_BytesReadDomain Bytes Total number of bytes read from Alluxio storage via a domain socket reported by all workers
    Total amount of data read/written_BytesReadLocal Bytes Total number of bytes short-circuit read from local storage by all clients
    Total amount of data read/written_BytesReadPerUfs Bytes Total number of bytes read from a specific UFS by all workers
    Total amount of data read/written_BytesWrittenAlluxio Bytes Total number of bytes written to Alluxio storage by all workers
    Total amount of data read/written_BytesWrittenUfsAll Bytes Total number of bytes written to all Alluxio UFSes by all workers
    Total amount of data read/written_BytesWrittenDomain Bytes Total number of bytes written to Alluxio storage via a domain socket by all workers
    Total amount of data read/written_BytesWrittenLocal Bytes Total number of bytes short-circuit written to local storage by all clients
    Total amount of data read/written_BytesWrittenPerUfs Bytes Total number of bytes written to a specific Alluxio UFS by all workers
    Data read/write throughput_BytesReadAlluxioThroughput Bytes Throughput of bytes read from Alluxio storage by all workers
    Data read/write throughput_BytesReadUfsThroughput Bytes Throughput of bytes read from all Alluxio UFSes by all workers
    Data read/write throughput_BytesReadDomainThroughput Bytes Throughput of bytes read from Alluxio storage via a domain socket by all workers
    Data read/write throughput_BytesReadLocalThroughput Bytes Throughput of bytes short-circuit read from local storage by all clients
    Data read/write throughput_BytesWrittenAlluxioThroughput Bytes Throughput of bytes written to Alluxio storage by all workers
    Data read/write throughput_BytesWrittenUfsThroughput Bytes Throughput of bytes written to all Alluxio UFSes by all workers
    Data read/write throughput_BytesWrittenDomainThroughput Bytes Throughput of bytes written to Alluxio storage via a domain socket by all workers
    Data read/write throughput_BytesWrittenLocalThroughput Bytes Throughput of bytes written to local storage by all clients
    Worker capacity_CapacityFree Bytes Total free bytes on all tiers of all workers
    Worker capacity_CapacityTotal Bytes Total capacity on all tiers of all workers
    Worker capacity_CapacityUsed Bytes Total used bytes on all tiers of all workers
    Worker count_Workers - Total number of active workers in the cluster

    Alluxio - Master

    Metric Name Unit Description
    YGC - Number of young GCs
    FGC - Number of full GCs
    FGCT s Time taken by full GCs
    GCT s Time taken by GCs
    YGCT s Time taken by young GCs
    S0 % Percentage of used survivor 0 memory
    E % Percentage of used eden memory
    CCS % Percentage of used compressed class space memory
    S1 % Percentage of used survivor 1 memory
    O % Percentage of used old memory
    M % Percentage of used metaspace memory
    MemNonHeapUsedM MB Amount of NonHeapMemory used by the JVM
    MemNonHeapCommittedM MB Amount of NonHeapMemory committed by the JVM
    MemHeapUsedM MB Amount of HeapMemory used by the JVM
    MemHeapCommittedM MB Amount of HeapMemory committed by the JVM
    MemHeapMaxM MB Amount of HeapMemory configured for the JVM
    MemHeapInitM MB Initial amount of HeapMem for the JVM
    MemNonHeapInitM MB Initial amount of NonHeapMem for the JVM
    CompleteFile operations_CompleteFileOps - Total number of CompleteFile operations
    CompleteFile operations_FilesCompleted - Total number of successful CompleteFile operations
    CreateDirectory operations_CreateDirectoryOps - Total number of CreateDirectory operations
    CreateDirectory operations_DirectoriesCreated - Total number of successful CreateDirectory operations
    CreateFile operations_CreateFileOps - Total number of CreateFile operations
    CreateFile operations_FilesCreated - Total number of successful CreateFile operations
    Delete operations_DeletePathOps - Total number of Delete operations
    Delete operations_PathsDeleted - Total number of successful Delete operations
    FreeFile operations_FreeFileOps - Total number of FreeFile operations
    FreeFile operations_FilesFreed - Total number of successful FreeFile operations
    GetFileBlockInfo operations_GetFileBlockInfoOps - Total number of GetFileBlockInfo operations
    GetFileBlockInfo operations_FileBlockInfosGot - Total number of successful GetFileBlockInfo operations
    GetFileInfo operations_GetFileInfoOps - Total number of GetFileInfo operations
    GetFileInfo operations_FileInfosGot - Total number of successful GetFileInfo operations
    GetNewBlock operations_GetNewBlockOps - Total number of GetNewBlock operations
    GetNewBlock operations_NewBlocksGot - Total number of successful GetNewBlock operations
    Mount operations_MountOps - Total number of Mount operations
    Mount operations_PathsMounted - Total number of successful Mount operations
    Unmount operations_UnmountOps - Total number of Unmount operations
    Unmount operations_PathsUnmounted - Total number of successful Unmount operations
    Rename operations_RenamePathOps - Total number of Rename operations
    Rename operations_PathsRenamed - Total number of successful Rename operations
    SetAcl operations_SetAclOps - Total number of SetAcl operations
    SetAttribute operations_SetAttributeOps - Total number of SetAttribute operations
    Operated file count_FilesPersisted - Total number of successfully saved files
    Operated file count_FilesPinned - Total number of currently pinned files
    File and directory count_TotalPaths - Total number of files and directory in Alluxio namespace

    Alluxio - Worker

    Metric Name Unit Description
    YGC - Number of young GCs
    FGC - Number of full GCs
    FGCT s Time taken by full GCs
    GCT s Time taken by GCs
    YGCT s Time taken by young GCs
    S0 % Percentage of used survivor 0 memory
    E % Percentage of used eden memory
    CCS % Percentage of used compressed class space memory
    S1 % Percentage of used survivor 1 memory
    O % Percentage of used old memory
    M % Percentage of used metaspace memory
    MemNonHeapUsedM MB Amount of NonHeapMemory used by the JVM
    MemNonHeapCommittedM MB Amount of NonHeapMemory committed by the JVM
    MemHeapUsedM MB Amount of HeapMemory used by the JVM
    MemHeapCommittedM MB Amount of HeapMemory committed by the JVM
    MemHeapMaxM MB Amount of HeapMemory configured for the JVM
    MemHeapInitM MB Initial amount of HeapMem for the JVM
    MemNonHeapInitM MB Initial amount of NonHeapMem for the JVM
    Async cache requests_AsyncCacheDuplicateRequests - Total number of duplicated async cache requests received by a worker
    Async cache requests_AsyncCacheRequests - Total number of async cache requests received by a worker
    Async cache block count_AsyncCacheFailedBlocks - Total number of blocks that fail to be async cached in a worker
    Async cache block count_AsyncCacheRemoteBlocks - Total number of blocks that need to be async cached from the remote source
    Async cache block count_AsyncCacheSucceededBlocks - Total number of blocks that are async cached successfully in a worker
    Async cache block count_AsyncCacheUfsBlocks - Total number of blocks that need to be async cached from the local source
    BlocksAccessed - Total number of times any one of the blocks in a worker is accessed
    BlocksCached - Total number of blocks used for caching data in a worker
    BlocksCancelled - Total number of aborted temporary blocks in a worker
    BlocksDeleted - Total number of deleted blocks in a worker by external requests.
    BlocksEvicted - Total number of evicted blocks in a worker
    BlocksLost - Total number of lost blocks in a worker
    BlocksPromoted - Total number of times any one of the blocks in a worker moved to a new tier
    Worker capacity_CapacityFree Bytes Total free bytes on all tiers of all workers
    Worker capacity_CapacityTotal Bytes Total capacity on all tiers of all workers
    Worker capacity_CapacityUsed Bytes Total used bytes on all tiers of all workers