tencent cloud

Feedback

Doris Monitoring Metrics

Last updated: 2022-05-16 12:45:12

    Doris - FE

    Title Metric Unit Description
    Node information FeNodeNum count Total number of FE nodes
    BeAliveNum count Number of alive BE nodes
    BkDeadNum count Number of dead broker nodes
    Connections Num count Number of FE node JVM connections
    JVM threads Total count Total number of threads in the JVM of the FE node, including daemon threads and non-daemon threads
    Peak count Peak number of threads in the JVM of the FE node
    GC count YoungGC count FE node JVM Young GC count
    OldGC count FE node JVM Old GC count
    GC time YoungGC s FE node JVM Young GC time
    OldGC s FE node JVM Old GC time
    FE query latency Quantile75 ms 75th percentile of the FE query latency
    Quantile95 ms 95th percentile of the FE query latency
    Quantile99 ms 99th percentile of the FE query latency
    Quantile999 ms 99.9th percentile of the FE query latency
    Maximum compaction score of tablet MAX score Maximum compaction score of FE tablet
    Scheduled tablets ScheduledTablet count Number of scheduled tablets in FE
    Request response QPS count Number of queries per second
    RPS count Number of requests that can be processed per second
    Query failure rate ErrRate % Query error rate
    Cache query SqlModelHitQuery count Number of queries that hit the SQL model
    PartitionModelHitQuery count Number of queries that hit the partition model
    SqlModelQuery count Number of queries in the SQL cache model
    PartitionModelQuery count Number of queries in the partition cache model
    CachePartitionHit count Number of partitions that hit the cache in the query
    CachePartitionScan count Number of all partitions scanned in the query
    Routine load rows TotalRows count Number of FE routine load rows
    ErrorRows count Number of FE routine load error rows
    Transaction status statistics Reject count Number of rejected transactions on FE
    Begin count Number of transactions that have begun on FE
    Success count Number of successful transactions on FE
    Failed count Number of failed transactions on FE
    Images Write count Number of image writes on FE
    Push count Number of image pushes on FE
    ALTER job statistics RollupRunning count Number of running alter jobs of ROLLUP type
    SchemaChangeRunning count Number of running alter jobs of SCHEMA_CHANGE type
    UNKNOWN load job statistics UNKNOWN count Number of load jobs of UNKNOWN type in UNKNOWN status
    PENDING count Number of load jobs of UNKNOWN type in PENDING status
    ETL count Number of load jobs of UNKNOWN type in ETL status
    LOADING count Number of load jobs of UNKNOWN type in LOADING status
    COMMITTED count Number of load jobs of UNKNOWN type in COMMITTED status
    FINISHED count Number of load jobs of UNKNOWN type in FINISHED status
    CANCELLED count Number of load jobs of UNKNOWN type in CANCELLED status
    SPARK load job statistics UNKNOWN count Number of load jobs of SPARK type in UNKNOWN status
    PENDING count Number of load jobs of SPARK type in PENDING status
    ETL count Number of load jobs of SPARK type in ETL status
    LOADING count Number of load jobs of SPARK type in LOADING status
    COMMITTED count Number of load jobs of SPARK type in COMMITTED status
    FINISHED count Number of load jobs of SPARK type in FINISHED status
    CANCELLED count Number of load jobs of SPARK type in CANCELLED status
    DELETE load job statistics UNKNOWN count Number of load jobs of DELETE type in UNKNOWN status
    PENDING count Number of load jobs of DELETE type in PENDING status
    ETL count Number of load jobs of DELETE type in ETL status
    LOADING count Number of load jobs of DELETE type in LOADING status
    COMMITTED count Number of load jobs of DELETE type in COMMITTED status
    FINISHED count Number of load jobs of DELETE type in FINISHED status
    CANCELLED count Number of load jobs of DELETE type in CANCELLED status
    INSERT load job statistics UNKNOWN count Number of load jobs of INSERT type in UNKNOWN status
    PENDING count Number of load jobs of INSERT type in PENDING status
    ETL count Number of load jobs of INSERT type in ETL status
    LOADING count Number of load jobs of INSERT type in LOADING status
    COMMITTED count Number of load jobs of INSERT type in COMMITTED status
    FINISHED count Number of load jobs of INSERT type in FINISHED status
    CANCELLED count Number of load jobs of INSERT type in CANCELLED status
    BROKER load job statistics UNKNOWN count Number of load jobs of BROKER type in UNKNOWN status
    PENDING count Number of load jobs of BROKER type in PENDING status
    ETL count Number of load jobs of BROKER type in ETL status
    LOADING count Number of load jobs of BROKER type in LOADING status
    COMMITTED count Number of load jobs of BROKER type in COMMITTED status
    FINISHED count Number of load jobs of BROKER type in FINISHED status
    CANCELLED count Number of load jobs of BROKER type in CANCELLED status
    MINI load job statistics UNKNOWN count Number of load jobs of MINI type in UNKNOWN status
    PENDING count Number of load jobs of MINI type in PENDING status
    ETL count Number of load jobs of MINI type in ETL status
    LOADING count Number of load jobs of MINI type in LOADING status
    COMMITTED count Number of load jobs of MINI type in COMMITTED status
    FINISHED count Number of load jobs of MINI type in FINISHED status
    CANCELLED count Number of load jobs of MINI type in CANCELLED status
    HADOOP load job statistics UNKNOWN count Number of load jobs of HADOOP type in UNKNOWN status
    PENDING count Number of load jobs of HADOOP type in PENDING status
    ETL count Number of load jobs of HADOOP type in ETL status
    LOADING count Number of load jobs of HADOOP type in LOADING status
    COMMITTED count Number of load jobs of HADOOP type in COMMITTED status
    FINISHED count Number of load jobs of HADOOP type in FINISHED status
    CANCELLED count Number of load jobs of HADOOP type in CANCELLED status

    Doris - BE

    Title Metric Unit Description
    Thrift utilization Broker count Number of thrifts used by broker
    Backend count Number of thrifts used by BE
    Extdatasource count Number of thrifts used by extdatasource
    Frontend count Number of thrifts used by FE
    Streaming load statistics RequestsTotal count Number of streaming load requests
    CurrentProcessing count Number of existing streaming load processes
    PipeCount count Number of streaming load pipes
    Streaming load time Duration ms Streaming load duration
    Streaming load data volume LoadTotal bytes Size of data imported by streaming load
    Fragment statistics PlanFragment count Number of plan fragments
    Endpoint count Number of DataStreams
    RequestsTotal count Number of fragment requests
    Fragment request duration Duration μs Fragment request duration
    BE memory Total bytes Size of BE memory pool
    Allocated bytes Size of allocated BE memory
    Maximum compaction score of tablet CumulativeMax score Maximum cumulative compaction score of tablet
    BaseMax score Maximum base compaction score of tablet
    Data handled by compaction Cumulative bytes Amount of data handled by cumulative compaction
    Base bytes Amount of data handled by base compaction
    Delta data handled by compaction Cumulative bytes Amount of delta data handled by cumulative compaction
    Base bytes Amount of delta data handled by base compaction
    MemPools used by compaction CurrentConsumption count Sum of MemPools used by compaction (all compaction threads)
    Process file handles Used count Number of file handles used by BE process
    SoftLimit count Soft limit on file handles for BE process
    HardLimit count Hard limit on file handles for BE process
    Running threads in process NUM count Number of threads running in BE process
    Engine request statistics FailedBaseCompaction count Number of failed engine requests of base_compaction type
    FailedCultCompt count Number of failed engine requests of cumulative_compaction type
    TotalBaseCompaction count Total number of engine requests of base_compaction type
    TotalCultCompt count Total number of engine requests of cumulative_compaction type

    Doris - BK

    Title Metric Unit Description
    GC count YGC - Young GC count
    FGC - Full GC count
    GC time FGCT s Full GC time
    GCT s Garbage collection time
    YGCT s Young GC time
    Memory zone proportion S0 % Percentage of used Survivor 0 memory
    E % Percentage of used Eden memory
    CCS % Percentage of used compressed class space memory
    S1 % Percentage of used Survivor 1 memory
    O % Percentage of used Old memory
    M % Percentage of used Metaspace memory
    JVM memory MemHeapUsedM MB Size of HeapMemory currently used by JVM
    MemHeapCommittedM MB Size of HeapMemory committed by JVM
    MemHeapMaxM MB Size of HeapMemory configured by JVM
    MemHeapInitM MB Size of initial JVM HeapMem
    MemNonHeapUsedM MB Size of NonHeapMemory currently used by JVM
    MemNonHeapCommittedM MB Size of NonHeapMemory currently committed by JVM
    MemNonHeapInitM MB Size of initial JVM NonHeapMem
    CPU utilization ProcessCpuLoad % CPU utilization
    File handles MaxFileDescriptorCount - Maximum number of file descriptors
    OpenFileDescriptorCount - Number of opened file descriptors
    CPU usage time ProcessCpuTime ms Cumulative CPU usage time
    Process execution duration Uptime s Process execution duration
    Worker threads ThreadCount - Number of threads
    PeakThreadCount - Peak number of threads
    DaemonThreadCount - Number of backend threads
    Contact Us

    Contact our sales team or business advisors to help your business.

    Technical Support

    Open a ticket if you're looking for further assistance. Our Ticket is 7x24 avaliable.

    7x24 Phone Support