tencent cloud

部署 node-exporter 和 prometheus

通过 node-exporter 实现对 Node 指标的监控，用户可以根据业务需求部署 node-exporter 和 prometheus。

聚合规则配置

在 node-exporter 获取节点监控数据后，需要通过 Prometheus 对原始的 node-exporter 采集数据进行聚合计算。为了获取动态调度器中需要的 cpu_usage_avg_5m、cpu_usage_max_avg_1h、cpu_usage_max_avg_1d、mem_usage_avg_5m、mem_usage_max _avg_1h、mem_usage_max_avg_1d 等指标，需要在 Prometheus 的 rules 规则进行如下配置：

apiVersion: monitoring.coreos.com/v1
kind: PrometheusRule
metadata:
   name: example-record
spec:
   groups:
     - name: cpu_mem_usage_active
       interval: 30s
       rules:
       - record: cpu_usage_active
         expr: 100 - (avg by (instance) (irate(node_cpu_seconds_total{mode="idle"}[30s])) * 100)
       - record: mem_usage_active
         expr: 100*(1-node_memory_MemAvailable_bytes/node_memory_MemTotal_bytes)
     - name: cpu-usage-5m
       interval: 5m
       rules:
       - record: cpu_usage_max_avg_1h
         expr: max_over_time(cpu_usage_avg_5m[1h])
       - record: cpu_usage_max_avg_1d
         expr: max_over_time(cpu_usage_avg_5m[1d])
     - name: cpu-usage-1m
       interval: 1m
       rules:
       - record: cpu_usage_avg_5m
         expr: avg_over_time(cpu_usage_active[5m])
     - name: mem-usage-5m
       interval: 5m
       rules:
       - record: mem_usage_max_avg_1h
         expr: max_over_time(mem_usage_avg_5m[1h])
       - record: mem_usage_max_avg_1d
         expr: max_over_time(mem_usage_avg_5m[1d])
     - name: mem-usage-1m
       interval: 1m
       rules:
       - record: mem_usage_avg_5m
         expr: avg_over_time(mem_usage_active[5m])

Prometheus 文件配置

1. 上述定义了动态调度器所需要的指标计算的 rules，需要将 rules 配置到 Prometheus 中，参考一般的 Prometheus 配置文件。示例如下：
   

   global:
        evaluation_interval: 30s
        scrape_interval: 30s
        external_labels:
   rule_files:
   - /etc/prometheus/rules/*.yml # /etc/prometheus/rules/*.yml 是定义的rules文件
   

2. 将 rules 配置复制到一个文件（例如 dynamic-scheduler.yaml），文件放到上述 prometheus 容器的 /etc/prometheus/rules/ 目录下。
3. 加载 Prometheus server，即可从 Prometheus 获取到动态调度器需要的指标。

说明

通常情况下，上述 Prometheus 配置文件和 rules 配置文件都是通过 configmap 存储，再挂载到 Prometheus server 容器，因此修改相应的 configmap 即可。

1. 登录容器服务控制台 ，在左侧菜单栏中选择 Prometheus 监控，进入“Prometheus 监控”页面。
2. 创建与 Cluster 处于同一 VPC 下的 Prometheus 实例，并 关联集群。如下图所示：
   
3. 与原生托管集群关联后，可以在用户集群查看到每个节点都已安装 node-exporter。如下图所示：
   
4. 设置 Prometheus 聚合规则，具体规则内容与上述 自建Prometheus监控服务 中的“聚合规则配置”相同。如下所示：
   

   apiVersion: monitoring.coreos.com/v1
   kind: PrometheusRule
   metadata:
      name: example-record
   spec:
      groups:
        - name: cpu_mem_usage_active
          interval: 30s
          rules:
          - record: cpu_usage_active
            expr: 100 - (avg by (instance) (irate(node_cpu_seconds_total{mode="idle"}[30s])) * 100)
          - record: mem_usage_active
            expr: 100*(1-node_memory_MemAvailable_bytes/node_memory_MemTotal_bytes)
        - name: cpu-usage-5m
          interval: 5m
          rules:
          - record: cpu_usage_max_avg_1h
            expr: max_over_time(cpu_usage_avg_5m[1h])
          - record: cpu_usage_max_avg_1d
            expr: max_over_time(cpu_usage_avg_5m[1d])
        - name: cpu-usage-1m
          interval: 1m
          rules:
          - record: cpu_usage_avg_5m
            expr: avg_over_time(cpu_usage_active[5m])
        - name: mem-usage-5m
          interval: 5m
          rules:
          - record: mem_usage_max_avg_1h
            expr: max_over_time(mem_usage_avg_5m[1h])
          - record: mem_usage_max_avg_1d
            expr: max_over_time(mem_usage_avg_5m[1d])
        - name: mem-usage-1m
          interval: 1m
          rules:
          - record: mem_usage_avg_5m
            expr: avg_over_time(mem_usage_active[5m])