tencent cloud

Feedback

Supernodes Overview

Last updated: 2022-05-24 10:37:10

    Overview

    A virtual node is not an actual node, but a kind of scheduling capability based on the native K8s. It supports scheduling the Pods in a standard Kubernetes cluster to a virtual node that does not occupy the cluster server resource. In the TKE cluster that has enabled the virtual node feature, the Pods that meet the scheduling conditions will be scheduled to the virtual node maintained by Elastic Kubernetes Service.

    Pods deployed on the virtual nodes have the same security isolation as CVM, and have the same network isolation and network connectivity as Pods deployed on existing nodes in the cluster, as shown in the figure below:

    Concepts

    Elastic container

    If a cluster has deployed a virtual node, the Pods scheduled to the virtual node are the elastic containers, which do not occupy the node resources of cluster server, nor is it restricted by the upper limit of server node resources.

    Node pool

    To help you efficiently manage nodes in a Kubernetes cluster, TKE introduced the concept of node pool. Basic node pool features allow you to conveniently and quickly create, manage, and terminate nodes and dynamically scale nodes in or out.

    Benefits

    Making elasticity faster and more efficient

    With compared to node pool and scaling group, scaling out and in process for virtual nodes simplifies server purchase, initialization and returning. This improves the speed of elasticity greatly, reduces possible failures in scaling out to the largest extent, and makes elasticity more efficient.

    • The scaling out process of virtual node is in seconds.
    • The scaling in process of virtual node is short. It can scale in instantaneously with non-stop service.

    Cost saving

    Virtual nodes have the advantages of second-level elasticity and serverless, on-demand product form, which makes them have a great advantage in terms of costs.

    • Use on demand to reduce the cluster resource buffer. Because the specifications of the Pods scheduled to real nodes cannot completely match the node specifications, there will always be some fragmented resources that cannot be used but are still billed. Virtual nodes are used on demand to avoid the generation of fragmented resources, therefore, it can improve the resource utilization of the overall cluster, reduce buffer and save costs.

    • Reduce the billing duration of elastic resources and save costs. Because the virtual node is scaling out in seconds and scaling in instantaneously, it will greatly reduce the costs in scaling.

    Billing

    Fees are not charged for virtual nodes, but charged based on the Pod resources scheduled to the virtual nodes.

    Elastic container on the virtual node is a pay-as-you-go service. The fees are calculated based on the configured amount of resources and the actual period of using them. Fees will be calculated based on the specifications of the CPU, GPU, and memory for a workload and the running time of the workload. For more information, see Product Pricing.

    Notes on scheduling

    Generally, a cluster with virtual node enabled will automatically scale out Pods to a virtual node when the server node resources are insufficient, and scale in the Pods on the virtual node first when the server node resources are sufficient. You can also schedule the Pods to a virtual node manually. For details, please see Notes on Scheduling Pod to Virtual Node.

    Operations

    Scaling out in seconds to deal with burst traffic easily

    For irregular burst traffic, it is difficult to guarantee timely node scaling. If resource specifications are configured with high traffic as a baseline, only a small portion of resources will be used when the traffic is stable, which is a serious waste of resources. It is recommended to configure virtual nodes without additional preset resources to deal with burst traffic.

    • High elasticity: scale out in seconds, and deal with burst traffic easily. It will automatically terminate the Pods when service traffic drops. Scale in with non-stop service.
    • Low costs: avoid resources idling costs and improve utilization of resources.

    Reducing the cluster resource buffer for long-term running service peaks

    For long-term running applications with tidal resource loads, virtual nodes can quickly deploy a large number of Pods without occupying cluster server node resources. When the Pods need to scale out at the service peak, they will be automatically scheduled to the nodes first, consuming the reserved node resources, and then be scheduled to the virtual nodes to supply more temporary resources to the cluster. These resources will be automatically returned as the Pods scale in.

    • High elasticity: scale out in seconds, automatically terminate Pods when service traffic drops, and scale in with non-stop service.
    • Low costs: you can reduce the reserved cluster buffer, make the usage and reservation of cluster node resources more reasonable, improve the resource utilization, and reduce costs.

    Replacing node scaling for short-term running tasks

    For tasks that run in a short term and have high resource demands, it is generally necessary to manually scale out a large number of nodes to ensure resources, then schedule the Pods, and return the server after the task is completed. Node resources have buffer, which causes a waste of resource. It is recommended to use virtual nodes and schedule Pods to virtual nodes manually without the need of node management.

    • No node scaling is required: No need to scale out and in the cluster nodes before and after deployment of these loads, which reduces the time period and maintenance cost of nodes scaling. When the task is completed and the Pod exits, resources will be returned automatically and billing will be stopped. No need for human or program intervention.
    • Use on demand to reduce cost: creating Pods based on resources required to avoid resource buffer.
    Contact Us

    Contact our sales team or business advisors to help your business.

    Technical Support

    Open a ticket if you're looking for further assistance. Our Ticket is 7x24 avaliable.

    7x24 Phone Support