NVIDIA GPU GN* instances provide powerful computing capabilities to help you process a large number of concurrent computing tasks in real time. NVIDIA GPU instances are not only suitable for general computing scenarios such as deep learning and scientific computing, but also graphic and image processing such as 3D rendering and video encoding and decoding. Tencent Cloud GPU Cloud Computing (GCC) provides a fast, stable, and elastic computing service and allows you to manage NVIDIA GPU instances the same way you manage CVM instances.

Overview

NVIDIA GPU instances are categorized into rendering and computing types:

• Rendering: suitable for 3D rendering, video encoding and decoding, computer-aided design (CAD), etc.
• Computing: suitable for deep learning, scientific computing, computer-aided engineering (CAE), etc.

GCC provides the following types of NVIDIA GPU instances:

Note：

Availability zone: accurate to the city level. For more information, please see the instance configuration information below.

Recommended NVIDIA GPU instances

Tencent Cloud provides NVIDIA GPU instances to meet business needs in different scenarios. Refer to the following tables to select an NVIDIA GPU instance as needed.

The table below lists recommended NVIDIA GPU instances provided by GCC. A tick (✓) indicates that the NVIDIA GPU instance supports the corresponding feature. A pentagram (★) indicates that the NVIDIA GPU instance is recommended.

Note：

GN2 supports video encoding and decoding in H.264 format, but not H.265. For more information, please see Video Encode and Decode GPU Support Matrix.

Except for GN2, other types of NVIDIA GN* instances allow you to install a GRID driver to process graphics and images. To use the GRID driver, you must purchase a license.

Video encoding and decoding

Recommended instance: GN7. GN7 uses T4 GPU. It features high performance and the lowest cost for transcoding a single video, making it suitable for video encoding and decoding.

Deep learning training

Recommended instance: GN8, GN10X, or GN10Xp. GN8 and GN10X use P40 or V100 mid- to high-end GPU. They feature powerful single-precision floating-point computing capabilities and large on-board memories, making them ideal for deep learning training.

Deep learning inference

Recommended instance: GN6, GN6S, GN7, or GN8. These instances use P4, T4, or P40 GPU. They feature INT8 computing capabilities and cost-efficiency, making them suitable for mass deployment.

Scientific computing

Recommended instance: GN10X or GN10Xp. GN10X and GN10Xp use V100 GPU. They feature powerful double-precision floating-point computing capabilities and provide optimal acceleration for computational science and engineering applications.

Note：

• These recommendations are for reference only. Please select an appropriate instance based on your needs.
• To use NVIDIA GPU instances for general computing tasks, you must install the Tesla driver and CUDA toolkit. For more information, please see Installing NVIDIA Driver and Installing CUDA Toolkit.
• To use NVIDIA GPU instances for 3D rendering tasks such as high-performance graphic processing and video encoding and decoding, you must install a GRID driver and configure a license server.

Service options

• NVIDIA GPU instances can be launched in Virtual Private Cloud (VPC).
• NVIDIA GPU instances support services such as Cloud Load Balancer (CLB) with no additional management and OPS costs. Private network traffic is free of charge.

GN10X and GN10Xp for computing tasks

NVIDIA GPU instances GN10X and GN10Xp support not only general GPU computing tasks such as deep learning and scientific computing, but also graphic and image processing tasks such as 3D rendering and video encoding and decoding.

Application scenarios

GN10X and GN10Xp feature powerful double-precision floating-point computing capabilities. They are applicable to the following scenarios:

• Large-scale deep learning training and inference as well as scientific computing scenarios, such as:
  • Deep learning
  • High-performance database
  • Computational fluid dynamics
  • Computational finance
  • Seismic analysis
  • Molecular modeling
  • Genomics and others
• Graphic and image processing scenarios, such as:
  • Graphic and image processing
  • Video encoding and decoding
  • Graph database

Hardware specifications

• CPU: GN10X is configured with an Intel^® Xeon^® Gold 6133 CPU with a clock rate of 2.5 GHz. GN10Xp is configured with an Intel^® Xeon^® Platinum 8255C CPU with a clock rate of 2.5 GHz.
• GPU: NVIDIA^® Tesla^® V100 NVLink 32GB, providing 15.7 TFLOPS of single-precision floating point performance, 7.8 TFLOPS of double-precision floating point performance, 125 TFLOPS of deep learning accelerator performance with Tensor cores, and 300 GB/s NVLink.
• Memory: DDR4, providing memory bandwidth up to 2,666 MT/s.
• Storage: Select the appropriate CBS cloud disk type. To expand the cloud disk capacity, create and mount an elastic cloud disk.
• Network: network optimization is enabled by default. The network performance of an instance depends on its specification. You can purchase public network bandwidth as needed.

GN10X and GN10Xp instances provide the following configurations:

Note：

vGPU: GN10X instance cluster provides vGPU-based instances, which are currently in beta. The vGPU type is vComputeServer, which only supports CUDA APIs.

GN8 for computing tasks

NVIDIA GPU instance GN8 supports not only general GPU computing tasks such as deep learning, but also graphic and image processing tasks such as 3D rendering and video encoding and decoding.

Application scenarios

GN8 is applicable to the following scenarios:

• Deep learning training and inference scenarios, such as:
  • AI inference with high throughput
  • Deep learning
• Graphic and image processing scenarios, such as:
  • Graphic and image processing
  • Video encoding and decoding
  • Graph database

Hardware specifications

• CPU: Intel^® Xeon^® E5-2680 v4 CPU, 2.4 GHz.
• GPU: NVIDIA^® Tesla^® P40, providing 12 TFLOPS of single-precision floating point performance and 47 TOPS for INT8.
• Memory: DDR4, providing memory bandwidth up to 2,666 MT/s.
• Storage: Select the appropriate CBS cloud disk type. To expand the cloud disk capacity, create and mount an elastic cloud disk.
• Network: network optimization is enabled by default. The network performance of an instance depends on its specification. You can purchase public network bandwidth as needed.

GN8 instance provides the following configurations:

GN7 for computing tasks

NVIDIA GPU instance GN7 supports not only general GPU computing tasks such as deep learning, but also graphic and image processing tasks such as 3D rendering and video encoding and decoding.

Application scenarios

GN7 is cost-effective and applicable to the following scenarios:

• Deep learning inference and small-scale training scenarios, such as:
  • AI inference for mass deployment
  • Small-scale deep learning training
• Graphic and image processing scenarios, such as:
  • Graphic and image processing
  • Video encoding and decoding
  • Graph database

Hardware specifications

• CPU: Intel^® Xeon^® Platinum 8255C CPU, 2.5 GHz.
• GPU: NVIDIA^® Tesla^® T4, providing 8.1 TFLOPS of single-precision floating point performance, 130 TOPS for INT8, and 260 TOPS for INT4.
• Memory: DDR4, providing memory bandwidth up to 2,666 MT/s.
• Storage: Select the appropriate CBS cloud disk type. To expand the cloud disk capacity, create and mount an elastic cloud disk.
• Network: network optimization is enabled by default. The network performance of an instance depends on its specification. You can purchase public network bandwidth as needed.

GN7 instance provides the following configurations:

Note：

vGPU: GN7 instance cluster provides vGPU-based instances. The vGPU type is vComputeServer, which only supports CUDA APIs.

GN6 and GN6S for computing tasks

NVIDIA GPU instances GN6 and GN6S support not only general GPU computing tasks such as deep learning, but also graphic and image processing tasks such as 3D rendering and video encoding and decoding.

Application scenarios

GN6 and GN6S are cost-effective and applicable to the following scenarios:

• Deep learning inference and small-scale training scenarios, such as:
  • AI inference for mass deployment
  • Small-scale deep learning training
• Graphic and image processing scenarios, such as:
  • Graphic and image processing
  • Video encoding and decoding
  • Graph database

Hardware specifications

• CPU: GN6 is configured with an Intel^® Xeon^® E5-2680 v4 CPU with a clock rate of 2.4 GHz. GN6S is configured with an Intel^® Xeon^® Silver 4110 CPU with a clock rate of 2.1 GHz.
• GPU: NVIDIA^® Tesla^® P4, providing 5.5 TFLOPS of single-precision floating point performance and 22 TOPS for INT8.
• Memory: DDR4, providing memory bandwidth up to 2,666 MT/s.
• Storage: Select the appropriate CBS cloud disk type. To expand the cloud disk capacity, create and mount an elastic cloud disk.
• Network: network optimization is enabled by default. The network performance of an instance depends on its specification. You can purchase public network bandwidth as needed.

GN6 and GN6S instances provide the following configurations:

GN2 for computing tasks

NVIDIA GPU instance GN2 supports not only general GPU computing tasks such as deep learning and scientific computing, but also graphic and image processing tasks such as video encoding and decoding.

Application scenarios

GN2 is applicable to deep learning training and inference as well as scientific computing scenarios, such as:

• Deep learning
• High-performance database
• Computational fluid dynamics
• Computational finance
• Seismic analysis
• Molecular modeling
• Genomics and others

GN2 is also applicable to graphic and image processing scenarios. For example, GN2 supports video encoding and decoding in H.264 format, but not H.265. For more information, please see Video Encode and Decode GPU Support Matrix.

Hardware specifications

• CPU: Intel^® Xeon^® E5-2680 v4 (Broadwell), 2.4 GHz.
• GPU: NVIDIA^® Tesla^® M40, providing 7 TFLOPS of single-precision floating point performance with GPU Boost and 0.2 TFLOPS of double-precision floating point performance.
• Memory: DDR4, providing memory bandwidth up to 2,666 MT/s.
• Storage: local SSD disk. Currently, this instance type does not support cloud disks.
• Network: network optimization is enabled by default. The network performance of an instance depends on its specification. You can purchase public network bandwidth as needed.

GN2 instance provides the following configurations:

Application scenarios

GN7vw is applicable to graphic and image processing scenarios, such as:

• Graphic and image processing
• Video encoding and decoding
• Graph database

Hardware specifications

• CPU: Intel^® Xeon^® Platinum 8255C CPU, 2.5 GHz.
• GPU: NVIDIA^® Tesla^® T4, providing 8.1 TFLOPS of single-precision floating point performance, 130 TOPS for INT8, and 260 TOPS for INT4.
• Memory: DDR4, providing memory bandwidth up to 2,666 MT/s.
• Storage: Select the appropriate CBS cloud disk type. To expand the cloud disk capacity, create and mount an elastic cloud disk.
• Network: network optimization is enabled by default. The network performance of an instance depends on its specification. You can purchase public network bandwidth as needed.