Tencent Cloud GPU Service
Tags: gpu, cvm, webdev, cloud
Published: 2022-08-26 08:04:02

Not sure which Tencent Cloud GPU instance is right for you? Still fumbling a way to elegantly install the driver and other underlying development tools? These are common questions that bother deep learning researchers and developers. No worries. This document shares all you need to know through the best practices of Tencent Cloud GPU instance.

**Environment and objective**

The mainstream Tencent Cloud GPU Computing GN7 model with an NVIDIA Tesla T4 GPU is selected as an example, to be more specific, GN7.5XLARGE80. This model features a high comprehensive performance offered by 20 CPU cores and 80 GB memory, making it suitable for general deep neural network training. In addition, it is the most cost-effective GPU T4 model in the world.

Purchase here. Pay-as-you-go models are even more flexible for experiments.

Instance in this tutorial: GPU models like GN7 (recommended) or GN10X

Recommended system image: Ubuntu 18.04 (note that you don't need to select **Automatically install GPU driver on the backend**.)

Other information: Beijing Zone 5, 1 Mbps public network bandwidth, and 100 GB system disk, which can be selected as needed.

**Installing CUDA Driver/Toolkit**

![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/akeodx86qbqfrf5yby3m.png)

**Install the DEB package from the official website**
![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/hk7trc2o5icpjp8rb6u8.png)
 

Download CUDA Toolkit 10.2 from NVIDIA's official website.

https://developer.nvidia.com/cuda-downloads

Select the download method based on your environment. Here, DEB package installation is selected as shown below:


Run the following command as prompted:

wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu1804/x86_64/cuda-ubuntu1804.pin sudo mv cuda-ubuntu1804.pin /etc/apt/preferences.d/cuda-repository-pin-600 sudo apt-key adv --fetch-keys https://developer.download.nvidia.com/compute/cuda/repos/ubuntu1804/x86_64/7fa2af80.pub sudo add-apt-repository "deb http://developer.download.nvidia.com/compute/cuda/repos/ubuntu1804/x86_64/ /" sudo apt-get update sudo apt-get -y install cuda

You can see that the official APT repository source of NVIDIA is installed in the system and `apt install cuda` is executed. Note that the last step of installation takes about five minutes and may be interrupted due to network and other issues, which can be fixed after a retry or two.

Note: The server needs to be restarted here.

Then how to know what is installed and verify the installation?

**Verify GPU driver installation - view the device information**

The NVIDIA GPU driver is a kernel module supporting CUDA programming. In the above steps, the driver is installed in the form of Dynamic Kernel Module Support (DKMS). This type of kernel module is not in the kernel source tree, but it can be automatically recompiled every time the kernel is updated and upgraded to generate a new initramfs. In addition, it is dynamically loaded as the system starts. In short, the driver only needs to be installed once, which is very convenient.

Log in after the restart and verify whether the driver module has been dynamically loaded.

![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/fg8td4z65vy9vxcw64dm.png)
 
As can be seen, the NVIDIA instead of Nouveau driver is loaded.

Read more at: https://www.tencentcloud.com/dynamic/insights/sample-article/100331