Knowledgebase

GPU Servers

NVIDIA GPU dedicated servers: drivers, CUDA, containers and monitoring

Articles

How to check that your GPU server can see its NVIDIA GPU? Updated 28 September 2026 NVIDIA GPU servers on Ubuntu 24.04 / 26.04 LTS After your GPU server is delivered, first confirm that the operating system can see the graphics card or cards. Do this before you install any AI software: it tells... How to choose which GPU an application uses on a multi-GPU server? Updated 28 September 2026 NVIDIA GPU servers on Ubuntu 24.04 / 26.04 LTS Servers with several GPUs (for example four A100 or seven A40 cards) run every program on all visible GPUs unless you limit it. Limiting is useful to run several jobs... How to fix the NVIDIA-SMI has failed error (cannot communicate with the NVIDIA driver)? Updated 11 October 2026 NVIDIA driver on Ubuntu 24.04 / 26.04 LTS The message NVIDIA-SMI has failed because it couldn't communicate with the NVIDIA driver. Make sure that the latest NVIDIA driver is installed and running. means the... How to install PyTorch with GPU (CUDA) support and test it? Updated 28 September 2026 PyTorch 2.14 (CUDA 13 build) on Ubuntu 24.04 / 26.04 LTS PyTorch is the most common framework for training and running AI models. Its pip packages contain the CUDA libraries they need, so a GPU server only needs the NVIDIA... How to install the CUDA Toolkit on Ubuntu 24.04 / 26.04? Updated 28 September 2026 CUDA Toolkit 13.4 on Ubuntu 24.04 / 26.04 LTS The CUDA Toolkit contains the nvcc compiler and the development libraries that you need to compile CUDA programs. You do not need it to run PyTorch, Ollama or most... How to install the NVIDIA driver on Ubuntu 24.04 / 26.04 for a GPU server? Updated 28 September 2026 NVIDIA driver on Ubuntu 24.04 / 26.04 LTS (CUDA 13 needs driver 580 or newer) Every GPU workload needs NVIDIA's driver first. On Ubuntu you can install it in two supported ways: with Ubuntu's own ubuntu-drivers tool (the simplest), or from... How to monitor GPU usage, memory and temperature on a GPU server? Updated 28 September 2026 NVIDIA GPU servers on Ubuntu 24.04 / 26.04 LTS While a model trains or answers requests, you want to know whether the GPU is busy, how much of its memory is used and how hot it runs. The nvidia-smi tool, installed... How to use your NVIDIA GPU in Docker with the NVIDIA Container Toolkit? Updated 28 September 2026 Docker Engine 29 and NVIDIA Container Toolkit 1.20 on Ubuntu 24.04 / 26.04 LTS Most AI projects ship as Docker images. To let a container use your NVIDIA GPU you install the NVIDIA Container Toolkit on the server and connect it to Docker. This...