GPU Servers
NVIDIA GPU dedicated servers: drivers, CUDA, containers and monitoring
Articles
How to check that your GPU server can see its NVIDIA GPU?
After your GPU server is delivered, first confirm that the operating system can see the graphics card or cards. Do this before you install any AI software: it tells...
How to choose which GPU an application uses on a multi-GPU server?
Servers with several GPUs (for example four A100 or seven A40 cards) run every program on all visible GPUs unless you limit it. Limiting is useful to run several jobs...
How to fix the NVIDIA-SMI has failed error (cannot communicate with the NVIDIA driver)?
The message NVIDIA-SMI has failed because it couldn't communicate with the NVIDIA driver. Make sure that the latest NVIDIA driver is installed and running. means the...
How to install PyTorch with GPU (CUDA) support and test it?
PyTorch is the most common framework for training and running AI models. Its pip packages contain the CUDA libraries they need, so a GPU server only needs the NVIDIA...
How to install the CUDA Toolkit on Ubuntu 24.04 / 26.04?
The CUDA Toolkit contains the nvcc compiler and the development libraries that you need to compile CUDA programs. You do not need it to run PyTorch, Ollama or most...
How to install the NVIDIA driver on Ubuntu 24.04 / 26.04 for a GPU server?
Every GPU workload needs NVIDIA's driver first. On Ubuntu you can install it in two supported ways: with Ubuntu's own ubuntu-drivers tool (the simplest), or from...
How to monitor GPU usage, memory and temperature on a GPU server?
While a model trains or answers requests, you want to know whether the GPU is busy, how much of its memory is used and how hot it runs. The nvidia-smi tool, installed...
How to use your NVIDIA GPU in Docker with the NVIDIA Container Toolkit?
Most AI projects ship as Docker images. To let a container use your NVIDIA GPU you install the NVIDIA Container Toolkit on the server and connect it to Docker. This...