Software
Operating systems and drivers
The five operating systems offered on DediGPU servers, the driver and toolkit each ships with, which cards they run on, and how long they are supported.
Five systems, all installed from our own mirrors with the GPU driver and toolkit already in place. You get root, you can replace any of it.
| System | Notes | Cards | Licence | Supported until |
|---|---|---|---|---|
| Ubuntu 24.04 LTS | Kernel 6.8 · the default for every template | NVIDIA, AMD · sxm, pcie, consumer | included | April 2029 |
| Ubuntu 22.04 LTS | Kernel 5.15 HWE · for stacks pinned to CUDA 11.8 / 12.1 | NVIDIA, AMD · sxm, pcie, consumer | included | April 2027 |
| Debian 12 | Bookworm · minimal, driver from the vendor repository | NVIDIA, AMD · sxm, pcie, consumer | included | June 2028 |
| Rocky Linux 9 | RHEL-compatible · Slurm, enterprise and HPC stacks | NVIDIA, AMD · sxm, pcie, consumer | included | May 2032 |
| Windows Server 2022 | Standard · RDP on :3389 · licence billed at our rate | NVIDIA · pcie, consumer | $28/mo | October 2031 |
Drivers and toolkits
- NVIDIA. Driver 570 with CUDA 12.8 on every Linux image; cuDNN, NCCL and the container toolkit on the templates that need them.
nvidia-smiworks at first login. - AMD MI300X. ROCm 6.4 with the PyTorch and vLLM builds that go with it.
rocm-smiandrocminfoat first login. - Windows. The Studio driver on workstation cards, the data-centre driver on PCIe cards, CUDA 12.8 toolkit installed.
Pinned stacks
Ubuntu 22.04 exists for code pinned to older CUDA (11.8, 12.1). The driver is still 570; CUDA 11.8 and 12.1 toolkits are on the mirror: apt install cuda-toolkit-11-8. Rocky Linux 9 is the choice for Slurm and RHEL-compatible stacks.
Your own image
Boot anything from an ISO through the IPMI virtual media. We support the hardware, not the image.