Modern AI, rendering, and HPC workloads rely on dedicated GPU servers, so having deep, real-time visibility into GPU utilization, memory, temperature, and power is essential for performance and uptime. In this guide, we will explore and set up Zabbix Monitoring for Dedicated GPU Servers.
You will learn a complete setup of Zabbix 7.4 with Ubuntu 24.04 LTS OS.
Also, you will learn how to integrate your NVIDIA-based GPU nodes using Zabbix agent2 and the official NVIDIA template, which allows you to monitor every GPU in your infrastructure.
If you are looking for high-performance GPU servers optimized for AI, rendering, and HPC workloads, PerLod Hosting provides the best plans for you.
Requirements for Zabbix Monitoring for Dedicated GPU Servers
Before starting the setup, make sure your Zabbix server and GPU nodes meet these requirements:
A clean Ubuntu 24.04 LTS server VM or bare metal) for the Zabbix server, with at least 4 vCPUs, 8 GB RAM, and 50 GB+ disk if you plan to monitor multiple GPU nodes and keep history data.
Root or sudo access on the Zabbix server and all dedicated GPU nodes with working internet access to download Zabbix repositories and packages.
A static IP address is configured on the Zabbix server and each GPU node, with firewall rules allowing TCP ports 80/8080 (HTTP), 443 (if using HTTPS), and 10050 (Zabbix agent).
NVIDIA drivers and CUDA stack already installed on each dedicated GPU server, with nvidia-smi working correctly and showing all GPUs.
Now, proceed to the following steps to set up Zabbix Monitoring for Dedicated GPU Servers.
Step 1. Set up Latest Zabbix Server for GPU Monitoring
The first step is to install the Zabbix server on your VM or bare metal. Add the latest Zabbix repository to your server with the commands below:
Note: If you monitor many GPU nodes with many NVML metrics, you can adjust higher values.
Step 2. Configure Nginx and PHP-FPM for Zabbix GPU Monitoring
At this point, you must prepare the Zabbix web interface to run efficiently on Ubuntu 24.04 using Nginx as the web server and PHP-FPM 8.3 for processing PHP requests.
Create or edit the Zabbix Nginx config file with the command below:
At this point, you can access the Zabbix web installer with:
Bash
http://zabbix.example.com:8080
Follow the setup wizard provided by Zabbix:
Check that all PHP modules and configuration pass the requirements.
Set DB connection: host localhost, DB zabbix, user zabbix, password Strong_Zabbix_DB_Pass.
Set server name and default timezone.
Then, log in with:
Username: Admin
Password: zabbix
Remember to change the password immediately.
Step 3. Install Zabbix Agent2 on GPU Nodes
After you set up the Zabbix server, you must add and install the Zabbix Agent2 on each GPU node you want to monitor. To do this, you can run the commands below:
Server and ServerActive: The IP address or DNS name of the Zabbix server.
Hostname: Must match the hostname configured in the Zabbix UI.
Enable and start the Zabbix Agent2 with:
Bash
systemctlenable--nowzabbix-agent2
Check if it is up and running:
Bash
systemctlstatuszabbix-agent2--no-pager
Step 4. Enable the Official NVIDIA GPU Template by Zabbix Agent2
You can directly connect Zabbix to NVIDIA’s NVML layer using the official NVIDIA GPU Template by Zabbix Agent2.
By linking this template to your GPU hosts, Zabbix can automatically discover all installed NVIDIA GPUs and start collecting detailed statistics such as utilization, memory usage, temperature, power draw, and driver version.
This gives you deep visibility into the health and performance of every GPU in your cluster.
This only works for Zabbix server 7.4+ and agent2 with the NVIDIA plugin. Be sure NVIDIA drivers are installed on the GPU node.
To link this template to a GPU host, follow the steps below:
From the Zabbix UI, navigate to the following path:
Nvidia by Zabbix agent 2 or Nvidia by Zabbix agent 2 active, depending on your package version.
Save the host; Zabbix will begin polling the node and discovering GPUs.
From the Zabbix server, test availability with an NVML key:
Bash
zabbix_get-s10.0.0.21-knvml.system.driver.version
If the configuration is correct, this returns the NVIDIA driver version from the GPU node.
Visualizing NVIDIA GPU Metrics and Alerts in Zabbix
After you start collecting NVIDIA GPU data in Zabbix, you need a simple way to see what is happening and get alerts when something goes wrong.
In this step, you will check live GPU metrics per host, build easy-to-read dashboards, and set basic triggers so Zabbix can notify you about overheating GPUs, sustained high utilization, or memory pressure before they impact your workloads.
1. View latest GPU data:
From the Zabbix UI, navigate to the following path:
Bash
Monitoring → Hosts → gpu-node-01 → Latestdata
You can filter by application or search for keys like:
That's it, you are done. You can now monitor every GPU in your infrastructure.
Conclusion
By combining Zabbix 7.4 on Ubuntu 24.04 with Zabbix agent2 and the official NVIDIA GPU template, you get a powerful, centralized monitoring stack tailored for dedicated GPU servers.
This setup lets you automatically discover all GPUs, track key metrics such as utilization, memory, temperature, and power, and build dashboards and alerts that help you detect problems early, protect your hardware, and keep AI, rendering, and HPC workloads running smoothly.
We hope you enjoy this Zabbix GPU Monitoring guide. Subscribe to our X and Facebook channels to get the latest updates and articles on GPU monitoring.
For NVIDIA GPU monitoring with the official template, you must use Zabbix agent2 because the NVIDIA GPU plugin is only available for agent2, not the classic agent.
With proper tuning, a single Zabbix server can monitor dozens of GPU nodes and hundreds of GPUs, but very large clusters may benefit from Zabbix proxies and a more powerful database backend.
It is technically possible in small environments, but it is recommended to run the Zabbix server on a separate VM or host, so monitoring is not impacted by GPU workloads.
We use cookies to run PerLod and to understand how the site is used. You can accept everything, or open Manage to turn individual categories off. Cookie policy.