GPU Installation
How to enable GPU support on your Bacalhau node
Was this helpful?
How to enable GPU support on your Bacalhau node
Was this helpful?
Bacalhau supports GPUs out of the box and defaults to allowing execution on all GPUs installed on the node.
Bacalhau makes the assumption that you have installed all the necessary drivers and tools on your node host and have appropriately configured them for use by Docker.
In general for GPUs from any vendor, the Bacalhau client requires:
Verify installation by
nvidia-smi
installed and functional
rocm-smi
tool installed and functional
See the for guidance on how to run Docker workloads on AMD GPU.
xpu-smi
tool installed and functional
See the for guidance on how to run Docker workloads on Intel GPU.
Access to GPUs can be controlled using . To limit the number of GPUs that can be used per job, set a job resource limit. To limit access to GPUs from all jobs, set a total resource limit.