Install NVIDIA Container Runtime Support（Optional）

• 1. Install the nvidia-container package repository on the node by following the instructions at: https://nvidia.github.io/libnvidia-container/

• 1. Install the nvidia container runtime packages. For example: apt install -y nvidia-container-runtime cuda-drivers-fabricmanager-515 nvidia-headless-515-server

• 1. Install K3s, or restart it if already installed: curl -ksL get.k3s.io | sh -

• 1. Confirm that the nvidia container runtime has been found by k3s: grep nvidia /var/lib/rancher/k3s/agent/etc/containerd/config.toml

• 1. Install nvidia device plugin

  kubectl create -f ./hack/install/nvidia_runtime.yaml
  kubectl create -f ./hack/install/nvidia_device_plugin.yml