#3256 Added GPU enabled sandbox image.
Pull request opened by
ahlgol
A new Dockerfile and build-target "build-gpu" in docker/sandbox-bundled that builds a CUDA enabled image named flyte-sandbox-gpu.
Describe your changes
• Build target added in Makefile for "build-gpu" that builds Dockerfile.gpu
• Build target added in Makefile for "manifests-gpu" that adds gpu-operator.yaml to manifests
• Dockerfile.gpu is based on existing Dockerfile, but uses a base image from nvidia and installs k3s and crictl and adds containerd config template for nvidia container runtime
• Adds bin/k3d-entrypoint-gpu-check.sh that checks if container is started in an nvidia enabled image and exits otherwise.
• bin/k3d-entrypoint.sh have been modified to allow for stderr to pass to output, so warning from other entrypoint scripts can be seen (now it will be missing in logfile however)
Check all the applicable boxes
☐ I updated the documentation accordingly.
☐ All new and existing tests passed.
☐ All commits are signed-off.
Note to reviewers
Changes have been added following info from these sources (plus some trial and error):
https://itnext.io/enabling-nvidia-gpus-on-k3s-for-cuda-workloads-a11b96f967b0
https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/install-guide.html
https://k3d.io/v5.4.6/usage/advanced/cuda/
flyteorg/flyte
GitHub Actions: trigger-sandbox-bundled-build
GitHub Actions: trigger-single-binary-build
DCO: DCO
✅ 8 other checks have passed
8/11 successful checks