Skip to main content
Version: Next

Allocate certain device memory

Allocate certain device memory to container

To allocate a certain size of GPU device memory, you need only to assign nvidia.com/gpumem besides nvidia.com/gpu.

apiVersion: v1
kind: Pod
metadata:
name: gpu-pod
spec:
containers:
- name: ubuntu-container
image: ubuntu:18.04
command: ["bash", "-c", "sleep 86400"]
resources:
limits:
nvidia.com/gpu: 2 # requesting 2 vGPUs
nvidia.com/gpumem: 3000 # each vGPU requests 3G device memory

NOTICE: nvidia.com/gpumem can't be used together with nvidia.com/gpumem-percentage