Allocate device memory to container

Allocate a certain size of device memory by specifying resources such as nvidia.com/gpumem. Optional, each unit of nvidia.com/gpumem equals 1 MiB.

Set nvidia.com/gpumem to a non-negative integer without a unit suffix.

resources:
  limits:
    nvidia.com/gpu: 1 # requesting 1 GPU
    nvidia.com/gpumem: 3000 # Each GPU contains 3000m device memory

Allocate a percentage of device memory by specifying resource nvidia.com/gpumem-percentage. Optional, each unit of nvidia.com/gpumem-percentage equals 1% of device memory.

resources:
  limits:
    nvidia.com/gpu: 1 # requesting 1 GPU
    nvidia.com/gpumem-percentage: 50 # Each GPU contains 50% device memory

note

Prefer specifying memory using one of these resources. If both are set and nvidia.com/gpumem is a positive integer, it takes precedence when determining the memory request. If nvidia.com/gpumem is omitted or 0, a valid nvidia.com/gpumem-percentage is used to calculate the memory request.

If nvidia.com/gpumem-percentage is 100 and nvidia.com/gpucores is not specified, HAMi automatically sets nvidia.com/gpucores: 100, even when nvidia.com/gpumem is also set to a positive integer.