Skip to main content
Version: v2.11.0

Devices supported by HAMi

Applicable version: HAMi v2.11.0. For the historical version, see the v2.10.0 support matrix.

Last verified: 2026-11-06, against the HAMi source, default device configuration, and device guides.

The table below lists device integration status, allocation modes, and multi-card partitioning capabilities for released and experimental HAMi integrations. See the device guides below for the required plugins, drivers, and container runtimes.

DeviceModeModelsIntegration statusMemory controlCompute controlMulti-card partitioning
NVIDIA GPUHAMi-coreAllStableMemory quotaTime-slice throttlingYes
NVIDIA GPUMIG (dynamic partitioning)MIG-capable modelsStableHardware profileHardware profileYes (subject to CUDA and driver requirements)
AMD GPUCU slicingInstinct / ROCm; see guideStableMemory quotaCU shareYes
AWS NeuronWhole device / core allocationInferentia / Trainium; see guideStableNo separate quota interfaceNeuronCore allocationCore allocation across devices (the last device can be partially allocated; selected devices must be idle and satisfy topology constraints)
Biren GPUWhole device / pre-partitioned SVIBiren166MStableFixed SVI partitionsFixed SVI partitionsYes (pre-partitioned SVI instances)
Cambricon MLUDynamic SMLU370, 590StableMemory quotaCore quotaNo
Enflame GCUDRSS60StableProfile-based allocationProfile-based allocationNo
Ascend NPUtemplate910A, 910B series, 910C, 310PStableTemplate-based allocationDetermined by templateNo
Ascend NPUhami-coreDepends on model and runtime; see guideStableMemory quotaCompute quotaYes
Ascend NPUENPUA2/910B, A3/910CStableMemory quotaDepends on ENPU policyNo
Ascend NPUWhole device950DT 9582 (96 GiB); requires a separate deployment of ascend-device-plugin v1.5.0 (Chart 0.2.2)StableNo separate quota interfaceNo separate quota interfaceN/A
Hygon HCUDynamic vHCU partitioningAllStableMemory quotaCompute shareNo
Iluvatar GPUvGPU (gpu-manager)MR-V100, MR-V50, BI-V150, BI-V100StableMemory quotaCore quotaNo
Kunlunxin XPUVXPUP800-OAMStablePartition sizeDetermined by partition sizeYes
MetaX GPUsGPUMXC500StableMemory quotaDepends on QoSYes (not supported with sgpu-app-class)
Mthreads GPUsGPUMTT S4000StableDiscrete memory sizesCore quotaNo
Teco GPU (Tecorigin)Core allocation (in development)To be confirmedExperimentalTo be validatedTo be validatedTo be validated
Vastai GPUWhole card / Die allocationVA16StableWhole card or Die allocationWhole card or Die allocationYes (Die allocation)

Stable means included in an official HAMi release. Release status in this table is checked against v2.11.0. Experimental means the integration is still in development or validation and has not been officially released.

Teco integration is not included in v2.11.0. Device models and capabilities remain to be validated. Track progress in HAMi #3369 and documentation PR #979.

Capability columns:

  • Memory control: The memory quota or partition size that a container can request. Templates and fixed partition sizes round memory allocations up to the corresponding size.
  • Compute control: Devices control compute resources through time slices, core allocation, hardware partitions, or QoS policies. See the linked references in the table for limitations.
  • Multi-card partitioning: A single container can allocate resources across multiple physical devices while using only part of the resources on some of those devices. Allocating only whole devices does not count as multi-card partitioning. See the linked references for allocation granularity and limitations. N/A means the mode allocates whole devices only.

Component integration guides​

For NVIDIA sharing, Volcano vGPU and KAI Scheduler retain their own scheduling capabilities and use HAMi-core for runtime isolation; the KAI Scheduler integration provides memory isolation. HAMi-DRA works with the Kubernetes scheduler through DRA drivers; its NVIDIA sharing path uses HAMi-core to enforce memory and compute limits at runtime.

The table below links to device and scheduling component integration guides, including installation steps, configuration requirements, and limitations. - means no guide is available.

ManufacturerHAMiHAMi-DRAVolcanoKAI-scheduler
NVIDIAAllocate device memory · Remote GPUDynamic Resource AllocationUse Volcano vGPUUse KAI Scheduler
AMDEnable AMD GPU sharing---
AWSManage AWS Neuron devices---
BirenEnable Biren sharing---
CambriconEnable Cambricon MLU sharing---
EnflameEnable Enflame GCU sharing---
Huawei AscendEnable Huawei Ascend sharing-Volcano Ascend vNPU-
HygonEnable Hygon HCU sharing---
IluvatarEnable Iluvatar GPU sharing---
KunlunxinWhole-device scheduling · VXPU sharing---
MetaXEnable MetaX GPU sharing---
MthreadsEnable Mthreads GPU sharing---
Teco (Tecorigin)Integration guide (in development)---
VastaiEnable Vastai sharing---

Each linked guide covers device-specific setup, configuration notes, and known limitations. Read it before deploying that device.

CNCFHAMi is a CNCF Incubating project