Skip to main content
Version: v2.10.0

Devices supported by HAMi

Applicable version: HAMi v2.10.0.

Last verified: 2026-11-06, against the HAMi source, default device configuration, and device guides.

The table below lists device integration status, allocation modes, and multi-card partitioning capabilities for released and experimental HAMi integrations. See the device guides below for the required plugins, drivers, and container runtimes.

DeviceModeModelsIntegration statusMemory controlCompute controlMulti-card partitioning
NVIDIA GPUHAMi-coreAllStableMemory quotaTime-slice throttlingYes
NVIDIA GPUMIG (dynamic partitioning)MIG-capable modelsStableHardware profileHardware profileYes (subject to CUDA and driver requirements)
AMD GPUCU slicingInstinct / ROCm; see guideStableMemory quotaCU shareYes
AWS NeuronWhole device / core allocationInferentia / Trainium; see guideStableNo separate quota interfaceNeuronCore allocationNo (multi-device requests allocate all cores on each device)
Biren GPUWhole device / pre-partitioned SVIBiren166MStableFixed SVI partitionsFixed SVI partitionsYes (pre-partitioned SVI instances)
Cambricon MLUDynamic SMLU370, 590StableMemory quotaCore quotaNo
Enflame GCUDRSS60StableProfile-based allocationProfile-based allocationNo
Ascend NPUtemplate910A, 910B series, 910C, 310PStableTemplate-based allocationDetermined by templateNo
Ascend NPUhami-coreDepends on model and runtime; see guideStableMemory quotaCompute quotaYes
Hygon DCUDynamic vDCU partitioningAllStableMemory quotaCompute shareNo
Iluvatar GPUvGPU (gpu-manager)MR-V100, MR-V50, BI-V150, BI-V100StableMemory quotaCore quotaNo
Kunlunxin XPUVXPUP800-OAMStablePartition sizeDetermined by partition sizeYes
MetaX GPUsGPUMXC500StableMemory quotaDepends on QoSYes (not supported with sgpu-app-class)
Mthreads GPUsGPUMTT S4000StableDiscrete memory sizesCore quotaNo
Teco GPU (Tecorigin)Core allocation (in development)To be confirmedExperimentalTo be validatedTo be validatedTo be validated
Vastai GPUWhole card / Die allocationVA16StableWhole card or Die allocationWhole card or Die allocationYes (Die allocation)

Stable means available in v2.10.0. Experimental means the integration is still in development or validation and is not part of the released support in v2.10.0.

Teco is not included in v2.10.0. Device models and capabilities remain to be validated. Track subsequent integration work in HAMi #3369 and documentation PR #979.

Capability columns:

  • Memory control: The memory quota or partition size that a container can request. Templates and fixed partition sizes round memory allocations up to the corresponding size.
  • Compute control: Devices control compute resources through time slices, core allocation, hardware partitions, or QoS policies. See the linked references in the table for limitations.
  • Multi-card partitioning: A single container can allocate resources across multiple physical devices while using only part of the resources on some of those devices. Allocating only whole devices does not count as multi-card partitioning. See the linked references for allocation granularity and limitations. N/A means the mode allocates whole devices only.

Component integration guides​

For NVIDIA sharing, Volcano vGPU and KAI Scheduler retain their own scheduling capabilities and use HAMi-core for runtime isolation; the KAI Scheduler integration provides memory isolation. HAMi-DRA works with the Kubernetes scheduler through DRA drivers; its NVIDIA sharing path uses HAMi-core to enforce memory and compute limits at runtime.

The table below links to device and scheduling component integration guides, including installation steps, configuration requirements, and limitations. - means no guide is available.

ManufacturerHAMiHAMi-DRAVolcanoKAI-scheduler
NVIDIAAllocate device memoryDynamic Resource AllocationUse Volcano vGPUUse KAI Scheduler
CambriconEnable Cambricon MLU sharing---
HygonEnable Hygon DCU sharing---
Huawei AscendEnable Huawei Ascend sharing-Volcano Ascend vNPU-
IluvatarEnable Iluvatar GPU sharing---
MthreadsEnable Mthreads GPU sharing---
MetaXEnable MetaX GPU sharing---
EnflameEnable Enflame GCU sharing---
KunlunxinWhole-device scheduling · VXPU sharing---
Teco (Tecorigin)----
VastaiEnable Vastai sharing---
AMDEnable AMD GPU sharing---
AWSManage AWS Neuron devices---
BirenEnable Biren sharing---

Device documentation index​

NVIDIA​

Cambricon​

Hygon​

Mthreads​

Iluvatar​

Enflame​

AMD​

AWS Neuron​

Vastai​

Biren​

Kunlunxin​

MetaX​

Huawei Ascend​

CNCFHAMi is a CNCF Incubating project