Heterogeneous Management
Manage and schedule GPU, NPU, MLU, and other accelerators in one workflow.
CNCF:Â SandboxLatest Release:Â v2.8.0
Heterogeneous GPU Sharing on Kubernetes
HAMi is an open-source, cloud-native GPU virtualization middleware that brings sharing, isolation and scheduling of heterogeneous accelerators to AI workloads on Kubernetes.
GPU SlicingHeterogeneous AcceleratorsKubernetes-native Scheduling
AI Workloads
LLM
ML
HPC
Kubernetes Scheduling Ecosystem
Virtualization âĸ Sharing âĸ Isolation âĸ Scheduling
GPU
1/2
1/4
1/N
Heterogeneous Accelerators
and more...
CNCF Sandbox Project
HAMi is a CNCF Sandbox project
HAMi is a Sandbox project of the Cloud Native Computing Foundation (CNCF), listed in both the CNCF Landscape and the CNAI Landscape.
Why HAMi
Hard Isolation
Slice memory and compute precisely with hard isolation at runtime.
Advanced scheduling
Use binpack, spread, and topology-aware policies for better placement.
Kubernetes native
Work with Kubernetes APIs, DRA, and CDI for easier adoption.
Resource Isolation & QoS
Control memory and core quotas for fairer and more stable sharing.
Unified Monitoring
Provide consistent metrics and visibility across device vendors.
Architecture & How It Works
From request to isolation, HAMi turns GPU slicing and heterogeneous scheduling into usable Kubernetes runtime paths.
HAMi Runtime Mechanism
PodSpec + Device Plugin / DRA + CDI
Control Plane
Decision pathData Plane
Enforcement Pathnvidia.com/gpu+gpumem/gpucoresBefore and After Using HAMi
Compare traditional whole-GPU allocation with HAMi GPU sharing under the same workloads.
Ecosystem & Device Support
Broad accelerator ecosystem across vendors. See docs for full support matrix.
Adopters
The organizations below are evaluating or using HAMi in production environments.
Join the adopters list
Submit your organization through the contributor guide process.
See submission instructions âContributors
HAMi is advanced by contributors from the community and industry. These organizations actively participate in project development and ecosystem collaboration.
Global Community Metrics
A live snapshot of HAMi community growth and open-source momentum.
