Lab 11: KServe Inference with HAMi DRA GPU Sharing
Deploy a KServe Standard vLLM service and run two Predictor replicas on one NVIDIA GPU through native HAMi DRA claims.
3 docs tagged with "hami"
View all tagsLab 15: Run SGLang on HAMi GPU Shares
Install HAMi on a GPU cluster and schedule SGLang inference services with GPU partitioning.
Lab 5: Fake-GPU Scheduling with nvml-mock
Simulate 8 A100 GPUs with HAMi scheduling features, no real GPU needed.
