HAMi-core design
Introduction
HAMi-core is a hook library for CUDA environment, it is the in-container gpu resource controller, it has beed adopted by HAMi, volcano
Features
HAMi-core has the following features:
- Virtualize device meory
Limit device utilization by self-implemented time shard
Real-time device utilization monitor
Design
HAMi-core operates by Hijacking the API-call between CUDA-Runtime(libcudart.so) and CUDA-Driver(libcuda.so), as the figure below:
