GitHub repository: Jye-525/SmartOffload
Primary language: Python
Description: Smartly offloading model weights to increase the inference performance and balance the trade-off between compute and memory