GitHub repository: sanowl/Efficient-LLM-Scheduling-by-Learning-to-Rank
Primary language: Python
Created: 2024-09-03T09:13:25Z
Description: This project implements an efficient scheduling system for Large Language Model (LLM) inference, as described in the paper "Efficient LLM Scheduling by Learning to Rank"