GitHub repository: vladislavkruglikov/strawberry
Primary language: Python
Description: 🍓 Strawberry is large language models benchmark inference tool that allows to compare different inference servers and evaluate them under particular load conditions