Spaces:
Running
Running
TITLE = """<h1 align="center" id="space-title">π€ Open LLM-Perf Leaderboard</h1>""" | |
INTRODUCTION_TEXT = f""" | |
The π€ Open LLM-Perf Leaderboard aims to benchmark the performance (latency & throughput) of Large Language Models (LLMs) on different backends and hardwares using [Optimum-Benchmark](https://github.com/huggingface/optimum-benchmark) | |
π€ Anyone from the community can submit a model for automated benchmarking on the π€ GPU cluster, as long as it is a π€ Transformers model with weights on the Hub. We also support benchmarks of models with delta-weights for non-commercial licensed models, such as LLaMa. | |
""" | |