Hugging Face's logo

Spaces:
optimum
/
llm-perf-leaderboard
Running

App Files Community
37
llm-perf-leaderboard
File size: 660 Bytes 
9f82a2b
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
 
- machine: 1xA10
  description: A10-24GB-150W 🖥️
  hardware_type: cuda
  subsets:
    - unquantized
    - awq
    - bnb
    - gptq
  backends:
    - pytorch

- machine: 1xA100
  description: A100-80GB-275W 🖥️
  hardware_type: cuda
  subsets:
    - unquantized
    - awq
    - bnb
    - gptq
  backends:
    - pytorch

- machine: 1xT4
  description: T4-16GB-70W 🖥️
  hardware_type: cuda
  subsets:
    - unquantized
    - awq
    - bnb
    - gptq
  backends:
    - pytorch

- machine: c7i
  description: 4th-Gen-Intel-Xeon-385W 🖥️
  hardware_type: intel
  subsets:
    - unquantized
  backends:
    - pytorch
    - onnxruntime
    - openvino