pytorch
/

gemma-3-12b-it-AWQ-INT4

Image-Text-to-Text

text-generation-inference

Model card Files Files and versions

jerryzh168 commited on Sep 29

Commit

7363f45

·

verified ·

1 Parent(s): fb96386

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -220,7 +220,7 @@ We rely on [lm-evaluation-harness](https://github.com/EleutherAI/lm-evaluation-h
 | Benchmark                        |                        |                                |                                 |
 |----------------------------------|------------------------|--------------------------------|---------------------------------|
 |                                  | google/gemma-3-12b-it  | jerryzh168/gemma-3-12b-it-INT4 | pytorch/gemma-3-12b-it-AWQ-INT4 |
-| philosophy                       | 79.10                  |     75.56                      | 76.85                            |
 Note: jerryzh168/gemma-3-12b-it-INT4 is the H100 optimized checkpoint for INT4

 | Benchmark                        |                        |                                |                                 |
 |----------------------------------|------------------------|--------------------------------|---------------------------------|
 |                                  | google/gemma-3-12b-it  | jerryzh168/gemma-3-12b-it-INT4 | pytorch/gemma-3-12b-it-AWQ-INT4 |
+| philosophy                       | 79.10                  |     75.56                      | 76.85                           |
 Note: jerryzh168/gemma-3-12b-it-INT4 is the H100 optimized checkpoint for INT4