Spaces:
Running
on
T4
Running
on
T4
liuhaotian
commited on
Commit
•
d1e2541
1
Parent(s):
f248b35
Update app.py
Browse files
app.py
CHANGED
@@ -342,12 +342,12 @@ title_markdown = """
|
|
342 |
|
343 |
ONLY WORKS WITH GPU!
|
344 |
|
345 |
-
You can load the model with
|
346 |
|
347 |
Recommended configurations:
|
348 |
-
| Hardware |
|
349 |
-
|
350 |
-
| **Bits** |
|
351 |
|
352 |
"""
|
353 |
|
|
|
342 |
|
343 |
ONLY WORKS WITH GPU!
|
344 |
|
345 |
+
You can load the model with 4-bit or 8-bit quantization to make it fit in smaller hardwares. Setting the environment variable `bits` to control the quantization.
|
346 |
|
347 |
Recommended configurations:
|
348 |
+
| Hardware | T4-Small (16G) | A10G-Medium (24G) | A100-Large (40G) |
|
349 |
+
|-------------------|-----------------|-------------------|------------------|
|
350 |
+
| **Bits** | 4 (default) | 8 | 16 |
|
351 |
|
352 |
"""
|
353 |
|