Update README.md
Browse files
README.md
CHANGED
@@ -1,6 +1,6 @@
|
|
1 |
-
AI Model Name: Llama 3
|
2 |
|
3 |
-
This is the result of running AutoAWQ to quantize the LLaMA-3
|
4 |
|
5 |
To launch an OpenAI-compatible API endpoint on your Linux server with 2x 3090 or 4090 GPUs:
|
6 |
|
|
|
1 |
+
AI Model Name: Llama 3 70B "Built with Meta Llama 3" https://llama.meta.com/llama3/license/
|
2 |
|
3 |
+
This is the result of running AutoAWQ to quantize the LLaMA-3 70B model to ~4 bits/parameter.
|
4 |
|
5 |
To launch an OpenAI-compatible API endpoint on your Linux server with 2x 3090 or 4090 GPUs:
|
6 |
|