catid commited on
Commit
6274e0a
·
verified ·
1 Parent(s): fbc0638

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -1,6 +1,6 @@
1
- AI Model Name: Llama 3 8B "Built with Meta Llama 3" https://llama.meta.com/llama3/license/
2
 
3
- This is the result of running AutoAWQ to quantize the LLaMA-3 8B model to ~4 bits/parameter.
4
 
5
  To launch an OpenAI-compatible API endpoint on your Linux server with 2x 3090 or 4090 GPUs:
6
 
 
1
+ AI Model Name: Llama 3 70B "Built with Meta Llama 3" https://llama.meta.com/llama3/license/
2
 
3
+ This is the result of running AutoAWQ to quantize the LLaMA-3 70B model to ~4 bits/parameter.
4
 
5
  To launch an OpenAI-compatible API endpoint on your Linux server with 2x 3090 or 4090 GPUs:
6