Abhinav Kulkarni
commited on
Commit
•
bd30822
1
Parent(s):
ba66a0b
Updated README
Browse files
README.md
CHANGED
|
@@ -18,7 +18,7 @@ July 5, 2023
|
|
| 18 |
|
| 19 |
## Model License
|
| 20 |
|
| 21 |
-
Please refer to original
|
| 22 |
|
| 23 |
Please refer to the AWQ quantization license ([link](https://github.com/llm-awq/blob/main/LICENSE)).
|
| 24 |
|
|
@@ -40,6 +40,7 @@ git clone https://github.com/mit-han-lab/llm-awq \
|
|
| 40 |
```
|
| 41 |
|
| 42 |
```python
|
|
|
|
| 43 |
import torch
|
| 44 |
from awq.quantize.quantizer import real_quantize_model_weight
|
| 45 |
from transformers import AutoModelForCausalLM, AutoConfig, AutoTokenizer, TextStreamer
|
|
|
|
| 18 |
|
| 19 |
## Model License
|
| 20 |
|
| 21 |
+
Please refer to original Open Llama model license ([link](https://huggingface.co/VMware/open-llama-13b-open-instruct)).
|
| 22 |
|
| 23 |
Please refer to the AWQ quantization license ([link](https://github.com/llm-awq/blob/main/LICENSE)).
|
| 24 |
|
|
|
|
| 40 |
```
|
| 41 |
|
| 42 |
```python
|
| 43 |
+
import time
|
| 44 |
import torch
|
| 45 |
from awq.quantize.quantizer import real_quantize_model_weight
|
| 46 |
from transformers import AutoModelForCausalLM, AutoConfig, AutoTokenizer, TextStreamer
|