Update README.md
Browse files
README.md
CHANGED
@@ -75,9 +75,9 @@ python3 convert.py ../LLaMA-2-7B-32K
|
|
75 |
./quantize ../LLaMA-2-7B-32K/ggml-model-f16.gguf \
|
76 |
../LLaMA-2-7B-32K/LLaMA-2-7B-32K-Q4_0.gguf Q4_0
|
77 |
```
|
78 |
-
11. run any quantizations you need and stop the container when finished (
|
79 |
-
generated files will remain available on your host computer)
|
80 |
-
12. the `basic-python` image may also be deleted unless you plan to use it again in the near future
|
81 |
|
82 |
You are now free to move the quanitization results to where you need them and run inferences with context
|
83 |
lengths up to 32K (depending on the amount of memory you will have available - long contexts need an awful
|
@@ -87,7 +87,7 @@ lot of RAM)
|
|
87 |
|
88 |
Concerning the license(s):
|
89 |
|
90 |
-
* the [original model](https://ai.meta.com/llama/) (from Meta AI) was released under a rather [
|
91 |
license](https://ai.meta.com/llama/license/)
|
92 |
* the fine tuned model from Together Computer uses the
|
93 |
[same license](https://huggingface.co/togethercomputer/LLaMA-2-7B-32K/blob/main/README.md)
|
|
|
75 |
./quantize ../LLaMA-2-7B-32K/ggml-model-f16.gguf \
|
76 |
../LLaMA-2-7B-32K/LLaMA-2-7B-32K-Q4_0.gguf Q4_0
|
77 |
```
|
78 |
+
11. run any quantizations you need and stop the container when finished (the container will automatically
|
79 |
+
be deleted deleted but the generated files will remain available on your host computer)
|
80 |
+
12. the `basic-python` image may also be deleted (manually) unless you plan to use it again in the near future
|
81 |
|
82 |
You are now free to move the quanitization results to where you need them and run inferences with context
|
83 |
lengths up to 32K (depending on the amount of memory you will have available - long contexts need an awful
|
|
|
87 |
|
88 |
Concerning the license(s):
|
89 |
|
90 |
+
* the [original model](https://ai.meta.com/llama/) (from Meta AI) was released under a rather [permissive
|
91 |
license](https://ai.meta.com/llama/license/)
|
92 |
* the fine tuned model from Together Computer uses the
|
93 |
[same license](https://huggingface.co/togethercomputer/LLaMA-2-7B-32K/blob/main/README.md)
|