rozek commited on
Commit
f116704
1 Parent(s): 0859069

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -4
README.md CHANGED
@@ -75,9 +75,9 @@ python3 convert.py ../LLaMA-2-7B-32K
75
  ./quantize ../LLaMA-2-7B-32K/ggml-model-f16.gguf \
76
  ../LLaMA-2-7B-32K/LLaMA-2-7B-32K-Q4_0.gguf Q4_0
77
  ```
78
- 11. run any quantizations you need and stop the container when finished (you may even delete it as the
79
- generated files will remain available on your host computer)
80
- 12. the `basic-python` image may also be deleted unless you plan to use it again in the near future
81
 
82
  You are now free to move the quanitization results to where you need them and run inferences with context
83
  lengths up to 32K (depending on the amount of memory you will have available - long contexts need an awful
@@ -87,7 +87,7 @@ lot of RAM)
87
 
88
  Concerning the license(s):
89
 
90
- * the [original model](https://ai.meta.com/llama/) (from Meta AI) was released under a rather [permittive
91
  license](https://ai.meta.com/llama/license/)
92
  * the fine tuned model from Together Computer uses the
93
  [same license](https://huggingface.co/togethercomputer/LLaMA-2-7B-32K/blob/main/README.md)
 
75
  ./quantize ../LLaMA-2-7B-32K/ggml-model-f16.gguf \
76
  ../LLaMA-2-7B-32K/LLaMA-2-7B-32K-Q4_0.gguf Q4_0
77
  ```
78
+ 11. run any quantizations you need and stop the container when finished (the container will automatically
79
+ be deleted deleted but the generated files will remain available on your host computer)
80
+ 12. the `basic-python` image may also be deleted (manually) unless you plan to use it again in the near future
81
 
82
  You are now free to move the quanitization results to where you need them and run inferences with context
83
  lengths up to 32K (depending on the amount of memory you will have available - long contexts need an awful
 
87
 
88
  Concerning the license(s):
89
 
90
+ * the [original model](https://ai.meta.com/llama/) (from Meta AI) was released under a rather [permissive
91
  license](https://ai.meta.com/llama/license/)
92
  * the fine tuned model from Together Computer uses the
93
  [same license](https://huggingface.co/togethercomputer/LLaMA-2-7B-32K/blob/main/README.md)