Andrew Canis commited on
Commit
f5c0256
1 Parent(s): 01be733

Update with llama.cpp release

Browse files
Files changed (1) hide show
  1. README.md +5 -11
README.md CHANGED
@@ -12,17 +12,11 @@ license: cc-by-nc-4.0
12
  This repo contains llama.cpp GGUF format model files for
13
  [Command-R 35B v1.0](https://huggingface.co/CohereForAI/c4ai-command-r-v01).
14
 
15
- Note: you need to clone llama.cpp and compile until the
16
- [PR6033](https://github.com/ggerganov/llama.cpp/pull/6033) is merged upstream:
17
- ```
18
- git clone https://github.com/acanis/llama.cpp.git
19
- cd llama.cpp
20
- mkdir build
21
- cd build
22
- cmake .. -DLLAMA_CUBLAS=ON
23
- cmake --build . --config Release -- -j16
24
- cd ..
25
- ```
26
 
27
  ## F16 files are split and require joining
28
 
 
12
  This repo contains llama.cpp GGUF format model files for
13
  [Command-R 35B v1.0](https://huggingface.co/CohereForAI/c4ai-command-r-v01).
14
 
15
+ <!-- compatibility_gguf start -->
16
+ ## Compatibility
17
+
18
+ These quantised GGUF files are compatible with llama.cpp from Mar 16, 2024 onwards,
19
+ starting from release [b2440](https://github.com/ggerganov/llama.cpp/releases/tag/b2440)
 
 
 
 
 
 
20
 
21
  ## F16 files are split and require joining
22