Transformers
mpt
Composer
MosaicML
llm-foundry
text-generation-inference
TheBloke commited on
Commit
4ab4293
1 Parent(s): 795af01

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -0
README.md CHANGED
@@ -51,6 +51,7 @@ Please note that these MPT GGMLs are **not compatbile with llama.cpp**. Please s
51
  These files are **not** compatible with llama.cpp.
52
 
53
  Currently they can be used with:
 
54
  * The ctransformers Python library, which includes LangChain support: [ctransformers](https://github.com/marella/ctransformers)
55
  * The GPT4All-UI which uses ctransformers: [GPT4All-UI](https://github.com/ParisNeo/gpt4all-ui)
56
  * [rustformers' llm](https://github.com/rustformers/llm)
 
51
  These files are **not** compatible with llama.cpp.
52
 
53
  Currently they can be used with:
54
+ * KoboldCpp, a powerful inference engine based on llama.cpp, with good UI: [KoboldCpp](https://github.com/LostRuins/koboldcpp)
55
  * The ctransformers Python library, which includes LangChain support: [ctransformers](https://github.com/marella/ctransformers)
56
  * The GPT4All-UI which uses ctransformers: [GPT4All-UI](https://github.com/ParisNeo/gpt4all-ui)
57
  * [rustformers' llm](https://github.com/rustformers/llm)