dranger003
/

dbrx-instruct-iMat.GGUF

Text Generation

Model card Files Files and versions Community

dranger003 commited on Apr 13

Commit

c8e1842

•

1 Parent(s): 444460a

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -7,7 +7,7 @@ pipeline_tag: text-generation
 base_model: databricks/dbrx-instruct
 ---
 **2024-04-12**: Support for this model is still being worked on - [`PR #6515`](https://github.com/ggerganov/llama.cpp/pull/6515).
-Testing of the quants appears to currently work, however the PR has not yet been merged.
 * GGUF importance matrix (imatrix) quants for https://huggingface.co/databricks/dbrx-instruct
 * The importance matrix is trained for ~100K tokens (200 batches of 512 tokens) using [wiki.train.raw](https://huggingface.co/datasets/wikitext).

 base_model: databricks/dbrx-instruct
 ---
 **2024-04-12**: Support for this model is still being worked on - [`PR #6515`](https://github.com/ggerganov/llama.cpp/pull/6515).
+Testing of the quants appears to currently work and the PR has been approved but has not yet been merged into the main branch.
 * GGUF importance matrix (imatrix) quants for https://huggingface.co/databricks/dbrx-instruct
 * The importance matrix is trained for ~100K tokens (200 batches of 512 tokens) using [wiki.train.raw](https://huggingface.co/datasets/wikitext).