MatrixC7
/

karakuri-lm-70b-v0.1-exl2

Text Generation

Model card Files Files and versions Community

MatrixC7 commited on Feb 3

Commit

0a94f11

•

1 Parent(s): be4fc94

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -15,7 +15,7 @@ tags:
 - llama-2
 ---
-This repository contains the exl2 quants of [karakuri-ai/karakuri-lm-70b-v0.1](https://huggingface.co/karakuri-ai/karakuri-lm-70b-v0.1).
 Compatible with [exllamav2](https://github.com/turboderp/exllamav2) version 0.0.11 and later. For optimal model loading, it is recommended to use [tabbyAPI](https://github.com/theroyallab/tabbyAPI).

 - llama-2
 ---
+This repository contains the exl2 quants of [karakuri-ai/karakuri-lm-70b-v0.1](https://huggingface.co/karakuri-ai/karakuri-lm-70b-v0.1), calibrated using [the default dataset built by exllamav2](https://github.com/turboderp/exllamav2/blob/3b0f5230e9619fc0ddf1f302785049d10a65fe26/conversion/tokenize.py#L55).
 Compatible with [exllamav2](https://github.com/turboderp/exllamav2) version 0.0.11 and later. For optimal model loading, it is recommended to use [tabbyAPI](https://github.com/theroyallab/tabbyAPI).