Isaak-Carter
/

dolphin-2.8-gemma-2b_gguf

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

Isaak-Carter commited on Mar 29

Commit

32051a9

•

1 Parent(s): c569d7b

Update README.md

Files changed (1) hide show

README.md +4 -1

README.md CHANGED Viewed

	@@ -1 +1,4 @@
1	- I ~~tried it and it's bad.~~

+# IMPORTANT!!!!!
+This gguf model is outputting in latin. probably because quantization it self is wrong.
+I will later quantize it with Apples mlx framework the model will then be in .safetensors format.