Text Generation
GGUF
English
creative
creative writing
fiction writing
plot generation
sub-plot generation
story generation
scene continue
storytelling
fiction story
science fiction
romance
all genres
story
writing
vivid prosing
vivid writing
fiction
roleplaying
bfloat16
swearing
rp
horror
mistral nemo
mergekit
Inference Endpoints
conversational
Update README.md
Browse files
README.md
CHANGED
@@ -80,6 +80,8 @@ Here is the Bfloat16 repo (with a link to the Imatrix versions too) of this mode
|
|
80 |
|
81 |
I suggest downloading the same quant(s) of the "Bfloat16" and "Float32" version and compare the two for your use case(s).
|
82 |
|
|
|
|
|
83 |
The Imatrix versions of this model have even lower perplexity (1/2 level of magnitude lower than this model, 1 full level of magnitude
|
84 |
lower than LLama3 Instruct) then both this model and Llama3 Instruct and enhanced output.
|
85 |
|
|
|
80 |
|
81 |
I suggest downloading the same quant(s) of the "Bfloat16" and "Float32" version and compare the two for your use case(s).
|
82 |
|
83 |
+
Note the "character" of each model differs too.
|
84 |
+
|
85 |
The Imatrix versions of this model have even lower perplexity (1/2 level of magnitude lower than this model, 1 full level of magnitude
|
86 |
lower than LLama3 Instruct) then both this model and Llama3 Instruct and enhanced output.
|
87 |
|