PrunaAI
/

Phi-3-mini-128k-instruct-GGUF-Imatrix-smashed

Inference Endpoints

Model card Files Files and versions Community

Resources

View closed (2)

Why is the generated content always the same when I use this model?

#7 opened 3 months ago by

Phi 3 tokenizer_config has been updated upstream

#6 opened 7 months ago by

Mistake in readme instructions

#5 opened 7 months ago by

gibberish results when context is greater 2048

#4 opened 7 months ago by

Do they work with ollama? How was the conversion done for 128K, llama.cpp/convert.py complains about ROPE.

#2 opened 7 months ago by