jorgedelpozolerida/medX_v2-Q4_K_M-GGUF
Updated
β’
1
Yes, I have tried them but I felt like it wasn't quite there yet, what were your thoughts on it? I have somewhat decent hardware but it takes a long time to get to the final answer on the distilled models.
We need more affordable hardware first, most people aren't locally running a 685B model, and if they are it's usually slow.
Can you guys please stick to using one huggingface account?