Stateful models for single GPU. https://docs.openvino.ai/2024/openvino-workflow/running-inference/stateful-models.html
Emerson Tatelbaum
Echo9Zulu
·
AI & ML interests
None yet
Organizations
None yet
Collections
2
models
22
Echo9Zulu/Grand-Horror-25B-Godzillas-Wicked-Sister-int8-ns-ov
Updated
•
4
Echo9Zulu/Gemma-The-Writer-9B-int8-ov
Updated
•
4
Echo9Zulu/Gemma-The-Writer-9B-fp16-ns-ov
Updated
•
4
Echo9Zulu/Gemma-The-Writer-9B-fp16-ov
Updated
•
6
Echo9Zulu/dolphincoder-starcoder2-15b-fp16-ov
Updated
•
4
Echo9Zulu/dolphincoder-starcoder2-15b-fp16-ns-ov
Updated
•
4
Echo9Zulu/Trinas_Nectar-8B-model_stock-fp16-ov
Updated
•
5
Echo9Zulu/dolphincoder-starcoder2-15b-int8-ns-ov
Updated
•
4
Echo9Zulu/Hermes-2-Theta-Llama-3-8B-int4-ov
Updated
•
3
Echo9Zulu/Qwen2.5-Coder-7B-Instruct-fp16-ov
Updated
•
3
datasets
None public yet