adamo1139/Qwen2.5-7B-Instruct-FP8-Dynamic_FP16-Vision
Updated
•
2
Edit Models filters
Inference Providers
Active filters:
compressed-tensors
adamo1139/Qwen2.5-7B-Sydney-FP8-Dynamic_FP16-Vision
Updated
•
4
noneUsername/Mistral-Small-Instruct-2409-abliterated-W8A8-Dynamic-Per-Token
Updated
•
9
adamo1139/Hermes-3-Llama-3.1-8B-Static-FP8-KV
Updated
•
6
adamo1139/Hermes-3-Llama-3.1-8B-Dynamic-FP8-KV
Updated
•
7
noneUsername/SuperNova-Medius-W8A8-Dynamic-Per-Token
Updated
•
7
•
1
flowaicom/Flow-Judge-v0.1-FP8
Updated
•
3
•
1
flowaicom/Flow-Judge-v0.1-W8A16
Updated
•
6
•
1
flowaicom/Flow-Judge-v0.1-W4A16
Updated
•
3
•
1
adamo1139/Hermes-3-Llama-3.1-8B_W8A8
Updated
•
2
leafspark/Llama-3.1-Nemotron-70B-Instruct-HF-FP8-Dynamic
Updated
•
6
daisd-ai/UniNER-W4A16
Updated
•
282
daisd-ai/anydef-v2-linear-W4A16
Updated
•
228
aleiko/NVLM-D-72B-w4a16
Updated
•
106
neuralmagic/Llama-3.1-Nemotron-70B-Instruct-HF-FP8-dynamic
Text Generation
•
Updated
•
906
•
14
nm-testing/MiniCPM-V-2_6-FP8-dynamic
Updated
•
31
nm-testing/Phi-3.5-vision-instruct-W8A8-Dynamic-Per-Token
Updated
•
23
noneUsername/Ministral-8B-Instruct-2410-HF-W8A8-Dynamic-Per-Token
Updated
•
7
noneUsername/TouchNight-Ministral-8B-Instruct-2410-HF-W8A8-Dynamic-Per-Token
Updated
•
4
CalamitousFelicitousness/Magnum-V4-72B-FP8-Dynamic
Text Generation
•
Updated
•
4
gmonair/Qwen2.5-Math-1.5B-Instruct-W8A8-Dynamic-Per-Token
Updated
•
2
gmonair/Qwen2.5-Math-1.5B-Instruct-W8A16
Updated
•
2
noneUsername/magnum-v4-22b-W8A8-Dynamic-Per-Token
Updated
•
17
gmonair/Qwen2.5-Math-7B-Instruct-W8A16
Updated
•
4
noneUsername/magnum-v4-12b-W8A8-Dynamic-Per-Token
Updated
•
3
nm-testing/SparseLlama-3-8B-pruned_50.2of4_Fp8-compressed
Updated
•
2
nm-testing/TinyLlama-1.1B-Chat-v1.0-pruned_50.2of4-FP8-compressed
Updated
•
12
•
1
nm-testing/TinyLlama-1.1B-Chat-v1.0-pruned_50.2of4-INT8-compressed
Updated
•
4
asabet/Llama-3.2-11B-Vision-Instruct-fp8-dynamic
Updated
•
3
PyrTools/Ministral-8B-Instruct-2410-FP8-Dynamic
Updated
•
4