Hugging Face model: PrunaAI/LoneStriker-DeepSeek-R1-Distill-Llama-70B-8.0bpw-h8-exl2-GGUF-smashed
Author: PrunaAI
Created: 2025-02-02 22:24:27
Last modified: 2026-03-25 16:48:36
Library: pruna-ai
Likes: 0 | Downloads: 74
Tags: pruna-ai, gguf, base_model:LoneStriker/DeepSeek-R1-Distill-Llama-70B-8.0bpw-h8-exl2, base_model:quantized:LoneStriker/DeepSeek-R1-Distill-Llama-70B-8.0bpw-h8-exl2, endpoints_compatible, region:us, conversational
Base model relation: quantized
Base models: id: LoneStriker/DeepSeek-R1-Distill-Llama-70B-8.0bpw-h8-exl2
Card metadata:
base_model: LoneStriker/DeepSeek-R1-Distill-Llama-70B-8.0bpw-h8-exl2
metrics: memory_disk, memory_inference, inference_latency, inference_throughput, inference_CO2_emissions, inference_energy_consumption
tags: pruna-ai