Model: PrunaAI/llama-moe-LLaMA-MoE-v1-3_0B-2_16-bnb-4bit-smashed
Author: PrunaAI
Library: pruna-ai
Tags: pruna-ai, safetensors, llama_moe, custom_code, base_model:llama-moe/LLaMA-MoE-v1-3_0B-2_16, base_model:quantized:llama-moe/LLaMA-MoE-v1-3_0B-2_16, 4-bit, bitsandbytes, region:us
Base models (quantized): id: llama-moe/LLaMA-MoE-v1-3_0B-2_16
Card metadata: thumbnail: https://assets-global.website-files.com/646b351987a8d8ce158d1940/64ec9e96b4334c0e1ac41504_Logo%20with%20white%20text.svg
base_model: llama-moe/LLaMA-MoE-v1-3_0B-2_16
metrics: memory_disk, memory_inference, inference_latency, inference_throughput, inference_CO2_emissions, inference_energy_consumption
tags: pruna-ai
Likes: 0 | All-time downloads: 151
Created: 2024-06-27 08:19:31