Hugging Face model: PrunaAI/JackFram-llama-68m-bnb-4bit-smashed
Author: PrunaAI
Created: 2024-04-03 09:12:19
Last modified: 2026-03-25 16:46:03
Library: pruna-ai
Likes: 0 | Downloads: 10
Tags: pruna-ai, safetensors, llama, base_model:JackFram/llama-68m, base_model:quantized:JackFram/llama-68m, 4-bit, bitsandbytes, region:us
Base model relation: quantized
Base models: id: JackFram/llama-68m
Card metadata:
base_model: JackFram/llama-68m
metrics: memory_disk, memory_inference, inference_latency, inference_throughput, inference_CO2_emissions, inference_energy_consumption
tags: pruna-ai