Model: PrunaAI/mattshumer-Hermes-2-Pro-11B-GPTQ-8bit
Author: PrunaAI
Library: pruna-engine
Tags: pruna-engine, safetensors, mistral, 8-bit, gptq, region:us
Card metadata: library_name: pruna-engine
thumbnail: https://assets-global.website-files.com/646b351987a8d8ce158d1940/64ec9e96b4334c0e1ac41504_Logo%20with%20white%20text.svg
metrics: memory_disk, memory_inference, inference_latency, inference_throughput, inference_CO2_emissions, inference_energy_consumption
Likes: 0 | All-time downloads: 233
Created: 2024-03-27 07:26:32