Hugging Face model: cyankiwi/Hermes-4-70B-AWQ-8bit
Author: cyankiwi
Created: 2025-08-27 12:52:54
Last modified: 2026-07-21 18:30:03
Pipeline: text-generation
Library: transformers
Likes: 1 | Downloads: 15
Tags: transformers, safetensors, llama, text-generation, Llama-3.1, instruct, finetune, reasoning, hybrid-mode, chatml, function calling, tool use, json mode, structured outputs, atropos, dataforge, long context, roleplaying, chat, conversational, en, arxiv:2508.18255, base_model:NousResearch/Hermes-4-70B, base_model:quantized:NousResearch/Hermes-4-70B, license:llama3, text-generation-inference, endpoints_compatible, compressed-tensors, region:us
Base model relation: quantized
Base models: id: NousResearch/Hermes-4-70B
Card metadata:
base_model: NousResearch/Hermes-4-70B
language: en
library_name: transformers
license: llama3
pipeline_tag: text-generation
tags: Llama-3.1, instruct, finetune, reasoning, hybrid-mode, chatml, function calling, tool use, json mode, structured outputs, atropos, dataforge, long context, roleplaying, chat