Model: cyankiwi/Hermes-4-70B-AWQ-8bit
Author: cyankiwi
Pipeline: text-generation
Library: transformers
Tags: transformers, safetensors, llama, text-generation, Llama-3.1, instruct, finetune, reasoning, hybrid-mode, chatml, function calling, tool use, json mode, structured outputs, atropos, dataforge, long context, roleplaying, chat, conversational, en, arxiv:2508.18255, base_model:NousResearch/Hermes-4-70B, base_model:quantized:NousResearch/Hermes-4-70B, license:llama3, text-generation-inference, endpoints_compatible, compressed-tensors, region:us
Base models (quantized): id: NousResearch/Hermes-4-70B
Card metadata: base_model: NousResearch/Hermes-4-70B
language: en
library_name: transformers
license: llama3
pipeline_tag: text-generation
tags: Llama-3.1, instruct, finetune, reasoning, hybrid-mode, chatml, function calling, tool use, json mode, structured outputs, atropos, dataforge, long context, roleplaying, chat
widget: example_title: Hermes 4
messages: system: You are Hermes 4, a capable, neutrally-aligned assistant. Prefer concise, correct answers., user: Explain the difference between BFS and DFS to a new CS student.
model-index: name: Hermes-4-Llama-3.1-70B
Likes: 1 | All-time downloads: 369
Created: 2025-08-27 12:52:54