Hugging Face's logo

IntraFind
/
Llama-3-SauerkrautLM-8b-16k-Instruct-AWQ

Text Generation
Transformers
Safetensors
llama
4-bit precision
AWQ
Inference Endpoints
conversational
text-generation-inference
awq
Model card Files Community
Llama-3-SauerkrautLM-8b-16k-Instruct-AWQ / README.md
br3no's picture
br3no
Adding model
dac67bb
preview code
|
raw
history blame contribute delete
No virus
643 Bytes
metadata
library_name: transformers
tags:
  - 4-bit
  - AWQ
  - text-generation
  - autotrain_compatible
  - endpoints_compatible
pipeline_tag: text-generation
inference: false
quantized_by: mayflowergmbh

VAGOsolutions/Llama-3-SauerkrautLM-8b-Instruct

This model is a variant of https://huggingface.co/mayflowergmbh/Llama-3-SauerkrautLM-8b-Instruct-AWQ extended to 16k context size by means of ROPE scaling.