Configuration Parsing Warning:In config.json: "quantization_config.modules_to_not_convert" must be an array

YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

Quantization made by Richard Erkhov.

Github

Discord

Request more models

tiny - AWQ

Original model description:

language: - en license: apache-2.0 tags: - text-generation-inference - transformers - unsloth - llama - trl base_model: unsloth/tinyllama-bnb-4bit

Uploaded model

  • Developed by: jaykchen
  • License: apache-2.0
  • Finetuned from model : unsloth/tinyllama-bnb-4bit

This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.

Downloads last month
23
Safetensors
Model size
1B params
Tensor type
I32
ยท
F16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support