brittlewis12's picture
Create README.md
5851db5 verified
metadata
license: other
base_model: Qwen/Qwen1.5-0.5B
datasets:
  - teknium/OpenHermes-2.5
language:
  - en
model_creator: minghaowu
model_name: Qwen1.5-0.5B-OpenHermes-2.5
model_type: qwen
inference: false
pipeline_tag: text-generation
prompt_template: |
  <|im_start|>system
  {{system_message}}<|im_end|>
  <|im_start|>user
  {{prompt}}<|im_end|>
  <|im_start|>assistant
quantized_by: brittlewis12

Qwen1.5-0.5B-OpenHermes-2.5 GGUF

Original model: Qwen1.5-0.5B-OpenHermes-2.5 Model creator: minghaowu

This repo contains GGUF format model files for minghaowu’s Qwen1.5-0.5B-OpenHermes-2.5.

This model is a fine-tuned version of Qwen/Qwen1.5-0.5B on the teknium/OpenHermes-2.5 dataset.

What is GGUF?

GGUF is a file format for representing AI models. It is the third version of the format, introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp. Converted using llama.cpp b2116 (f026f81)

Prompt template: ChatML

  <|im_start|>system
  {{system_message}}<|im_end|>
  <|im_start|>user
  {{prompt}}<|im_end|>
  <|im_start|>assistant

Download & run with cnvrs on iPhone, iPad, and Mac!

cnvrs.ai

cnvrs is the best app for private, local AI on your device:

  • create & save Characters with custom system prompts & temperature settings
  • download and experiment with any GGUF model you can find on HuggingFace!
  • make it your own with custom Theme colors
  • powered by Metal ⚡️ & Llama.cpp, with haptics during response streaming!
  • try it out yourself today, on Testflight!
  • follow cnvrs on twitter to stay up to date