Instructions to use HATAFUNDING/HATA-LLM-Qwen-32B-Merged-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use HATAFUNDING/HATA-LLM-Qwen-32B-Merged-4bit with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("HATAFUNDING/HATA-LLM-Qwen-32B-Merged-4bit", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Unsloth Desktop
Uploaded finetuned model
- Developed by: HATAFUNDING
- License: apache-2.0
- Finetuned from model : unsloth/Qwen2.5-32B-Instruct-bnb-4bit
This qwen2 model was trained 2x faster with Unsloth and Huggingface's TRL library.
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for HATAFUNDING/HATA-LLM-Qwen-32B-Merged-4bit
Base model
Qwen/Qwen2.5-32B Finetuned
Qwen/Qwen2.5-32B-Instruct Quantized
unsloth/Qwen2.5-32B-Instruct-bnb-4bit