Hugging Face model: hailsbop/mistral7BXHV2L
Author: hailsbop
Created: 2025-11-15 15:35:12
Last modified: 2025-11-15 16:00:31
Pipeline: text-generation
Likes: 0 | Downloads: 3
Tags: safetensors, mistral, merge, lora, text-generation, conversational, en, base_model:mistralai/Mistral-7B-Instruct-v0.2, base_model:adapter:mistralai/Mistral-7B-Instruct-v0.2, license:apache-2.0, 4-bit, bitsandbytes, region:us
Base model relation: adapter
Base models: id: mistralai/Mistral-7B-Instruct-v0.2
Card metadata:
model_name: mistral-base
tokenizer_name: mistral-base
lora: r: 32
alpha: 64
dropout: 0.05
target_modules: q_proj, k_proj, v_proj, o_proj, gate_proj, up_proj, down_proj
training: output_dir: ./lora-out
batch_size: 4
micro_batch_size: 1
gradient_accumulation_steps: 4
learning_rate: 0.0002
weight_decay: 0
warmup_ratio: 0.03
num_epochs: 3
max_grad_norm: 1
fp16: yes
dataset: path: ./data
field: text
shuffle: yes
num_workers: 4
generation: bos_token_id: 1
eos_token_id: 2
max_new_tokens: 256
temperature: 0.7
top_p: 0.9
logging: steps: 10
save_steps: 200
license: apache-2.0
language: en
base_model: mistralai/Mistral-7B-Instruct-v0.2
pipeline_tag: text-generation
tags: merge, lora