Qwen2-7B-embed-base

This is a base model derived from Qwen2.5-7B-Instruct with the language modeling head removed. It's intended to be used as a base for embedding tasks and further fine-tuning.

Model Details

  • Base model: Qwen2.5-7B-Instruct
  • The 'lm_head' layer has been removed
  • Maintains the original model's norm layers
  • Suitable for embedding tasks and custom head additions
Downloads last month
18
Safetensors
Model size
7.07B params
Tensor type
FP16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support