Commerce-Rerank-Qwen3-8B-LoRA

🇰🇷 Korean card: MODEL_CARD.ko.md

These are the LoRA adapter weights that were merged to build ThakiCloud/Commerce-Rerank-Qwen3-8B. They are published so the training can be reproduced, and so the model can be loaded as an adapter instead of as merged weights. Intended use, training data, evaluation and limitations are documented on the merged model's card. This repo does not change any of them.

Stages

#	stage	where	trained on	r / alpha
1	lora	repo root	Qwen/Qwen3-Reranker-8B	16 / 32

There is one stage.

How to use

import torch
from transformers import AutoModelForCausalLM
from peft import PeftModel

model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen3-Reranker-8B", torch_dtype=torch.bfloat16)
model = PeftModel.from_pretrained(model, "ThakiCloud/Commerce-Rerank-Qwen3-8B-LoRA").merge_and_unload()  # stage 1: lora

How we checked these are the right adapters

For 4 randomly chosen LoRA target tensors we compared the published merged weights minus Qwen/Qwen3-Reranker-8B with the adapter deltas (scale x B x A). The median cosine is 0.985. Rounding the merged weights to bf16 keeps it below 1; an adapter that was not used scores about 0.

Notes

• adapter_config.json names the public model each stage was trained on. Training used a local copy of the same weights, and the adapter weights are unchanged.

License

Same as ThakiCloud/Commerce-Rerank-Qwen3-8B: apache-2.0.