Artex Coder 7B

Artex is a concise, accurate, to-the-point coding assistant, fine-tuned from Qwen2.5-Coder-7B-Instruct. It answers in the user's language.

Usage

from transformers import AutoModelForCausalLM, AutoTokenizer

repo = "0XARTEX/artex-coder-7b"
tokenizer = AutoTokenizer.from_pretrained(repo)
model = AutoModelForCausalLM.from_pretrained(repo, torch_dtype="auto", device_map="auto")

messages = [{"role": "user", "content": "Write a Python function that checks if a string is a palindrome."}]
inputs = tokenizer.apply_chat_template(messages, add_generation_prompt=True, return_tensors="pt").to(model.device)
output = model.generate(inputs, max_new_tokens=512)
print(tokenizer.decode(output[0][inputs.shape[1]:], skip_special_tokens=True))

Training

Base model Qwen/Qwen2.5-Coder-7B-Instruct (bf16)
Method LoRA (r=16, alpha=32, all linear layers), merged into the base weights
Data 4,000 samples from Magicoder-OSS-Instruct-75K (MIT) + Artex identity conversations (EN/ID)
Loss completion-only (assistant replies)
Epochs 2, lr 1e-4 cosine, effective batch 16, max length 2048
Hardware 1× NVIDIA H100 80GB, ~18 minutes
Validation loss 0.286 → 0.172

Limitations

  • No standardized benchmark (HumanEval, MBPP) has been run yet; quality is expected to be close to the base model.
  • Like any LLM, Artex can produce incorrect or insecure code. Review its output before using it.

License

Apache 2.0, the same as the base model. The training data from Magicoder-OSS-Instruct-75K is MIT-licensed.

surplus-launcher: 0xab3fA342FEa0d30f99fEF14B3DdBa7bEc363729D

Downloads last month
-
Safetensors
Model size
8B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for 0XARTEX/artex-coder-7b

Base model

Qwen/Qwen2.5-7B
Finetuned
(472)
this model

Dataset used to train 0XARTEX/artex-coder-7b