---
base_model:
- IlyaGusev/gemma-2-9b-it-abliterated
---
Created with: 
```
from transformers import AutoModelForCausalLM
import torch

# 加载模型并解除共享
model = AutoModelForCausalLM.from_pretrained("IlyaGusev/gemma-2-9b-it-abliterated", tie_word_embeddings=False)

# 解除共享的 lm_head 和 embed_tokens 权重
model.lm_head.weight.data = model.model.embed_tokens.weight.data.clone()

# 将模型转换为 bf16 格式
model = model.to(dtype=torch.bfloat16)

# 指定保存路径
untied_model_dir = "mergekit/output"

# 保存解除共享且为 bf16 格式的模型
model.save_pretrained(untied_model_dir)
model.config.save_pretrained(untied_model_dir)
```
I didn't copy tokenizer from the original model, do it yourself if you want.