Model Details

dataset : DPO dataset (huggingface datasets, 2digit datasets 활용)

Training Method Method : DPO.

Usage

from transformers import AutoModelForCausalLM, AutoTokenizer
import torch
repo = "sdhan/SD_SOLAR_10.7B_v1.0"
model = AutoModelForCausalLM.from_pretrained(
        repo,
        return_dict=True,
        torch_dtype=torch.float16,
        device_map='auto'
)
tokenizer = AutoTokenizer.from_pretrained(repo)

Downloads last month: 2,184

Safetensors

Model size

10.7B params

Tensor type

FP16

Inference Examples

Text Generation

This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for sdhan/SD_SOLAR_10.7B_v1.0

Quantizations

2 models

sdhan
/

SD_SOLAR_10.7B_v1.0

Model tree for sdhan/SD_SOLAR_10.7B_v1.0

Spaces using sdhan/SD_SOLAR_10.7B_v1.0 5