RichardErkhov
/

LDCC_-_LDCC-SOLAR-10.7B-4bits

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Edit model card

YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

Quantization made by Richard Erkhov.

Request more models

LDCC-SOLAR-10.7B - bnb 4bits

Model creator: https://huggingface.co/LDCC/
Original model: https://huggingface.co/LDCC/LDCC-SOLAR-10.7B/

Original model description:

license: cc-by-nc-4.0 language: - ko

Model Card for LDCC-SOLAR-10.7B

Developed by : Wonchul Kim (Lotte Data Communication AI Technical Team)

Hardware and Software

Hardware: We utilized an A100x4 * 1 for training our model
Training Factors: We fine-tuned this model using a combination of the DeepSpeed library and the HuggingFace TRL Trainer / HuggingFace Accelerate

Method

This model was trained using the learning method introduced in the SOLAR paper.

Base Model

yanolja/KoSOLAR-10.7B-v0.1 (This model is no longer supported due to a tokenizer issue.)

Caution

If you want to fine-tune this model, it is recommended to use the tokenizer.json and tokenizer_config.json files from revision v1.1.

Downloads last month: 10

Safetensors

Model size

5.79B params

Tensor type

F32

·

FP16

·

U8

·

Inference API

Text Generation

This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.