Edit model card

Model Card for TarsDolly

Model Details

TarsDolly is FT on HuggingFaceH4/zephyr-7b-alpha using Dolly-15k dataset for general chat.

Dolly-15k dataset was converted into chatml style for futher FT on zephyr-7b-beta model

epochs 4 batch_size 1 block_size 2096 lr 2e-4

Safetensors

Model size

7.24B params

Tensor type

BF16

Inference Examples

Inference API (serverless) does not yet support adapter-transformers models for this pipeline type.