Experimental Test Model of Llama-3-8B (base)

Finetuned using the ChatML formatting. Only 50% of epoch 1 was done out of two epochs.

Extended to 1 Million context using the PoSE technique.

Downloads last month: 8

Safetensors

Model size

8.03B params

Tensor type

BF16

Text Generation

This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.