LLama-3-3x8b-multilingual

This model is MoE merge of following three models

namespace-Pt/Llama-3-8B-Instruct-80K-QLoRA-Merged
meta-llama/Meta-Llama-3-8B-Instruct
lightblue/suzume-llama-3-8B-multilingual

The model has context length of 80k.

Downloads last month: 6

Safetensors

Model size

19.3B params

Tensor type

BF16

Inference API

Text Generation

This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for Souvik3333/Llama-3-3x8B-multilingual

Quantizations

2 models