metadata

license: llama3.2

MedIT SUN 2.4B

Base Model

Llama 3.2 1B

Extended Size

1B to 2.4B parameters

Extension Method

Proprietary technique developed by MedIT Solutions

Fine-tuning

Open conversation datasets
Open SFT datasets

Training Status

In progress
Current checkpoint: 26000
Note: Model is still in the training phase

Key Features

Built on Llama 3.2 architecture
Expanded from 1B to 2.4B parameters
Optimized for open-ended conversations
Incorporates supervised fine-tuning for improved performance

Use Case

General conversation and task-oriented interactions

Limitations As the model is still in training, performance and capabilities may vary. Users should be aware that the model is not in its final form and may exhibit inconsistencies or limitations typical of in-progress AI models.