Evaluation results

Dataset	GPT-3.5	Tuned Llama 3 V1	Tuned Llama 3 V2
MMLU Clinical Knowledge	69.8	74.34	73.20
MMLU College Biology	72.2	72.92	74.30
MMLU College Medicine	61.3	61.85	66.47
MMLU Medical Genetics	70.0	76.0	74.0
MMLU Professional Medicine	70.2	72.43	71.32
MMLU Anatomy	56.3	61.48	64.44

Downloads last month: 15

Safetensors

Model size

4.65B params

Tensor type

FP16

F32

Text Generation

This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

MohamedAhmedAE
/

Llama3-8B-Medical-Finetune-V2-Merged

Evaluation results

Datasets used to train MohamedAhmedAE/Llama3-8B-Medical-Finetune-V2-Merged