Llama-3-11.5B-V2 / README.md
rombodawg's picture
Update README.md
ef7dcb3 verified
|
raw
history blame contribute delete
No virus
708 Bytes
metadata
license: other
license_name: llama-3
license_link: https://llama.meta.com/llama3/license/

Llama-3-11.5B-v2

Thank you to Meta for the weights for Meta-Llama-3-8B

image/png

This is an upscaling of the Meta-Llama-3-8B Ai using techniques created for chargoddard/mistral-11b-slimorca. This Ai model has been upscaled from 8b parameters to 11.5b parameters without any continuous pretraining or fine-tuning.

Unlike version 1 this model has no issues at fp16 or any quantizations.

The model that was used to create this one is linked below:

https://huggingface.co/meta-llama/Meta-Llama-3-8B