---
language:
- en
license: apache-2.0
tags:
- not-for-all-audiences
datasets:
- Intel/orca_dpo_pairs
- athirdpath/DPO_Pairs-Roleplay-Alpaca-NSFW
- Open-Orca/SlimOrca
- MinervaAI/Aesir-Preview
- allenai/ultrafeedback_binarized_cleaned
---
# GALAXY-16B-v1.0

![image/png](https://huggingface.co/TeeZee/GALAXY-16B-v1.0/resolve/main/GALAXY-16B-v1.0.jpg)

## Technical notes
- 72 layers,DUS procedure, mistral(32)->SOLAR(48)->GALAXY(72)
- 16B parameters
- model created as a extension of depth upscaling procedure used for SOLAR by upstage

## Results
- model can and will produce NSFW content
- waiting for eval results