|
--- |
|
language: |
|
- en |
|
license: apache-2.0 |
|
tags: |
|
- not-for-all-audiences |
|
datasets: |
|
- Intel/orca_dpo_pairs |
|
- athirdpath/DPO_Pairs-Roleplay-Alpaca-NSFW |
|
- Open-Orca/SlimOrca |
|
- MinervaAI/Aesir-Preview |
|
- allenai/ultrafeedback_binarized_cleaned |
|
--- |
|
# GALAXY-16B-v1.0 |
|
|
|
 |
|
|
|
## Technical notes |
|
- 72 layers,DUS procedure, mistral(32)->SOLAR(48)->GALAXY(72) |
|
- 16B parameters |
|
- model created as a extension of depth upscaling procedure used for SOLAR by upstage |
|
|
|
## Results |
|
- model can and will produce NSFW content |
|
- waiting for eval results |
