File size: 616 Bytes
d3139c4 c943659 d3139c4 c943659 d3139c4 c943659 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 |
---
language:
- en
license: apache-2.0
tags:
- not-for-all-audiences
datasets:
- Intel/orca_dpo_pairs
- athirdpath/DPO_Pairs-Roleplay-Alpaca-NSFW
- Open-Orca/SlimOrca
- MinervaAI/Aesir-Preview
- allenai/ultrafeedback_binarized_cleaned
---
# GALAXY-16B-v1.0
## Technical notes
- 72 layers,DUS procedure, mistral(32)->SOLAR(48)->GALAXY(72)
- 16B parameters
- model created as a extension of depth upscaling procedure used for SOLAR by upstage
## Results
- model can and will produce NSFW content
- waiting for eval results |