icefog72/IceDrinkNameGoesHereV0RP-7b-Model_Stock

IceDrinkNameGoesHereRP-7b-Model_Stock

This is a merge of pre-trained language models created using mergekit.

Updates:

14.09.24 : "rope_theta": 1000000 -> 40000

Merge Method

This model was merged using the Model Stock merge method using mistralai\Mistral-7B-Instruct-v0.2 as a base.

Models Merged

The following models were included in the merge:

• icefog72\IceSomeDrinkNameHereRP-7b-Della
• icefog72\IceTea21EnergyDrinkRPV13-DPOv3.5

Configuration

The following YAML configuration was used to produce this model:

models:
- model: mistralai\Mistral-7B-Instruct-v0.2
- model: icefog72\IceTea21EnergyDrinkRPV13-DPOv3.5
- model: icefog72\IceSomeDrinkNameHereRP-7b-Della
merge_method: model_stock
base_model: mistralai\Mistral-7B-Instruct-v0.2
dtype: bfloat16