Llama-3-15b-StockTest

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the Model Stock merge method using athirdpath/Llama-3-15b-Instruct-GLUED as a base.

Models Merged

The following models were included in the merge:

• athirdpath/Llama-3-15b-Instruct-GLUED-Plus
• athirdpath/Llama-3-15b-OpenBioLexi-GLUED
• athirdpath/Llama-3-15b-Instruct-CoT
• athirdpath/Llama-3-15b-HermesPlaying-GLUED

Configuration

The following YAML configuration was used to produce this model:

  models:
    - model: athirdpath/Llama-3-15b-Instruct-GLUED-Plus
    - model: athirdpath/Llama-3-15b-Instruct-CoT
    - model: athirdpath/Llama-3-15b-OpenBioLexi-GLUED
    - model: athirdpath/Llama-3-15b-HermesPlaying-GLUED
    
  merge_method: model_stock
  base_model: athirdpath/Llama-3-15b-Instruct-GLUED
  parameters:
    normalize: true
    int8_mask: true
  dtype: float16