Hugging Face's logo

arcee-ai
/
saul-zephyr-7b-ties

Text Generation
Transformers
Safetensors
mistral
Merge
mergekit
Equall/Saul-Base
HuggingFaceH4/zephyr-7b-beta
text-generation-inference
Inference Endpoints
Model card Files Community

arcee-ai/saul-zephyr-7b-ties

arcee-ai/saul-zephyr-7b-ties is a merge of the following models using mergekit:

🧩 Configuration 

models:
  - model: mistralai/Mistral-7B-v0.1
    # no parameters necessary for base model
  - model: Equall/Saul-Base
    parameters:
      density: 0.5
      weight: 0.5
  - model: HuggingFaceH4/zephyr-7b-beta
    parameters:
      density: 0.5
      weight: 0.5

merge_method: ties
base_model: mistralai/Mistral-7B-v0.1
parameters:
  normalize: false
  int8_mask: true
dtype: float16
Downloads last month
18
Safetensors
Model size
7.24B params
Tensor type
FP16
·
Inference Examples
Text Generation
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Collection including arcee-ai/saul-zephyr-7b-ties