Hugging Face's logo

ddh0
/
EstopianOrcaMaid-13b

Text Generation
Transformers
Safetensors
llama
mergekit
Merge
Inference Endpoints
text-generation-inference
Model card Files Community
EstopianOrcaMaid-13b / README.md
ddh0's picture
ddh0
Update README.md
8a21b9c verified
preview code
|
raw history blame contribute delete
No virus
1.9 kB
metadata
base_model:
  - KatyTheCutie/EstopianMaid-13B
tags:
  - mergekit
  - merge
license_name: microsoft-research-license
license_link: https://huggingface.co/microsoft/Orca-2-13b/blob/main/LICENSE
pipeline_tag: text-generation

EstopianOrcaMaid-13b

This is a merge of pre-trained language models created using mergekit.

The goal of this merge is to create an unusually intelligent and human-like model especially for RP.

The prompt format is Alpaca. You can use the standard format as shown, but for best results, you should customize the system prompt to your specific needs.

Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
{YOUR MESSAGE HERE}

### Response:
{BOT MESSAGE HERE}

Misc. information

  • BOS token is <s>
  • EOS token is </s>
  • Native context length is 4096
  • Base model is Llama 2
  • Due to the inclusion of Orca-2-13b, the model is subject to the terms of the Microsoft Research License

Merge Method

This model was merged using the linear merge method.

Models Merged

The following models were included in the merge:

Configuration

The following YAML configuration was used to produce this model:

models:
  - model: /Volumes/Sabrent/LLMs/EstopianMaid-13B
    parameters:
      weight: 0.8
  - model: "/Volumes/SanDisk/LLM Archive/Orca-2-13b"
    parameters:
      weight: 0.2
merge_method: linear
dtype: float16

Thanks