Hugging Face's logo

SanjiWatsuki
/
llama-stampede-64x101m

Text Generation
Transformers
Safetensors
mixtral
Merge
mergekit
lazymergekit
text-generation-inference
Inference Endpoints
Model card Files Community

llama-stampede-64x101m

llama-stampede-64x101m is a merge of the following models using mergekit:

🧩 Configuration 

base_model: BEE-spoke-data/smol_llama-101M-GQA
gate_mode: random
dtype: bfloat16
experts:
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
  - source_model: BEE-spoke-data/smol_llama-101M-GQA
    positive_prompts: [""]
Downloads last month
79
Safetensors
Model size
2.78B params
Tensor type
BF16
·
Inference Providers NEW
Text Generation
This model is not currently available via any of the supported Inference Providers.