Hugging Face model: mradermacher/smol_llama-4x220M-MoE-GGUF
Author: mradermacher
Created: 2025-01-24 03:46:48
Last modified: 2025-01-24 03:55:58
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 95
Tags: transformers, gguf, moe, merge, mergekit, lazymergekit, BEE-spoke-data/smol_llama-220M-openhermes, BEE-spoke-data/beecoder-220M-python, BEE-spoke-data/zephyr-220m-sft-full, BEE-spoke-data/zephyr-220m-dpo-full, text-generation, en, dataset:JeanKaddour/minipile, dataset:pszemraj/simple_wikipedia_LM, dataset:mattymchen/refinedweb-3m, dataset:HuggingFaceH4/ultrachat_200k, dataset:teknium/openhermes, dataset:HuggingFaceH4/ultrafeedback_binarized, dataset:EleutherAI/proof-pile-2, dataset:bigcode/the-stack-smol-xl, base_model:Isotonic/smol_llama-4x220M-MoE, base_model:quantized:Isotonic/smol_llama-4x220M-MoE, license:apache-2.0, endpoints_compatible, region:us
Base model relation: quantized
Base models: id: Isotonic/smol_llama-4x220M-MoE
Card metadata:
base_model: Isotonic/smol_llama-4x220M-MoE
datasets: JeanKaddour/minipile, pszemraj/simple_wikipedia_LM, mattymchen/refinedweb-3m, HuggingFaceH4/ultrachat_200k, teknium/openhermes, HuggingFaceH4/ultrafeedback_binarized, EleutherAI/proof-pile-2, bigcode/the-stack-smol-xl
language: en
library_name: transformers
license: apache-2.0
quantized_by: mradermacher
tags: moe, merge, mergekit, lazymergekit, BEE-spoke-data/smol_llama-220M-openhermes, BEE-spoke-data/beecoder-220M-python, BEE-spoke-data/zephyr-220m-sft-full, BEE-spoke-data/zephyr-220m-dpo-full, text-generation