Hugging Face model: Isotonic/smol_llama-4x220M-MoE
Author: Isotonic
Created: 2024-02-03 13:19:27
Last modified: 2024-04-04 02:48:19
Pipeline: text-generation
Library: transformers
Likes: 4 | Downloads: 45
Tags: transformers, safetensors, mixtral, text-generation, moe, merge, mergekit, lazymergekit, BEE-spoke-data/smol_llama-220M-openhermes, BEE-spoke-data/beecoder-220M-python, BEE-spoke-data/zephyr-220m-sft-full, BEE-spoke-data/zephyr-220m-dpo-full, dataset:JeanKaddour/minipile, dataset:pszemraj/simple_wikipedia_LM, dataset:mattymchen/refinedweb-3m, dataset:HuggingFaceH4/ultrachat_200k, dataset:teknium/openhermes, dataset:HuggingFaceH4/ultrafeedback_binarized, dataset:EleutherAI/proof-pile-2, dataset:bigcode/the-stack-smol-xl, license:apache-2.0, text-generation-inference, endpoints_compatible, region:us
Card metadata:
license: apache-2.0
tags: moe, merge, mergekit, lazymergekit, BEE-spoke-data/smol_llama-220M-openhermes, BEE-spoke-data/beecoder-220M-python, BEE-spoke-data/zephyr-220m-sft-full, BEE-spoke-data/zephyr-220m-dpo-full, text-generation
datasets: JeanKaddour/minipile, pszemraj/simple_wikipedia_LM, mattymchen/refinedweb-3m, HuggingFaceH4/ultrachat_200k, teknium/openhermes, HuggingFaceH4/ultrafeedback_binarized, EleutherAI/proof-pile-2, bigcode/the-stack-smol-xl
pipeline_tag: text-generation