MobileLLM / README.md
Yangyang1205's picture
Update README.md
1140c52 verified
metadata
license: mit
language:
  - en
pipeline_tag: text-generation
tags:
  - mobilellm
  - pytorch

MobileLLM 80M (Replication)

This is a replicated version of the MobileLLM 80M model, based on the paper MobileLLM: Optimizing Sub-billion Parameter Language Models for On-Device Use Cases.

  • Model Size: 80M parameters
  • Architecture: Llama-based (Deep & Thin)
  • Status: Research / Testing