OpenNLPLab/TransNormerLLM3-15B-Intermediate-Checkpoints
Text Generation
•
Updated
•
75
•
15
TransNormerLLM
TransNormerLLM: A Faster and Better Large Language Model with Improved TransNormer
-
-
OpenNLPLab/TransNormerLLM2-1B-300B
Text Generation • Updated • 10 • 3 -
OpenNLPLab/TransNormerLLM2-3B-300B
Text Generation • Updated • 9 • 3 -
OpenNLPLab/TransNormerLLM2-7B-300B
Text Generation • Updated • 8 • 4 -
OpenNLPLab/TransNormerLLM-385M
Text Generation • Updated • 8 • 8 -
OpenNLPLab/TransNormerLLM-1B
Text Generation • Updated • 54 • 12 -
OpenNLPLab/TransNormerLLM-7B
Text Generation • Updated • 12 • 17 -
Scaling TransNormer to 175 Billion Parameters
Paper • 2307.14995 • Published • 21 -
Lightning Attention-2: A Free Lunch for Handling Unlimited Sequence Lengths in Large Language Models
Paper • 2401.04658 • Published • 25 -
Linear Attention Sequence Parallelism
Paper • 2404.02882 • Published • 3 -
Scaling Laws for Linear Complexity Language Models
Paper • 2406.16690 • Published • 22