LLM360

LLM360 is an initiative to open-source large language models (LLMs) that foster transparency, trust, and collaborative research.

All models under LLM360 will release:

• Up to 360 Intermediate Model Checkpoints
• Training Data with Full Data Sequence
• Training, Data Processing, and Evaluation Source Code
• Logs and Metrics