|
|
--- |
|
|
title: README |
|
|
emoji: 🏢 |
|
|
colorFrom: pink |
|
|
colorTo: blue |
|
|
sdk: static |
|
|
pinned: false |
|
|
--- |
|
|
|
|
|
|
|
|
**LLM360 is an initiative to open-source large language models (LLMs) that foster transparency, trust, and collaborative research.** |
|
|
|
|
|
<img style="float: right;" src="logo-web250.png" width="256" height="256"> |
|
|
|
|
|
All models under LLM360 will release: |
|
|
|
|
|
* Up to 360 Intermediate Model Checkpoints |
|
|
* Training Data with Full Data Sequence |
|
|
* Training, Data Processing, and Evaluation Source Code |
|
|
* Logs and Metrics |
|
|
|
|
|
LLM360 is a collaboration between Petuum, MBZUAI, and Cerebras. |
