| license: mit | |
| language: | |
| - en | |
| # OpenSML: An Family of Small Language Models | |
| *William Zebrowski* | |
| Introduce **OpenSML**, a series of **Open** **SM**al**L** Language Models. These models arcitecture are built stricly will Apple's [MLX](https://ml-explore.github.io/mlx/build/html/index.html#) framework. | |
| The pre-training dataset contains OpenWebText with approximately 2.3 billion tokens. | |