README.md

metadata

license: mit
language:
  - en

OpenSML: An Family of Small Language Models

William Zebrowski

Introduce OpenSML, a series of Open SMalL Language Models. These models arcitecture are built stricly will Apple's MLX framework.

The pre-training dataset contains OpenWebText with approximately 2.3 billion tokens.