| license: apache-2.0 | |
| language: | |
| - en | |
| tags: | |
| - logic | |
| # TinyGPT (Minimal) — Colab A100 Run | |
| - Tokens: TinyStories 10% | |
| - Context: 512 | |
| - Dim: 512 | |
| - Layers: 6 | |
| - Heads: 8 | |
| - Files: `model.safetensors`, `pytorch_model.bin`, `tokenizer.json`, `config.json` | |
| A cute little experiment for testing. Lets teach our little robot some fun pentachoron behavior. |