File size: 353 Bytes
fe52e98 f375fb0 ba825b8 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 |
---
license: apache-2.0
language:
- en
tags:
- logic
---
# TinyGPT (Minimal) — Colab A100 Run
- Tokens: TinyStories 10%
- Context: 512
- Dim: 512
- Layers: 6
- Heads: 8
- Files: `model.safetensors`, `pytorch_model.bin`, `tokenizer.json`, `config.json`
A cute little experiment for testing. Lets teach our little robot some fun pentachoron behavior. |