metadata
license: apache-2.0
language:
- en
tags:
- logic
TinyGPT (Minimal) — Colab A100 Run
- Tokens: TinyStories 10%
- Context: 512
- Dim: 512
- Layers: 6
- Heads: 8
- Files:
model.safetensors,pytorch_model.bin,tokenizer.json,config.json
A cute little experiment for testing. Lets teach our little robot some fun pentachoron behavior.