Nanotron Research

community

AI & ML interests

Large scale distributed AI model training, model parallelisation, low-level GPU acceleration, make GPUs go brrrrr

Recent Activity

tfrere new activity 5 days ago

nanotron/ultrascale-playbook:dark-mode

tfrere updated a Space 5 days ago

nanotron/ultrascale-playbook

lvwerra new activity 5 days ago

nanotron/ultrascale-playbook:typos

View all activity

nanotron 's datasets 15

nanotron/book

Updated 27 days ago • 1.07k • 4

nanotron/ultrascale-playbook-data

Updated Mar 12 • 337 • 7

nanotron/picotron_bench

Viewer • Updated Dec 17, 2024 • 740 • 318 • 2

nanotron/minipile_100_samples

Viewer • Updated Jul 10, 2024 • 100 • 459 • 2

nanotron/llama3-1024-passkey-retrieval-eval

Viewer • Updated Jul 4, 2024 • 12.6k • 78 • 1

nanotron/llama3-16k-passkey-retrieval-finetuning

Viewer • Updated Jun 20, 2024 • 77.3k • 48 • 1

nanotron/llama3-16k-passkey-retrieval-eval

Viewer • Updated Jun 19, 2024 • 712 • 48 • 1

nanotron/llama3_needle_16k_finetuning

Viewer • Updated Jun 15, 2024 • 3.57k • 38 • 1

nanotron/needle_32k_eval_dataset

Viewer • Updated May 29, 2024 • 1.79k • 49 • 2

nanotron/needle_32k_finetuning_dataset

Viewer • Updated May 16, 2024 • 35.5k • 78 • 1

nanotron/needle_in_a_hay_stack_finetuning_dataset

Viewer • Updated May 14, 2024 • 21 • 17

nanotron/needle_in_a_hay_stack_eval_dataset

Viewer • Updated May 14, 2024 • 1 • 9 • 1

nanotron/needle_in_a_hay_stack_finetune_dataset

Viewer • Updated May 3, 2024 • 12.6k • 98 • 2

nanotron/simple_needle_in_a_hay_stack

Viewer • Updated Apr 24, 2024 • 12.6k • 37 • 1

nanotron/the-pile-for-doremi

Updated Feb 20, 2024 • 2