ChavyvAkvar/atma-10b-L40S-mbs16-polar__reg-baseline__distr-0__mem-1__win-0
Updated • 15
ATMA Checkpoint
-
-
ChavyvAkvar/atma-10b-L4-mbs4-nope__reg-baseline__distr-0__mem-1__win-0
Updated • 9 -
ChavyvAkvar/atma-10b-L40S-mbs16-nope__reg-baseline__distr-0__mem-1__win-0
Updated • 18 -
ChavyvAkvar/atma-10b-L40S-mbs16-rope__reg-baseline__distr-0__mem-1__win-0
Updated • 12 -
ChavyvAkvar/atma-10b-L40S-mbs4-nope__reg-baseline__distr-0__mem-1__win-0
Updated • 13 -
ChavyvAkvar/atma-10b-L40S-mbs16-atma-raven-titans__reg-baseline__distr-0__mem-1__win-0
Updated • 12 -
ChavyvAkvar/atma-10b-L40S-mbs16-raven-native__reg-baseline__distr-0__mem-0__win-0
Updated • 6 -
ChavyvAkvar/atma-10b-babilong-2k-ft-atma-raven-titans
Updated • 8 -
ChavyvAkvar/atma-10b-babilong-2k-ft-raven-native
Updated • 5 -
ChavyvAkvar/atma-10b-babilong-2k-ft-nope
Updated • 4 -
ChavyvAkvar/atma-10b-babilong-2k-ft-polar
Updated • 4 -
ChavyvAkvar/atma-10b-babilong-2k-ft-rope
Updated • 5 -
ChavyvAkvar/atma-foveal-cpt-all
Updated -
ChavyvAkvar/repl_seed1_polar
Updated • 12 -
ChavyvAkvar/repl_seed1_nope
Updated • 12 -
ChavyvAkvar/repl_seed2_polar
Updated • 34 -
ChavyvAkvar/repl_seed2_nope
Updated • 30 -
ChavyvAkvar/scaled_tda_hybrid
Updated • 20 -
ChavyvAkvar/scaled_tda_hybrid_babilong
Updated • 21 -
ChavyvAkvar/foveal_babilong_2k_ft
Updated -
ATMA: Length-Invariant Language Modeling via Polar Attention and Gated-Delta Compression Memory
Paper • 2606.25156 • Published • 2