True Speech-to-Speech Langugage Model
AI & ML interests
LLM
Recent Activity
-
fnlp/Embodied_R1-ScienceWorld
8B • Updated • 1 -
fnlp/Embodied_Planner-R1-Alfworld
8B • Updated • 2 -
Unleashing Embodied Task Planning Ability in LLMs via Reinforcement Learning
Paper • 2506.23127 • Published • 1 -
World Modeling Makes a Better Planner: Dual Preference Optimization for Embodied Task Planning
Paper • 2503.10480 • Published • 53
The MHA2MLA model published in the paper "Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-Based LLMs"
Open source weights of Lorsa modules introduced in "Towards Understanding the Nature of Attention with Low-Rank Sparse Decomposition".
The MHA2MLA model published in the paper "Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-Based LLMs"
-
Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs
Paper • 2502.14837 • Published • 3 -
fnlp/Llama-2-7B-MLA-d_kv_16
Text Generation • 6B • Updated • 3 -
fnlp/Llama-2-7B-MLA-d_kv_32
Text Generation • 6B • Updated -
fnlp/Llama-2-7B-MLA-d_kv_64
Text Generation • 7B • Updated
True Speech-to-Speech Langugage Model
-
fnlp/Embodied_R1-ScienceWorld
8B • Updated • 1 -
fnlp/Embodied_Planner-R1-Alfworld
8B • Updated • 2 -
Unleashing Embodied Task Planning Ability in LLMs via Reinforcement Learning
Paper • 2506.23127 • Published • 1 -
World Modeling Makes a Better Planner: Dual Preference Optimization for Embodied Task Planning
Paper • 2503.10480 • Published • 53
Open source weights of Lorsa modules introduced in "Towards Understanding the Nature of Attention with Low-Rank Sparse Decomposition".
The MHA2MLA model published in the paper "Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-Based LLMs"
The MHA2MLA model published in the paper "Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-Based LLMs"
-
Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs
Paper • 2502.14837 • Published • 3 -
fnlp/Llama-2-7B-MLA-d_kv_16
Text Generation • 6B • Updated • 3 -
fnlp/Llama-2-7B-MLA-d_kv_32
Text Generation • 6B • Updated -
fnlp/Llama-2-7B-MLA-d_kv_64
Text Generation • 7B • Updated