Cody Steinmetz PRO

codys12's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

upvoted an article 4 months ago

view article

Article

No GPU left behind: Unlocking Efficiency with Co-located vLLM in TRL

• 
• 
• +4

Jun 3

•

96

upvoted an article 7 months ago

view article

Article

Falcon-H1: A Family of Hybrid-Head Language Models Redefining Efficiency and Performance

• 

May 21

•

38

upvoted an article 10 months ago

view article

Article

Fine-tuning LLMs to 1.58bit: extreme quantization made easy

• 
• 
• +4

Sep 18, 2024

•

272

upvoted a paper 11 months ago

Optimizing Large Language Model Training Using FP4 Quantization

Paper • 2501.17116 • Published Jan 28 • 36

upvoted a collection over 1 year ago

Mamba2-In-Llama3

Collection

Mamba2 distilled from Llama3 8B instruct. The Mamba in the Llama: Distilling and Accelerating Hybrid Models (https://arxiv.org/abs/2408.15237). • 4 items • Updated Sep 9, 2024 • 2

upvoted a paper over 1 year ago

The Mamba in the Llama: Distilling and Accelerating Hybrid Models

Paper • 2408.15237 • Published Aug 27, 2024 • 42

upvoted an article over 1 year ago

view article

Article

4D masks support in Transformers

• 

Jan 8, 2024

•

31

upvoted a paper about 2 years ago

QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models

Paper • 2310.16795 • Published Oct 25, 2023 • 27