LagPixelLOL

v2ray's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in QuixiAI/DeepSeek-R1-0528-AWQ 2 months ago

running with flashmla on A100s

1

#1 opened 2 months ago by

ehartford

New activity in QuixiAI/DeepSeek-V3-0324-AWQ 3 months ago

could you give me a reason why you ignore kv_a_proj_with_mqa layer when quantizing this model?

1

#10 opened 3 months ago by

superahn

New activity in dphn/Dolphin3.0-Llama3.1-8B-GGUF 3 months ago

gshshdhdhhdididhxbcbdhdudhbdbdbdbehe

4

#3 opened 3 months ago by

MYNK337

New activity in QuixiAI/DeepSeek-R1-AWQ 3 months ago

H800 has errors

1

#35 opened 3 months ago by

yiyepialing

update vllm to 0.8.x and meet some trouble

3

#34 opened 3 months ago by

HuggingLianWang

New activity in wassname/qwen-14B-codefourchan 4 months ago

Big L.O.V.E. to YOU <3

❤️ 2

1

#1 opened 4 months ago by

v2ray

New activity in QuixiAI/DeepSeek-V3-0324-AWQ 4 months ago

Stuck when run on 8xH100

1

#8 opened 4 months ago by

Thai

why tokenizer_config.json changed for AWQ model.

2

#7 opened 4 months ago by

rockcat-miao

Does FlashMLA support kv cache fp8 dtype and how to enable FlashMLA ?

10

#6 opened 4 months ago by

CharlesLincoln

New activity in QuixiAI/DeepSeek-R1-AWQ 4 months ago

AMD Instinct MI210 + vllm fail to run this model, any solutions please? Is there any other deepseek-r1-671b models that can run succesfully on AMD Instinct MI210 + vllm? Thanks!

5

#33 opened 4 months ago by

luciagan

New activity in discord-community/WelcomeBot 4 months ago

test

👀 2

131

#2 opened 6 months ago by

lunarflu

New activity in QuixiAI/DeepSeek-R1-AWQ 4 months ago

How to Resolve "GLIBC_2.32 Not Found" Error When Deploying vLLM Environment?

8

#32 opened 5 months ago by

lastsummerLi

New activity in QuixiAI/DeepSeek-V3-0324-AWQ 5 months ago

Can the 4090 device run this model?

3

#3 opened 5 months ago by

jinzhongwei

vllm crach with a slightly longer prompt

1

#4 opened 5 months ago by

rockcat-miao

可以添加一下LICENSE文件吗？

2

#2 opened 5 months ago by

adol-ch

New activity in QuixiAI/DeepSeek-R1-AWQ 5 months ago

Are there any updates to the recommended commands?

5

#27 opened 5 months ago by

NaiveYan

Why hasn't the MTP layer of the 61st layer been quantized?

1

#30 opened 5 months ago by

yang001002

Is there any testing on the support for running on other memory capacities

1

#29 opened 5 months ago by

HRan2004

Any one can run this model with SGlang framework？

5

#13 opened 6 months ago by

muziyongshixin

DeepSeek-R1-AWQ quantized model missing one layer of experts

4

#28 opened 5 months ago by

virilo