community's picture

1 6

community

Complete123123

·

jiuyuehe

AI & ML interests

None yet

Recent Activity

new activity about 2 months ago

NexaAI/DeepSeek-OCR-GGUF:cann't run？

new activity 2 months ago

NexaAI/DeepSeek-OCR-GGUF:cann't run？

replied to mitkox's post 2 months ago

I just threw Qwen3-0.6B in BF16 into an on device AI drag race on AMD Strix Halo with vLLM: 564 tokens/sec on short 100-token sprints 96 tokens/sec on 8K-token marathons TL;DR You don't just run AI on AMD. You negotiate with it. The hardware absolutely delivers. Spoiler alert; there is exactly ONE configuration where vLLM + ROCm + Triton + PyTorch + Drivers + Ubuntu Kernel to work at the same time. Finding it required the patience of a saint Consumer AMD for AI inference is the ultimate "budget warrior" play, insane performance-per-euro, but you need hardcore technical skills that would make a senior sysadmin nod in quiet respect.

View all activity

Organizations

None yet

Complete123123 's models

None public yet