Alexone's picture

38

Alexone

krustik

·

https://www.reddit.com/r/ai_tests/

AI & ML interests

Testing Evaluating

Recent Activity

new activity 10 days ago

unsloth/Kimi-K2-Instruct-GGUF:Amazing quality in such low Q4 on 2014 ANCIENT Xeon CPU with just shy 582Gb RAM

new activity 10 days ago

moonshotai/Kimi-K2-Instruct:Amazing quality in Q4 on 2014 ANCIENT Xeon CPU with just shy 582Gb RAM

new activity 15 days ago

KVCache-ai/Kimi-K2-Instruct-GGUF:any hope for running on 256gb ram and 12gb vram ?

View all activity

Organizations

None yet

New activity in unsloth/Kimi-K2-Instruct-GGUF 10 days ago

Amazing quality in such low Q4 on 2014 ANCIENT Xeon CPU with just shy 582Gb RAM

#15 opened 20 days ago by

New activity in moonshotai/Kimi-K2-Instruct 10 days ago

Amazing quality in Q4 on 2014 ANCIENT Xeon CPU with just shy 582Gb RAM

#34 opened 20 days ago by

New activity in KVCache-ai/Kimi-K2-Instruct-GGUF 15 days ago

any hope for running on 256gb ram and 12gb vram ?

#3 opened 29 days ago by

New activity in unsloth/DeepSeek-R1-0528-GGUF 2 months ago

Please share feedback here!

#6 opened 2 months ago by

New activity in unsloth/Qwen3-235B-A22B-GGUF 3 months ago

Amazing, uses humble 255Gb RAM on my ancient 2014 Xeon PC for Q8

#15 opened 3 months ago by

New activity in allenai/Llama-3.1-Tulu-3-405B 4 months ago

Test result

#2 opened 6 months ago by

New activity in Qwen/Qwen2.5-Omni-7B 4 months ago

Where is the MLX version of qwen 2.5 Omni?

#22 opened 4 months ago by

New activity in bartowski/DeepSeek-R1-GGUF 4 months ago

Tested Q6, uses 567Gb Ram

#2 opened 6 months ago by

New activity in deepseek-ai/DeepSeek-V3-0324 4 months ago

Amazing, test result by 567Gb RAM on 10 years old hardware

#42 opened 5 months ago by

New activity in unsloth/DeepSeek-V3-0324-GGUF 5 months ago

How many bits of Quantization is enough for Code Generation Tasks?

#5 opened 5 months ago by

New activity in deepseek-ai/DeepSeek-V3-0324 5 months ago

Can a quantized version of deepseek-v3-0324 be implemented on a machine with a cluster of 8 *A100s?

#19 opened 5 months ago by

Please, hurry up and release the quantized version!

#23 opened 5 months ago by

New activity in Qwen/QwQ-32B-GGUF 5 months ago

Why many small files?

#1 opened 5 months ago by

rdtfddgrffdgfdghfghdfujgdhgsf

New activity in yandex/YandexGPT-5-Lite-8B-pretrain 5 months ago

Где gguf?

#2 opened 6 months ago by

Огромное вам спасибо. Продолжение?

#5 opened 6 months ago by

New activity in unsloth/DeepSeek-R1-GGUF 6 months ago

New research paper, R1 type reasoning models can be drastically improved in quality

#19 opened 6 months ago by

A Step-by-step deployment guide with ollama

#16 opened 6 months ago by

New activity in unsloth/DeepSeek-V3-GGUF 7 months ago

First review, Q5-K-M require 502Gb RAM, better than Meta 405billions

#11 opened 7 months ago by

New activity in deepseek-ai/DeepSeek-V3-Base 7 months ago

Resource Requirements for Running DeepSeek v3 Locally

#56 opened 7 months ago by

New activity in deepseek-ai/DeepSeek-V3 7 months ago

Smaller version for Home User GPU's

#2 opened 8 months ago by