NikolayKozloff/NVIDIA-Nemotron-Nano-12B-v2-Q6_K-GGUF Text Generation • 12B • Updated Aug 30, 2025 • 31 • 2
NikolayKozloff/NVIDIA-Nemotron-Nano-12B-v2-Q5_K_M-GGUF Text Generation • 12B • Updated Aug 30, 2025 • 18 • 1
NikolayKozloff/NVIDIA-Nemotron-Nano-12B-v2-Q5_K_S-GGUF Text Generation • 12B • Updated Aug 30, 2025 • 8 • 1
NikolayKozloff/NVIDIA-Nemotron-Nano-12B-v2-Q4_K_M-GGUF Text Generation • 12B • Updated Aug 30, 2025 • 18 • 1
cyankiwi/NVIDIA-Nemotron-Nano-12B-v2-AWQ-4bit Text Generation • 3B • Updated Sep 13, 2025 • 2.43k • 4
cyankiwi/NVIDIA-Nemotron-Nano-12B-v2-AWQ-8bit Text Generation • 4B • Updated Sep 13, 2025 • 2.26k • 1