NM Testing

company

AI & ML interests

None defined yet.

Recent Activity

shanjiaz updated a model about 6 hours ago

nm-testing/Speculator-Qwen3-30B-MOE-VL-Eagle3

kylesayrs updated a model 2 days ago

nm-testing/Qwen3-0.6B-FP8_BLOCK

kylesayrs published a model 2 days ago

nm-testing/Qwen3-0.6B-FP8_BLOCK

View all activity

nm-testing 's models 519

nm-testing/Phi-3.5-vision-instruct-FP8-dynamic

4B • Updated Oct 17, 2024 • 273

nm-testing/MiniCPM-V-2_6-FP8-dynamic

8B • Updated Oct 17, 2024 • 3

nm-testing/tinyllama-one-shot-w4a16-group-packed

Text Generation • 0.3B • Updated Oct 10, 2024 • 3

nm-testing/llama1.1b_0.5_sparse_bitmask

Text Generation • 0.8B • Updated Oct 9, 2024 • 1

nm-testing/llama7b-one-shot-2_4-w4a16-packed

Text Generation • 1B • Updated Oct 9, 2024 • 8

nm-testing/tinyllama-one-shot-w4a16-group128-packed

Text Generation • 0.3B • Updated Oct 9, 2024 • 1

nm-testing/tinyllama-one-shot-w4a16-channel-packed

Text Generation • 0.3B • Updated Oct 9, 2024 • 1

nm-testing/tinyllama-one-shot-w4a16-channel-compressed

Text Generation • 1B • Updated Oct 9, 2024 • 2

nm-testing/tinyllama-one-shot-dynamic-test

Text Generation • 1B • Updated Oct 9, 2024

nm-testing/tinyllama-one-shot-static-quant-test-compressed

Text Generation • 1B • Updated Oct 9, 2024 • 1

nm-testing/asym-w8w8-int8-static-per-tensor-tiny-llama

1B • Updated Oct 9, 2024 • 1.91k

nm-testing/tinyllama-oneshot-w8a8-channel-dynamic-token-v2-asym

1B • Updated Oct 9, 2024 • 2

nm-testing/OLMoE-1B-7B-0924-Instruct-FP8

7B • Updated Oct 9, 2024 • 38

nm-testing/DeepSeek-Coder-V2-Lite-Instruct-W8A8

16B • Updated Oct 9, 2024 • 7

nm-testing/TinyLlama-1.1B-Chat-v1.0-actorder-weight

Text Generation • 0.3B • Updated Oct 9, 2024 • 1

nm-testing/TinyLlama-1.1B-Chat-v1.0-actorder-group

Text Generation • 0.3B • Updated Oct 9, 2024 • 733

nm-testing/tinyllama-w8a16-dense

1B • Updated Oct 9, 2024 • 250

nm-testing/tinyllama-w8a8-compressed

1B • Updated Oct 9, 2024 • 666

nm-testing/tinyllama-w4a16-compressed

0.3B • Updated Oct 9, 2024 • 582

nm-testing/tinyllama-fp8-dynamic-compressed

1B • Updated Oct 9, 2024 • 336

nm-testing/SmolLM-1.7B-Instruct-quantized.w4a16

Text Generation • 0.4B • Updated Oct 9, 2024 • 1

nm-testing/SmolLM-360M-Instruct-quantized.w4a16

0.1B • Updated Oct 9, 2024

nm-testing/SmolLM-135M-Instruct-quantized.w4a16

Text Generation • 71.6M • Updated Oct 9, 2024 • 1

nm-testing/Mixtral-8x7B-Instruct-v0.1-W4A16-channel-quantized

6B • Updated Oct 9, 2024 • 768

nm-testing/Meta-Llama-3-8B-Instruct-fp8-compressed

8B • Updated Oct 9, 2024 • 1

nm-testing/Phi-3-mini-128k-instruct-FP8

4B • Updated Oct 9, 2024 • 965

nm-testing/Mixtral-8x7B-Instruct-v0.1-FP8-quantized

47B • Updated Oct 9, 2024 • 1

nm-testing/Mixtral-8x7B-Instruct-v0.1-W8A16-quantized

12B • Updated Oct 9, 2024 • 776

nm-testing/Mixtral-8x7B-Instruct-v0.1-W4A16-quantized

6B • Updated Oct 9, 2024 • 774

nm-testing/tinyllama-oneshot-w8a8-dynamic-token-v2-asym

Text Generation • 1B • Updated Oct 9, 2024 • 8