mradermacher

/

model_requests

like 137

It's queued!

You can check for progress at http://hf.tst.eu/status.html or regularly check the model
summary page at https://hf.tst.eu/model#INTELLECT-3.1-GGUF for quants to appear.

error loading model: missing tensor 'blk.46.attn_norm.weight'

weird, doesnt quant for some reason

hm but https://huggingface.co/noctrex/INTELLECT-3.1-MXFP4_MOE-GGUF/tree/main
ah yes I see the community comment

I mean it is technically possible to force to gguf, it just will not run lol

https://github.com/ggml-org/llama.cpp/issues/19733

I cant exactly do it myself, at least not right now. Perhaps I could ask nico, or you could just ask PrimeIntellect to fix it to make everything properly

https://huggingface.co/PrimeIntellect/INTELLECT-3.1/discussions/2