QuantFactory/Sekhmet_Aleph-L3.1-8B-v0.1-GGUF

This is quantized version of Nitral-AI/Sekhmet_Aleph-L3.1-8B-v0.1 created using llama.cpp

Original Model Card

image/png

Sekhmet_Aleph [v-0.1] (replace later).

GGUF Quant's available Thanks to (replace later): [GGUF Here](replace later)

EXL2 Quant's available Thanks to (replace later) : [Exl2 Here](replace later)

Recomended ST Presets: Sekhmet Presets(Same as Hathor's)


Note: Sekhmet_Aleph [v0.1] is trained on (replace later)

Additional Note's: (replace later)

Downloads last month
9
GGUF
Model size
8.03B params
Architecture
llama
Hardware compatibility
Log In to view the estimation

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support