Hugging Face's logo

Darkhn
/
L3.3-70B-Animus-V4-Final-GGUF

GGUF
llama.cpp
iq1-m
imatrix
conversational
Model card Files
xet
Community

L3.3-70B-Animus-V4-Final-GGUF

GGUF model files for L3.3-70B-Animus-V4-Final.

This repository contains GGUF models quantized using llama.cpp.

  • Base Model: L3.3-70B-Animus-V4-Final
  • Quantization Methods Processed in this Job: IQ3_XS, IQ3_XXS, Q2_K_S, IQ2_M, IQ2_S, IQ2_XS, IQ2_XXS, IQ1_M
  • Importance Matrix Used: Yes

This specific upload is for the IQ1_M quantization.

Downloads last month
84
GGUF
Model size
70.6B params
Architecture
llama
Hardware compatibility
Log In to view the estimation

1-bit

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Darkhn/L3.3-70B-Animus-V4-Final-GGUF

Base model

meta-llama/Llama-3.1-70B
Finetuned
meta-llama/Llama-3.3-70B-Instruct
Finetuned
Darkhn/L3.3-70B-Animus-V4-Final
Quantized
(2)
this model

Collection including Darkhn/L3.3-70B-Animus-V4-Final-GGUF