GGUF
conversational

QuantFactory Banner

QuantFactory/medllama3-v20-GGUF

This is quantized version of ProbeMedicalYonseiMAILab/medllama3-v20 created using llama.cpp

Original Model Card

The model is a fine-tuned large language model on using publically available medical data.

Model Description

  • Developed by: Probe Medical, MAILAB from Yonsei University
  • Model type: LLM
  • Language(s) (NLP): English

Training Hyperparameters

  • Lora Targets: "o_proj", "down_proj", "v_proj", "gate_proj", "up_proj", "k_proj", "q_proj"
Downloads last month
13
GGUF
Model size
8.03B params
Architecture
llama
Hardware compatibility
Log In to view the estimation

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support