metadata
base_model: unsloth/llama-3.2-3b-Instruct
tags:
- text-generation-inference
- transformers
- unsloth
- llama
- trl
license: apache-2.0
language:
- en
datasets:
- davzoku/moecule-kyc
🫐🥫 kyc_adapter_3b
Model Details
This is a LoRA adapter for Moecule family of MoE models.
It is part of Moecule Ingredients and all relevant expert models, LoRA adapters, and datasets can be found there.
Additional Information
- QLoRA 4-bit fine-tuning with Unsloth
- Base Model:
unsloth/llama-3.2-3b-Instruct
The Team
- CHOCK Wan Kee
- Farlin Deva Binusha DEVASUGIN MERLISUGITHA
- GOH Bao Sheng
- Jessica LEK Si Jia
- Sinha KHUSHI
- TENG Kok Wai (Walter)