Upload README.md with huggingface_hub
Browse files
README.md
ADDED
@@ -0,0 +1,21 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
|
2 |
+
# kevin009/llama323
|
3 |
+
|
4 |
+
## Model Description
|
5 |
+
This is a LoRA-tuned version of unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit using KTO (Knowledge Transfer Optimization).
|
6 |
+
|
7 |
+
## Training Parameters
|
8 |
+
- Learning Rate: 2.5e-05
|
9 |
+
- Batch Size: 1
|
10 |
+
- Training Steps: 1300
|
11 |
+
- LoRA Rank: 16
|
12 |
+
- Training Date: 2025-01-02
|
13 |
+
|
14 |
+
## Usage
|
15 |
+
```python
|
16 |
+
from peft import AutoPeftModelForCausalLM
|
17 |
+
from transformers import AutoTokenizer
|
18 |
+
|
19 |
+
model = AutoPeftModelForCausalLM.from_pretrained("kevin009/llama323", token="YOUR_TOKEN")
|
20 |
+
tokenizer = AutoTokenizer.from_pretrained("kevin009/llama323")
|
21 |
+
```
|