kevin009 commited on
Commit
2c44ece
·
verified ·
1 Parent(s): cec09e2

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +21 -0
README.md ADDED
@@ -0,0 +1,21 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+
2
+ # kevin009/llama323
3
+
4
+ ## Model Description
5
+ This is a LoRA-tuned version of unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit using KTO (Knowledge Transfer Optimization).
6
+
7
+ ## Training Parameters
8
+ - Learning Rate: 2.5e-05
9
+ - Batch Size: 1
10
+ - Training Steps: 1300
11
+ - LoRA Rank: 16
12
+ - Training Date: 2025-01-02
13
+
14
+ ## Usage
15
+ ```python
16
+ from peft import AutoPeftModelForCausalLM
17
+ from transformers import AutoTokenizer
18
+
19
+ model = AutoPeftModelForCausalLM.from_pretrained("kevin009/llama323", token="YOUR_TOKEN")
20
+ tokenizer = AutoTokenizer.from_pretrained("kevin009/llama323")
21
+ ```