Instructions to use chchen/Llama3-OpenBioLLM-8B-PsyCourse-fold9 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use chchen/Llama3-OpenBioLLM-8B-PsyCourse-fold9 with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("aaditya/Llama3-OpenBioLLM-8B") model = PeftModel.from_pretrained(base_model, "chchen/Llama3-OpenBioLLM-8B-PsyCourse-fold9") - Notebooks
- Google Colab
- Kaggle
Training in progress, step 1350
Browse files- adapter_model.safetensors +1 -1
- trainer_log.jsonl +6 -0
adapter_model.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 83945296
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a34eccc4b00be3a0fe6c8dc4ee7710281d762d9bd2e142311114c34c911819ed
|
| 3 |
size 83945296
|
trainer_log.jsonl
CHANGED
|
@@ -154,3 +154,9 @@
|
|
| 154 |
{"current_steps": 1290, "total_steps": 3255, "loss": 0.0315, "lr": 7.557060724579484e-05, "epoch": 1.980426021876799, "percentage": 39.63, "elapsed_time": "4:27:52", "remaining_time": "6:48:03"}
|
| 155 |
{"current_steps": 1300, "total_steps": 3255, "loss": 0.0469, "lr": 7.51082913063978e-05, "epoch": 1.9957781615812704, "percentage": 39.94, "elapsed_time": "4:29:20", "remaining_time": "6:45:03"}
|
| 156 |
{"current_steps": 1300, "total_steps": 3255, "eval_loss": 0.03991750255227089, "epoch": 1.9957781615812704, "percentage": 39.94, "elapsed_time": "4:32:23", "remaining_time": "6:49:38"}
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 154 |
{"current_steps": 1290, "total_steps": 3255, "loss": 0.0315, "lr": 7.557060724579484e-05, "epoch": 1.980426021876799, "percentage": 39.63, "elapsed_time": "4:27:52", "remaining_time": "6:48:03"}
|
| 155 |
{"current_steps": 1300, "total_steps": 3255, "loss": 0.0469, "lr": 7.51082913063978e-05, "epoch": 1.9957781615812704, "percentage": 39.94, "elapsed_time": "4:29:20", "remaining_time": "6:45:03"}
|
| 156 |
{"current_steps": 1300, "total_steps": 3255, "eval_loss": 0.03991750255227089, "epoch": 1.9957781615812704, "percentage": 39.94, "elapsed_time": "4:32:23", "remaining_time": "6:49:38"}
|
| 157 |
+
{"current_steps": 1310, "total_steps": 3255, "loss": 0.026, "lr": 7.464308685619099e-05, "epoch": 2.0111303012857418, "percentage": 40.25, "elapsed_time": "4:33:54", "remaining_time": "6:46:41"}
|
| 158 |
+
{"current_steps": 1320, "total_steps": 3255, "loss": 0.0166, "lr": 7.417504741327587e-05, "epoch": 2.026482440990213, "percentage": 40.55, "elapsed_time": "4:35:22", "remaining_time": "6:43:40"}
|
| 159 |
+
{"current_steps": 1330, "total_steps": 3255, "loss": 0.0212, "lr": 7.370422682189755e-05, "epoch": 2.0418345806946845, "percentage": 40.86, "elapsed_time": "4:36:50", "remaining_time": "6:40:41"}
|
| 160 |
+
{"current_steps": 1340, "total_steps": 3255, "loss": 0.0163, "lr": 7.323067924625024e-05, "epoch": 2.0571867203991556, "percentage": 41.17, "elapsed_time": "4:38:17", "remaining_time": "6:37:42"}
|
| 161 |
+
{"current_steps": 1350, "total_steps": 3255, "loss": 0.0193, "lr": 7.275445916424627e-05, "epoch": 2.0725388601036268, "percentage": 41.47, "elapsed_time": "4:39:45", "remaining_time": "6:34:46"}
|
| 162 |
+
{"current_steps": 1350, "total_steps": 3255, "eval_loss": 0.04122938960790634, "epoch": 2.0725388601036268, "percentage": 41.47, "elapsed_time": "4:42:48", "remaining_time": "6:39:03"}
|