Update README.md
Browse files
README.md
CHANGED
|
@@ -87,6 +87,21 @@ model-index:
|
|
| 87 |
|
| 88 |
---
|
| 89 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 90 |
## 📊 Dataset
|
| 91 |
|
| 92 |
Custom dataset extracted from Linux kernel Git history.
|
|
|
|
| 87 |
|
| 88 |
---
|
| 89 |
|
| 90 |
+
## 📈 Training Progress
|
| 91 |
+
The model was trained for 1000 steps with the following key metrics:
|
| 92 |
+
### Training Results
|
| 93 |
+
- **Final Loss**: ~0.3335 (converged)
|
| 94 |
+
- **Final Learning Rate**: 2.08304527802282E-06
|
| 95 |
+
- **Training Steps**: 1000
|
| 96 |
+
- **Convergence**: Stable loss plateau achieved
|
| 97 |
+
### Training Curves
|
| 98 |
+

|
| 99 |
+
*Training loss over 1000 steps showing convergence around 0.3335*
|
| 100 |
+

|
| 101 |
+
*Learning rate decay schedule with final rate of 2.08304527802282E-06*
|
| 102 |
+
|
| 103 |
+
---
|
| 104 |
+
|
| 105 |
## 📊 Dataset
|
| 106 |
|
| 107 |
Custom dataset extracted from Linux kernel Git history.
|