Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,78 @@
|
|
1 |
-
---
|
2 |
-
license: apache-2.0
|
3 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: apache-2.0
|
3 |
+
datasets:
|
4 |
+
- ulab-ai/Time-Bench
|
5 |
+
base_model:
|
6 |
+
- Qwen/Qwen2.5-3B-Instruct
|
7 |
+
tags:
|
8 |
+
- temporal-reasoning
|
9 |
+
- reinforcement-learning
|
10 |
+
- large-language-models
|
11 |
+
paperswithcode:
|
12 |
+
arxiv_id: 2505.13508
|
13 |
+
model_index:
|
14 |
+
- name: Time-R1-S1P1
|
15 |
+
---
|
16 |
+
<center>
|
17 |
+
<img src="https://cdn-uploads.huggingface.co/production/uploads/65d188a4aa309d842e438ef1/d6YiWBndm7WzANfl3e1qi.png" alt="Output Examples" width="600">
|
18 |
+
</center>
|
19 |
+
|
20 |
+
<div align="center">
|
21 |
+
<a href="https://huggingface.co/datasets/ulab-ai/Time-Bench"> 📊 <strong>Dataset</strong></a> | <a href="https://github.com/ulab-uiuc/Time-R1">🚀 <strong>Code</strong></a> | <a href="https://arxiv.org/abs/2505.13508">📖 <strong>Paper</strong></a>
|
22 |
+
</div>
|
23 |
+
|
24 |
+
# Time-R1 Model Series
|
25 |
+
|
26 |
+
This collection hosts the official checkpoints for the **Time-R1** model, as described in the paper "Time-R1: Towards Comprehensive Temporal Reasoning in LLMs". Time-R1 is a 3B parameter Large Language Model trained with a novel three-stage reinforcement learning curriculum to endow it with comprehensive temporal abilities: understanding, prediction, and creative generation.
|
27 |
+
|
28 |
+
These models are trained using the [Time-Bench dataset](https://huggingface.co/datasets/ulab-ai/Time-Bench).
|
29 |
+
|
30 |
+
## Model Checkpoints
|
31 |
+
|
32 |
+
We provide several checkpoints representing different stages of the Time-R1 training process:
|
33 |
+
|
34 |
+
### Stage 1: Temporal Comprehension Models
|
35 |
+
|
36 |
+
These models are trained to develop foundational temporal understanding.
|
37 |
+
|
38 |
+
* **[Time-R1-S1P1](https://huggingface.co/ulab-ai/Time-R1-S1P1):** Checkpoint after Phase 1 of Stage 1 training.
|
39 |
+
* *Focus: Foundational logic on easy timestamp inference tasks.*
|
40 |
+
* **[Time-R1-S1P2](https://huggingface.co/ulab-ai/Time-R1-S1P2):** Checkpoint after Phase 2 of Stage 1 training.
|
41 |
+
* *Focus: Full task exploration on all Stage 1 subtasks with mixed difficulty.*
|
42 |
+
* **[Time-R1-Theta1](https://huggingface.co/ulab-ai/Time-R1-Theta1):** Checkpoint θ₁, after Phase 3 (full Stage 1 training).
|
43 |
+
* *Focus: Refined precision on all Stage 1 subtasks under stricter evaluation.*
|
44 |
+
* **[Time-R1-Theta1_prime](https://huggingface.co/ulab-ai/Time-R1-Theta1_prime):** Ablation model θ₁', trained for Stage 1 without the dynamic reward design.
|
45 |
+
* *Focus: Serves as a baseline to evaluate the efficacy of the dynamic reward curriculum.*
|
46 |
+
|
47 |
+
### Stage 2: Future Event Time Prediction Model
|
48 |
+
|
49 |
+
This model builds upon Stage 1 capabilities to predict future event timings.
|
50 |
+
|
51 |
+
* **[Time-R1-Theta2](https://huggingface.co/ulab-ai/Time-R1-Theta2):** Checkpoint θ₂, after Stage 2 training.
|
52 |
+
* *Focus: Predicting the timing of future events occurring after its initial knowledge cutoff.*
|
53 |
+
|
54 |
+
Please refer to the [main paper](https://arxiv.org/abs/2505.13508) for detailed discussions on the architecture, training methodology, and comprehensive evaluations.
|
55 |
+
|
56 |
+
## How to Use
|
57 |
+
|
58 |
+
For loading and using these models, please refer to the example scripts and documentation provided in our [GitHub repository](https://github.com/ulab-uiuc/Time-R1).
|
59 |
+
|
60 |
+
Typically, you can load the models using the Hugging Face `transformers` library:
|
61 |
+
|
62 |
+
```python
|
63 |
+
from transformers import AutoModelForCausalLM, AutoTokenizer
|
64 |
+
# Example for one of the models (replace with the specific model name)
|
65 |
+
model_name = "ulab-ai/Time-R1-Theta1" # Or your specific Hugging Face model path
|
66 |
+
tokenizer = AutoTokenizer.from_pretrained(model_name)
|
67 |
+
model = AutoModelForCausalLM.from_pretrained(model_name)
|
68 |
+
# Further usage instructions would go here or in the repository
|
69 |
+
```
|
70 |
+
|
71 |
+
## Citations
|
72 |
+
```bibtex
|
73 |
+
@article{liu2025time,
|
74 |
+
title={Time-R1: Towards Comprehensive Temporal Reasoning in LLMs},
|
75 |
+
author={Liu, Zijia and Han, Peixuan and Yu, Haofei and Li, Haoru and You, Jiaxuan},
|
76 |
+
journal={arXiv preprint arXiv:2505.13508},
|
77 |
+
year={2025}
|
78 |
+
}
|