Safetensors
llama
zqh11 commited on
Commit
941af00
·
verified ·
1 Parent(s): fa366fa

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +96 -5
README.md CHANGED
@@ -1,5 +1,96 @@
1
- ---
2
- license: other
3
- license_name: deepseek
4
- license_link: LICENSE
5
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ license_name: deepseek
4
+ license_link: LICENSE
5
+ ---
6
+ <!-- markdownlint-disable first-line-h1 -->
7
+ <!-- markdownlint-disable html -->
8
+ <!-- markdownlint-disable no-duplicate-header -->
9
+
10
+ <div align="center">
11
+ <img src="https://github.com/deepseek-ai/DeepSeek-V2/blob/main/figures/logo.svg?raw=true" width="60%" alt="DeepSeek-V2" />
12
+ </div>
13
+ <hr>
14
+ <div align="center" style="line-height: 1;">
15
+ <a href="https://www.deepseek.com/" target="_blank" style="margin: 2px;">
16
+ <img alt="Homepage" src="https://github.com/deepseek-ai/DeepSeek-V2/blob/main/figures/badge.svg?raw=true" style="display: inline-block; vertical-align: middle;"/>
17
+ </a>
18
+ <a href="https://chat.deepseek.com/" target="_blank" style="margin: 2px;">
19
+ <img alt="Chat" src="https://img.shields.io/badge/🤖%20Chat-DeepSeek%20V2-536af5?color=536af5&logoColor=white" style="display: inline-block; vertical-align: middle;"/>
20
+ </a>
21
+ <a href="https://huggingface.co/deepseek-ai" target="_blank" style="margin: 2px;">
22
+ <img alt="Hugging Face" src="https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-DeepSeek%20AI-ffc107?color=ffc107&logoColor=white" style="display: inline-block; vertical-align: middle;"/>
23
+ </a>
24
+ </div>
25
+
26
+ <div align="center" style="line-height: 1;">
27
+ <a href="https://discord.gg/Tc7c45Zzu5" target="_blank" style="margin: 2px;">
28
+ <img alt="Discord" src="https://img.shields.io/badge/Discord-DeepSeek%20AI-7289da?logo=discord&logoColor=white&color=7289da" style="display: inline-block; vertical-align: middle;"/>
29
+ </a>
30
+ <a href="https://github.com/deepseek-ai/DeepSeek-V2/blob/main/figures/qr.jpeg?raw=true" target="_blank" style="margin: 2px;">
31
+ <img alt="Wechat" src="https://img.shields.io/badge/WeChat-DeepSeek%20AI-brightgreen?logo=wechat&logoColor=white" style="display: inline-block; vertical-align: middle;"/>
32
+ </a>
33
+ <a href="https://twitter.com/deepseek_ai" target="_blank" style="margin: 2px;">
34
+ <img alt="Twitter Follow" src="https://img.shields.io/badge/Twitter-deepseek_ai-white?logo=x&logoColor=white" style="display: inline-block; vertical-align: middle;"/>
35
+ </a>
36
+ </div>
37
+ <div align="center" style="line-height: 1;">
38
+ <a href="https://github.com/deepseek-ai/DeepSeek-V2/blob/main/LICENSE-CODE" style="margin: 2px;">
39
+ <img alt="Code License" src="https://img.shields.io/badge/Code_License-MIT-f5de53?&color=f5de53" style="display: inline-block; vertical-align: middle;"/>
40
+ </a>
41
+ <a href="https://github.com/deepseek-ai/DeepSeek-V2/blob/main/LICENSE-MODEL" style="margin: 2px;">
42
+ <img alt="Model License" src="https://img.shields.io/badge/Model_License-Model_Agreement-f5de53?&color=f5de53" style="display: inline-block; vertical-align: middle;"/>
43
+ </a>
44
+ </div>
45
+ <p align="center">
46
+ <a href="#2-evaluation-results">Evaluation Results</a> |
47
+ <a href="#3-model-downloads">Model Download</a> |
48
+ <a href="#4-license">License</a> |
49
+ <a href="#5-contact">Contact</a>
50
+ </p>
51
+
52
+
53
+
54
+ <p align="center">
55
+ <a href="https://arxiv.org/abs/2405.14333"><b>Paper Link</b>👁️</a>
56
+ </p>
57
+
58
+ # DeepSeek-Prover: Advancing Theorem Proving in LLMs through Large-Scale Synthetic Data
59
+
60
+ ## 1. Introduction
61
+
62
+ Proof assistants like Lean have revolutionized mathematical proof verification, ensuring high accuracy and reliability. Although large language models (LLMs) show promise in mathematical reasoning, their advancement in formal theorem proving is hindered by a lack of training data. To address this issue, we introduce an approach to generate extensive Lean 4 proof data derived from high-school and undergraduate-level mathematical competition problems. This approach involves translating natural language problems into formal statements, filtering out low-quality statements, and generating proofs to create synthetic data. After fine-tuning the DeepSeekMath 7B model on this synthetic dataset, which comprises 8 million formal statements with proofs, our model achieved whole-proof generation accuracies of 46.3% with 64 samples and 52% cumulatively on the Lean 4 miniF2F test, surpassing the baseline GPT-4 at 23.0% with 64 samples and a tree search reinforcement learning method at 41.0%. Additionally, our model successfully proved 5 out of 148 problems in the Lean 4 Formalized International Mathematical Olympiad (FIMO) benchmark, while GPT-4 failed to prove any. These results demonstrate the potential of leveraging large-scale synthetic data to enhance theorem-proving capabilities in LLMs. Both the synthetic dataset and the model will be made available to facilitate further research in this promising field.
63
+
64
+ ## 2. Evaluation Results
65
+
66
+ <div align="center">
67
+
68
+ | | miniF2F-test |
69
+ |--------|------------------|
70
+ | **ReProver** | 26.5% |
71
+ | **GPT-f** | 36.6% |
72
+ | **Hypertree Proof Search** | 41.0% |
73
+ | **DeepSeek-Prover-V1** | 50.0% |
74
+
75
+ </div>
76
+
77
+ ## 3. Model Downloads
78
+
79
+ We release the DeepSeek-Prover-V1.5 with 7B parameters to the public.
80
+
81
+ <div align="center">
82
+
83
+ | **Model** | **Download** |
84
+ | :-----------------------------: | :----------------------------------------------------------: |
85
+ | DeepSeek-Prover-V1 | [🤗 HuggingFace](https://huggingface.co/deepseek-ai/DeepSeek-Prover-V1) |
86
+
87
+ </div>
88
+
89
+ ## 4. License
90
+ This code repository is licensed under the MIT License. The use of DeepSeek-Prover models is subject to the Model License. DeepSeek-Prover supports commercial use.
91
+
92
+ See the [LICENSE-CODE](LICENSE-CODE) and [LICENSE-MODEL](LICENSE-MODEL) for more details.
93
+
94
+ ## 5. Contact
95
+
96
+ If you have any questions, please raise an issue or contact us at [[email protected]](mailto:[email protected]).