Update README.md
Browse files
README.md
CHANGED
|
@@ -4,13 +4,15 @@ datasets:
|
|
| 4 |
- GenPRM/GenPRM-MATH-Data
|
| 5 |
base_model:
|
| 6 |
- deepseek-ai/DeepSeek-R1-Distill-Qwen-7B
|
|
|
|
|
|
|
| 7 |
---
|
| 8 |
|
| 9 |
# Introduction
|
| 10 |
|
| 11 |
We propose **GenPRM**, a strong generative process reward model with the following features:
|
| 12 |
|
| 13 |
-
-
|
| 14 |
- improving Monte Carlo estimation and hard label with **Relative Progress Estimation (RPE)**;
|
| 15 |
- supporting GenPRM **test-time scaling** in a parallel manner with majority voting;
|
| 16 |
- supporting policy model test-time scaling with GenPRM as **verifiers** or **critics**.
|
|
@@ -106,4 +108,4 @@ Our recent work on LLM test-time scaling with PRMs:
|
|
| 106 |
journal = {arXiv preprint arXiv:2502.06703},
|
| 107 |
year = {2025}
|
| 108 |
}
|
| 109 |
-
```
|
|
|
|
| 4 |
- GenPRM/GenPRM-MATH-Data
|
| 5 |
base_model:
|
| 6 |
- deepseek-ai/DeepSeek-R1-Distill-Qwen-7B
|
| 7 |
+
language:
|
| 8 |
+
- en
|
| 9 |
---
|
| 10 |
|
| 11 |
# Introduction
|
| 12 |
|
| 13 |
We propose **GenPRM**, a strong generative process reward model with the following features:
|
| 14 |
|
| 15 |
+
- performing explicit **CoT reasoning** and **code verfication** before providing the process judgment;
|
| 16 |
- improving Monte Carlo estimation and hard label with **Relative Progress Estimation (RPE)**;
|
| 17 |
- supporting GenPRM **test-time scaling** in a parallel manner with majority voting;
|
| 18 |
- supporting policy model test-time scaling with GenPRM as **verifiers** or **critics**.
|
|
|
|
| 108 |
journal = {arXiv preprint arXiv:2502.06703},
|
| 109 |
year = {2025}
|
| 110 |
}
|
| 111 |
+
```
|