Update docs.md
Browse files
docs.md
CHANGED
@@ -109,11 +109,12 @@ Five completed samples serve as few-shot examples, and all testing samples with
|
|
109 |
<p>Due to privacy and security considerations of clinical data, regulated-access datasets can not be directly published. However, all detailed task descriptions and their corresponding data sources are available in our <a href="https://arxiv.org/abs/2504.19467">BRIDGE paper</a>.
|
110 |
Importantly, all 87 datasets have been verified to be either fully open-access or publicly accessible via reasonable request in our <a href="https://ai.nejm.org/doi/full/10.1056/AIra2400012">systematic review</a>.</p>
|
111 |
|
112 |
-
<h4>π₯ Result Submission and Evaluation</h4>
|
113 |
-
<p>If you would like to
|
114 |
<ul>
|
115 |
-
<li><strong>Run
|
116 |
-
|
|
|
117 |
<li><strong>Code Reference:</strong> About LLM inference, result extraction, and evaluation scheme, please refer to our <a href="https://github.com/YLab-Open/BRIDGE">BRIDGE GitHub repo</a>.</li>
|
118 |
</ul>
|
119 |
We will review and evaluate your submission and update the leaderboard accordingly.
|
@@ -128,7 +129,7 @@ We will review and evaluate your submission and update the leaderboard according
|
|
128 |
<!-- Contributing --------------------------------------------------------->
|
129 |
<h2>π€ Contributing</h2>
|
130 |
<p>We welcome and greatly value contributions and collaborations from the community!
|
131 |
-
If you have clinical text datasets that you would like to
|
132 |
<p>We are committed to expanding BRIDGE while strictly adhering to appropriate data use agreements and ethical guidelines. Let's work together to advance the responsible application of LLMs in medicine!</p>
|
133 |
|
134 |
<!-- Donation ------------------------------------------------------------->
|
|
|
109 |
<p>Due to privacy and security considerations of clinical data, regulated-access datasets can not be directly published. However, all detailed task descriptions and their corresponding data sources are available in our <a href="https://arxiv.org/abs/2504.19467">BRIDGE paper</a>.
|
110 |
Importantly, all 87 datasets have been verified to be either fully open-access or publicly accessible via reasonable request in our <a href="https://ai.nejm.org/doi/full/10.1056/AIra2400012">systematic review</a>.</p>
|
111 |
|
112 |
+
<h4>π₯ Result Submission and Model Evaluation</h4>
|
113 |
+
<p>If you would like to see how an unevaluated model perform on BRIDGE, please follow these steps:</p>
|
114 |
<ul>
|
115 |
+
<li><strong>Run model inference:</strong> This can be done by you locally or by us.
|
116 |
+
<li><strong>If you want to do inference locally:</strong> Download the <a href="https://huggingface.co/datasets/YLab-Open/BRIDGE-Open">BRIDGE-Open</a> dataset and perform inference locally. Save the generated output of each sample in its "pred" field for each dataset file. Then send your results to us via <a href="https://forms.gle/gU3GjSn9SqJRvs3b9">the Google Form</a></li>
|
117 |
+
<li><strong>If you want us to do model inference:</strong></li> Send the link of the model to us via <a href="https://forms.gle/gU3GjSn9SqJRvs3b9">the Google Form</a>.
|
118 |
<li><strong>Code Reference:</strong> About LLM inference, result extraction, and evaluation scheme, please refer to our <a href="https://github.com/YLab-Open/BRIDGE">BRIDGE GitHub repo</a>.</li>
|
119 |
</ul>
|
120 |
We will review and evaluate your submission and update the leaderboard accordingly.
|
|
|
129 |
<!-- Contributing --------------------------------------------------------->
|
130 |
<h2>π€ Contributing</h2>
|
131 |
<p>We welcome and greatly value contributions and collaborations from the community!
|
132 |
+
If you have clinical text datasets that you would like to add to the BRIDEG benchmark, please fill in <a href="https://forms.gle/gU3GjSn9SqJRvs3b9">the Google Form</a> and let us know!</p>
|
133 |
<p>We are committed to expanding BRIDGE while strictly adhering to appropriate data use agreements and ethical guidelines. Let's work together to advance the responsible application of LLMs in medicine!</p>
|
134 |
|
135 |
<!-- Donation ------------------------------------------------------------->
|