henrygu123 commited on
Commit
3131f9d
Β·
verified Β·
1 Parent(s): fa21de9

Update docs.md

Browse files
Files changed (1) hide show
  1. docs.md +6 -5
docs.md CHANGED
@@ -109,11 +109,12 @@ Five completed samples serve as few-shot examples, and all testing samples with
109
  <p>Due to privacy and security considerations of clinical data, regulated-access datasets can not be directly published. However, all detailed task descriptions and their corresponding data sources are available in our <a href="https://arxiv.org/abs/2504.19467">BRIDGE paper</a>.
110
  Importantly, all 87 datasets have been verified to be either fully open-access or publicly accessible via reasonable request in our <a href="https://ai.nejm.org/doi/full/10.1056/AIra2400012">systematic review</a>.</p>
111
 
112
- <h4>πŸ”₯ Result Submission and Evaluation</h4>
113
- <p>If you would like to submit your model results to BRIDGE and demonstrate its performance, please follow these steps:</p>
114
  <ul>
115
- <li><strong>Run local inference:</strong> Download the <a href="https://huggingface.co/datasets/YLab-Open/BRIDGE-Open">BRIDGE-Open</a> dataset and perform inference locally. Save the generated output of each sample in its "pred" field for each dataset file.</li>
116
- <li><strong>Prepare your submission:</strong> Send your results to us (see the following Contact Information). Please clearly describe your model details and experimental settings, including the inference strategy used (zero-shot, few-shot, or CoT), and note any additional relevant configurations if applicable.</li>
 
117
  <li><strong>Code Reference:</strong> About LLM inference, result extraction, and evaluation scheme, please refer to our <a href="https://github.com/YLab-Open/BRIDGE">BRIDGE GitHub repo</a>.</li>
118
  </ul>
119
  We will review and evaluate your submission and update the leaderboard accordingly.
@@ -128,7 +129,7 @@ We will review and evaluate your submission and update the leaderboard according
128
  <!-- Contributing --------------------------------------------------------->
129
  <h2>🀝 Contributing</h2>
130
  <p>We welcome and greatly value contributions and collaborations from the community!
131
- If you have clinical text datasets that you would like to share for broader exploration, please contact us!</p>
132
  <p>We are committed to expanding BRIDGE while strictly adhering to appropriate data use agreements and ethical guidelines. Let's work together to advance the responsible application of LLMs in medicine!</p>
133
 
134
  <!-- Donation ------------------------------------------------------------->
 
109
  <p>Due to privacy and security considerations of clinical data, regulated-access datasets can not be directly published. However, all detailed task descriptions and their corresponding data sources are available in our <a href="https://arxiv.org/abs/2504.19467">BRIDGE paper</a>.
110
  Importantly, all 87 datasets have been verified to be either fully open-access or publicly accessible via reasonable request in our <a href="https://ai.nejm.org/doi/full/10.1056/AIra2400012">systematic review</a>.</p>
111
 
112
+ <h4>πŸ”₯ Result Submission and Model Evaluation</h4>
113
+ <p>If you would like to see how an unevaluated model perform on BRIDGE, please follow these steps:</p>
114
  <ul>
115
+ <li><strong>Run model inference:</strong> This can be done by you locally or by us.
116
+ <li><strong>If you want to do inference locally:</strong> Download the <a href="https://huggingface.co/datasets/YLab-Open/BRIDGE-Open">BRIDGE-Open</a> dataset and perform inference locally. Save the generated output of each sample in its "pred" field for each dataset file. Then send your results to us via <a href="https://forms.gle/gU3GjSn9SqJRvs3b9">the Google Form</a></li>
117
+ <li><strong>If you want us to do model inference:</strong></li> Send the link of the model to us via <a href="https://forms.gle/gU3GjSn9SqJRvs3b9">the Google Form</a>.
118
  <li><strong>Code Reference:</strong> About LLM inference, result extraction, and evaluation scheme, please refer to our <a href="https://github.com/YLab-Open/BRIDGE">BRIDGE GitHub repo</a>.</li>
119
  </ul>
120
  We will review and evaluate your submission and update the leaderboard accordingly.
 
129
  <!-- Contributing --------------------------------------------------------->
130
  <h2>🀝 Contributing</h2>
131
  <p>We welcome and greatly value contributions and collaborations from the community!
132
+ If you have clinical text datasets that you would like to add to the BRIDEG benchmark, please fill in <a href="https://forms.gle/gU3GjSn9SqJRvs3b9">the Google Form</a> and let us know!</p>
133
  <p>We are committed to expanding BRIDGE while strictly adhering to appropriate data use agreements and ethical guidelines. Let's work together to advance the responsible application of LLMs in medicine!</p>
134
 
135
  <!-- Donation ------------------------------------------------------------->