Update app.py
Browse files
app.py
CHANGED
|
@@ -65,14 +65,16 @@ article = """
|
|
| 65 |
</tr>
|
| 66 |
</tbody></table>
|
| 67 |
<h3>Conclusion and Future Work</h3>
|
| 68 |
-
If F1 score is considered, the results show that there may be no advantage in using domain-specific masked language models to generate Biomedical QA models.
|
| 69 |
-
|
|
|
|
| 70 |
However, if only unanswerable questions are taken into account, the model with the best F1 score is hackathon-pln-es/roberta-base-biomedical-es-squad2-es.
|
|
|
|
| 71 |
As future work, the following experiments could be carried out:
|
| 72 |
<ul>
|
| 73 |
-
<li>Use Biomedical masked-language models that were not
|
| 74 |
<li>Create a Biomedical training dataset with SQUAD v2 format.
|
| 75 |
-
<li>Generate a new and
|
| 76 |
<li>Ensamble different models.
|
| 77 |
</ul>
|
| 78 |
</p>
|
|
|
|
| 65 |
</tr>
|
| 66 |
</tbody></table>
|
| 67 |
<h3>Conclusion and Future Work</h3>
|
| 68 |
+
If F1 score is considered, the results show that there may be no advantage in using domain-specific masked language models to generate Biomedical QA models.
|
| 69 |
+
In any case, the scores reported for the biomedical roberta-based models are not far below from those of the general roberta-based model.
|
| 70 |
+
|
| 71 |
However, if only unanswerable questions are taken into account, the model with the best F1 score is hackathon-pln-es/roberta-base-biomedical-es-squad2-es.
|
| 72 |
+
|
| 73 |
As future work, the following experiments could be carried out:
|
| 74 |
<ul>
|
| 75 |
+
<li>Use Biomedical masked-language models that were not trained from scratch from a Biomedical corpus but have been adapted from a general model, so as not to lose words and features of Spanish that are also present in Biomedical questions and articles.
|
| 76 |
<li>Create a Biomedical training dataset with SQUAD v2 format.
|
| 77 |
+
<li>Generate a new and bigger validation dataset based on questions and contexts generated directly in Spanish and not translated as in SQUAD_Es v2.
|
| 78 |
<li>Ensamble different models.
|
| 79 |
</ul>
|
| 80 |
</p>
|