Update README.md
Browse files
README.md
CHANGED
|
@@ -39,4 +39,22 @@ labels =[
|
|
| 39 |
results = pipeline(text, labels, threshold=0.5)[0] #because we have one text
|
| 40 |
for result in results:
|
| 41 |
print(result["label"], "=>", result["score"])
|
| 42 |
-
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 39 |
results = pipeline(text, labels, threshold=0.5)[0] #because we have one text
|
| 40 |
for result in results:
|
| 41 |
print(result["label"], "=>", result["score"])
|
| 42 |
+
```
|
| 43 |
+
|
| 44 |
+
### Benchmarking:
|
| 45 |
+
| Dataset | Base NDCG@10 | GLiClass NDCG@10 |
|
| 46 |
+
|---------|-------------|------------------|
|
| 47 |
+
| NanoArguAna | 0.489 | 0.525 |
|
| 48 |
+
| NanoClimateFEVER | 0.318 | 0.870 |
|
| 49 |
+
| NanoDBPedia | 0.614 | 0.871 |
|
| 50 |
+
| NanoFEVER | 0.809 | 0.770 |
|
| 51 |
+
| NanoFiQA2018 | 0.437 | 0.719 |
|
| 52 |
+
| NanoHotpotQA | 0.828 | 0.647 |
|
| 53 |
+
| NanoMSMARCO | 0.540 | 0.445 |
|
| 54 |
+
| NanoNFCorpus | 0.325 | 0.710 |
|
| 55 |
+
| NanoNQ | 0.501 | 0.588 |
|
| 56 |
+
| NanoQuoraRetrieval | 0.869 | 0.540 |
|
| 57 |
+
| NanoSCIDOCS | 0.335 | 0.917 |
|
| 58 |
+
| NanoSciFact | 0.710 | 0.652 |
|
| 59 |
+
| NanoTouche2020 | 0.694 | 0.490 |
|
| 60 |
+
| **NanoBEIR (mean)** | 0.574 | **0.673** |
|