Spaces:
Running
Running
Update README.md
Browse files
README.md
CHANGED
@@ -18,18 +18,18 @@ The available datasets are the CallHome (Japanese, Chinese, German, Spanish, Eng
|
|
18 |
Each model has been fine-tuned on a specific Callhome language subset. They achieve better performances on multilingual data compared to pyannote's pre-trained [segmentation-3.0](https://huggingface.co/pyannote/segmentation-3.0) model:
|
19 |
|
20 |
|
21 |
-
| Callhome dataset subset | Model | DER | False alarm | Missed detection| Confusion |
|
22 |
| ------------------------| ------------- | ------------- | ------------- | --------------- | ------------- |
|
23 |
-
| Japanese | Pretrained | 25.44 | 2.30
|
24 |
-
| | Fine-tuned |
|
25 |
-
| Spanish | Pretrained | 33.44 | 2.59
|
26 |
-
| | Fine-tuned | 25.72
|
27 |
-
| English | Pretrained | 22.16 | 6.29
|
28 |
-
| | Fine-tuned | 18.40
|
29 |
-
| German | Pretrained | 21.90 | 3.10
|
30 |
-
| | Fine-tuned | 16.75
|
31 |
-
| Chinese | Pretrained | 19.73 | 4.81
|
32 |
-
| | Fine-tuned | 15.95
|
33 |
|
34 |
|
35 |
Note: Results have been obtained using the [test script](https://github.com/kamilakesbi/diarizers/blob/main/test_segmentation.py) from diarizers.
|
|
|
18 |
Each model has been fine-tuned on a specific Callhome language subset. They achieve better performances on multilingual data compared to pyannote's pre-trained [segmentation-3.0](https://huggingface.co/pyannote/segmentation-3.0) model:
|
19 |
|
20 |
|
21 |
+
| Callhome test dataset subset | Model | DER | False alarm | Missed detection| Confusion |
|
22 |
| ------------------------| ------------- | ------------- | ------------- | --------------- | ------------- |
|
23 |
+
| Japanese | Pretrained | 25.44 | **2.30** | 17.45 | 5.69 |
|
24 |
+
| | Fine-tuned | **18.23** | 6.31 | **6.91** | **5.01** |
|
25 |
+
| Spanish | Pretrained | 33.44 | **2.59** | 25.19 | **5.66** |
|
26 |
+
| | Fine-tuned | **25.72** | 6.87 | **12.73** | 6.12 |
|
27 |
+
| English | Pretrained | 22.16 | **6.29** | 10.97 | 4.90 |
|
28 |
+
| | Fine-tuned | **18.40** | 7.10 | **6.98** | **4.32** |
|
29 |
+
| German | Pretrained | 21.90 | **3.10** | 14.25 | 4.55 |
|
30 |
+
| | Fine-tuned | **16.75** | 5.00 | **7.75** | **4.00** |
|
31 |
+
| Chinese | Pretrained | 19.73 | **4.81** | 9.82 | 5.11 |
|
32 |
+
| | Fine-tuned | **15.95** | 5.04 | **7.24** | **3.68** |
|
33 |
|
34 |
|
35 |
Note: Results have been obtained using the [test script](https://github.com/kamilakesbi/diarizers/blob/main/test_segmentation.py) from diarizers.
|