Dominik Macháček
commited on
Commit
·
2249846
1
Parent(s):
fc74626
Update README.md
Browse files
README.md
CHANGED
@@ -1,6 +1,15 @@
|
|
1 |
# whisper_streaming
|
2 |
Whisper realtime streaming for long speech-to-text transcription and translation
|
3 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
4 |
Demo video: https://player.vimeo.com/video/840442741
|
5 |
|
6 |
## Installation
|
@@ -174,7 +183,7 @@ Contributions are welcome.
|
|
174 |
|
175 |
### Tests
|
176 |
|
177 |
-
|
178 |
|
179 |
## Contact
|
180 |
|
|
|
1 |
# whisper_streaming
|
2 |
Whisper realtime streaming for long speech-to-text transcription and translation
|
3 |
|
4 |
+
**Turning Whisper into Real-Time Transcription System**
|
5 |
+
|
6 |
+
Demonstration paper, by Dominik Macháček, Raj Dabre, Ondřej Bojar, 2023
|
7 |
+
|
8 |
+
Abstract: Whisper is one of the recent state-of-the-art multilingual speech recognition and translation models, however, it is not designed for real time transcription. In this paper, we build on top of Whisper and create Whisper-Streaming, an implementation of real-time speech transcription and translation of Whisper-like models. Whisper-Streaming uses local agreement policy with self-adaptive latency to enable streaming transcription. We show that Whisper-Streaming achieves high quality and 3.3 seconds latency on unsegmented long-form speech transcription test set, and we demonstrate its robustness and practical usability as a component in live transcription service at a multilingual conference.
|
9 |
+
|
10 |
+
|
11 |
+
Pre-print: https://arxiv.org/abs/2307.14743
|
12 |
+
|
13 |
Demo video: https://player.vimeo.com/video/840442741
|
14 |
|
15 |
## Installation
|
|
|
183 |
|
184 |
### Tests
|
185 |
|
186 |
+
[See the results in paper.](https://arxiv.org/abs/2307.14743)
|
187 |
|
188 |
## Contact
|
189 |
|