Dominik Macháček commited on
Commit
2249846
·
1 Parent(s): fc74626

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +10 -1
README.md CHANGED
@@ -1,6 +1,15 @@
1
  # whisper_streaming
2
  Whisper realtime streaming for long speech-to-text transcription and translation
3
 
 
 
 
 
 
 
 
 
 
4
  Demo video: https://player.vimeo.com/video/840442741
5
 
6
  ## Installation
@@ -174,7 +183,7 @@ Contributions are welcome.
174
 
175
  ### Tests
176
 
177
- Rigorous quality and latency tests are pending.
178
 
179
  ## Contact
180
 
 
1
  # whisper_streaming
2
  Whisper realtime streaming for long speech-to-text transcription and translation
3
 
4
+ **Turning Whisper into Real-Time Transcription System**
5
+
6
+ Demonstration paper, by Dominik Macháček, Raj Dabre, Ondřej Bojar, 2023
7
+
8
+ Abstract: Whisper is one of the recent state-of-the-art multilingual speech recognition and translation models, however, it is not designed for real time transcription. In this paper, we build on top of Whisper and create Whisper-Streaming, an implementation of real-time speech transcription and translation of Whisper-like models. Whisper-Streaming uses local agreement policy with self-adaptive latency to enable streaming transcription. We show that Whisper-Streaming achieves high quality and 3.3 seconds latency on unsegmented long-form speech transcription test set, and we demonstrate its robustness and practical usability as a component in live transcription service at a multilingual conference.
9
+
10
+
11
+ Pre-print: https://arxiv.org/abs/2307.14743
12
+
13
  Demo video: https://player.vimeo.com/video/840442741
14
 
15
  ## Installation
 
183
 
184
  ### Tests
185
 
186
+ [See the results in paper.](https://arxiv.org/abs/2307.14743)
187
 
188
  ## Contact
189