National Repository of Grey Literature 1 records found  Search took 0.04 seconds. 
Multi-Source Simultaneous Speech Translation
Macháček, Dominik ; Bojar, Ondřej (advisor) ; Yvon, Francois (referee) ; Niehues, Jan (referee)
Neural machine translation has the capability to translate from several parallel in- puts into different languages. Current simultaneous speech translation sometimes faces issues with quality, especially when the source is noisy. We investigate the opportunity to use multiple parallel speech signals - the original and simultaneous interpreting - as sources for translation to achieve higher quality. We create an evaluation set ESIC (Europarl Simultaneous Interpreting Corpus). We analyze the challenges of simultane- ous interpreting when used as an additional parallel source. Then, we investigate the robustness of multi-sourcing to transcription errors and assess the reliability of machine translation metrics when evaluating simultaneous speech translation. Last but not least, we implement Whisper-Streaming, a tool that enables real-time processing of large offline speech-to-text models and demonstrates the state of the art. 1

Interested in being notified about new results for this query?
Subscribe to the RSS feed.