视听语音识别(Audio-visual speech recognition)视听语音识别(AVSR)和唇读的问题紧密相关。Mroueh等[36]使用前馈深度神经网络(DNN)在大型非公共视听数据集上进行音素分类。事实证明,将HMM与手工制作或预先训练的视觉功能结合使用很普遍——[48]使用DBF编码输入图像;[20]使用DCT;[38]使用经过预训练的CNN对音素进行分类...
(2) we investigate to what extent lip reading is complementary to audio speech recognition, especially when the audio signal is noisy; (3) we introduce and publicly release a new dataset for audio-visual speech recognition, LRS2-BBC, consisting of thousands of natural sentences from British ...
Audio-visual speech recognition (AVSR) system is thought to be one of the most promising solutions for reliable speech recognition, particularly when the audio is corrupted by noise. However, cautious selection of sensory features is crucial for attainin
Audio-visual deep learning for noise robust speech recognition. In Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Con-... H Jing,B Kingsbury - IEEE International Conference on Acoustics 被引量: 99发表: 2013年 Listening with Your Eyes: Towards a Practical Visual Speech...
本文探讨了深度音频-视觉语音分离技术，通过引入注意力机制提升分离效果。文章引入了基于《The Conversation:Deep Audio-Viusal Speech Enhancement》的baseline模型，其特点在于利用了一个目标说话人的视觉流。然而，该文章进一步创新，提出了深度音频-视觉语音分离方法，并在模型中加入了注意力机制，以更精准地...
论文地址:相位感知深度语音增强:这完全取决于帧长 论文代码:https://github.com/CarmiShimon/Phase-Aware-Deep-Speech-Enhancement 引用格式:Peer T, Gerkmann T. Phase-aware deep speech enha
s converservation in a crowded city square. Despite many ingenious placements of microphones, he did not use the lip motion of the speakers to suppress speech from others nearby. In this paper we propose a new model for this task of audio-visual speech enhancement, that he could have used....
2、proposed deep audio-visual speech separation with attention baseline只输入一个说话人的visual representation, 而作者模型将两个说话人的visual representation输入到模型中。 图3 这仅仅表示magnitude subnetwork, phase subnetwork 和baseline一样 Attention Mechanism for Audio-Visual Speech Separation 作者还提出一...
A deep model for speech recognition via Keras(front_end) and TensorFlow(back_end). - saturn-lab/audioNet
To create the datasets for training, I gathered english speech clean voices and environmental noises from different sources. The clean voices were mainly gathered fromLibriSpeech: an ASR corpus based on public domain audio books. I used as well some datas fromSiSec. The environmental noises were ...