Recently, the speech community is seeing a significant trend of moving from deep neural
network based hybrid modeling to end-to-end (E2E) modeling for automatic speech …

Artificial Neural Networks (ANNs) were created inspired by the neural networks in the
human brain and have been widely applied in speech processing. The application areas of …

Phishing websites belong to a social engineering attack where perpetrators fake legitimate
websites to lure people to access so as to illegally acquire user's identity, password, privacy …

Sufficient knowledge extraction from the teacher network plays a critical role in the
knowledge distillation task to improve the performance of the student network. Existing …

The goal of this work is to train strong models for visual speech recognition without requiring
human annotated ground truth data. We achieve this by distilling from an Automatic Speech …

We present a novel large-context end-to-end automatic speech recognition (E2E-ASR)
model and its effective training method based on knowledge distillation. Common E2E-ASR …

Knowledge distillation (KD) approach is widely used in the deep learning field mainly for
model size reduction. KD utilizes soft labels of teacher model, which contain the dark …

Knowledge distillation (KD) is a new method for transferring knowledge of a structure under
training to another one. The conventional application of KD is in the form of learning a small …

Automatic speech recognition (ASR) is a crucial technology for man-machine interaction.
End-to-end models have been studied recently in deep learning for ASR. However, these …

Speech is one of the most effective means of communication and is full of information that
helps the transmission of utterer's thoughts. However, mainly due to the cumbersome …