어텐션 기반 엔드투엔드 음성인식 시각화 분석 Visual analysis of attention-based end-to-end speech recognition

Cited 0 time in webofscience Cited 0 time in scopus
  • Hit : 1128
  • Download : 352
An end-to-end speech recognition model consisting of a single integrated neural network model was recently proposed. The end-to-end model does not need several training steps, and its structure is easy to understand. However, it is difficult to understand how the model recognizes speech internally. In this paper, we visualized and analyzed the attention-based end-to-end model to elucidate its internal mechanisms. We compared the acoustic model of the BLSTM-HMM hybrid model with the encoder of the end-to-end model, and visualized them using t-SNE to examine the difference between neural network layers. As a result, we were able to delineate the difference between the acoustic model and the end-to-end model encoder. Additionally, we analyzed the decoder of the end-to-end model from a language model perspective. Finally, we found that improving end-to-end model decoder is necessary to yield higher performance.
Publisher
한국음성학회
Issue Date
2019-03
Language
Korean
Citation

말소리와 음성과학, v.11, no.1, pp.41 - 49

ISSN
2005-8063
DOI
10.13064/KSSS.2019.11.1.041
URI
http://hdl.handle.net/10203/263262
Appears in Collection
EE-Journal Papers(저널논문)
Files in This Item
109888.pdf(751.77 kB)Download

qr_code

  • mendeley

    citeulike


rss_1.0 rss_2.0 atom_1.0