Loading...

A new bigram-PLSA language model for speech recognition

Bahrani, M ; Sharif University of Technology | 2010

745 Viewed
  1. Type of Document: Article
  2. DOI: 10.1155/2010/308437
  3. Publisher: 2010
  4. Abstract:
  5. A novel method for combining bigram model and Probabilistic Latent Semantic Analysis (PLSA) is introduced for language modeling. The motivation behind this idea is the relaxation of the bag of words assumption fundamentally present in latent topic models including the PLSA model. An EM-based parameter estimation technique for the proposed model is presented in this paper. Previous attempts to incorporate word order in the PLSA model are surveyed and compared with our new proposed model both in theory and by experimental evaluation. Perplexity measure is employed to compare the effectiveness of recently introduced models with the new proposed model. Furthermore, experiments are designed and carried out on continuous speech recognition (CSR) tasks using word error rate (WER) as the evaluation criterion. The superiority of the new bigram-PLSA model over Nie et al.'s bigram-PLSA and simple PLSA models is demonstrated in the results of our experiments. Experiments on BLLIP WSJ corpus show about 12 reduction in perplexity and 2.8 WER improvement compared to Nie et al.'s bigram-PLSA model. Copyright
  6. Keywords:
  7. Bag of words ; Evaluation criteria ; Experimental evaluation ; Language model ; Language modeling ; Latent topic model ; Novel methods ; PLSA model ; Probabilistic latent semantic analysis ; Word error rate ; Word orders ; Computational linguistics ; Continuous speech recognition ; Experiments ; Parameter estimation ; Models
  8. Source: Eurasip Journal on Advances in Signal Processing ; Volume 2010 , July , 2010 ; 16876172 (ISSN)
  9. URL: http://asp.eurasipjournals.springeropen.com/articles/10.1155/2010/308437