Feature-rich continuous language models for speech recognition

P Mirowski, S Chopra, S Balakrishnan… - … Spoken Language …, 2010 - ieeexplore.ieee.org
… While language modeling is our task and hence test perplexity is a natural evaluation
metric, we also evaluate our model on word accuracy for speech recognition (section 4.3). …

[PDF][PDF] Bilingual word embeddings for phrase-based machine translation

WY Zou, R Socher, D Cer… - … in natural language …, 2013 - aclanthology.org
… A number of methods have been explored to train and apply word embeddings using
continuous models for language. Collobert et al. (2008) learn embeddings in an unsupervised …

Discriminative adaptation of continuous space translation models

QK Do, A Allauzen, F Yvon - … Workshop on Spoken Language …, 2014 - aclanthology.org
… do here, SMT systems rely on Continuous Space Language Models (CSLMs) or Translation
… as more efficient to train FeatureRich Translation systems. This property is especially rele…

[PDF][PDF] Feature-rich sub-lexical language models using a maximum entropy approach for German LVCSR.

MAB Shaik, AED Mousa, R Schlüter, H Ney - Interspeech, 2013 - academia.edu
language model (LM) probabilities in the large vocabulary continuous speech recognition
(LVCSR) systems… LM could be further improved using feature-rich LMs like maximum entropy (…

Improved relation extraction with feature-rich compositional embedding models

MR Gormley, M Yu, M Dredze - arXiv preprint arXiv:1505.02419, 2015 - arxiv.org
… information relies on continuous word embeddings2 as … -art systems, they are used
alongside features of the broader … We are the first to apply neural language model embeddings …

[PDF][PDF] Fast and robust neural network joint models for statistical machine translation

J Devlin, R Zbib, Z Huang, T Lamar… - proceedings of the …, 2014 - aclanthology.org
… of +3.0 BLEU on top of a powerful, featurerich baseline which already includes a target-only …
lation direction of the languages, as well as the direction of the language model. We denote …

[PDF][PDF] Morpheme level hierarchical pitman-yor class-based language models for LVCSR of morphologically rich languages.

AED Mousa, MAB Shaik… - …, 2013 - www-i6.informatik.rwth-aachen.de
… We make use of the HPYLM methodology to build CLMs using … , along with the benefits of
feature-rich modeling, in addition to … language modeling in continuous space,” in Proc. Human …

Neural network translation models for grammatical error correction

S Chollampatt, K Taghipour, HT Ng - arXiv preprint arXiv:1606.00189, 2016 - arxiv.org
… We take advantage of continuous space representation by … language model features: a
5-gram language model trained … by data-intensive and feature-rich statistical machine translation. …

[PDF][PDF] Morpheme Level Feature-based Language Models for German LVCSR.

AED Mousa, MAB Shaik, R Schlüter, H Ney - INTERSPEECH, 2012 - isca-archive.org
… Thus, we combine the benefits of both morpheme level and feature rich modeling. We … -mixture
language modeling in continuous space,” in Proc. Human Language Technology …

Analysis methods in neural language processing: A survey

Y Belinkov, J Glass - … of the Association for Computational Linguistics, 2019 - direct.mit.edu
… in various tasks, including language modeling (Mikolov et al., … In many cases, traditional
feature-rich systems are being … MT system after mapping sentences into continuous space with …