Adaptive Language Modeling With Minimum Discriminant Estimation.pdf

H92-1020.pdf
Preview of Adaptive Language Modeling with Minimum Discriminant Estimation
🔗 Source: aclanthology.org
📊 Size: 280 KB
👤 Author: S. Della Pietra; V. Della Pietra; R. L. Mercer; S. Roukos
⬇️ Downloads: 29

Summary

The authors present an algorithm to adapt an n-gram language model to a document as it's dictated, improving its accuracy. Here's a concise summary:

- Problem: Static n-gram language models (SLM) have fixed probabilities, independent of the document being predicted, leading to suboptimal performance.
- Solution: Adapt the language model to match the current document more closely using a partially dictated document.
- Method: Estimate a unigram distribution for observed words, then find the closest n-gram distribution to the static one that satisfies the marginal constraints derived from the document, using minimum discrimination information (MDI) estimation.
- Algorithm: Alternating minimization, cycling through constraints until convergence.
- Application: Implemented for a bigram model (ME cache), reducing perplexity from 290 to 208 on a 321-word document.
- Previous Work: Similar approaches were used for part-of-speech models and trigram models, showing up to 25% lower recognition error rates.

Description

Algorithm adapts n-gram language model to a dictating document, reducing perplexity from 290 to 208 on a 321-word document.

Technical Information

  • File Format: PDF
  • File Size: 280 KB
  • Pages: 4
  • Language: EN
  • Author: S. Della Pietra; V. Della Pietra; R. L. Mercer; S. Roukos
  • Total Downloads: 29
  • Last Updated: 2 hours ago

Document Overview

This PDF document about Adaptive Language Modeling with Minimum Discriminant Estimation provides comprehensive information and guidance. Whether you're a beginner or advanced user, this resource offers valuable insights into Adaptive Language Modeling with Minimum Discriminant Estimation.

Related Topics

If you're interested in Adaptive Language Modeling with Minimum Discriminant Estimation, you might also want to explore:

Download Adaptive Language Modeling with Minimum Discriminant Estimation eBooks for free and learn more about Adaptive Language Modeling with Minimum Discriminant Estimation. These books contain exercises and tutorials to improve your practical skills, at all levels!

Not satisfied with this document? We have related documents to Adaptive Language Modeling with Minimum Discriminant Estimation, try searching with similar keywords: Adaptive Language Modeling with Minimum Discriminant Estimation, Manual For The Patterns Of Adaptive Adaptive Learning, arborecence maximale de cout minimum d exercice corrigee cout minimum, Living A Minimum Lifestyle On Minimum, Minimum 10 Year Outcome Of Minimum 10 Year Outcome, Adaptive Covariance Matrix Estimation Through Bloc, Adaptive Kernel Density Estimation, Channel Estimation And Prediction Based Adaptive W

You can download PDF versions of the user's guide, manuals and ebooks about Adaptive Language Modeling with Minimum Discriminant Estimation, you can also find and download for free A free online manual (notices) with beginner and intermediate, Downloads Documentation, You can download PDF files (or DOC and PPT) about Adaptive Language Modeling with Minimum Discriminant Estimation for free, but please respect copyrighted ebooks.