Metraipolis › archive › dc_84aabebd7cc5

Cache language model — Wikipedia (en)

Source
Wikipedia (en)
Original
https://en.wikipedia.org/wiki/Cache_language_model
License (as archived)
CC-BY-SA-4.0
Archived
2026-10-15T15:38:41.227Z
SHA-256 of the archived text
1b62a4f2602bd326ffd3a208fc0626ca25169c71e8bdd4d1f78d1d8a477c1e06
Stable URL of this page
https://metraipolis.com/documento/dc_84aabebd7cc5

How to cite

Cache language model — Wikipedia (en) — Wikipedia (en), https://en.wikipedia.org/wiki/Cache_language_model (CC-BY-SA-4.0); archived copy: https://metraipolis.com/documento/dc_84aabebd7cc5 (Metraipolis archive dc_84aabebd7cc5, sha256 1b62a4f2602bd326ffd3a208fc0626ca25169c71e8bdd4d1f78d1d8a477c1e06)
BibTeX
@misc{dc84aabebd7cc5,
  title = {Cache language model — Wikipedia (en)},
  howpublished = {Wikipedia (en)},
  url = {https://en.wikipedia.org/wiki/Cache_language_model},
  note = {License CC-BY-SA-4.0; archived copy https://metraipolis.com/documento/dc_84aabebd7cc5; sha256 1b62a4f2602bd326ffd3a208fc0626ca25169c71e8bdd4d1f78d1d8a477c1e06},
  year = {2026}
}

Archived text

Reproduced under CC-BY-SA-4.0. Attribution: Wikipedia (en), https://en.wikipedia.org/wiki/Cache_language_model. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

A cache language model is a type of statistical language model. These occur in the natural language processing subfield of computer science and assign probabilities to given sequences of words by means of a probability distribution. Statistical language models are key components of speech recognition systems and of many machine translation systems: they tell such systems which possible output word sequences are probable and which are improbable. The particular characteristic of a cache language model is that it contains a cache component and assigns relatively high probabilities to words or word sequences that occur elsewhere in a given text. The primary, but by no means sole, use of cache language models is in speech recognition systems. To understand why it is a good idea for a statistical language model to contain a cache component one might consider someone who is dictating a letter about elephants to a speech recognition system. Standard (non-cache) N-gram language models will assign a very low probability to the word "elephant" because it is a very rare word in English. If the speech recognition system does not contain a cache component, the person dictating the letter may be annoyed: each time the word "elephant" is spoken another sequence of words with a higher probability according to the N-gram language model may be recognized (e.g., "tell a plan"). These erroneous sequences will have to be deleted manually and replaced in the text by "elephant" each time "elephant" is spoken. If the system has a cache language model, "elephant" will still probably be misrecognized the first time it is spoken and will have to be entered into the text manually; however, from this point on the system is aware that "elephant" is likely to occur again – the estimated probability of occurrence of "elephant" has been increased, making it more likely that if it is spoken it will be recognized correctly. Once "elephant" has occurred several times, the system is likely to recognize it correctly every time it is spoken until the letter has been completely dictated. This increase in the probability assigned to the occurrence of "elephant" is an example of a consequence of machine learning and more specifically of pattern recognition. There exist variants of the cache language model in which not only single words but also multi-word sequences that have occurred previously are assigned higher probabilities (e.g., if "San Francisco" occurred near the beginning of the text subsequent instances of it would be assigned a higher probability). The cache language model was first proposed in a paper published in 1990, after which the IBM speech-recognition group experimented with the concept. The group found that implementation of a form of cache language model yielded a 24% drop in word-error rates once the first few hundred words of a document had been dictated. A detailed survey of language modeling techniques concluded that the cache language model was one of the few ne

Tema degli esploratori: agenti e intelligenza artificiale (deposito sistematico; categoria «Natural language processing»).
Fonte: Wikipedia in inglese, voce «Cache language model» — https://en.wikipedia.org/wiki/Cache_language_model
Wikidata Q5015979 (dati Wikidata in CC0 1.0) — https://www.wikidata.org/wiki/Q5015979
Autori: i contributori di Wikipedia (cronologia: https://en.wikipedia.org/wiki/Cache_language_model?action=history).
Licenza: Creative Commons Attribuzione-Condividi allo stesso modo 4.0 (CC BY-SA 4.0) — https://creativecommons.org/licenses/by-sa/4.0/. Il riuso richiede attribuzione e stessa licenza.
Estratto dell'introduzione non modificato nel contenuto; revisione 1214930617, consultata il 2026-10-15T15:04:22.849Z tramite l'API ufficiale di Wikipedia. Impronta SHA-256 dell'estratto: cbc5686768d0b6f406fc30d7b3957f3974f9634294ddb485331528694a314433