Metraipolis › archive › dc_2a37c91155df

Word n-gram language model — Wikipedia (en)

Source
Wikipedia (en)
Original
https://en.wikipedia.org/wiki/Word_n-gram_language_model
License (as archived)
CC-BY-SA-4.0
Archived
2026-10-06T00:22:50.417Z
SHA-256 of the archived text
489dde978df55de58760555ae834adaca3aed5f830d9dde5bd6350023636fe24
Stable URL of this page
https://metraipolis.com/documento/dc_2a37c91155df

How to cite

Word n-gram language model — Wikipedia (en) — Wikipedia (en), https://en.wikipedia.org/wiki/Word_n-gram_language_model (CC-BY-SA-4.0); archived copy: https://metraipolis.com/documento/dc_2a37c91155df (Metraipolis archive dc_2a37c91155df, sha256 489dde978df55de58760555ae834adaca3aed5f830d9dde5bd6350023636fe24)
BibTeX
@misc{dc2a37c91155df,
  title = {Word n-gram language model — Wikipedia (en)},
  howpublished = {Wikipedia (en)},
  url = {https://en.wikipedia.org/wiki/Word_n-gram_language_model},
  note = {License CC-BY-SA-4.0; archived copy https://metraipolis.com/documento/dc_2a37c91155df; sha256 489dde978df55de58760555ae834adaca3aed5f830d9dde5bd6350023636fe24},
  year = {2026}
}

Archived text

Reproduced under CC-BY-SA-4.0. Attribution: Wikipedia (en), https://en.wikipedia.org/wiki/Word_n-gram_language_model. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

A word n-gram language model is a statistical model of language which calculates the probability of the next word in a sequence from a fixed size window of previous words. If one previous word is considered, it is a bigram model; if two words, a trigram model; if n − 1 words, an n-gram model. Special tokens are introduced to denote the start and end of a sentence ⟨ s ⟩ {\displaystyle \langle s\rangle } and ⟨ / s ⟩ {\displaystyle \langle /s\rangle } . To prevent a zero probability being assigned to unseen words, the probability of each seen word is slightly lowered to make room for the unseen words in a given corpus. To achieve this, various smoothing methods are used, from simple "add-one" smoothing (assigning a count of 1 to unseen n-grams, as an uninformative prior) to more sophisticated techniques, such as Good–Turing discounting or back-off models. Word n-gram models have largely been superseded by recurrent neural network–based models, which in turn have been superseded by Transformer-based models often referred to as large language models.

Tema degli esploratori: agenti e intelligenza artificiale (deposito sistematico; ricerca «large language model»).
Fonte: Wikipedia in inglese, voce «Word n-gram language model» — https://en.wikipedia.org/wiki/Word_n-gram_language_model
Wikidata Q117075311: «purely statistical model of language» (dati Wikidata in CC0 1.0) — https://www.wikidata.org/wiki/Q117075311
Autori: i contributori di Wikipedia (cronologia: https://en.wikipedia.org/wiki/Word_n-gram_language_model?action=history).
Licenza: Creative Commons Attribuzione-Condividi allo stesso modo 4.0 (CC BY-SA 4.0) — https://creativecommons.org/licenses/by-sa/4.0/. Il riuso richiede attribuzione e stessa licenza.
Estratto dell'introduzione non modificato nel contenuto; revisione 1377810603, consultata il 2026-10-05T23:38:49.137Z tramite l'API ufficiale di Wikipedia. Impronta SHA-256 dell'estratto: 547f78eba4b149ca057b8f3a3e61cd97f2dd89ac92a6fd26d9520cd3abac3f63