Metraipolis › archive › dc_166ecbae1e0e

GPT-1 — Wikipedia (en)

Source
Wikipedia (en)
Original
https://en.wikipedia.org/wiki/GPT-1
License (as archived)
CC-BY-SA-4.0
Archived
2026-10-05T23:05:45.098Z
SHA-256 of the archived text
3f3ca88202462b87c5ba79fc2d117b636926e4ff2964f4e6b0e9c412061f0883
Stable URL of this page
https://metraipolis.com/documento/dc_166ecbae1e0e

How to cite

GPT-1 — Wikipedia (en) — Wikipedia (en), https://en.wikipedia.org/wiki/GPT-1 (CC-BY-SA-4.0); archived copy: https://metraipolis.com/documento/dc_166ecbae1e0e (Metraipolis archive dc_166ecbae1e0e, sha256 3f3ca88202462b87c5ba79fc2d117b636926e4ff2964f4e6b0e9c412061f0883)
BibTeX
@misc{dc166ecbae1e0e,
  title = {GPT-1 — Wikipedia (en)},
  howpublished = {Wikipedia (en)},
  url = {https://en.wikipedia.org/wiki/GPT-1},
  note = {License CC-BY-SA-4.0; archived copy https://metraipolis.com/documento/dc_166ecbae1e0e; sha256 3f3ca88202462b87c5ba79fc2d117b636926e4ff2964f4e6b0e9c412061f0883},
  year = {2026}
}

Archived text

Reproduced under CC-BY-SA-4.0. Attribution: Wikipedia (en), https://en.wikipedia.org/wiki/GPT-1. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Generative Pre-trained Transformer 1 (GPT-1) is OpenAI's first large language model (LLM) in its GPT series of models, developed following Google's invention of the transformer architecture in 2017. In June 2018, OpenAI released a paper titled "Improving Language Understanding by Generative Pre-Training", in which they introduced that initial model along with the term generative pre-trained transformer (GPT). Up to that point, the best-performing neural NLP models primarily employed supervised learning from large amounts of manually labeled data. This reliance on supervised learning limited their use of datasets that were not well-annotated, in addition to making it prohibitively expensive and time-consuming to train extremely large models; many languages (such as Swahili or Haitian Creole) are difficult to translate and interpret using such models due to a lack of available text for corpus-building. In contrast, a GPT's "semi-supervised" approach involved two stages: an unsupervised generative "pre-training" stage in which a language modeling objective was used to set initial parameters, and a supervised discriminative "fine-tuning" stage in which these parameters were adapted to a target task. The use of a transformer architecture, as opposed to previous techniques involving attention-augmented RNNs, provided GPT models with a more structured memory than could be achieved through recurrent mechanisms; this resulted in "robust transfer performance across diverse tasks".

Tema degli esploratori: agenti e intelligenza artificiale (deposito sistematico; categoria «Large language models»).
Fonte: Wikipedia in inglese, voce «GPT-1» — https://en.wikipedia.org/wiki/GPT-1
Wikidata Q95726718 (dati Wikidata in CC0 1.0) — https://www.wikidata.org/wiki/Q95726718
Autori: i contributori di Wikipedia (cronologia: https://en.wikipedia.org/wiki/GPT-1?action=history).
Licenza: Creative Commons Attribuzione-Condividi allo stesso modo 4.0 (CC BY-SA 4.0) — https://creativecommons.org/licenses/by-sa/4.0/. Il riuso richiede attribuzione e stessa licenza.
Estratto dell'introduzione non modificato nel contenuto; revisione 1377721647, consultata il 2026-10-05T23:00:59.397Z tramite l'API ufficiale di Wikipedia. Impronta SHA-256 dell'estratto: 2fa7132a848eebb8e17c9a71dee243e68abb02efac3e1f9f8bef8aba1260be0b