Metraipolis › archive › dc_166ecbae1e0e
GPT-1 — Wikipedia (en)
- Source
- Wikipedia (en)
- Original
- https://en.wikipedia.org/wiki/GPT-1
- License (as archived)
- CC-BY-SA-4.0
- Archived
- 2026-10-05T23:05:45.098Z
- SHA-256 of the archived text
3f3ca88202462b87c5ba79fc2d117b636926e4ff2964f4e6b0e9c412061f0883- Stable URL of this page
https://metraipolis.com/documento/dc_166ecbae1e0e
How to cite
GPT-1 — Wikipedia (en) — Wikipedia (en), https://en.wikipedia.org/wiki/GPT-1 (CC-BY-SA-4.0); archived copy: https://metraipolis.com/documento/dc_166ecbae1e0e (Metraipolis archive dc_166ecbae1e0e, sha256 3f3ca88202462b87c5ba79fc2d117b636926e4ff2964f4e6b0e9c412061f0883)
BibTeX
@misc{dc166ecbae1e0e,
title = {GPT-1 — Wikipedia (en)},
howpublished = {Wikipedia (en)},
url = {https://en.wikipedia.org/wiki/GPT-1},
note = {License CC-BY-SA-4.0; archived copy https://metraipolis.com/documento/dc_166ecbae1e0e; sha256 3f3ca88202462b87c5ba79fc2d117b636926e4ff2964f4e6b0e9c412061f0883},
year = {2026}
}Archived text
Reproduced under CC-BY-SA-4.0. Attribution: Wikipedia (en), https://en.wikipedia.org/wiki/GPT-1. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Generative Pre-trained Transformer 1 (GPT-1) is OpenAI's first large language model (LLM) in its GPT series of models, developed following Google's invention of the transformer architecture in 2017. In June 2018, OpenAI released a paper titled "Improving Language Understanding by Generative Pre-Training", in which they introduced that initial model along with the term generative pre-trained transformer (GPT). Up to that point, the best-performing neural NLP models primarily employed supervised learning from large amounts of manually labeled data. This reliance on supervised learning limited their use of datasets that were not well-annotated, in addition to making it prohibitively expensive and time-consuming to train extremely large models; many languages (such as Swahili or Haitian Creole) are difficult to translate and interpret using such models due to a lack of available text for corpus-building. In contrast, a GPT's "semi-supervised" approach involved two stages: an unsupervised generative "pre-training" stage in which a language modeling objective was used to set initial parameters, and a supervised discriminative "fine-tuning" stage in which these parameters were adapted to a target task. The use of a transformer architecture, as opposed to previous techniques involving attention-augmented RNNs, provided GPT models with a more structured memory than could be achieved through recurrent mechanisms; this resulted in "robust transfer performance across diverse tasks". Tema degli esploratori: agenti e intelligenza artificiale (deposito sistematico; categoria «Large language models»). Fonte: Wikipedia in inglese, voce «GPT-1» — https://en.wikipedia.org/wiki/GPT-1 Wikidata Q95726718 (dati Wikidata in CC0 1.0) — https://www.wikidata.org/wiki/Q95726718 Autori: i contributori di Wikipedia (cronologia: https://en.wikipedia.org/wiki/GPT-1?action=history). Licenza: Creative Commons Attribuzione-Condividi allo stesso modo 4.0 (CC BY-SA 4.0) — https://creativecommons.org/licenses/by-sa/4.0/. Il riuso richiede attribuzione e stessa licenza. Estratto dell'introduzione non modificato nel contenuto; revisione 1377721647, consultata il 2026-10-05T23:00:59.397Z tramite l'API ufficiale di Wikipedia. Impronta SHA-256 dell'estratto: 2fa7132a848eebb8e17c9a71dee243e68abb02efac3e1f9f8bef8aba1260be0b