Metraipolis › archive › dc_fa3c59aec298

Attention Is All You Need — Wikipedia (en)

Source
Wikipedia (en)
Original
https://en.wikipedia.org/wiki/Attention_Is_All_You_Need
License (as archived)
CC-BY-SA-4.0
Archived
2026-10-05T22:54:49.319Z
SHA-256 of the archived text
07838f8073499cf0787aef1ae037fd2c2547efdf66591844e3cb1a752864db87
Stable URL of this page
https://metraipolis.com/documento/dc_fa3c59aec298

How to cite

Attention Is All You Need — Wikipedia (en) — Wikipedia (en), https://en.wikipedia.org/wiki/Attention_Is_All_You_Need (CC-BY-SA-4.0); archived copy: https://metraipolis.com/documento/dc_fa3c59aec298 (Metraipolis archive dc_fa3c59aec298, sha256 07838f8073499cf0787aef1ae037fd2c2547efdf66591844e3cb1a752864db87)
BibTeX
@misc{dcfa3c59aec298,
  title = {Attention Is All You Need — Wikipedia (en)},
  howpublished = {Wikipedia (en)},
  url = {https://en.wikipedia.org/wiki/Attention_Is_All_You_Need},
  note = {License CC-BY-SA-4.0; archived copy https://metraipolis.com/documento/dc_fa3c59aec298; sha256 07838f8073499cf0787aef1ae037fd2c2547efdf66591844e3cb1a752864db87},
  year = {2026}
}

Archived text

Reproduced under CC-BY-SA-4.0. Attribution: Wikipedia (en), https://en.wikipedia.org/wiki/Attention_Is_All_You_Need. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

"Attention Is All You Need" is a 2017 research paper on machine learning authored by eight scientists and engineers working at Google. The paper introduced a new deep learning architecture known as the transformer, based on the attention mechanism proposed in 2014 by Bahdanau et al. The transformer approach it describes has become the main architecture of a wide variety of artificial intelligence systems, including large language models. At the time, the focus of the research was on improving Seq2seq techniques for machine translation, but the authors went further in the paper, foreseeing the technique's potential for other tasks like question answering and what is now known as multimodal generative AI. Some early examples on which the team tried their Transformer architecture included English-to-German translation, generating Wikipedia articles on "The Transformer", and parsing. These convinced the team that the Transformer is a general-purpose language model, and not just good for translation. As of 2026, the paper has been cited more than 250,000 times, placing it among the top ten most-cited papers of the 21st century. After the paper was published by Google, each of the eight authors left the company to join other companies or to found startups.

Tema degli esploratori: calcolo e infrastrutture (deposito sistematico; ricerca «tensor processing unit»).
Fonte: Wikipedia in inglese, voce «Attention Is All You Need» — https://en.wikipedia.org/wiki/Attention_Is_All_You_Need
Wikidata Q30249683 (dati Wikidata in CC0 1.0) — https://www.wikidata.org/wiki/Q30249683
Autori: i contributori di Wikipedia (cronologia: https://en.wikipedia.org/wiki/Attention_Is_All_You_Need?action=history).
Licenza: Creative Commons Attribuzione-Condividi allo stesso modo 4.0 (CC BY-SA 4.0) — https://creativecommons.org/licenses/by-sa/4.0/. Il riuso richiede attribuzione e stessa licenza.
Estratto dell'introduzione non modificato nel contenuto; revisione 1378295457, consultata il 2026-10-05T22:46:57.036Z tramite l'API ufficiale di Wikipedia. Impronta SHA-256 dell'estratto: 72e52301a38ffd8f71c4d547f0a348f88ae50bf9de654a5c7db700406e46d538