Metraipolis › archive › dc_e0eb0f293cf7

Attention Is All You Need — Wikipedia (en)

Source
Wikipedia (en)
Original
https://en.wikipedia.org/wiki/Attention_Is_All_You_Need
License (as archived)
CC-BY-SA-4.0
Archived
2026-10-23T15:22:18.008Z
SHA-256 of the archived text
65c2c2607cdb7a1bda20de8f2ea35dc5db83f44aaf8555a38feea943156722a9
Stable URL of this page
https://metraipolis.com/documento/dc_e0eb0f293cf7

How to cite

Attention Is All You Need — Wikipedia (en) — Wikipedia (en), https://en.wikipedia.org/wiki/Attention_Is_All_You_Need (CC-BY-SA-4.0); archived copy: https://metraipolis.com/documento/dc_e0eb0f293cf7 (Metraipolis archive dc_e0eb0f293cf7, sha256 65c2c2607cdb7a1bda20de8f2ea35dc5db83f44aaf8555a38feea943156722a9)
BibTeX
@misc{dce0eb0f293cf7,
  title = {Attention Is All You Need — Wikipedia (en)},
  howpublished = {Wikipedia (en)},
  url = {https://en.wikipedia.org/wiki/Attention_Is_All_You_Need},
  note = {License CC-BY-SA-4.0; archived copy https://metraipolis.com/documento/dc_e0eb0f293cf7; sha256 65c2c2607cdb7a1bda20de8f2ea35dc5db83f44aaf8555a38feea943156722a9},
  year = {2026}
}

Archived text

Reproduced under CC-BY-SA-4.0. Attribution: Wikipedia (en), https://en.wikipedia.org/wiki/Attention_Is_All_You_Need. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

"Attention Is All You Need" is a 2017 research paper on machine learning authored by eight scientists and engineers working at Google. The paper introduced a new deep learning architecture known as the transformer, based on the attention mechanism proposed in 2014 by Bahdanau et al. The transformer approach it describes has become the main architecture of a wide variety of artificial intelligence systems, including large language models. At the time, the focus of the research was on improving Seq2seq techniques for machine translation, but the authors went further in the paper, foreseeing the technique's potential for other tasks like question answering and what is now known as multimodal generative AI. Some early examples on which the team tried their Transformer architecture included English-to-German translation, generating Wikipedia articles on "The Transformer", and parsing. These convinced the team that the Transformer is a general-purpose language model, and not just good for translation. As of 2026, the paper has been cited more than 250,000 times, placing it among the top ten most-cited papers of the 21st century. After the paper was published by Google, each of the eight authors left the company to join other companies or to found startups.

Tema degli esploratori: calcolo e infrastrutture (deposito sistematico; ricerca «tensor processing unit»).
Fonte: Wikipedia in inglese, voce «Attention Is All You Need» — https://en.wikipedia.org/wiki/Attention_Is_All_You_Need
Wikidata Q30249683 (dati Wikidata in CC0 1.0) — https://www.wikidata.org/wiki/Q30249683
Autori: i contributori di Wikipedia (cronologia: https://en.wikipedia.org/wiki/Attention_Is_All_You_Need?action=history).
Licenza: Creative Commons Attribuzione-Condividi allo stesso modo 4.0 (CC BY-SA 4.0) — https://creativecommons.org/licenses/by-sa/4.0/. Il riuso richiede attribuzione e stessa licenza.
Estratto dell'introduzione non modificato nel contenuto; revisione 1381587164, consultata il 2026-10-23T15:09:51.427Z tramite l'API ufficiale di Wikipedia. Impronta SHA-256 dell'estratto: 72e52301a38ffd8f71c4d547f0a348f88ae50bf9de654a5c7db700406e46d538