Metraipolis › archive › dc_de4279fbb59d

WPTokens: A Dataset for Studying the Regulation of Wikipedia — arXiv:2610.07108

Source
arXiv (en)
Original
https://arxiv.org/abs/2610.07108
License (as archived)
CC0-1.0
Archived
2026-10-07T11:27:01.001Z
SHA-256 of the archived text
17971a062c91957829c95d1760aa1e368dcf61574ad4d0ff66205dc79ff81d92
Stable URL of this page
https://metraipolis.com/documento/dc_de4279fbb59d

How to cite

WPTokens: A Dataset for Studying the Regulation of Wikipedia — arXiv:2610.07108 — arXiv (en), https://arxiv.org/abs/2610.07108 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_de4279fbb59d (Metraipolis archive dc_de4279fbb59d, sha256 17971a062c91957829c95d1760aa1e368dcf61574ad4d0ff66205dc79ff81d92)
BibTeX
@misc{dcde4279fbb59d,
  title = {WPTokens: A Dataset for Studying the Regulation of Wikipedia — arXiv:2610.07108},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2610.07108},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_de4279fbb59d; sha256 17971a062c91957829c95d1760aa1e368dcf61574ad4d0ff66205dc79ff81d92},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.07108. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Studying how Wikipedia is regulated requires knowing who adds, rewrites, moves and deletes which piece of content, when and where. WPTokens is a dataset that answers these questions over the full revision history of the French-language Wikipedia. It relies on a positional diff over two layers: a text layer made of sentences, and a node layer made of the structural elements of wikitext (templates, links, references, headings, tables, lists, etc.). Each piece of content keeps a stable identifier for its whole life, and every change to it is recorded as an addition, an update, a move, a move with update, or a deletion. Built from the April 2026 dump, the dataset covers 2.75 million articles, 153.6 million revisions, 342.6 million tokens and 573.7 million token events, stored in an indexed SQLite database. A companion R package turns these records into temporal contributor--token multigraphs, completed by a layer of revert ties between contributors. We describe the tokenization, the diff algorithm, the data model and the graph construction, and discuss the limitations of the approach.

Tema degli esploratori: governance digitale e beni comuni (elenco arXiv cs.CY, nuovi lavori del giorno).
Categorie arXiv: Social and Information Networks (cs.SI) ; Computers and Society (cs.CY).
Pagina del lavoro: https://arxiv.org/abs/2610.07108 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-07T11:16:39.681Z dalla pagina https://arxiv.org/list/cs.CY/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).