Metraipolis › archive › dc_57bdef29fa3a

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora — arXiv:2608.09093

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.09093
License (as archived)
CC0-1.0
Archived
2026-10-19T08:50:15.106Z
SHA-256 of the archived text
97998c7ea50063ee1491335923a8728993520cb36249ff14aba67ec1c98f6858
Stable URL of this page
https://metraipolis.com/documento/dc_57bdef29fa3a

How to cite

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora — arXiv:2608.09093 — arXiv (en), https://arxiv.org/abs/2608.09093 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_57bdef29fa3a (Metraipolis archive dc_57bdef29fa3a, sha256 97998c7ea50063ee1491335923a8728993520cb36249ff14aba67ec1c98f6858)
BibTeX
@misc{dc57bdef29fa3a,
  title = {The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora — arXiv:2608.09093},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.09093},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_57bdef29fa3a; sha256 97998c7ea50063ee1491335923a8728993520cb36249ff14aba67ec1c98f6858},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.09093. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

How a document's arrangement is written down, its notation, is a training variable that no dataset card records. The field has established that text-extraction choices change model behaviour, and has never once measured the notation of what those choices put into the corpus. We define clean-window survival, a deterministic count of how much of a stream still demands the boundary inference, and measure notation on three fronts. What corpora carry: a census of thirteen public corpora, where survival falls to 0.153 in a vision-converted PDF slice against 0.889 in C4; the scarce resource is not unmarked text but long unmarked text; a pre-registered supply test finds what remains institutional, not consumer. Our own pre-registered prediction failed: converters do not fabricate structure on prose, and that null forced the reliability mechanism that survives it. What readers use: across five base models spanning 0.6B to 8.2B and two pipelines, deleting a structural announcement makes the following prose measurably harder to predict, while swapping its notation moves nothing. That zero does not make notation unimportant; it relocates the variable: the operative cue is the announcement, not the sigil. What writers impose: a bounded null. Base models do not impose the marked register above the authored baseline, and handed prose with every announcement deleted they do not put one back, at a rate indistinguishable from zero against an authored reference of zero. We ship the format those measurements imply: the pure frame, paragraphs in authored order, every announcement deleted into a reversible sidecar, mixed against the marked copy over announcement presence rather than notation. Choose format operators by the capability they train, not by the fidelity they preserve, and record extractor identity and survival on data cards.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-11 in cs.CL).
Categorie arXiv: Computation and Language (cs.CL) ; Artificial Intelligence (cs.AI).
Pagina del lavoro: https://arxiv.org/abs/2608.09093 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-19T08:49:41.911Z dalla pagina https://arxiv.org/catchup/cs.CL/2026-08-11?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).