Metraipolis › archive › dc_755bed3f7607

TranScope: What the Software Hides About LLM Training Data, the Hardware Reveals at Scale, and Accelerators Magnify — arXiv:2610.06848

Source
arXiv
Original
https://arxiv.org/abs/2610.06848
License (as archived)
CC0-1.0
Archived
2026-10-06T05:29:59.726Z
SHA-256 of the archived text
bde0177fcf50c4c0e899e12706f12e0d7c90069d0912bf6e3defac5190b730e6
Stable URL of this page
https://metraipolis.com/documento/dc_755bed3f7607

How to cite

TranScope: What the Software Hides About LLM Training Data, the Hardware Reveals at Scale, and Accelerators Magnify — arXiv:2610.06848 — arXiv, https://arxiv.org/abs/2610.06848 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_755bed3f7607 (Metraipolis archive dc_755bed3f7607, sha256 bde0177fcf50c4c0e899e12706f12e0d7c90069d0912bf6e3defac5190b730e6)
BibTeX
@misc{dc755bed3f7607,
  title = {TranScope: What the Software Hides About LLM Training Data, the Hardware Reveals at Scale, and Accelerators Magnify — arXiv:2610.06848},
  howpublished = {arXiv},
  url = {https://arxiv.org/abs/2610.06848},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_755bed3f7607; sha256 bde0177fcf50c4c0e899e12706f12e0d7c90069d0912bf6e3defac5190b730e6},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv, https://arxiv.org/abs/2610.06848. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Membership is the root privacy primitive in machine learning: to date, no hardware-based out-of-distribution detection on black-box models has been demonstrated against constant-time, static neural networks with masked confidence. This paper performs the first cycle-level examination of how large language models and vision transformers interact with various modern microarchitecture components, including integrated accelerators, as LLMs scale in size and answers the question of whether the data that a model was trained on affects its execution footprint even without any input-dependent branch, dynamic optimization, or early exit and in constant-time models. The results confirm that the answer is yes and identify which modern hardware components, such as TLBs or on-core accelerators, reveal or amplify that effect. The results also answer whether the signal is informative enough to reliably classify the in-/vs/out-of-distribution property of membership. To understand why, we perform a systematic root cause analysis and find that the transformer's tokenization steps, which happen during training, alter the locality of the accesses the model makes to fetch the vocabulary token later during inference and, as a result, change the page table access patterns and TLB in a previously unknown data-dependent way, causing microarchitectural state to vary significantly based on whether or not the input was in the distribution of the transformer training data. Building on the above observation, we introduce TranScope: the first microarchitecture tool for detecting membership information with low cost, no need for a surrogate model, and significantly higher robustness, e.g., 0.6 AUC for PETAL (best previously reported) vs 0.9 AUC (ours). This reintroduces hardware as both an opportunity, e.g., a tool for checking copyright violation for the first time, and a new channel for inferring membership (MIA).

Tema degli esploratori: fiducia digitale e crittografia (elenco arXiv cs.CR, nuovi lavori del giorno).
Categorie arXiv: Cryptography and Security (cs.CR).
Pagina del lavoro: https://arxiv.org/abs/2610.06848 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-06T05:26:35.379Z dalla pagina https://arxiv.org/list/cs.CR/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).