Metraipolis › archive › dc_6c2fb217712e

From Language to Behavior: Scaling Sequence Transformers for Industrial Recommendation Ranking with Rec-Native Designs — arXiv:2609.01240

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.01240
License (as archived)
CC0-1.0
Archived
2026-10-17T06:34:01.644Z
SHA-256 of the archived text
2dff51876509721b76c4e5d5f87f7cd750e867540a080e4463bfdcfc303a392e
Stable URL of this page
https://metraipolis.com/documento/dc_6c2fb217712e

How to cite

From Language to Behavior: Scaling Sequence Transformers for Industrial Recommendation Ranking with Rec-Native Designs — arXiv:2609.01240 — arXiv (en), https://arxiv.org/abs/2609.01240 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_6c2fb217712e (Metraipolis archive dc_6c2fb217712e, sha256 2dff51876509721b76c4e5d5f87f7cd750e867540a080e4463bfdcfc303a392e)
BibTeX
@misc{dc6c2fb217712e,
  title = {From Language to Behavior: Scaling Sequence Transformers for Industrial Recommendation Ranking with Rec-Native Designs — arXiv:2609.01240},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.01240},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_6c2fb217712e; sha256 2dff51876509721b76c4e5d5f87f7cd750e867540a080e4463bfdcfc303a392e},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.01240. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Scaling Transformers has driven large gains in language modeling, but transplanting this to behavior-sequence modeling in production ranking is challenging: recommendation differs in signal quality, where behavior sequences are noisy, temporally irregular, and sparsely supervised, and in computation asymmetry, where each request scores many candidates against one shared user history under tight latency budgets. We propose ReST, a recommendation-native Transformer scaling framework. For signal quality, it introduces a sequence encoder with dual-gated attention, rotary positional and temporal embedding, stabilized residual normalization, and training-only auxiliary objectives. For computation asymmetry, it factorizes ranking into a heavy reusable encoder and a lightweight cross decoder with projection-free KV attention and token-specific parameterization, coupling user-level shared-prefix training with shared-prefix serving for compute-once, decode-many-times ranking. Across industrial and public benchmarks, ReST achieves higher accuracy and scales more consistently along sequence length, depth, and width, where LLM-style Transformer blocks saturate. A one-week online A/B test on a production advertising platform improves online AUC by 1.31% and lifts a core revenue metric by 11.93% within a 50 ms P99 budget; ReST has since been fully deployed in production, showing that behavior-sequence scaling remains a promising, under-exploited axis for production ranking.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-02 in cs.AI).
Categorie arXiv: Information Retrieval (cs.IR) ; Artificial Intelligence (cs.AI); Machine Learning (cs.LG).
Pagina del lavoro: https://arxiv.org/abs/2609.01240 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-17T06:15:12.874Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-09-02?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).