Metraipolis › archive › dc_cb1752730274

QueryFormer: Winning Solution for KDD Cup 2026 Tencent UniRec Challenge — arXiv:2609.16548

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.16548
License (as archived)
CC0-1.0
Archived
2026-10-15T18:32:06.503Z
SHA-256 of the archived text
f314f5859197ea6ad90d9fc3b2d3e947808acf6e5d7e2869be3a2df74b137eca
Stable URL of this page
https://metraipolis.com/documento/dc_cb1752730274

How to cite

QueryFormer: Winning Solution for KDD Cup 2026 Tencent UniRec Challenge — arXiv:2609.16548 — arXiv (en), https://arxiv.org/abs/2609.16548 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_cb1752730274 (Metraipolis archive dc_cb1752730274, sha256 f314f5859197ea6ad90d9fc3b2d3e947808acf6e5d7e2869be3a2df74b137eca)
BibTeX
@misc{dccb1752730274,
  title = {QueryFormer: Winning Solution for KDD Cup 2026 Tencent UniRec Challenge — arXiv:2609.16548},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.16548},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_cb1752730274; sha256 f314f5859197ea6ad90d9fc3b2d3e947808acf6e5d7e2869be3a2df74b137eca},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.16548. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Post-click conversion rate (pCVR) prediction requires jointly modeling feature interactions and sequential user behaviors. The KDD Cup 2026 Tencent UniRec Challenge calls for a unified architecture addressing both. We observe that existing unified architectures often generate query tokens---the central information hub---with projection-based multi-layer perceptrons (MLPs), without explicit token-to-query attention for refining the query side. We propose QueryFormer, centered on a stackable unified field--sequence block that bridges non-sequential multi-field features and behavioral sequences, and provide a latency-aware scaling study over view width $H$, model width, depth, data, and compute. The block generates queries through cross-attention and packs sequence queries into shared-parameter attention. QueryFormer secured 1st place in the Industrial Track, achieving an official test area under the ROC curve (AUC) of 0.83254; a modest post-competition scale-up reached 0.832713. Within our grid, $H$-scaling improves validation AUC from 0.84540 to 0.84615 and beats HyFormer at comparable budgets. Ablation identifies query generation as the largest contributor. Packed shared-parameter cross-attention keeps H=8 inference latency to only 1.89x that of H=1, positioning the bridge as an efficient stackable unified block.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-16 in cs.AI).
Categorie arXiv: Artificial Intelligence (cs.AI).
Pagina del lavoro: https://arxiv.org/abs/2609.16548 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-15T18:03:09.442Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-09-16?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).