Metraipolis › archive › dc_8e18ebfa57db

Kernel Singular Value Decomposition with Extension to Multiple Data Sources — arXiv:2610.03216

Source
arXiv
Original
https://arxiv.org/abs/2610.03216
License (as archived)
CC0-1.0
Archived
2026-10-05T23:10:11.544Z
SHA-256 of the archived text
82975acb43814e8a90b329c4287a52cd97ba76b2eabb4bd45c57498a44f86446
Stable URL of this page
https://metraipolis.com/documento/dc_8e18ebfa57db

How to cite

Kernel Singular Value Decomposition with Extension to Multiple Data Sources — arXiv:2610.03216 — arXiv, https://arxiv.org/abs/2610.03216 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_8e18ebfa57db (Metraipolis archive dc_8e18ebfa57db, sha256 82975acb43814e8a90b329c4287a52cd97ba76b2eabb4bd45c57498a44f86446)
BibTeX
@misc{dc8e18ebfa57db,
  title = {Kernel Singular Value Decomposition with Extension to Multiple Data Sources — arXiv:2610.03216},
  howpublished = {arXiv},
  url = {https://arxiv.org/abs/2610.03216},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_8e18ebfa57db; sha256 82975acb43814e8a90b329c4287a52cd97ba76b2eabb4bd45c57498a44f86446},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv, https://arxiv.org/abs/2610.03216. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Kernel Singular Value Decomposition (KSVD) learns a pair of singular vectors w.r.t. an asymmetric kernel matrix, which can be induced by two data sources, e.g., the queries and keys in self-attention or the rows and columns of a given matrix. In this work, we extend KSVD to multiple data sources, namely eKSVD, which conducts joint nonlinear feature learning upon asymmetric kernels. In the primal formulation, the projections associated with each data source are jointly learned to capture maximal information, while incorporating pair-wise couplings. With the Lagrangian and its Karush-Kuhn-Tucker (KKT) conditions, the optimization in the dual leads to a generalization of the shifted eigenvalue problem in Lanczos decomposition theorem of KSVD. Further, a covariance-based framework is derived together with using neural networks (NNs) for explicit feature mappings, complementary to the kernel-based interpretation and optimization. Numerical experiments verify the effectiveness of our eKSVD compared to methods based on Mercer kernels for tackling multiple data sources, and our innovation of deploying NNs demonstrates great flexibility for kernel methods.

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.LG, nuovi lavori del giorno).
Categorie arXiv: Machine Learning (cs.LG).
Pagina del lavoro: https://arxiv.org/abs/2610.03216 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-05T23:01:38.678Z dalla pagina https://arxiv.org/list/cs.LG/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).