Metraipolis › archive › dc_d577d5100fd9

GPU-Enabled Large-Scale Optimization Using Randomized Linear Algebra — arXiv:2609.08136

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.08136
License (as archived)
CC0-1.0
Archived
2026-10-16T13:58:08.924Z
SHA-256 of the archived text
06aa4cc51c32ba18dfa448be3b0bc93d14c228d869c7d2b14730eff3c43df92d
Stable URL of this page
https://metraipolis.com/documento/dc_d577d5100fd9

How to cite

GPU-Enabled Large-Scale Optimization Using Randomized Linear Algebra — arXiv:2609.08136 — arXiv (en), https://arxiv.org/abs/2609.08136 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_d577d5100fd9 (Metraipolis archive dc_d577d5100fd9, sha256 06aa4cc51c32ba18dfa448be3b0bc93d14c228d869c7d2b14730eff3c43df92d)
BibTeX
@misc{dcd577d5100fd9,
  title = {GPU-Enabled Large-Scale Optimization Using Randomized Linear Algebra — arXiv:2609.08136},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.08136},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_d577d5100fd9; sha256 06aa4cc51c32ba18dfa448be3b0bc93d14c228d869c7d2b14730eff3c43df92d},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.08136. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

This paper introduces rlaopt, a PyTorch-based package for large-scale optimization and scientific computing using randomized numerical linear algebra (RandNLA). Despite substantial progress in RandNLA-based algorithms, few implementations combine GPU acceleration with a simple interface for specifying optimization problems. rlaopt addresses this gap by providing GPU-enabled solvers for positive-definite linear systems and convex empirical risk minimization with constraints and regularizers. These solvers use RandNLA to accelerate conjugate gradient (NystromPCG), operator splitting (NysADMM), and stochastic gradient methods (SAPPHIRE). Moreover, rlaopt includes a modeling language that lets users specify problems using natural mathematical syntax. rlaopt automatically checks compatibility with the selected solver and performs the required problem decomposition. The solvers also support differentiation through their iterations, enabling applications such as hyperparameter tuning. Experiments on ridge regression, bounded multinomial logistic regression, and bounded elastic net identify when randomized preconditioning improves performance and demonstrate substantial speedups from GPU execution. The package is open-source under an Apache license, with source code at this https URL and version 0.1.0 available on PyPI.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-09 in cs.LG).
Categorie arXiv: Machine Learning (cs.LG) ; Optimization and Control (math.OC); Machine Learning (stat.ML).
Pagina del lavoro: https://arxiv.org/abs/2609.08136 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-16T13:39:43.024Z dalla pagina https://arxiv.org/catchup/cs.LG/2026-09-09?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).