Metraipolis › archive › dc_e24510244960
Accelerated Learning of High Dimensional Functions with a Tensor-Featured Training Network — arXiv:2608.10351
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2608.10351
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-19T06:19:19.072Z
- SHA-256 of the archived text
df7186e99038d9ece5923e62858e812e85b52bb9939bea64d130965e922b26ed- Stable URL of this page
https://metraipolis.com/documento/dc_e24510244960
How to cite
Accelerated Learning of High Dimensional Functions with a Tensor-Featured Training Network — arXiv:2608.10351 — arXiv (en), https://arxiv.org/abs/2608.10351 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_e24510244960 (Metraipolis archive dc_e24510244960, sha256 df7186e99038d9ece5923e62858e812e85b52bb9939bea64d130965e922b26ed)
BibTeX
@misc{dce24510244960,
title = {Accelerated Learning of High Dimensional Functions with a Tensor-Featured Training Network — arXiv:2608.10351},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2608.10351},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_e24510244960; sha256 df7186e99038d9ece5923e62858e812e85b52bb9939bea64d130965e922b26ed},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.10351. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
In this work we present a method to accelerate the optimization of learning high dimensional functions using deep neural network (DNN). This optimization procedure introduces contextual features into the first layer of a DNN. The parameters of DNN are optimized via standard gradient descent while keeping the input-feature basis fixed. After optimization of the DNN parameters, the feature layer is provided a chance to update and change before DNN optimization resumes. The feature layer has two types of functions: those that can be evaluated quickly in a matrix-free way on the domain (i.e. rank-1 features) and more complex features that must first be decomposed using tensor network (TN) decomposition strategies (tensor features). In particular, we study the effect of adding features which distill pretrained DNN into TNs using a discretize and decompose strategy. To efficiently decompose high-dimensional functions constructed from discretized DNN, we leverage a randomized tensor decomposition strategy. Using randomization, we are able to reduce the storage cost of decomposing high dimensional functions by at least 8 orders of magnitude. Using this approach, we are able to efficiently train models between 5 and 40 dimensions. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-12 in cs.LG). Categorie arXiv: Machine Learning (cs.LG). Pagina del lavoro: https://arxiv.org/abs/2608.10351 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-19T06:11:45.073Z dalla pagina https://arxiv.org/catchup/cs.LG/2026-08-12?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).