Metraipolis › archive › dc_135da318ebaa
Regularized Least Squares Training of Quadratic Neural Networks with Applications to System Identification — arXiv:2609.17654
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.17654
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-15T15:04:22.670Z
- SHA-256 of the archived text
33cb0f36321fec3d8cef146507f52a879763c722e2dc33dd47ceec2fc8845cd3- Stable URL of this page
https://metraipolis.com/documento/dc_135da318ebaa
How to cite
Regularized Least Squares Training of Quadratic Neural Networks with Applications to System Identification — arXiv:2609.17654 — arXiv (en), https://arxiv.org/abs/2609.17654 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_135da318ebaa (Metraipolis archive dc_135da318ebaa, sha256 33cb0f36321fec3d8cef146507f52a879763c722e2dc33dd47ceec2fc8845cd3)
BibTeX
@misc{dc135da318ebaa,
title = {Regularized Least Squares Training of Quadratic Neural Networks with Applications to System Identification — arXiv:2609.17654},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.17654},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_135da318ebaa; sha256 33cb0f36321fec3d8cef146507f52a879763c722e2dc33dd47ceec2fc8845cd3},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.17654. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
This paper proposes a least squares approach for the training of quadratic neural networks with regularization. The proposed methodology yields a lower bound on the solution of the training optimization problem for the case where the regularization coefficient is positive. Moreover, it yields closed-form expressions for the approximate solution and its sensitivity The lower bound is tight and the approximate solution is the optimal solution when the regularization coefficient is zero. Having a closed-form expression for the weights reduces considerably the computational time when compared with iterative numerical methods such as backpropagation that can get stuck in local minima. The proposed approach has three main contributions, namely, (i) it yields an analytical expression for the weights, (ii) an analytical expression for the sensitivity of the weights to errors in the data is also provided, (iii) it establishes a connection between the optimization to compute a lower bound and nuclear norm minimization. The proposed least squares training is successfully applied to a nonlinear system identification example where the proposed lower bound is compared with the optimal value. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-17 in cs.LG). Categorie arXiv: Machine Learning (cs.LG) ; Systems and Control (eess.SY). Pagina del lavoro: https://arxiv.org/abs/2609.17654 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-15T14:08:19.054Z dalla pagina https://arxiv.org/catchup/cs.LG/2026-09-17?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).