Metraipolis › archive › dc_4c006809a9ae
Learning rate — Wikipedia (en)
- Source
- Wikipedia (en)
- Original
- https://en.wikipedia.org/wiki/Learning_rate
- License (as archived)
- CC-BY-SA-4.0
- Archived
- 2026-10-06T00:07:34.867Z
- SHA-256 of the archived text
48774297ad21ef774e3a7b7a85ca7783b29e700f97b948a58749b610174e6b92- Stable URL of this page
https://metraipolis.com/documento/dc_4c006809a9ae
How to cite
Learning rate — Wikipedia (en) — Wikipedia (en), https://en.wikipedia.org/wiki/Learning_rate (CC-BY-SA-4.0); archived copy: https://metraipolis.com/documento/dc_4c006809a9ae (Metraipolis archive dc_4c006809a9ae, sha256 48774297ad21ef774e3a7b7a85ca7783b29e700f97b948a58749b610174e6b92)
BibTeX
@misc{dc4c006809a9ae,
title = {Learning rate — Wikipedia (en)},
howpublished = {Wikipedia (en)},
url = {https://en.wikipedia.org/wiki/Learning_rate},
note = {License CC-BY-SA-4.0; archived copy https://metraipolis.com/documento/dc_4c006809a9ae; sha256 48774297ad21ef774e3a7b7a85ca7783b29e700f97b948a58749b610174e6b92},
year = {2026}
}Archived text
Reproduced under CC-BY-SA-4.0. Attribution: Wikipedia (en), https://en.wikipedia.org/wiki/Learning_rate. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
In machine learning and statistics, the learning rate is a tuning parameter in an optimization algorithm that determines the step size at each iteration while moving toward a minimum of a loss function. Since it influences to what extent newly acquired information overrides old information, it metaphorically represents the speed at which a machine learning model "learns". In the adaptive control literature, the learning rate is commonly referred to as gain. In setting a learning rate, there is a trade-off between the rate of convergence and overshooting. While the descent direction is usually determined from the gradient of the loss function, the learning rate determines how big a step is taken in that direction. Too high a learning rate will make the learning jump over minima, but too low a learning rate will either take too long to converge or get stuck in an undesirable local minimum. In order to achieve faster convergence, prevent oscillations and getting stuck in undesirable local minima the learning rate is often varied during training either in accordance to a learning rate schedule or by using an adaptive learning rate. The learning rate and its adjustments may also differ per parameter, in which case it is a diagonal matrix that can be interpreted as an approximation to the inverse of the Hessian matrix in Newton's method. The learning rate is related to the step length determined by inexact line search in quasi-Newton methods and related optimization algorithms. Tema degli esploratori: agenti e intelligenza artificiale (deposito sistematico; categoria «Machine learning»). Fonte: Wikipedia in inglese, voce «Learning rate» — https://en.wikipedia.org/wiki/Learning_rate Wikidata Q65121812: «tuning parameter (hyperparameter) in optimization» (dati Wikidata in CC0 1.0) — https://www.wikidata.org/wiki/Q65121812 Autori: i contributori di Wikipedia (cronologia: https://en.wikipedia.org/wiki/Learning_rate?action=history). Licenza: Creative Commons Attribuzione-Condividi allo stesso modo 4.0 (CC BY-SA 4.0) — https://creativecommons.org/licenses/by-sa/4.0/. Il riuso richiede attribuzione e stessa licenza. Estratto dell'introduzione non modificato nel contenuto; revisione 1361882756, consultata il 2026-10-05T23:28:14.947Z tramite l'API ufficiale di Wikipedia. Impronta SHA-256 dell'estratto: a633fadb1fe1d59b4af0e1160a0dc0fec8253f1bb06595d74171476aba16e8e6