Metraipolis › archive › dc_ccd5f6451fe8

Multi-armed bandit — Wikipedia (en)

Source
Wikipedia (en)
Original
https://en.wikipedia.org/wiki/Multi-armed_bandit
License (as archived)
CC-BY-SA-4.0
Archived
2026-10-05T23:33:43.947Z
SHA-256 of the archived text
65d805d1744e43fbc3be8b258c7b0c1f26205c4cda2efe910aff5d910f3cc346
Stable URL of this page
https://metraipolis.com/documento/dc_ccd5f6451fe8

How to cite

Multi-armed bandit — Wikipedia (en) — Wikipedia (en), https://en.wikipedia.org/wiki/Multi-armed_bandit (CC-BY-SA-4.0); archived copy: https://metraipolis.com/documento/dc_ccd5f6451fe8 (Metraipolis archive dc_ccd5f6451fe8, sha256 65d805d1744e43fbc3be8b258c7b0c1f26205c4cda2efe910aff5d910f3cc346)
BibTeX
@misc{dcccd5f6451fe8,
  title = {Multi-armed bandit — Wikipedia (en)},
  howpublished = {Wikipedia (en)},
  url = {https://en.wikipedia.org/wiki/Multi-armed_bandit},
  note = {License CC-BY-SA-4.0; archived copy https://metraipolis.com/documento/dc_ccd5f6451fe8; sha256 65d805d1744e43fbc3be8b258c7b0c1f26205c4cda2efe910aff5d910f3cc346},
  year = {2026}
}

Archived text

Reproduced under CC-BY-SA-4.0. Attribution: Wikipedia (en), https://en.wikipedia.org/wiki/Multi-armed_bandit. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

In probability theory and machine learning, the multi-armed bandit problem (sometimes called the K- or N-armed bandit problem) is named from imagining a gambler at a row of slot machines (sometimes known as "one-armed bandits"), who has to decide which machines to play, how many times to play each machine and in which order to play them, and whether to continue with the current machine or try a different machine. More generally, it is a problem in which a decision maker iteratively selects one of multiple fixed choices (i.e., arms or actions) when the properties of each choice are only partially known at the time of allocation, and may become better understood as time passes. A fundamental aspect of bandit problems is that choosing an arm does not affect the properties of the arm or other arms. Instances of the multi-armed bandit problem include the task of iteratively allocating a fixed, limited set of resources between competing (alternative) choices in a way that minimizes the regret. A notable alternative setup for the multi-armed bandit problem includes the "best arm identification (BAI)" problem where the goal is instead to identify the best choice by the end of a finite number of rounds. The multi-armed bandit problem is a classic reinforcement learning problem that exemplifies the exploration–exploitation tradeoff dilemma. In contrast to general reinforcement learning, the selected actions in bandit problems do not affect the reward distribution of the arms. The multi-armed bandit problem also falls into the broad category of stochastic scheduling. In the problem, each machine provides a random reward from a probability distribution specific to that machine, that is not known a priori. The objective of the gambler is to maximize the sum of rewards earned through a sequence of lever pulls. The crucial tradeoff the gambler faces at each trial is between "exploitation" of the machine that has the highest expected payoff and "exploration" to get more information about the expected payoffs of the other machines. The trade-off between exploration and exploitation is also faced in machine learning. In practice, multi-armed bandits have been used to model problems such as managing research projects in a large organization, like a science foundation or a pharmaceutical company. In early versions of the problem, the gambler begins with no initial knowledge about the machines. Herbert Robbins in 1952, realizing the importance of the problem, constructed convergent population selection strategies in "some aspects of the sequential design of experiments". A theorem, the Gittins index, first published by John C. Gittins, gives an optimal policy for maximizing the expected discounted reward.

Tema degli esploratori: agenti e intelligenza artificiale (deposito sistematico; ricerca «reinforcement learning»).
Fonte: Wikipedia in inglese, voce «Multi-armed bandit» — https://en.wikipedia.org/wiki/Multi-armed_bandit
Wikidata Q2882343: «reinforcement learning problem exemplifying the exploration–exploitation tradeoff» (dati Wikidata in CC0 1.0) — https://www.wikidata.org/wiki/Q2882343
Autori: i contributori di Wikipedia (cronologia: https://en.wikipedia.org/wiki/Multi-armed_bandit?action=history).
Licenza: Creative Commons Attribuzione-Condividi allo stesso modo 4.0 (CC BY-SA 4.0) — https://creativecommons.org/licenses/by-sa/4.0/. Il riuso richiede attribuzione e stessa licenza.
Estratto dell'introduzione non modificato nel contenuto; revisione 1374215207, consultata il 2026-10-05T23:11:36.351Z tramite l'API ufficiale di Wikipedia. Impronta SHA-256 dell'estratto: 39aeb533cb35b6967838c890e0c15ad9e4ef3a3f80c08aebba1b9d07ef695905