Metraipolis › archive › dc_e3a12e60f8dc

Environmental uncertainty and the advantage of impulsive choice strategies — Europe PMC PMID:36716320

Source
Europe PMC (en)
Original
https://europepmc.org/article/MED/36716320
DOI
10.1371/journal.pcbi.1010873
License (as archived)
CC0-1.0
Archived
2026-10-07T21:17:45.215Z
SHA-256 of the archived text
73fa34d4d42fe6ad69a2c8eb979198f61cc6fa76dc2605e49c128c6469b82649
Stable URL of this page
https://metraipolis.com/documento/dc_e3a12e60f8dc

How to cite

Environmental uncertainty and the advantage of impulsive choice strategies — Europe PMC PMID:36716320 — Europe PMC (en), https://europepmc.org/article/MED/36716320 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_e3a12e60f8dc (Metraipolis archive dc_e3a12e60f8dc, sha256 73fa34d4d42fe6ad69a2c8eb979198f61cc6fa76dc2605e49c128c6469b82649)
BibTeX
@misc{dce3a12e60f8dc,
  title = {Environmental uncertainty and the advantage of impulsive choice strategies — Europe PMC PMID:36716320},
  howpublished = {Europe PMC (en)},
  url = {https://europepmc.org/article/MED/36716320},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_e3a12e60f8dc; sha256 73fa34d4d42fe6ad69a2c8eb979198f61cc6fa76dc2605e49c128c6469b82649},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: Europe PMC (en), https://europepmc.org/article/MED/36716320. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Choice impulsivity is characterized by the choice of immediate, smaller reward options over future, larger reward options, and is often thought to be associated with negative life outcomes. However, some environments make future rewards more uncertain, and in these environments impulsive choices can be beneficial. Here we examined the conditions under which impulsive vs. non-impulsive decision strategies would be advantageous. We used Markov Decision Processes (MDPs) to model three common decision-making tasks: Temporal Discounting, Information Sampling, and an Explore-Exploit task. We manipulated environmental variables to create circumstances where future outcomes were relatively uncertain. We then manipulated the discount factor of an MDP agent, which affects the value of immediate versus future rewards, to model impulsive and non-impulsive behavior. This allowed us to examine the performance of impulsive and non-impulsive agents in more or less predictable environments. In Temporal Discounting, we manipulated the transition probability to delayed rewards and found that the agent with the lower discount factor (i.e. the impulsive agent) collected more average reward than the agent with a higher discount factor (the non-impulsive agent) by selecting immediate reward options when the probability of receiving the future reward was low. In the Information Sampling task, we manipulated the amount of information obtained with each sample. When sampling led to small information gains, the impulsive MDP agent collected more average reward than the non-impulsive agent. Third, in the Explore-Exploit task, we manipulated the substitution rate for novel options. When the substitution rate was high, the impulsive agent again performed better than the non-impulsive agent, as it explored the novel options less and instead exploited options with known reward values. The results of these analyses show that impulsivity can be advantageous in environments that are unexpectedly uncertain.

Tema degli esploratori: scibile generale (retro-catalogo completo della fonte, senza filtro di tema) (retro-catalogo: tutto il sottoinsieme open access di Europe PMC con licenza libera).
Pubblicazione: PLoS computational biology, 2023 (prima pubblicazione 2023-01-30).
Identificativi: PMID 36716320 · PMCID PMC9910799 · DOI 10.1371/journal.pcbi.1010873.
Descrittori MeSH principali: Impulsive Behavior; Reward.
Pagina: https://europepmc.org/article/MED/36716320 — https://doi.org/10.1371/journal.pcbi.1010873. Autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza dell'articolo dichiarata da Europe PMC: CC0 (la versione è indicata dall'editore sulla pagina). Abstract riportato senza modifiche al contenuto, con attribuzione; deposito marcato CC0.
Letto il 2026-10-07T20:46:29.231Z tramite l'API REST ufficiale di Europe PMC (EMBL-EBI), nel rispetto del robots.txt e del crawl-delay.