Metraipolis › archive › dc_5b728fc2f49b

Moral Rebel Agents: Decision-Making Under Conflicting Obligations — arXiv:2609.14716

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.14716
License (as archived)
CC0-1.0
Archived
2026-10-15T22:47:35.105Z
SHA-256 of the archived text
71f4c061f20f60c81390cd2ac74bc61b1627fdbb58a02d77b25feb0713a091cd
Stable URL of this page
https://metraipolis.com/documento/dc_5b728fc2f49b

How to cite

Moral Rebel Agents: Decision-Making Under Conflicting Obligations — arXiv:2609.14716 — arXiv (en), https://arxiv.org/abs/2609.14716 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_5b728fc2f49b (Metraipolis archive dc_5b728fc2f49b, sha256 71f4c061f20f60c81390cd2ac74bc61b1627fdbb58a02d77b25feb0713a091cd)
BibTeX
@misc{dc5b728fc2f49b,
  title = {Moral Rebel Agents: Decision-Making Under Conflicting Obligations — arXiv:2609.14716},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.14716},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_5b728fc2f49b; sha256 71f4c061f20f60c81390cd2ac74bc61b1627fdbb58a02d77b25feb0713a091cd},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.14716. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Autonomous agents are typically obliged to follow user-assigned tasks. However, strict obedience may conflict with moral obligations that arise during execution. This paper investigates \textbf{moral rebellion}: the ability of an autonomous agent to deviate from a user-assigned task when morally justified. We formalize five agent architectures: an \textit{amoral agent} that pursues assigned tasks without considering moral obligations, and four forms of \textbf{moral rebel agency}: (1) \textit{utilitarian agents} that opportunistically maximize task outcomes; (2) \textit{deontic} agents that enforce normative constraints; (3) \textit{utilitarian-deontic} (UD) agents that combine deontic constraints with utilitarian reasoning; and (4) \textit{dutiful} agents that additionally preserve commitments to assigned tasks. We implement these architectures within a hierarchical task network planning framework and evaluate them in a Mini Search-and-Rescue domain that exposes trade-offs among assigned-task completion, opportunistic rescue, and norm compliance. Our empirical results show that the proposed agents exhibit distinct trade-offs among rescue results, assigned-task completion, and norm compliance. In particular, the preservation of task commitments emerges as an important dimension of moral rebellion, for which the UD and dutiful agents produce substantially different behaviors despite their shared utilitarian and deontological foundations. These findings highlight the importance of commitment-aware moral reasoning for autonomous agents operating in morally consequential environments.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-15 in cs.AI).
Categorie arXiv: Artificial Intelligence (cs.AI).
Pagina del lavoro: https://arxiv.org/abs/2609.14716 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-15T22:29:03.206Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-09-15?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).