Metraipolis › archive › dc_25beff492648
JaleesBench: Are AI Assistants Good Spiritual Company? — arXiv:2608.07508
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2608.07508
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-19T08:50:35.419Z
- SHA-256 of the archived text
918be20f0a26042c6da0b9f38007fe57ed8a5f1195aecdcc665aee049c42945c- Stable URL of this page
https://metraipolis.com/documento/dc_25beff492648
How to cite
JaleesBench: Are AI Assistants Good Spiritual Company? — arXiv:2608.07508 — arXiv (en), https://arxiv.org/abs/2608.07508 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_25beff492648 (Metraipolis archive dc_25beff492648, sha256 918be20f0a26042c6da0b9f38007fe57ed8a5f1195aecdcc665aee049c42945c)
BibTeX
@misc{dc25beff492648,
title = {JaleesBench: Are AI Assistants Good Spiritual Company? — arXiv:2608.07508},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2608.07508},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_25beff492648; sha256 918be20f0a26042c6da0b9f38007fe57ed8a5f1195aecdcc665aee049c42945c},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.07508. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Large language models are already advisors to millions of people of faith who bring them real decisions. The pressing question for a person of faith is not what a model knows or professes but what its counsel does to the person who receives it. We introduce JaleesBench, which measures whether an AI agent is a righteous companion, judged by the residue an exchange leaves on the user, in the manner of the perfume-seller and the blacksmith. It comprises 140 two-turn scenarios drawn from a classical compilation organized by virtue (Riyad al-Salihin), under six adversarial pressures and three framings, scored by two frontier judges against each scenario's own supporting texts. Across eight systems: (1) generic frontier models are only middling companions out of the box but a one-page guide makes them genuinely good ones, on par with the domain-tuned assistant: the frontier APIs climb from +0.28/+0.23 to a Guided +0.84-0.87, so most of the expert's edge is companionship instruction that fits in a prompt; (2) every system caves under relational pressure, insistence and personal appeal; (3) the domain-tuned assistant's advantage is overwhelmingly its retrieval-and-prompting layer, not its base model (+0.74 over the identical underlying model); and (4) it can be used to improve existing systems: guided by its diagnosis, a single steadfastness instruction lifts a deployed Islamic assistant from +0.48 to +0.84 (Faith unstated, after pressure), matching the best guided frontier systems while preserving first-response quality. The construct is faith-general; we instantiate it for Islam as the first of a planned cross-tradition family. Code, scenario bank, and rubric are open source ( this http URL ), with an interactive results browser at this http URL . Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-11 in cs.CL). Categorie arXiv: Human-Computer Interaction (cs.HC) ; Artificial Intelligence (cs.AI); Computation and Language (cs.CL). Pagina del lavoro: https://arxiv.org/abs/2608.07508 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-19T08:49:41.955Z dalla pagina https://arxiv.org/catchup/cs.CL/2026-08-11?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).