Metraipolis › archive › dc_acbe1fde9934
BANGLAPLAN: A Benchmark for Constraint-Based Planning and Decision-Making in Bangla — arXiv:2610.19704
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2610.19704
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-15T20:24:05.683Z
- SHA-256 of the archived text
11a05be7fdfb647fa7e5aeb07505c19689d6ea5770918c8e04dbd44e932a79aa- Stable URL of this page
https://metraipolis.com/documento/dc_acbe1fde9934
How to cite
BANGLAPLAN: A Benchmark for Constraint-Based Planning and Decision-Making in Bangla — arXiv:2610.19704 — arXiv (en), https://arxiv.org/abs/2610.19704 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_acbe1fde9934 (Metraipolis archive dc_acbe1fde9934, sha256 11a05be7fdfb647fa7e5aeb07505c19689d6ea5770918c8e04dbd44e932a79aa)
BibTeX
@misc{dcacbe1fde9934,
title = {BANGLAPLAN: A Benchmark for Constraint-Based Planning and Decision-Making in Bangla — arXiv:2610.19704},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2610.19704},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_acbe1fde9934; sha256 11a05be7fdfb647fa7e5aeb07505c19689d6ea5770918c8e04dbd44e932a79aa},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.19704. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Large language models (LLMs) increasingly help users arrange appointments, plan journeys, and allocate limited resources. These tasks require models to satisfy constraints on time, cost, capacity, and order, or determine that no feasible solution exists. Bangla is the world's seventh most widely spoken language, and existing benchmarks cover many language and reasoning tasks. However, benchmarks for evaluating planning and decision-making in Bangla under explicit constraints remain lacking. We introduce BANGLAPLAN, a benchmark of 1,000 problems across ten task families grounded in everyday life and institutions in Bangladesh. It includes feasible and infeasible problems in four language registers: everyday, formal, colloquial, and Bangla--English mixed. Answers cover eight structured types, including schedules, routes, allocations, and ordered steps, in a common JSON format. We construct the benchmark through language-model-assisted drafting and independent human validation. We evaluate 11 open-weight and proprietary model configurations using exact match, separately reporting feasible-case accuracy, infeasibility detection, and format errors. We find a large performance gap: GPT-6.1 Sol achieves 98.7% accuracy and Qwen3.5-27B with thinking reaches 80.3%, while direct-answer configurations score at most 30.9%. Seven of eleven configurations perform below the always-``infeasible'' baseline. Our findings also suggest that harder problems primarily reduce plan-construction accuracy, while infeasibility detection remains more robust. BANGLAPLAN provides a reproducible basis for evaluating planning and decision-making in Bangla. BANGLAPLAN is available at: this https URL . Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.CL, nuovi lavori del giorno). Categorie arXiv: Computation and Language (cs.CL). Pagina del lavoro: https://arxiv.org/abs/2610.19704 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-15T19:36:18.213Z dalla pagina https://arxiv.org/list/cs.CL/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).