Metraipolis › archive › dc_40d7b0da4e60

How Should I Pick a Foundation Model for My Robot? In Favor of a Community Evaluation Framework for Social Robots — arXiv:2608.06898

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.06898
License (as archived)
CC0-1.0
Archived
2026-10-19T09:47:10.676Z
SHA-256 of the archived text
94eec7290cf4798ffdac94e96d3a0efe045692c5147bb4c46d1d3346e1a84724
Stable URL of this page
https://metraipolis.com/documento/dc_40d7b0da4e60

How to cite

How Should I Pick a Foundation Model for My Robot? In Favor of a Community Evaluation Framework for Social Robots — arXiv:2608.06898 — arXiv (en), https://arxiv.org/abs/2608.06898 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_40d7b0da4e60 (Metraipolis archive dc_40d7b0da4e60, sha256 94eec7290cf4798ffdac94e96d3a0efe045692c5147bb4c46d1d3346e1a84724)
BibTeX
@misc{dc40d7b0da4e60,
  title = {How Should I Pick a Foundation Model for My Robot? In Favor of a Community Evaluation Framework for Social Robots — arXiv:2608.06898},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.06898},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_40d7b0da4e60; sha256 94eec7290cf4798ffdac94e96d3a0efe045692c5147bb4c46d1d3346e1a84724},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.06898. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Researchers who seek to build social robot applications on foundation models are faced with a difficult question: how should we pick a model? Public leaderboards offer little guidance: the demands of real-time, embodied social interaction lie largely outside their focus. And direct evaluation is impractical at scale: each embodied study requires scarce participant, robot, and experimenter time. In this paper, we identify five evaluation dimensions for foundation models in social robots: (i) conversational competence, (ii) user safety, (iii) embodied character, (iv) target scene effectiveness, and (v) audience appropriateness. To make model selection cheaper and better informed, we propose a three-tiered evaluation funnel paradigm that first filters with general metrics, then extends to simulated interactions, and terminates in more expensive, robot-specific evaluation. We map all five dimensions across all three tiers, chart where applicable evaluation methods exist and are missing, and close with a call to action: let's build the evaluation framework together as a community.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-10 in cs.CL).
Categorie arXiv: Robotics (cs.RO) ; Computation and Language (cs.CL); Human-Computer Interaction (cs.HC).
Pagina del lavoro: https://arxiv.org/abs/2608.06898 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-19T09:46:37.267Z dalla pagina https://arxiv.org/catchup/cs.CL/2026-08-10?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).