Metraipolis › archive › dc_ff89ed8a85c4
Seeing Like a Shopper: Validating Vision-Language Models as Synthetic Consumers — arXiv:2611.09977
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2611.09977
- License (as archived)
- CC0-1.0
- Archived
- 2026-11-10T18:42:05.101Z
- SHA-256 of the archived text
973563f5bef2e6f4fa058353ea05f5b62d92b5818cfee71804b0eba59a27b562- Stable URL of this page
https://metraipolis.com/documento/dc_ff89ed8a85c4
How to cite
Seeing Like a Shopper: Validating Vision-Language Models as Synthetic Consumers — arXiv:2611.09977 — arXiv (en), https://arxiv.org/abs/2611.09977 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_ff89ed8a85c4 (Metraipolis archive dc_ff89ed8a85c4, sha256 973563f5bef2e6f4fa058353ea05f5b62d92b5818cfee71804b0eba59a27b562)
BibTeX
@misc{dcff89ed8a85c4,
title = {Seeing Like a Shopper: Validating Vision-Language Models as Synthetic Consumers — arXiv:2611.09977},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2611.09977},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_ff89ed8a85c4; sha256 973563f5bef2e6f4fa058353ea05f5b62d92b5818cfee71804b0eba59a27b562},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.09977. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Language models are widely used as synthetic respondents in surveys, behavioral experiments, and market research. Most of these respondents read text, whereas shoppers in a store choose by looking at shelves, which makes vision-language models (VLMs) natural synthetic shoppers. We test whether VLM shoppers follow real consumers at two levels. At the purchase level, VLM shoppers built from household records plan their trips from a store directory and select products from shelf images, and we compare their purchases with six public datasets from three countries. The synthetic baskets hit held-out purchases as often as the households' own past trips, and synthetic group differences correlate with real ones twice as strongly as those of a trained regression. Without fitting, VLM shoppers reproduce alcohol purchases by gender and age in Russia and trip sizes by store distance in Taiwan, and respond to situations, prices, and displays within measured ranges. At the level of a single shelf choice, a model's answer confounds the product with its position and letter label. We therefore introduce ShelfSight, shelf renderings that vary products, positions, labels, viewpoints, and prices independently, together with a factor model that separates product preferences from the effects of label and position, which we call answer effects. On ShelfSight, hosted VLMs read the shelf, follow stated needs, keep their product preferences across views, and respond to price as budget shoppers. These answer effects, a preference for the letter A and for positions in the image, are estimated once per image type and removed. VLMs are thus good synthetic shoppers whose corrected shelf choices reflect product preferences. Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno). Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV) ; Artificial Intelligence (cs.AI). Pagina del lavoro: https://arxiv.org/abs/2611.09977 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-11-10T18:37:37.563Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).