Metraipolis › archive › dc_a0e11996cfec

Analyzing Public Discourse on Urbanism: Topic Clustering, Sentiment Analysis and Retrieval-Augmented Generation using YouTube Comments — arXiv:2609.22705

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.22705
License (as archived)
CC0-1.0
Archived
2026-10-09T06:49:35.781Z
SHA-256 of the archived text
bdfb5dfe7dd44a2b8615f88d1c6afc43e07acc0f699fa7e0c0d7ba19ed127733
Stable URL of this page
https://metraipolis.com/documento/dc_a0e11996cfec

How to cite

Analyzing Public Discourse on Urbanism: Topic Clustering, Sentiment Analysis and Retrieval-Augmented Generation using YouTube Comments — arXiv:2609.22705 — arXiv (en), https://arxiv.org/abs/2609.22705 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_a0e11996cfec (Metraipolis archive dc_a0e11996cfec, sha256 bdfb5dfe7dd44a2b8615f88d1c6afc43e07acc0f699fa7e0c0d7ba19ed127733)
BibTeX
@misc{dca0e11996cfec,
  title = {Analyzing Public Discourse on Urbanism: Topic Clustering, Sentiment Analysis and Retrieval-Augmented Generation using YouTube Comments — arXiv:2609.22705},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.22705},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_a0e11996cfec; sha256 bdfb5dfe7dd44a2b8615f88d1c6afc43e07acc0f699fa7e0c0d7ba19ed127733},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.22705. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Online discourse about urban issues - walkability, cycling infrastructure, public transit, housing density, and street safety - is voluminous but unstructured, and existing city-evaluation tools capture none of it. We present a pipeline and conversational system that combines geographic entity resolution, topic modeling, sentiment analysis, and Retrieval-Augmented Generation (RAG) over 22,788 chunks of YouTube transcripts and comments spanning 309 North American cities. Beyond the system itself, our contribution is a set of measurements about what happens when standard NLP components meet short, informal, geographically ambiguous text. A Twitter-tuned RoBERTa classifier outperforms a VADER lexicon baseline by 12.6 macro-F1 points (0.589 vs. 0.464; McNemar p = 0.0001), but both models collapse on the neutral class, which dominates urbanist comment traffic; annotators disagree on the same class (Cohen's kappa = 0.53). Dense retrieval beats a TF-IDF baseline at every cutoff (P@5 0.790 vs. 0.560), and video-level relevance proxies understate chunk-level precision by a wide margin (0.660 vs. 0.94 under human rating). For groundedness evaluation, we find BERTScore unusable when a multi-sentence generated summary is compared against a single short comment - scores are nearly flat regardless of relevance - and show that ROUGE-1-based groundedness is a paraphrase-driven lower bound rather than a hallucination rate. These findings generalize beyond the urbanist domain to any RAG system built over short user-generated documents.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-22 in cs.CL).
Categorie arXiv: Computation and Language (cs.CL) ; Artificial Intelligence (cs.AI).
Pagina del lavoro: https://arxiv.org/abs/2609.22705 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-09T06:48:44.951Z dalla pagina https://arxiv.org/catchup/cs.CL/2026-09-22?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).