Metraipolis › archive › dc_eca18648eb17
Does Syntax Matter? A Graph-Augmented Variational Topic Model for Computational Social Sciences — arXiv:2609.07797
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.07797
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-16T12:45:47.035Z
- SHA-256 of the archived text
8497ddfca196765e5340e74961755b3f0ba4dda3d63f0f7eaebd769b7171ccc5- Stable URL of this page
https://metraipolis.com/documento/dc_eca18648eb17
How to cite
Does Syntax Matter? A Graph-Augmented Variational Topic Model for Computational Social Sciences — arXiv:2609.07797 — arXiv (en), https://arxiv.org/abs/2609.07797 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_eca18648eb17 (Metraipolis archive dc_eca18648eb17, sha256 8497ddfca196765e5340e74961755b3f0ba4dda3d63f0f7eaebd769b7171ccc5)
BibTeX
@misc{dceca18648eb17,
title = {Does Syntax Matter? A Graph-Augmented Variational Topic Model for Computational Social Sciences — arXiv:2609.07797},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.07797},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_eca18648eb17; sha256 8497ddfca196765e5340e74961755b3f0ba4dda3d63f0f7eaebd769b7171ccc5},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.07797. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Topic modeling is widely used in computational social sciences to identify latent themes in large text corpora. Traditional approaches rely on Bag-of-Words representations and generative models such as LDA, while recent methods like BERTopic operate on dense document embeddings. This paper introduces the Structural Contextual Probabilistic Topic Model (SCPTM), an architecture that incorporates syntactic dependency relations into topic inference. SCPTM represents a corpus as a heterogeneous graph of documents and words connected by lexical and syntactic edges, processed through a Graph Attention Network within a Variational Autoencoder to produce probabilistic, mixed-membership topic distributions. We evaluate seven topic modeling techniques (including four SCPTM ablations) across four corpora differing in register and discourse structure. Our framework combines coherence (C_V, C_NPMI), topic diversity, clustering-label alignment (NMI), and phrase-level diagnostics (complementarity and valence gap). Results show that SCPTM's neural architecture yields substantial gains in document-topic alignment over generative baselines, but these gains are attributable to the variational encoder rather than to syntax. Syntax contributes to topic diversity, where graph-augmented variants outperform the no-graph baseline across all corpora, and to descriptor quality: dependency paths capture predicate-argument structures and stance in deliberative registers, while proving redundant in technical and institutional corpora. The valence gap is positive across all variants, but driven primarily by phrase grouping rather than syntactic filtering. We conclude that syntactic encoding matters conditionally: it benefits action-oriented, argumentative texts, but introduces noise in informational or administrative registers. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-09 in cs.CL). Categorie arXiv: Computation and Language (cs.CL). Pagina del lavoro: https://arxiv.org/abs/2609.07797 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-16T12:30:25.144Z dalla pagina https://arxiv.org/catchup/cs.CL/2026-09-09?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).