Metraipolis › archive › dc_aa117aaaf6f6

Semantic Layer Induction from Raw Telemetry via Hierarchical LLM and RAG Abstraction — arXiv:2609.19615

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.19615
License (as archived)
CC0-1.0
Archived
2026-10-10T03:23:27.893Z
SHA-256 of the archived text
3d1d03ab004a9affca3c8249455429f61538c09261d7626efb1f7371b8533bba
Stable URL of this page
https://metraipolis.com/documento/dc_aa117aaaf6f6

How to cite

Semantic Layer Induction from Raw Telemetry via Hierarchical LLM and RAG Abstraction — arXiv:2609.19615 — arXiv (en), https://arxiv.org/abs/2609.19615 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_aa117aaaf6f6 (Metraipolis archive dc_aa117aaaf6f6, sha256 3d1d03ab004a9affca3c8249455429f61538c09261d7626efb1f7371b8533bba)
BibTeX
@misc{dcaa117aaaf6f6,
  title = {Semantic Layer Induction from Raw Telemetry via Hierarchical LLM and RAG Abstraction — arXiv:2609.19615},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.19615},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_aa117aaaf6f6; sha256 3d1d03ab004a9affca3c8249455429f61538c09261d7626efb1f7371b8533bba},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.19615. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Modern applications generate massive volumes of raw telemetry data, but translating those noisy, heterogeneous event streams into actionable business insights remains a fundamental challenge. Data engineers and analysts expend substantial effort reconciling semantic discrepancies, hand-crafting parsing logics, and maintaining fragile mappings between raw data and business KPIs. In this paper, we present an end-to-end framework that fully automates the construction of a business semantic layer from application raw logs. Our approach introduces a two-stage semantic abstraction: first, high-level business features are identified via LLM inference augmented with domain-specific industry knowledge; second, fine-grained business nodes are derived through a structured pipeline comprising data refinement, hybrid retrieval, multi-stage filtering, semantic clustering, and canonical naming. Evaluation on production-scale telemetry demonstrates that our system improves human-assessed semantic quality from 50 to 80+ on a 100-point scale, reduces maintenance effort by 80%, filters out 74% of noise, and achieves 0.87 Cohen's kappa via an integrated LLM-as-Judge evaluation, enabling continuous, scalable quality assurance. Overall, our work distinguishes itself from prior work by addressing the novel problem of business semantic layer induction from raw telemetry, operating without labeled training data or manual rule engineering.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-18 in cs.AI).
Categorie arXiv: Computation and Language (cs.CL) ; Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Software Engineering (cs.SE).
Pagina del lavoro: https://arxiv.org/abs/2609.19615 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-10T03:04:13.841Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-09-18?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).