Metraipolis › archive › dc_a4b03bf44ffc
Enhancing Tabular Learners with Context-Aware Semantic Embeddings — arXiv:2608.03565
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2608.03565
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-31T12:16:26.583Z
- SHA-256 of the archived text
7f0d99e42ff89c9498ee0aee2f8218b8c60cd2440c4cf5e59dc7a4d3096f25b3- Stable URL of this page
https://metraipolis.com/documento/dc_a4b03bf44ffc
How to cite
Enhancing Tabular Learners with Context-Aware Semantic Embeddings — arXiv:2608.03565 — arXiv (en), https://arxiv.org/abs/2608.03565 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_a4b03bf44ffc (Metraipolis archive dc_a4b03bf44ffc, sha256 7f0d99e42ff89c9498ee0aee2f8218b8c60cd2440c4cf5e59dc7a4d3096f25b3)
BibTeX
@misc{dca4b03bf44ffc,
title = {Enhancing Tabular Learners with Context-Aware Semantic Embeddings — arXiv:2608.03565},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2608.03565},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_a4b03bf44ffc; sha256 7f0d99e42ff89c9498ee0aee2f8218b8c60cd2440c4cf5e59dc7a4d3096f25b3},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.03565. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
While modern tabular learners excel at capturing statistical patterns, they frequently operate in a semantic vacuum, treating textual features as discrete symbols, ignoring the rich semantics inherent in feature names or cell entries. We propose CASE (Context-Aware Semantic Embeddings), a novel framework that bridges the gap between the semantic understanding of Large Language Models (LLMs) and the statistical capabilities of tabular learners. Unlike existing methods that embed rows in isolation, CASE utilizes a contextualization strategy: we pre-fill the KV cache of a custom-trained Gemma 3-based Tabular Language Model with a representative sample of rows to establish a persistent anchor of the dataset's semantics. This ensures that generated row embeddings are dynamically contextualized, resolving semantic ambiguities and anchoring representations in domain-specific context. Our experiments across several benchmarks (CARTE, TextTab, and TabArena) demonstrate that CASE substantially improves the performance of tabular learners on semantically rich datasets, particularly in low-data regimes. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-05 in cs.AI). Categorie arXiv: Artificial Intelligence (cs.AI) ; Machine Learning (cs.LG). Pagina del lavoro: https://arxiv.org/abs/2608.03565 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-31T12:05:52.810Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-08-05?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).