Metraipolis › archive › dc_d5453ee695be

TabFM-Auto: Self-Evolving Pipelines for Tabular Foundation Models — arXiv:2609.37989

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.37989
License (as archived)
CC0-1.0
Archived
2026-10-07T17:31:58.274Z
SHA-256 of the archived text
f79ed81839c4cdb4835883ec08bff6b572aba533665dbe2e86d288c1cf887220
Stable URL of this page
https://metraipolis.com/documento/dc_d5453ee695be

How to cite

TabFM-Auto: Self-Evolving Pipelines for Tabular Foundation Models — arXiv:2609.37989 — arXiv (en), https://arxiv.org/abs/2609.37989 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_d5453ee695be (Metraipolis archive dc_d5453ee695be, sha256 f79ed81839c4cdb4835883ec08bff6b572aba533665dbe2e86d288c1cf887220)
BibTeX
@misc{dcd5453ee695be,
  title = {TabFM-Auto: Self-Evolving Pipelines for Tabular Foundation Models — arXiv:2609.37989},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.37989},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_d5453ee695be; sha256 f79ed81839c4cdb4835883ec08bff6b572aba533665dbe2e86d288c1cf887220},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.37989. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Tabular foundation models achieve strong zero-shot accuracy on structured data by pretraining on synthetic tables, but they ignore the column names, task descriptions, and auxiliary files that carry dataset semantics. Meanwhile, self-evolving machine learning engineering (MLE) agents train models from scratch on each dataset, yet jointly searching over features, architectures, and hyperparameters is noisy and prone to overfitting. We introduce TabFM-Auto, which pairs a tabular foundation model, TabFM, with a language model agent that evolves the data pipeline around it. Guided by dataset metadata and validation feedback, TabFM-Auto iteratively refines data cleaning, feature engineering, context selection, and post-processing to reduce TabFM's error. Across all 51 datasets of the TabArena benchmark, five TabFM-Auto configurations with different agents and language models take the top five overall positions, and the best raises TabFM from 1785 to 2013 Elo. The discovered pipelines also transfer to other frozen tabular foundation models (+69 to +143 Elo) with no further search. On the 8 tabular competitions of MLE-Bench, TabFM-Auto ranks first overall among MLE agents.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-30 in cs.LG).
Categorie arXiv: Machine Learning (cs.LG).
Pagina del lavoro: https://arxiv.org/abs/2609.37989 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-07T16:59:48.406Z dalla pagina https://arxiv.org/catchup/cs.LG/2026-09-30?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).