Metraipolis › archive › dc_f07528089246

Dynamic Quadtree Tokenization and Transformer for Adaptive Mesh PDE Forecasting — arXiv:2610.04044

Source
arXiv
Original
https://arxiv.org/abs/2610.04044
License (as archived)
CC0-1.0
Archived
2026-10-06T05:31:57.767Z
SHA-256 of the archived text
b3d3df6e057a5a2abd37e7d53dd1d771ad0bb1747990911dde66d13a9236d302
Stable URL of this page
https://metraipolis.com/documento/dc_f07528089246

How to cite

Dynamic Quadtree Tokenization and Transformer for Adaptive Mesh PDE Forecasting — arXiv:2610.04044 — arXiv, https://arxiv.org/abs/2610.04044 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_f07528089246 (Metraipolis archive dc_f07528089246, sha256 b3d3df6e057a5a2abd37e7d53dd1d771ad0bb1747990911dde66d13a9236d302)
BibTeX
@misc{dcf07528089246,
  title = {Dynamic Quadtree Tokenization and Transformer for Adaptive Mesh PDE Forecasting — arXiv:2610.04044},
  howpublished = {arXiv},
  url = {https://arxiv.org/abs/2610.04044},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_f07528089246; sha256 b3d3df6e057a5a2abd37e7d53dd1d771ad0bb1747990911dde66d13a9236d302},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv, https://arxiv.org/abs/2610.04044. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

The quadratic attention cost of Vision Transformers (ViTs) forces a trade-off between spatial resolution and rollout horizon, particularly for fine-scale PDEs where shocks, reaction fronts, and material interfaces occupy small, evolving regions of the domain. Conventional neural surrogates also lack mechanisms to adapt resolution dynamically. We propose WAMRViT, a ViT that tokenizes inputs as balanced quadtrees using a wavelet-inspired refinement criterion, jointly encodes position and refinement level with 3D rotary positional embeddings, and regrids in cell space during inference for stable long-horizon rollouts. A multi-scale variant retains each leaf at its native source resolution and lets the model learn across resolution levels. Unlike fixed-budget adaptive-tokenization methods, WAMRViT imposes no predetermined token count and supports fully adaptive topology throughout autoregressive rollout. To our knowledge, it is the first machine-learning surrogate to natively tokenize multi-level Adaptive Mesh Refinement (AMR) data. On uniform-grid benchmarks, uniform-patch WAMRViT improves finest-level region-of-interest VRMSE over a finest-patch uniform ViT while using substantially fewer tokens. The multi-scale variant achieves the lowest first-step full-field RMSE and VRMSE on both benchmarks and improves rollout-averaged full-field and refined-region accuracy at long horizons. With parallelized regridding, its end-to-end rollout cost lies between finest-patch and approximately token-matched coarser-patch ViTs. On a complex AMR combustion problem whose finest features cannot be represented natively by the evaluated uniform-grid baselines, WAMRViT operates directly on adaptive cells and substantially reduces finest-level error at matched transformer capacity. Code: this https URL

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.LG, nuovi lavori del giorno).
Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV) ; Machine Learning (cs.LG).
Pagina del lavoro: https://arxiv.org/abs/2610.04044 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-06T05:27:05.938Z dalla pagina https://arxiv.org/list/cs.LG/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).