Metraipolis › archive › dc_502ffa448f2d

Cluster Attention Neural Operators for Solving Parametric Partial Differential Equations — arXiv:2609.39914

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.39914
License (as archived)
CC0-1.0
Archived
2026-10-07T12:45:56.692Z
SHA-256 of the archived text
b9d4f7a109bb5f655a32351bc9dc28ff8a0710bd89c55fdd86000a6463bbc475
Stable URL of this page
https://metraipolis.com/documento/dc_502ffa448f2d

How to cite

Cluster Attention Neural Operators for Solving Parametric Partial Differential Equations — arXiv:2609.39914 — arXiv (en), https://arxiv.org/abs/2609.39914 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_502ffa448f2d (Metraipolis archive dc_502ffa448f2d, sha256 b9d4f7a109bb5f655a32351bc9dc28ff8a0710bd89c55fdd86000a6463bbc475)
BibTeX
@misc{dc502ffa448f2d,
  title = {Cluster Attention Neural Operators for Solving Parametric Partial Differential Equations — arXiv:2609.39914},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.39914},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_502ffa448f2d; sha256 b9d4f7a109bb5f655a32351bc9dc28ff8a0710bd89c55fdd86000a6463bbc475},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.39914. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Traditional simulations of parametric partial differential equations (PDEs) rely on repetitive computations for each parameter, which makes high-fidelity design impractical. Neural operators address this issue by learning solution operators, accelerating parameter-space mapping by orders of magnitude. Recent Transformer-based neural operators attempt to capture global dependencies, but often at the cost of quadratic attention complexity. Transolver resolves this problem by projecting physical states into a reduced slice space for attention computation. Although fast, this projection sacrifices fine spatial information. Moreover, by operating in this reduced space with shared weights across attention heads, it may constrain the model's flexibility, thereby limiting its capacity to capture complex phenomena. To address these issues, we propose the Cluster Attention Neural Operator (CANO), which reformulates attention via a novel cross-attention mechanism that dynamically clusters queries while preserving full-resolution keys and values. This avoids slice compression loss and removes weight-sharing limits. At the same time, the model remains fast without losing global interactions. Empirically, CANO achieves state-of-the-art performance across canonical PDE benchmarks, covering fluid and solid dynamics (e.g., Navier-Stokes, Airfoil, Plasticity), irregular unstructured geometries (e.g., Pipe Turbulence, Composites), and long-term temporal rollouts. Across solid deformation and turbulent flow benchmarks, CANO achieves lower errors than baselines and exhibits strong geometric adaptability and temporal consistency.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-10-01 in cs.AI).
Categorie arXiv: Mathematical Physics (math-ph) ; Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Dynamical Systems (math.DS).
Pagina del lavoro: https://arxiv.org/abs/2609.39914 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-07T12:14:14.179Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-10-01?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).