Metraipolis › archive › dc_7ef16250d6cf
Polynomial Denoisers on the Image Manifold: Volterra Networks for Self-Contained Pixel Diffusion — arXiv:2611.10857
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2611.10857
- License (as archived)
- CC0-1.0
- Archived
- 2026-11-10T18:41:16.143Z
- SHA-256 of the archived text
56562eee1e2174bd632eadb21a8cd91d266c478e1350243aa41d20228b3cd17a- Stable URL of this page
https://metraipolis.com/documento/dc_7ef16250d6cf
How to cite
Polynomial Denoisers on the Image Manifold: Volterra Networks for Self-Contained Pixel Diffusion — arXiv:2611.10857 — arXiv (en), https://arxiv.org/abs/2611.10857 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_7ef16250d6cf (Metraipolis archive dc_7ef16250d6cf, sha256 56562eee1e2174bd632eadb21a8cd91d266c478e1350243aa41d20228b3cd17a)
BibTeX
@misc{dc7ef16250d6cf,
title = {Polynomial Denoisers on the Image Manifold: Volterra Networks for Self-Contained Pixel Diffusion — arXiv:2611.10857},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2611.10857},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_7ef16250d6cf; sha256 56562eee1e2174bd632eadb21a8cd91d266c478e1350243aa41d20228b3cd17a},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.10857. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Natural images are often conjectured to lie on a low-dimensional manifold within the high-dimensional pixel space. Recent work leverages this to build self-contained pixel-space diffusion models without specialized machinery or pretrained components. A plain Transformer on raw image patches suffices, provided it predicts the clean image rather than the noise and compresses each patch through an aggressive bottleneck. The mixing operator, however, has remained softmax attention, inherited from sequence modeling rather than derived from denoising. For Gaussian noise, the optimal denoiser admits a canonical expansion in polynomial functionals of the observation, the Wiener--Volterra series. We prove that softmax attention, and any normalized mixing rule (including linear attention), cannot realize any polynomial map beyond an affine one. In contrast, Volterra layers realize this class directly and, on a data manifold, achieve approximation rates governed by the manifold dimension rather than the ambient pixel dimension. We therefore propose the architecture these results prescribe; raw image patches passed through a bottleneck embedding, followed by cascaded low-rank Volterra layers, which carry no activation function because each layer is nonlinear in its own right. To our knowledge this is the first pixel-space diffusion architecture whose mixing operators are Volterra layers throughout, with no attention, no convolution, no pretrained components, and no activation function on the residual path. On ImageNet $256 \times 256$ and $512 \times 512$, the resulting model is competitive with self-contained pixel-space diffusion at matched parameter and FLOP budgets. Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno). Categorie arXiv: Artificial Intelligence (cs.AI). Pagina del lavoro: https://arxiv.org/abs/2611.10857 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-11-10T18:37:37.507Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).