Metraipolis › archive › dc_20b84cae55de

VQ-LIC: Shared Vector-Quantized Learned Image Compression on a Resource-Constrained FPGA — arXiv:2609.29727

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.29727
License (as archived)
CC0-1.0
Archived
2026-10-08T04:51:05.944Z
SHA-256 of the archived text
5a535534f93cdb1cea3f91cc0789ab21a2871ef185914a1fdcacc30d56989ce3
Stable URL of this page
https://metraipolis.com/documento/dc_20b84cae55de

How to cite

VQ-LIC: Shared Vector-Quantized Learned Image Compression on a Resource-Constrained FPGA — arXiv:2609.29727 — arXiv (en), https://arxiv.org/abs/2609.29727 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_20b84cae55de (Metraipolis archive dc_20b84cae55de, sha256 5a535534f93cdb1cea3f91cc0789ab21a2871ef185914a1fdcacc30d56989ce3)
BibTeX
@misc{dc20b84cae55de,
  title = {VQ-LIC: Shared Vector-Quantized Learned Image Compression on a Resource-Constrained FPGA — arXiv:2609.29727},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.29727},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_20b84cae55de; sha256 5a535534f93cdb1cea3f91cc0789ab21a2871ef185914a1fdcacc30d56989ce3},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.29727. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Learned image compression (LIC) is hard to deploy on severely resource-constrained FPGAs, since how fast it actually runs depends not just on arithmetic count, but also on memory traffic, imbalance between different operations, and how the hardware batches its work. We present VQ-LIC, an asymmetric edge-cloud codec in which a compact INT8 depthwise (DW)-pointwise (PW) analysis transform and multi-codebook vector quantization (VQ) run at the edge on a reusable DW/PW engine pair, while reconstruction is handled by a larger cloud decoder. Since VQ codeword matching is expressible as a dot product, it is mapped directly onto the same PW engine, removing the need for a separate VQ compute array, to our knowledge a first for FPGA LIC. A novel latency model, derived from deterministic RTL cycle counts of an FPGA's read, DW, PW, and write costs, predicts an analysis transform's per-block latency; since VQ shares the same PW datapath, the model applies to VQ as well. Validated directly against silicon, the model predicts deployed analysis and VQ latency within 0.26\% and 0.05\%, and guides the selection of a three-block $16$-$48$-$64$ transform. Post-training codebook reduction then cuts VQ arithmetic and codebook storage by $4\times$ and shrinks the fixed-width latent representation. On a 220-DSP Zynq-7020, VQ-LIC's mid-rate preset reaches 0.1398 bits per pixel at 28.69 dB PSNR and 13.06 dB MS-SSIM on CLIC~2017, outperforming a similarly sized neural encoder and reaching a rate-distortion range comparable to a codec three orders of magnitude larger. The complete 0.1945-kMAC/pixel analysis-VQ pipeline runs at 47.98 frames per second and 42.84 mJ per frame on silicon, using an order of magnitude fewer DSPs than comparable FPGA LIC accelerators while achieving lower bitrate, higher throughput, and lower energy per frame at a modest PSNR tradeoff.

Tema degli esploratori: calcolo e infrastrutture (retro-catalogo arXiv: annunci del 2026-09-25 in cs.AR).
Categorie arXiv: Hardware Architecture (cs.AR) ; Image and Video Processing (eess.IV).
Pagina del lavoro: https://arxiv.org/abs/2609.29727 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-08T04:28:37.307Z dalla pagina https://arxiv.org/catchup/cs.AR/2026-09-25?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).