Metraipolis › archive › dc_f792bffa72d3

NutriVision: Ingredient-Conditioned Fusion and Prediction for Single-Image Food Nutrition Estimation — arXiv:2609.33076

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.33076
License (as archived)
CC0-1.0
Archived
2026-10-07T21:00:56.837Z
SHA-256 of the archived text
366c020939a5d3925f44f1cf9cd66794ef01bfbcad09c14666beff771bcc9615
Stable URL of this page
https://metraipolis.com/documento/dc_f792bffa72d3

How to cite

NutriVision: Ingredient-Conditioned Fusion and Prediction for Single-Image Food Nutrition Estimation — arXiv:2609.33076 — arXiv (en), https://arxiv.org/abs/2609.33076 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_f792bffa72d3 (Metraipolis archive dc_f792bffa72d3, sha256 366c020939a5d3925f44f1cf9cd66794ef01bfbcad09c14666beff771bcc9615)
BibTeX
@misc{dcf792bffa72d3,
  title = {NutriVision: Ingredient-Conditioned Fusion and Prediction for Single-Image Food Nutrition Estimation — arXiv:2609.33076},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.33076},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_f792bffa72d3; sha256 366c020939a5d3925f44f1cf9cd66794ef01bfbcad09c14666beff771bcc9615},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.33076. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Nutrition estimation is a fundamental task in consumer diet tracking, clinical dietetics, chronic disease management, sports and hospital nutrition, and broader food computing systems. The existing approaches have progressed along two largely separate axes, vision models that rely on calibrated RGB-depth captures and ingredient-aware methods that use textual cues but use limited multimodal fusion. We introduce NutriVision, an end-to-end framework that leverages visual geometry and ingredient semantics to estimate calories, mass, fat content, carbohydrates, and protein from a single RGB image and an optional ingredient list. It obtains the unavailable depth modality using DepthAnything-V3 and encodes ingredient descriptions using CLIP. It integrates three complementary mechanisms: (1) an \emph{Ingredient-Conditioned Frequency-Aligned Fusion Module (IC-FAFM)}, which uses textual guidance to reweight and align RGB-depth frequency components; (2) an \emph{Ingredient-Aware Mask-based Prediction Head (IA-MPH)}, whose gating and channel masks are conditioned on food identity; and (3) modality-specific \emph{Internal Semantic Modeling (ISM)} blocks. On the Nutrition5k dataset, NutriVision achieves a mean PMAE of $\mathbf{13.60\pm0.10\%}$, outperforming our IGSMNet implementation by $0.89$ percentage points and OmniFood8k by $2.90$ percentage points (both $p<0.001$). The module-level ablations identify the ingredient-aware prediction head as the primary architectural contributor, improving mean PMAE by $1.50\pm0.17$ percentage points ($p<0.001$). These results demonstrate that ingredient-conditioned prediction and frequency-aware RGB-depth fusion provide measurable gains for single-image nutrient estimation. More broadly, NutriVision offers a practical route toward nutrition-assessment systems that exploit geometric and semantic cues without requiring specialized depth-sensing hardware

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-29 in cs.AI).
Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV) ; Artificial Intelligence (cs.AI).
Pagina del lavoro: https://arxiv.org/abs/2609.33076 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-07T20:29:02.533Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-09-29?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).