Metraipolis › archive › dc_c12214db0dcd

Omni-modal decomposition autoencoders learn full-stack wearable disentangled representations — arXiv:2608.07385

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.07385
License (as archived)
CC0-1.0
Archived
2026-10-19T11:04:05.768Z
SHA-256 of the archived text
22f3281e8a2d5f4a1ccef44e9ba148d3bc0259812846bbe07973318686797f12
Stable URL of this page
https://metraipolis.com/documento/dc_c12214db0dcd

How to cite

Omni-modal decomposition autoencoders learn full-stack wearable disentangled representations — arXiv:2608.07385 — arXiv (en), https://arxiv.org/abs/2608.07385 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_c12214db0dcd (Metraipolis archive dc_c12214db0dcd, sha256 22f3281e8a2d5f4a1ccef44e9ba148d3bc0259812846bbe07973318686797f12)
BibTeX
@misc{dcc12214db0dcd,
  title = {Omni-modal decomposition autoencoders learn full-stack wearable disentangled representations — arXiv:2608.07385},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.07385},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_c12214db0dcd; sha256 22f3281e8a2d5f4a1ccef44e9ba148d3bc0259812846bbe07973318686797f12},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.07385. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Learning disentangled representations is a key requirement for developing versatile, general-purpose, and sustainable models in multi-modal wearable computing. However, existing approaches do not operate as full-stack wearable processors, i.e., they do not simultaneously address task-specific classification performance, disentangled and interpretable representation learning, fusion, and generative modeling of highly heterogeneous multi-modal time series. To address this gap, we introduce Omni-modal Variational Decomposition Autoencoders (OmniDecVAEs), a framework that efficiently learns multi-purpose representations in a unified and scalable manner from arbitrarily many modalities. OmniDecVAEs extend DecVAEs by learning modality-conditioned time-frequency latent subspaces through a multi-view self-supervised decomposition loss and a shared asymmetric autoencoder (AE) architecture. Results on a challenging omni-modal human activity recognition (HAR) setting with up to thirty modalities, demonstrate the ability of OmniDecVAEs to learn full-stack wearable representations. When compared to transformer-based and VAE-based methods, OmniDecVAEs full-stack disentangled representation properties lead to accuracy improvements of 1.01% and 6.75% in activity and identity recognition, respectively. Furthermore, OmniDecVAEs synthesize realistic omni-modal time-frequency data that manifest with enhanced reconstructions (mean absolute error improves by 76.84%) and distributional similarity between real and synthetic data (maximum mean discrepancy improves by 13.85%). Our results highlight OmniDecVAEs potential as a lightweight model suitable for intelligent edge wearables and clinical healthcare, unifying processing requirements and abilities in a single model, through its enhanced representational capacity, modality-invariant spatial complexity (4.1M parameters), and real-time latency.

Tema degli esploratori: statistica e scienza dei dati (retro-catalogo arXiv: annunci del 2026-08-10 in stat.ML).
Categorie arXiv: Machine Learning (cs.LG) ; Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP); Machine Learning (stat.ML).
Pagina del lavoro: https://arxiv.org/abs/2608.07385 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-19T11:02:26.984Z dalla pagina https://arxiv.org/catchup/stat.ML/2026-08-10?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).