Metraipolis › archive › dc_279ef7ea6648

QECGBERT: A Scalable ECG Foundation Model Based on Self-Supervised Language Learning via VQ-VAE Waveform Tokenization — arXiv:2610.33964

Source
arXiv (en)
Original
https://arxiv.org/abs/2610.33964
License (as archived)
CC0-1.0
Archived
2026-10-27T08:00:35.329Z
SHA-256 of the archived text
e28c8eb4a83036223d87df05cafe1d35216f317937f1ac28e9e2684a715007c9
Stable URL of this page
https://metraipolis.com/documento/dc_279ef7ea6648

How to cite

QECGBERT: A Scalable ECG Foundation Model Based on Self-Supervised Language Learning via VQ-VAE Waveform Tokenization — arXiv:2610.33964 — arXiv (en), https://arxiv.org/abs/2610.33964 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_279ef7ea6648 (Metraipolis archive dc_279ef7ea6648, sha256 e28c8eb4a83036223d87df05cafe1d35216f317937f1ac28e9e2684a715007c9)
BibTeX
@misc{dc279ef7ea6648,
  title = {QECGBERT: A Scalable ECG Foundation Model Based on Self-Supervised Language Learning via VQ-VAE Waveform Tokenization — arXiv:2610.33964},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2610.33964},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_279ef7ea6648; sha256 e28c8eb4a83036223d87df05cafe1d35216f317937f1ac28e9e2684a715007c9},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.33964. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

AI foundation models play a pivotal role in advancing heart disease diagnosis from electrocardiogram (ECG) data, particularly for rare diseases where the lack of sufficient labeled data hinders supervised learning. However, most self-supervised learning methods treat ECGs as generic sequence or image data without exploiting underlying physiological structure. To address this limitation, we propose QECGBERT, a self-supervised ECG language model that explicitly encodes physiological semantics by tokenizing the P, QRS, T, and isoelectric background waveforms. Vector-quantized variational autoencoder (VQ-VAE) tokenization is applied to each 12-lead ECG, with tokens enriched by continuous waveform features to preserve morphology lost during quantization without increasing sequence length. This design enables compact BERT masked language modeling with short sequences, improving scalability and reducing computational cost relative to long-sequence approaches. QECGBERT applies BERT pre-training to the MIMIC-IV dataset containing over 800,000 unlabeled ECG recordings, and fine-tuning on labeled PTB-XL, CPSC2018, and Chapman--Shaoxing--Ningbo datasets for evaluation. The results demonstrate that QECGBERT achieves comparable or superior performance to published benchmarks, offering a scalable, physiologically aware approach to ECG foundation modeling for cardiac diagnosis.

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno).
Categorie arXiv: Machine Learning (cs.LG) ; Artificial Intelligence (cs.AI).
Pagina del lavoro: https://arxiv.org/abs/2610.33964 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-27T07:55:30.867Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).