Metraipolis › archive › dc_78331c4d2825
CookVoice: Unified Framework for Style Controllable Multi-Modal Human Voice Generation — arXiv:2608.11590
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2608.11590
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-19T05:40:16.473Z
- SHA-256 of the archived text
a7d34e94469e5a777687fbb7197881f37199e531719e4912c3e8cc25f34cfccc- Stable URL of this page
https://metraipolis.com/documento/dc_78331c4d2825
How to cite
CookVoice: Unified Framework for Style Controllable Multi-Modal Human Voice Generation — arXiv:2608.11590 — arXiv (en), https://arxiv.org/abs/2608.11590 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_78331c4d2825 (Metraipolis archive dc_78331c4d2825, sha256 a7d34e94469e5a777687fbb7197881f37199e531719e4912c3e8cc25f34cfccc)
BibTeX
@misc{dc78331c4d2825,
title = {CookVoice: Unified Framework for Style Controllable Multi-Modal Human Voice Generation — arXiv:2608.11590},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2608.11590},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_78331c4d2825; sha256 a7d34e94469e5a777687fbb7197881f37199e531719e4912c3e8cc25f34cfccc},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.11590. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Human voice generation has made rapid progress in speech generation, singing voice generation, voice cloning, and voice editing. However, most existing systems are designed for specific tasks and often rely on task-dependent architectures, control signals, or autoregressive decoding, limiting fine-grained controllability and inference efficiency. In this paper, we propose CookVoice, a unified framework for multimodal, multi-style, and multi-task human voice generation. CookVoice decomposes the human voice into three key factors: content, prosody, and style, enabling both speech and singing voice generation within a unified model. To achieve precise and flexible controllability, we design a flexible alignment strategy that maps text, style, and prosody control signals onto the frame-level of spectrogram. This design allows CookVoice to support a wide range of tasks, including text-to-speech, text-to-singing voice, style-controllable generation, voice mimicry, voice conversion, and voice editing. Experimental results show that CookVoice achieves generation quality comparable to existing Text-to-Speech and text-to-singing voice baselines, while providing stronger style and prosody controllability. Moreover, CookVoice achieves comparable performance to large-scale baselines with only 43.51 million parameters and efficient inference using as few as 4 ODE steps, making it a practical solution for real-world human voice generation applications. Demo page is available at this https URL . Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-13 in cs.LG). Categorie arXiv: Sound (cs.SD) ; Machine Learning (cs.LG). Pagina del lavoro: https://arxiv.org/abs/2608.11590 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-19T05:18:32.539Z dalla pagina https://arxiv.org/catchup/cs.LG/2026-08-13?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).