VoxGen, an AMD-optimized TTS inference engine for VoxCPM 2 models
热度趋势
百分比基于当前可用热度信号，而非评论数或独立用户人数。
GitHub 相关模型动态已经出现，适合跟踪能力变化、生态影响和后续可用性。
VoxGen 是一款专为 VoxCPM 2 模型设计的 AMD 优化 TTS 推理引擎。开发者创建 VoxGen 的原因是，现有框架（包括 VoxCPM 2）主要针对 NVIDIA GPU 进行优化，导致在 AMD 显卡上出现卡顿和 GPU 峰值等性能问题。此外，开发者认为 Python 和 PyTorch 依赖项带来了诸多不便。VoxGen 旨在为 AMD 用户提供更高效的解决方案。目前，Windows 预构建二进制文件已在其 GitHub 发布页面上提供。
Hi, everyone,
I’ve just released VoxGen, a lightweight native inference engine for VoxCPM2, written in Rust and using Vulkan compute instead of Python/PyTorch/CUDA.
Why VoxGen?
The main reason I started the project was because I needed a decent local text-to-speech solution.
I therefore saw VoxCPM 2 as a reasonable solution. However, most frameworks are NVIDIA-first, and VoxCPM 2 is no exception; as a result, my card was severely stuttering, and my GPU was always spiking. Also, having Python and Pytorch as a dependency is absolute hell.
This is why VoxCPM was created: not only we sidestep Pytorch completely, but performance on AMD cards is buttery smooth (and if you have a XTX 7900, I have designed a mode with even more aggressive power and speed optimizations)!
This application can also be run from a shell, so it can be integrated with other programs and scripts!
Installation:
You'll only need voxgen.exe (or the Linux equivalent) and the following files at https://huggingface.co/DennisHuang648/VoxCPM2-GGUF:
VoxCPM2-BaseLM-Q8_0.gguf VoxCPM2-Acoustic-F16.gguf
And that's it!
If you are interested, check out the Github page: https://github.com/NullMagic2/VoxGen Prebuilt binaries (for now, Windows only) are available here: https://github.com/NullMagic2/VoxGen/releases