Hi FireRedTeam team!
Thanks for open-sourcing FireRedTTS3. I noticed the current requirements.txt pins flash_attn==2.8.3, which is CUDA-only and blocks running on Apple Silicon (Mac M-series).
Feature request: Add MLX or MPS support so FireRedTTS3 can run locally on Apple Silicon, similar to how the community has ported FireRedTTS / other TTS models to mlx-audio.
A few options that would help:
- Make
flash_attn optional and fall back to a standard attention implementation on non-NVIDIA devices.
- Provide MLX conversion scripts for the checkpoints.
- Document the minimal steps to run on an MPS backend.
Happy to contribute if you can point me to where the attention is wired in. Thanks!
Hi FireRedTeam team!
Thanks for open-sourcing FireRedTTS3. I noticed the current
requirements.txtpinsflash_attn==2.8.3, which is CUDA-only and blocks running on Apple Silicon (Mac M-series).Feature request: Add MLX or MPS support so FireRedTTS3 can run locally on Apple Silicon, similar to how the community has ported FireRedTTS / other TTS models to mlx-audio.
A few options that would help:
flash_attnoptional and fall back to a standard attention implementation on non-NVIDIA devices.Happy to contribute if you can point me to where the attention is wired in. Thanks!