tkrmagid/javis_bot
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases 20 Wiki Activity

feat(tts): default to offline GPU MeloTTS with brain-role worker

Browse Source 
Switch the default TTS engine from online Edge TTS to offline GPU
MeloTTS (privacy-first: reply text never leaves the host). Adds a
supervisord melo-worker program that runs in full/bot/brain roles and
synthesises Korean on the GPU (MELO_DEVICE=cuda, MELO_SPEED=1.5), a
baked /opt/melo py3.11 venv layer in the Dockerfile, and compose/env
defaults. Edge TTS stays available as an opt-in online fallback via
TTS_ENGINE=edge.

Verified on the RTX 5050 (Blackwell sm_120): melo-worker logs
"ready (lang=KR speed=1.5 device=cuda)", /health returns ok, and a
/synth round-trip returns a 177KB WAV.

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
This commit is contained in:
javis-bot
2026-07-22 20:39:54 +09:00
parent 8562548571
commit bb60c4db3b
5 changed files with 65 additions and 20 deletions
Download Patch File Download Diff File Expand all files Collapse all files

23
docker/supervisord.conf
View File

@@ -49,8 +49,27 @@ stdout_logfile_maxbytes=0
stderr_logfile=/dev/stderr
stderr_logfile_maxbytes=0
# (No TTS worker program: the default Edge TTS engine synthesises in-process in
# the bridge via the `edge-tts` package — no warm model/worker is needed.)
[program:melo-worker]
; Warm GPU MeloTTS Korean voice (offline) in its own py3.11 venv (/opt/melo). The
; bridge's synthesize() POSTs here when TTS_ENGINE=melo. Runs wherever the bridge
; runs (full/bot/brain) so a GPU brain host serves TTS on the GPU. If TTS_ENGINE
; =edge the bridge synthesises in-process and never calls this worker.
command=/app/docker/run-if-role.sh full,bot,brain /opt/melo/bin/python /app/bridge/melo_worker.py
directory=/app
; HF_HOME points at the dedicated, image-baked melo cache (warmed in
; setup-melo.sh). The whisper_cache volume is mounted over /root/.cache/huggingface,
; so without this the pre-cached BERT + KR checkpoint would be shadowed and
; re-downloaded (and would fail offline). HF_HUB_OFFLINE/TRANSFORMERS_OFFLINE
; force pure-cache reads. MELO_DEVICE/MELO_SPEED inherit from the container env
; (compose sets both with defaults cuda / 1.5), so MELO_SPEED must always be set
; in the env or this %(ENV_x)s expansion fails at startup (compose guarantees it).
environment=MELO_LANGUAGE="KR",MELO_SPEED="%(ENV_MELO_SPEED)s",MELO_DEVICE="%(ENV_MELO_DEVICE)s",MELO_WORKER_HOST="127.0.0.1",MELO_WORKER_PORT="8770",HF_HOME="/opt/melo-cache",HF_HUB_OFFLINE="1",TRANSFORMERS_OFFLINE="1"
priority=280
autorestart=true
stdout_logfile=/dev/stdout
stdout_logfile_maxbytes=0
stderr_logfile=/dev/stderr
stderr_logfile_maxbytes=0
[program:bridge]
command=/app/docker/run-if-role.sh full,bot,brain /opt/venv/bin/python -m bridge.server