HEL-877 把连续语音接到同一位她的聊天内核（候选，不合并） #13

2026-10-26T22:41:45+08:00

leefer commented

2026-10-26 22:41:45 +08:00

Co-authored-by: multica-agent github@multica.ai

Co-authored-by: multica-agent <github@multica.ai>

leefer added 2 commits 2026-10-26 22:41:45 +08:00

HEL-876: voice-base read-only verification + R5/R6 readiness materials - docs/voice-r5-readiness-HEL876.md records the 2026-10-26 bounded read-only audit of 192.168.200.12 with timestamps: LiveKit/FunASR/8090 alive with health evidence, 8081 corrected as the voice-agent livekit worker (not a legacy lip-sync piece), CosyVoice TTS 9880 gracefully stopped since 2026-10-24 22:17 and NOT running, MuseTalk 8010 unit gone, ComfyUI 8188 holding 26.6GB of the 32GB GPU leaving 3.9GB free < ~5.6GB TTS requirement (the only hard resource gap, coordination not unilateral action), voice catalog (11 voices, rain selected) with whitelisted config field names only and no credentials read or printed, .11 gateway model-list probe and open-meteo outbound both 200; the R5 seam is fixed at src/cybergril/api/app.py:488 - the worker must reuse the same chat chain via a livekit LLM adapter speaking the identical RealChatAdapter protocol (epoch sync/serialized turns/barge-in cancel/idempotent replay/receipt round-trip), proven offline with zero model calls by scripts/verify_hel876_voice_seam.py (six checks all pass on 3.11 venv + requirements.lock installed from the local uv offline cache, ruff clean, explicitly NOT claimed as end-to-end voice verification); R6 seams located read-only: city placeholder ManagePanel.tsx:182 with no backend, no weather client (outbound now proven), demo-only material import :178/:183, full-backup boundary = companion.db + vec_public + mem0_public_history.db + embed ledger where copying the single db file is not a complete backup and Persona.fingerprint is the same-her check; three-column honest conclusions (verified / unverified / actually-missing) plus six zero-cost work items ready for dispatch; no product code touched (src/ web/ unchanged), no new product PR, candidate branch not merged, dual-target requirement checks 4/4 pass with handoff-HEL-876.json 23415fbcd0

Co-authored-by: multica-agent <github@multica.ai>

Merge remote-tracking branch 'origin/hel-870-assembly' into agent/2/6a08a4c18f23 a324fd57b7

leefer added 1 commit 2026-10-26 22:42:24 +08:00

HEL-877: wire the audited .12 voice base into the one CyberGril chat chain as backend-only code (no deploy, no real voice call) - new independent src/cybergril/voice module: session+router add POST /api/voice/session / DELETE end / GET honest status on the unified instance (server-side room + dedicated cybergril-voice-agent dispatch + short-TTL join token via zero-new-dependency livekit_wire HS256/Twirp matching the installed SDK's wire format verified claim-for-claim on the .12 agent venv stdin-only; keys never reach the browser; unconfigured/no-profile/TTS-down refuse honestly and capabilities.voice stays false), chat_api_client speaks the exact real.ts RealChatAdapter protocol (per-turn health epoch, bounded 409 resync, robust incremental SSE parsing across multibyte/CRLF/multi-data chunk splits, fixed turn_id idempotency, immediate HTTP-stream close on barge-in without waiting for the next ASR final), llm_chat_api is a livekit llm.LLM adapter whose only backend is POST /api/chat so persona/mood/dyad/memory/life-sharing/budget gates and the one same-turn chat_lock govern text and voice identically (phi spoken verbatim via ChatChunk, never archived, no receipt), receipt.py confirms a sharing receipt only after real SDK playback completion with every negative (interrupted/failed/mid-playout/phi/incomplete/stale-epoch) fail-closed and exactly once per turn, stt_funasr/tts_cosyvoice reuse the proven .12 adapters verbatim with provenance, worker.py assembles the dedicated worker (independent voice_state_cybergril.json so D1 stays undecided, no second persona, cg.subtitle data-channel contract for the visual lead, CG-011 proactive seam left as an explicit no-op hook, built-in health port 8082); app.py keeps a minimal registration with voice_service injection for isolated tests; deployment drafts only (config/voice.example.yaml, worker.env.example, restart_cybergril.sh.example with exact-pattern process matching, serve_dual_8360_8361.py keeping HTTP 8360 and the HTTPS voice entry on ONE process sharing state/locks, runbook-hel877-voice.md contract+startup+rollback incl. the >=6GB GPU precondition and the do-not-copy historical fuser warning) - verification: 281 pytest pass on 3.11 venv + requirements.lock after merging the chief engineer's mid-flight HEL-874 rework e978e87 in full (parallel work preserved), verify_hel877_voice_chain.py 8/8 offline full-chain incl. socket-level barge-in fail-close and text/voice mutual same-gate cancellation, real-SDK check on the .12 livekit-agents 1.8.8 venv 8/8 ALL PASS via SSH stdin with zero writes zero network, dual-port single-process smoke on loopback 18360/18361 with a throwaway self-signed cert then stopped, ruff clean on all new code, dual-target requirement checks pass vs origin/hel-870-assembly (current tip e978e87) and origin/main with handoff-HEL-877.json; zero real LLM/embed/TTS/ASR requests, no mic/camera, no downloads/installs, no service start/stop, no 4080 access, no third-account or profile writes, web/ untouched, not merged, not deployed aba2aebeb0

Co-authored-by: multica-agent <github@multica.ai>

## HEL-877 交付摘要（R5 后台施工，未部署未合并）

- 新独立模块 src/cybergril/voice/：专属 livekit worker（agent_name=cybergril-voice-agent，复用 .12 FunASR/CosyVoice/silero 底座，不 fork 不另搭平台，无第二人格/记忆，不直连 LLM）；llm_chat_api 适配器与文字前端 real.ts 同协议走 POST /api/chat（epoch 409 有界重同步、SSE 分片、turn_id 幂等、打断即断流）；/api/voice/session 建房+专属派发+短时限 token 全服务端（密钥不进浏览器；缺配置/无档案/TTS 停机诚实拒绝；capabilities.voice 不伪造）；receipt 仅在 SDK 真实播放完成后确认（打断/失败/φ 轮/旧 epoch 全 fail-closed）。
- 部署草案：/opt/voice-agent-cybergril 目录、worker 健康端口 8082、HTTP 8360 + HTTPS 8361 同进程双入口（deploy/voice/serve_dual_8360_8361.py，共用同一状态/锁）、启动顺序含 TTS GPU≥6GB 前置与回滚；本卡未执行任何启停。契约（开关/字幕/失败/打断/挂断 + CG-011 主动开口接缝）见 docs/runbook-hel877-voice.md §3。
- 自测（零真实请求）：281 pytest 全过（含语音 25 例：socket 级打断断流、SSE 边界、重放零调用、文字/语音同门互打断、回执全负例、token 房间隔离）；scripts/verify_hel877_voice_chain.py 8/8；.12 agent venv（livekit-agents 1.8.8）真 SDK 检查 8/8（stdin-only 零写入零网络）；双端口同进程本地冒烟通过；ruff 干净；需求检查双目标通过（含 handoff-HEL-877.json）。
- 施工中总工 HEL-874（e978e87）推上同分支，本卡已完整并入，不覆盖并行成果。未验证如实列明：端到端语音（TTS 停机/GPU 3.9GB<5.6GB）、真 LiveKit server 的 dispatch/delete、移动端实机——待接线/审核卡真机验收，未经真实验收不称 R5 完成。

leefer force-pushed leefer/hel-877-voice-chain from 966859002a to aba2aebeb0

2026-10-26 22:42:24 +08:00

Compare

You are not authorized to merge this pull request.

This pull request can be merged automatically.

This branch is out-of-date with the base branch

View command line instructions

Checkout

From your project repository, check out a new branch and test the changes.

git fetch -u origin refs/pull/13/head:leefer/hel-877-voice-chain

git checkout leefer/hel-877-voice-chain

Sign in to join this conversation.

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: leefer/CyberGril#13