Compare commits

..
Author SHA1 Message Date
总管andmultica-agent 8cd4265182 HEL-797: allocate first-use memory budget across team verification and user trial
Co-authored-by: multica-agent <github@multica.ai>
2026-10-29 22:41:31 +08:00
总管andmultica-agent 049d3dbdff HEL-913: correct runtime wiring and closeout instructions after coordinator checks
Co-authored-by: multica-agent <github@multica.ai>
2026-10-29 22:39:04 +08:00
总工andmultica-agent 8ea5fdc4c9 HEL-913 close-out: executable package version/dir entry, consistent pending-approval enablement, complete auditable mem0 install (isolated venv), identity-checked ctl scripts + voice-window wiring (42/42 offline stub checks), fact-table accuracy fixes
Co-authored-by: multica-agent <github@multica.ai>
2026-10-29 22:30:56 +08:00
总工andmultica-agent 0146e370b1 HEL-913: unified-experience run package — fixed-version manifest, sanitized templates, offline zero-real-call verification (34/34), mem0 cp311 gap verified, capability list + one-shot enablement proposal
Co-authored-by: multica-agent <github@multica.ai>
2026-10-29 22:04:52 +08:00
施工员2号andmultica-agent 4a38106eef HEL-911: fix AgentHandoff/shutdown seams, attribute & fix the 3.66s pre-generation wait
- worker _on_item: filter conversation_item_added by the real 1.8.8 item
  discriminator (ChatMessage | AgentHandoff | _TypeDiscriminator); only
  assistant str-part body feeds the echo filter (HEL-910 AttributeError)
- bind_interrupt_channel unload: async (JobContext shutdown callbacks are
  awaited), idempotent, disconnect-safe; interrupt/receipt/budget paths
  untouched (HEL-910 TypeError await None)
- TURN_HANDLING: explicit turn_detection=None — 1.8.8 silently installs an
  English EOU TurnDetector whose unlikely verdicts on Chinese finals push
  endpointing to max_delay=6.0 (measured 3.667/3.654s HEL-910 call2; offline
  A/B on the real SDK: baseline 3.704s vs fixed 0.004s). Endpointing
  0.8/6.0 kept verbatim; no VAD/buffer_turn/semantic change
- scripts/gen_hel911_wait_repro.py: offline reproduction harness (real
  AgentSession + real silero VAD + HEL-910 wav and measured timings)
- tests: +3 real-SDK checks (11/11 on .12 agent venv; prior 8 regressions
  kept, unload call sites await the new protocol)
- hel910_call1.mjs reliability: segmented probe/recorder dumps to disk,
  timing-A trigger requires the server-committed voice turn row (not a
  we-sent-it proxy); node --check only, no real run
- window-record.md §9: appended factual corrections (companion 9 not 18,
  turn_start +6.099 not +4.10, assistant_final is the playout/receipt gate,
  post-window ListRooms token failure is not empty-room evidence); original
  record untouched
- docs/rework/hel911/summary.md + handoff-HEL-911.json; requirement checks
  pass vs origin/main and 407fc81

Co-authored-by: multica-agent <github@multica.ai>
2026-10-29 21:25:25 +08:00
xiaomoandmultica-agent 407fc8158c HEL-910: real-call retest window record — web text interrupt, wait chain, budgets, cleanup evidence
Co-authored-by: multica-agent <github@multica.ai>
2026-10-29 20:24:52 +08:00
67 changed files with 5945 additions and 17 deletions
+393
View File
@@ -0,0 +1,393 @@
# HEL-913 · 统一体验运行包(固定版本,未部署、cap=0)
> 本目录是把已通过 HEL-912 审核的统一候选装成的**可交接运行包**:精确源码
> 版本、产物与哈希、脱敏配置模板、唯一启动方式、独立空资料空间、停止/
> 备份/保留资料回退说明、一次零真实调用的运行准备验证记录、真实记忆的
> 完整可审安装清单,以及语音窗口的唯一布防接线。**本卡未部署任何现网
> 服务、未监听 836x/8082/9880/8090、未改任何现有实例;实际启用与新用量
> 由总管统一向白栖知说明并获批准后再执行。**
## 0. 精确版本:产品基线 vs 运行包提交(不要混同)
- **已审产品基线**:`agent/2/8e99cc2cc592` @ `4a38106eef21c43ba24ab7d07992b1bfe539137d`
(HEL-911 接缝修复;HEL-912 审核「通过,无必须修复项」)。父线:
`407fc81`(HEL-910 窗口记录)← `958c696`(HEL-908 R1/R2 返工)。
**产品代码(src/web/config/tools/tests)以这个提交为准。**
- **运行包提交**:同一分支上、`4a38106` 之后的追加提交——只新增/修改
`deploy/hel913-unified/` 与 `docs/` 下文件,**不改任何产品代码**。交付
评论给出运行包精确 head;本文件自身就在该提交里,所以不能在文件内
写死自己的哈希。部署**照抄入口是运行包提交**(本目录随它一起走),
只 checkout `4a38106` 会没有本目录——这是收口修正点,别再踩。
- **部署前自校验**(两条都必须通过):
```bash
git merge-base --is-ancestor 4a38106eef21c43ba24ab7d07992b1bfe539137d HEAD && echo ok
git diff --stat 4a38106eef21c43ba24ab7d07992b1bfe539137d HEAD -- src web config tools tests # 必须为空
```
- 需求基准 v1.12(`docs/requirements/`),需求检查见 `handoff-HEL-913.json`。
## 1. 交付物清单(本目录)
| 文件 | 作用 |
| --- | --- |
| `README.md` | 本运行说明(唯一照抄入口;不跳旧 HEL-895 通用步骤) |
| `manifest.json` | 机器可读清单:产品基线、dist 哈希、环境引用、边界 |
| `dist-manifest.json` | web dist 8 文件 SHA256(复用 HEL-910 实测构建) |
| `models.template.yaml` | 脱敏模型/预算配置(**一切预算=0**;占位符标注待批写入位置) |
| `voice.template.yaml` | 脱敏语音配置(livekit_url 必须是 wss 桥地址,见 §5) |
| `worker.env.template` | 语音 worker 环境模板(含 ASR 窗口闸三项,默认未布防=拒绝一切 ASR) |
| `voice-window-arm.template.env` | 语音窗口一次性布防参数模板(默认全 0/未布防) |
| `api_ctl.sh` / `worker_ctl.sh` | 统一实例 API(单进程 HTTP+HTTPS)与语音 worker 启停(身份核验版) |
| `bridge_ctl.template.sh` | wss TLS 桥启停(获批语音窗口用;浏览器侧语音的前提) |
| `tts_ctl.template.sh` | 共享 TTS 9880 窗口内临时恢复/停回(只停自己起的 PID) |
| `force_end.template.sh` | 窗口到期强制收尾(`now` 立即 / `watch <epoch>` 到点;封窗停服) |
| `verify_offline.py` | 零真实调用运行准备验证(34 项;TestClient 进程内,不监听端口) |
| `test_ctl_scripts.sh` | 启停脚本离线替身检查(42 项;stub,零真实服务) |
| `mem0-cp311-wheels.txt` | 真实 Mem0 记忆栈 cp311 缺项轮清单(40 项,待批一次性下载) |
运行记录:`docs/rework/hel913/verify-offline-run.txt`(.12 产品 3.11 venv
实跑 34/34)、`docs/rework/hel913/ctl-checks-run.txt`(收口轮启停检查 42/42)。
## 2. 版本固定与产物复用
- **源码**:产品基线 `4a38106`(含 `requirements.lock` 19 项固定版本,
Python 3.11 实测)+ 运行包提交(仅本目录与 docs)。
- **web dist 复用**:`git diff 958c696 4a38106 -- web/` 为空(网页源码零变动),
直接复用 HEL-910 已实测部署的 dist(.12 `/opt/cybergril-hel910/current/web/dist`,
REVISION 标记 `958c6962…`),只读拷贝,不安装 node、不重建、不跳任何会
`npm install` 或创建旧端口实例的旧发布步骤(如 `deploy/hel895-release-candidate.md`
的通用总装流程——那不是本包的入口)。8 文件哈希见 `dist-manifest.json`
(2026-10-29 于 .12 逐文件实测),部署时核对一致即可。
- **解释器(既有环境引用,不新建、不增改)**:
- 产品 API:`.12 /opt/cybergril-hel879/current/.venv311`(Python 3.11.16,
requirements.lock 全量,fastapi 0.159.1 / uvicorn 0.54.0 / httpx 0.28.1 /
pydantic 2.14.1)。**只借用运行,绝不向它安装任何东西**(记忆栈装进
本实例自己的隔离 venv,见 §7)。
- 语音 worker:`.12 /opt/voice-agent/agent/venv`(livekit-agents 1.8.8,
含 silero VAD)。
- 证书:`.12 /opt/cybergril-voice-certs/cybergril-voice.{pem,key}`(既有
自签,覆盖 192.168.200.12;8361 与 wss 桥 8363 共用)。
- 本机 LiveKit `ws://127.0.0.1:7880`(常驻);TTS 9880 / 面板 8090 /
wss 桥 8363 只在获批窗口内启动(§5),未获批保持停机。
## 3. 目标实例布局(唯一布局;用户实例 data 必须为空)
```
/opt/cybergril-hel913/ # 实例根(名字可换;以下结构固定)
current/ # git checkout <运行包提交>(见 §0,不是 4a38106)
web/dist/ # 按 dist-manifest.json 核哈希后放入(只读复用件)
etc/
models.yaml # 由 models.template.yaml 复制,填入获批网关与预算
voice.yaml # 由 voice.template.yaml 复制,填入服务器本地值
semantic.yaml # (仅批准真实记忆时)由 config/semantic.example.yaml 复制,见 §7
data/ # 独立空资料空间:新库从零初始化
worker/.env # 由 worker.env.template 复制并填好(占位全清)
logs/
```
**不打包进她的正式档案**:任何历史测试库(8360 团队库、HEL-907/910 窗口库)、
聊天记录、LiveKit/TTS 凭据、自签证书私钥、agent venv 内实物。用户实例在用户
亲自创建前 `companion` 表必须为空(离线验证第 3 项复现该守门)。
## 4. 首次准备与启停(唯一照抄入口)
### 4.1 首次准备(获批部署窗口内执行一次;不真启动服务)
```bash
# 0) 取运行包提交(精确 head 见交付评论;下述校验两条都要过,见 §0)
git clone -b agent/2/8e99cc2cc592 ssh://git@192.168.200.36:222/leefer/CyberGril.git \
/opt/cybergril-hel913/current
cd /opt/cybergril-hel913/current
git checkout --detach <本轮交付评论的运行包完整提交号>
git merge-base --is-ancestor 4a38106eef21c43ba24ab7d07992b1bfe539137d HEAD
git diff --stat 4a38106eef21c43ba24ab7d07992b1bfe539137d HEAD -- src web config tools tests # 空
# 1) 目录骨架(固定布局)
mkdir -p /opt/cybergril-hel913/{etc,data,logs,worker}
# 2) 配置落位(占位符必须全部替换;预算值未经批准一律保持 0)
cp deploy/hel913-unified/models.template.yaml /opt/cybergril-hel913/etc/models.yaml
cp deploy/hel913-unified/voice.template.yaml /opt/cybergril-hel913/etc/voice.yaml
cp deploy/hel913-unified/worker.env.template /opt/cybergril-hel913/worker/.env
vi /opt/cybergril-hel913/etc/models.yaml /opt/cybergril-hel913/etc/voice.yaml /opt/cybergril-hel913/worker/.env
# 3) web dist 只读复用(核哈希后拷入;不装 node、不重建)
rsync -a /opt/cybergril-hel910/current/web/dist/ /opt/cybergril-hel913/current/web/dist/
python3 - <<'EOF'
import hashlib, json, pathlib
m = json.loads(pathlib.Path("deploy/hel913-unified/dist-manifest.json").read_text())
bad = [k for k, want in m.items()
if hashlib.sha256((pathlib.Path("web/dist")/k).read_bytes()).hexdigest() != want]
raise SystemExit(f"dist hash mismatch: {bad}" if bad else 0)
EOF
# 4) 未创建档案守门复验(进程内 TestClient,零监听零出站;34 项全过才继续)
PYTHONPATH=src /opt/cybergril-hel879/current/.venv311/bin/python \
deploy/hel913-unified/verify_offline.py --web web/dist
```
### 4.2 启动与停止(唯一方式;子命令只认 start|stop|status)
```bash
# API:单进程双入口(HTTP 8360 + HTTPS 8361 共用同一 app 状态;lifespan 只进一次)
cd /opt/cybergril-hel913/current
HEL913_BASE=/opt/cybergril-hel913 bash deploy/hel913-unified/api_ctl.sh start
# 健康检查:curl -s http://127.0.0.1:8360/api/health(version=R4-assembly,
# semantic_backend=stub;llm.ok=false 是诚实状态——cap=0 且未配网关)
# 语音 worker(语音窗口获批后;接线与前置见 §5)
HEL913_BASE=/opt/cybergril-hel913 bash deploy/hel913-unified/worker_ctl.sh start
# 停止顺序:先 worker 后 API(语音会话先释放,再关统一进程)
HEL913_BASE=/opt/cybergril-hel913 bash deploy/hel913-unified/worker_ctl.sh stop
HEL913_BASE=/opt/cybergril-hel913 bash deploy/hel913-unified/api_ctl.sh stop
```
启停脚本安全口径(收口版,`test_ctl_scripts.sh` 42 项离线替身验证):
非法子命令拒绝退出 2,绝不静默当 start;重复 start 拒绝(不丢既有 pid
句柄);stop/失败收尾只杀**身份核验通过**(cmdline 含本启动器/模块名且
cwd 是本实例目录)的进程,PID 被复用时拒杀并报告;启动健康/注册检查
不过时清掉自己刚起的进程、保留日志退出 1;`worker_ctl.sh` 启动前拒绝
含未填 `<...>` 占位或解析失败的 `.env`。
同一数据目录**绝不允许**两个写入实例并存(双入口由 `deploy/voice/serve_dual_8360_8361.py`
在同一进程内保证;另起独立 uvicorn 会触发 lifespan 重入 fail-closed)。
## 5. 语音窗口唯一接线(获批窗口才动;默认全 0/未布防)
浏览器从 HTTPS(8361) 页面连 LiveKit **必须走 wss**(混合内容策略),
`voice.yaml` 的 `livekit_url` 因此必须是 wss 桥地址(默认拟 `wss://192.168.200.12:8363`,
`bridge_ctl.template.sh` 启停,与 8361 同证书、回环转发 7880)——**不是
可选件**;服务器内部(开房/删房/worker 注册)仍走 `livekit_internal` 的
本机明文 7880。窗口内各上限的唯一接线:
| 上限 | 接线(唯一) | 性质 |
| --- | --- | --- |
| ASR 音频总量 / 每通重连 | `worker/.env` 三项 `CYBERGRIL_ASR_WINDOW_ID`、`CYBERGRIL_ASR_WINDOW_MAX_AUDIO_SECONDS`、`CYBERGRIL_ASR_MAX_CONNECT_RETRIES_PER_CALL`(空/0=拒绝一切 ASR;布防值见 `voice-window-arm.template.env`) | 程序硬闸,发送前拒绝(`src/cybergril/voice/asr_usage.py`,逐通落账) |
| 每通墙钟/房间寿命 | `voice.yaml` `session_ttl_seconds: 600` + token TTL 300;挂断即删房(失败留账重试) | 程序硬闸 + 到期失效 |
| TTS 段数 | `tts_ctl.template.sh` start 时记录 tts.log 起始字节,`grep -c "first chunk"` 对照窗口段数上限 | 监控口径(到顶即人工 force_end;程序不硬闸) |
| 窗口总时限 | `force_end.template.sh watch <deadline>` 到点强制收尾(DELETE 全部会话→worker→api→bridge→tts,各按专属句柄);更可靠的等价物是获批后装 systemd timer 调 `now` | 可执行停服,非口头承诺 |
窗口启动顺序:tts_ctl snapshot→start → bridge_ctl start → 改 `worker/.env`
布防三项并 worker_ctl start → api_ctl start(见 §4.2)→ force_end watch
挂上。窗口结束(到期/触线/人工):force_end now → 按 `seal_budget_hel879.py`
封账归档(**封账不解除**,旧三窗口余额也不结转进新窗)。
## 6. 备份与保留资料回退
- **发布/阶段归档**(本包口径,沿用 HEL-896 收口工具,一致性快照):
```bash
# 停服口径(推荐;目录内 SQLite 一并 checkpoint+逐表核对)
bash deploy/hel913-unified/api_ctl.sh stop
/opt/cybergril-hel913/venv311/bin/python tools/release_snapshot_hel896.py snapshot \
--name <阶段名> --db /opt/cybergril-hel913/data/companion.db \
--file /opt/cybergril-hel913/data --out /opt/cybergril-hel913/archives/
```
产物含逐文件 SHA256、代码精确提交、逐表行数与回退演练;旧归档不删。
- **回退**:停服 → 解包快照到新 data 目录(按 rollback_plan 源路径映射)→
`current` 切回上一运行包提交(`git checkout <旧head>`)→ 起服务 → `verify` 通过。
- **整实例撤销但保留资料**:`api_ctl.sh stop`,data/ 原样保留,重新启用 =
同一 data 目录再 start(epoch 递增、聊天记忆保留,离线验证第 11 组复现)。
- **CG-009 每日自动备份/用户手动完整导出(R6)尚未实现**,本节只是发布归档,
不得冒充 R6 完成。
## 7. 零真实调用运行准备验证(已执行,34/34;口径如实)
在 .12 产品 3.11 venv 对产品基线树实跑 `verify_offline.py`(进程内
TestClient,零监听、零出站——网关地址重写为 127.0.0.1:1 + provider.stream
出站哨兵双保险):
- 包完整性:Python 3.11.16、候选树 import、**4 个关键包版本打印**
(fastapi/uvicorn/httpx/pydantic——不是 19 项锁依赖的逐项核对)、记忆栈
四项缺置如实。
- 入口/创建守门:health 诚实(llm.ok=false)、空库 404 无伪造档案、预览
本地计算、创建 201、二次创建 409、底色落库与预览一致、persona 在 cap=0
下诚实 failed(无编造诠释)。
- 传输:SSE 对话在预算 0 下诚实 `chat.error`,零 provider 出站;失败轮如实
落库;同轮重试幂等拒绝。
- 日子与回忆:**空库上的**未分享生活服务端裁剪(told=1;未做正反种子对照,
不夸成实质权限全覆盖)、分页形状、未知回执/详情 404。
- 语音:status 诚实 voice=false;TTS 不可达时开房 503 拒绝(绝不建房);
未知会话 DELETE 404。
- 重开:epoch=2、身份/关系/聊天保留、无伪造回复。
- dist:GET / 出 index.html;8 文件哈希与 manifest 全符。
- worker 接线:agent venv(livekit-agents 1.8.8)下 `import cybergril.voice.worker`
通过(只读 import,未启动注册)。
**预算 0 下只能诚实拒绝的**:一切真实创建诠释/习惯、对话生成、生活事件
生成、判定/成长/gist、主动措辞、嵌入、语音开房。`/api/health` 的 200 不代表
模型已运行——`llm.ok=false` 才是诚实状态。
## 8. 真实记忆(Mem0)最少安装与接线 —— 完整可审清单(零安装零下载,待批)
### 8.1 现状(2026-10-29 只读实测,收口轮复核沿用)
- 服务器 .12 产品 `.venv311`(3.11.16)内 `mem0 / qdrant_client /
fastembed / onnxruntime` 四项均未安装;服务器全盘无 mem0 安装、无固定
tarball、无已建轮、无 fastembed 缓存、uv 缓存仅 28K。**没有另一个已
准备好的 3.11 兼容环境**;旧 3.10 `hel857-venv`(工作站)不能混入 3.11
进程。
- 工作站本地实物(未上服务器):固定源 tarball `mem0-2c81af3.tar.gz`
(sha256 `9dcef9303ebcec116eec6739f01b8b35bd24459de6a569686b4d19b9412dda23`,
与 `deploy/mem0-stack.lock` 一致)、固定源已建轮
`mem0ai-2.2.1-py3-none-any.whl`(sha256
`698284b6083ab8b7761454d65876a6d1bb983d278ad21a7bee38d760cb20e9db`)、
fastembed 模型缓存 92MB(Qdrant/bge-small-zh-v1.5 + bm25)、uv 缓存可
复用 3 轮(greenlet/pillow/truststore cp311)。
### 8.2 安装目标环境:本实例自己的隔离 venv(不是产品 .venv311)
**绝不向借用的 `/opt/cybergril-hel879/current/.venv311` 增改任何依赖。**
目标环境是 `/opt/cybergril-hel913/venv311`(服务器既有 python3.11 基座
新建,3.11.16),装两套东西:产品锁 19 项 + 记忆栈 41 项(40 缺轮 + 固定
源 mem0ai 轮)。装好后本实例 API 用它跑(`api_ctl.sh` 里
`HEL913_VENV=/opt/cybergril-hel913/venv311/bin/python`),与 hel879 实例
彻底隔离;`.venv311` 保持只读借用前的原样(部署后可直接改回借用口径,
两者兼容——同一 requirements.lock)。
### 8.3 一次性批准窗口内的完整命令(逐项哈希留证;任一步失败即停)
```bash
# W0 · 固定源身份核对(零下载;哈希不符立即停,禁用索引同名轮替代)
sha256sum <hel857-data>/mem0-2c81af3.tar.gz # 必须等于 9dcef930…2dda23
sha256sum <hel857-data>/mem0ai-2.2.1-py3-none-any.whl # 必须等于 698284b6…20e9db
# W1 · 获批下载窗口(工作站联网执行;cp311/manylinux2014_x86_64 定版)
mkdir -p wheels-product wheels-mem0
python3 -m pip download --only-binary :all: --implementation cp \
--python-version 3.11 --platform manylinux2014_x86_64 --abi cp311 \
-r requirements.lock -d wheels-product/ # 产品锁 19 项
python3 -m pip download --only-binary :all: --implementation cp \
--python-version 3.11 --platform manylinux2014_x86_64 --abi cp311 \
-c requirements.lock -r deploy/hel913-unified/mem0-cp311-wheels.txt -d wheels-mem0/ # 记忆栈 40 项
# 其中 greenlet/pillow/truststore 3 项可从工作站 uv 缓存离线复用
# (release-artifacts.json 记录),命中即从 wheels-mem0/ 删除同版本再放缓存件
cp <hel857-data>/mem0ai-2.2.1-py3-none-any.whl wheels-mem0/
( cd wheels-product && sha256sum * > ../wheels-product.sha256 )
( cd wheels-mem0 && sha256sum * > ../wheels-mem0.sha256 ) # 逐项留证入库
# W2 · 传输与落位(scp 到 .12;约 wheels 250–350MB + 模型缓存 92MB)
scp -r wheels-product wheels-mem0 wheels-product.sha256 wheels-mem0.sha256 <hel857-data>/fastembed-cache root@192.168.200.12:/opt/cybergril-hel913/
ssh root@192.168.200.12 'cd /opt/cybergril-hel913/wheels-product && sha256sum -c ../wheels-product.sha256 && \
cd ../wheels-mem0 && sha256sum -c ../wheels-mem0.sha256' # 传输后复核
# W3 · 隔离 venv 创建 + 仅本地轮安装(--no-index 全程,失败即停)
ssh root@192.168.200.12
/opt/cybergril-hel879/runtime/cpython-3.11.16/bin/python3.11 -m venv /opt/cybergril-hel913/venv311
/opt/cybergril-hel913/venv311/bin/python -m pip install --no-index \
--find-links /opt/cybergril-hel913/wheels-product -r /opt/cybergril-hel913/current/requirements.lock
/opt/cybergril-hel913/venv311/bin/python -m pip install --no-index \
--find-links /opt/cybergril-hel913/wheels-mem0 \
--find-links /opt/cybergril-hel913/wheels-product \
-c /opt/cybergril-hel913/current/requirements.lock \
mem0ai==2.2.1 qdrant-client==1.20.0 fastembed==0.9.1
# mem0ai 的安装来源必须是 W0 的固定源码轮(同版本号不同来源不互认)
# W4 · co-import 冒烟(同进程;失败即停,不降级)
cd /opt/cybergril-hel913/current
MEM0_TELEMETRY=False HF_HUB_OFFLINE=1 TRANSFORMERS_OFFLINE=1 PYTHONPATH=src /opt/cybergril-hel913/venv311/bin/python -c \
"import cybergril.api, mem0, qdrant_client, fastembed; print('co-import ok')"
# W5 · 模型缓存落位(真实本地嵌入零下载)
mkdir -p /opt/cybergril-hel913/data/sem
cp -a /opt/cybergril-hel913/fastembed-cache /opt/cybergril-hel913/data/sem/fastembed-cache
# api_ctl.sh 通过 FASTEMBED_CACHE_PATH 指向它,模型资源禁止联网获取。
# W6 · 清理暂存(轮文件传输件用毕即删;哈希清单留档)
rm -rf /opt/cybergril-hel913/wheels-product /opt/cybergril-hel913/wheels-mem0 /opt/cybergril-hel913/fastembed-cache
```
**空间/影响(.12 实测口径估)**:`venv311` 成品约 450–550MB(产品 19 项
约 120–150MB + 记忆栈约 330–400MB,参照 3.10 同栈实测 366MB)+ 传输暂存
约 350MB(W6 删除)+ 模型缓存 92MB(常驻 data/sem)。首次本地嵌入零下载
(缓存就位)。**当前不触发任何嵌入**:装完不批 B 预算时
`CYBERGRIL_SEMANTIC=stub`,长期检索走词面 FTS,不以 stub 冒充真实 Mem0。
### 8.4 记忆账本与配置接线(新空用户库续账,不搬测试聊天)
- `CYBERGRIL_SEMANTIC`(api_ctl.sh 的 `HEL913_SEMANTIC`):`stub`(默认,
全链可跑、非语义)→ 批准后 `mem0`(真实)。
- 配置:`cp config/semantic.example.yaml /opt/cybergril-hel913/etc/semantic.yaml`,
启动器显式传 `CYBERGRIL_SEMANTIC_CONFIG=$BASE/etc/semantic.yaml`(不再误读仓库默认路径)。
`MEM0_TELEMETRY=False`、`FASTEMBED_CACHE_PATH=$BASE/data/sem/fastembed-cache`、
`HF_HUB_OFFLINE=1`、`TRANSFORMERS_OFFLINE=1` 由启动器在 import 前设置。
填 `ledger_path=/opt/cybergril-hel913/data/embed_ledger.sqlite3`、
`vector_root/history_root=/opt/cybergril-hel913/data/sem/{vec,hist}`、
网关三键(与 models.yaml 同源)、`authority` 块。
- **权威旧账续账(498 已用 / 原批 500 / 冻结 2 不动)**:把 HEL-857 系列
唯一权威嵌入账文件复制为实例 `data/embed_ledger.sqlite3`(只复制账本,
**不搬任何测试聊天/向量**——聊天在旧测试库,向量在新库从零生成);
`authority` 按 `config/semantic.example.yaml` 算式填
`prefix_rows: 181`、`prefix_sha256: <权威账前 181 行逐行摘要,总管按账现值填>`、
`min_used: 498`。批准 B 嵌入 180 条后写累计口径
`embed_cap: 680`、`embed_reserve: 2`(可用 = 680−498−2 = 180;**禁止**
把 180 直接填成 cap、禁止动冻结 2 条;缺/错 authority 在构造前拒绝,
指向新空文件重开余额同样被拒——`src/cybergril/memory/semantic.py`
`verify_ledger_authority`)。
- **不把旧实验余额当新用量**:39/60(HEL-857 真实请求旧账)与旧三窗口
余额一律不结转;用户实例的 LLM/请求账从 0 起记(自己的 SQLite 日账)。
- **副作用如实分开**:真实 embed(写入向量库+权威账)、SDK 内部提取 LLM
(`llm_ops` 独立 cap + 统一请求闸 "semantic" 类)、co-import 冒烟(零
调用,只 import)——三者互不冒充;当前阶段三者全部 0。
## 9. 本包不做的事
不部署、不监听现网端口、不恢复 9880/8090/836x/8082、不触 4080、不下载任何
依赖/模型/浏览器、不改模型/认证/运行时绑定、不合并 PR、不替换正式界面、
8300/8310/8320/8350 与既有资料不动、8340/ComfyUI 保持停机、不向
`/opt/cybergril-hel879/current/.venv311` 增改依赖。旧三次测试窗口余额不
结转;一切提额、安装、部署都是待批准建议。
## 10. 总管独立取件勘误与最终执行约束(2026-10-29)
本节优先于上文笼统模板描述,当前仍全部待批,零真实调用。
- 运行包基线8ea5fdc之后仅机械收口:补语义配置路径/缓存/禁遥测离线变量;
force_end按真实持久化sessions列表取session_id;补桥/TTS非法命令拒绝和失败收尾;
传输hash清单与目标工作目录、既有3.11解释器路径纠正;每通TTL改600秒与10分钟一致。
- 40项记忆缺轮与产品19项锁是现有版本清单。下载使用两份requirements合并约束,
不得让第二次下载/安装解析器静默换掉产品锁版本:W1增加`-c requirements.lock`,
W3记忆安装同时传`--find-links .../wheels-product -c .../requirements.lock`。
解析冲突/缺cp311轮即停并留首错,不自动换版本、不引入新模型。
- B记忆日顶明确为embed_daily=60、llm_daily=40(SDK提取另受累计llm_cap=60),
authority/累计embed_cap=680、reserve=2原样。语义日账按UTC(北京时间08:00)
切日,产品对话/生活日账显式TZ=Asia/Shanghai按北京时间00:00切日,不能混说。
- 不运行测试脚本里的失管sleep替身作为长期任务。未来实际截止保护用获批后的
systemd一次性定时服务(服务/日志/停机句柄可查);不能把本轮本地watch留到结束后。
部署卡执行`systemd-run --unit=cybergril-hel913-expiry --on-calendar="<明确UTC截止时间>" \
/usr/bin/env HEL913_BASE=/opt/cybergril-hel913 /usr/bin/bash \
/opt/cybergril-hel913/current/deploy/hel913-unified/force_end.template.sh now`,
放行前必须核`systemctl list-timers cybergril-hel913-expiry.timer`及临时实例停止句柄。
这是未来待批动作,本轮没有创建服务/定时器。
- 语音为团队陪同的3次预约短用,每次600秒,总ASR1800秒,建房尝试最多6次,
每通ASR重连最多2次,TTS60段及声音登记+试听合计10次由当班执行者监督计数。
这些软上限不冒充程序硬闸;不在无人值守时开启语音窗口。
TTS段顶/语音配额到顶只结束语音,B文字生活仍可用;到期/用户叫停才停全实例。
自定义声音需要既有8090面板的实例专属启动句柄与前后快照,
复用HEL907已有面板启动方法,不动8081;句柄或快照未备齐不放行上传/试听,
默认已有工程声音仍能通话。共享voices列表需恢复前快照,自定义参考材料在独立实例保留。
- 到期脚本负责停本实例入口与自己启动的语音服务。封账归档、LiveKit只读核空、
voices快照恢复由当班执行者另行执行并核实,不能把日志里的done当全部清理完成。
清理失败保留原始错误/账/日志,不解除封账、不重启服务来“证明已停”。
自定义声音细分额度(同一次待批方案):最多登记2段参考音频,每段由陪同人员先核≤20秒;
自动转写最多2次/合计40秒,单列监督账,不冒充通话ASR的1800秒硬闸。
最多试听8次;登记2次+试听8次共10次。试听合成并入60段TTS总上限。
两类ASR合计最大1840秒(通话1800+参考40);失败/重试同样记账,不返余额。
本轮未执行登记、转写或试听。
### 最终统一预算勘误:团队先验真实记忆,再交用户(总管)
此条取代上文A“0嵌入”的旧建议,仅修改待批方案,当前真实额度仍0。
团队先用独立测试资料核真实Mem0接入,不把首次故障留给用户:
A的55请求/50万tokens内,最多10次用于SDK提取;先用最多20条新嵌入。
这10次/20条从同一批新申请的60次提取/180条嵌入中先扣,
不是另加额度;余量(至少50次提取/160条嵌入)留给用户期,使用实账计算。
两阶段共用唯一活动记账文件、串行写入,测试向量/档案与用户向量/档案分开,
只共用计数账,不拷贝测试聊天或测试记忆给用户。旧权威embed_ops前缀不改,
旧39/60实验的授权和账原封保存,不挪用其余额;新提取批建立独立可审计操作记录。
如旧llm_ops表已有用量,新60次必须按现值加增量并保存旧行,不可清表/重置;
操作前核旧基数并留证,实际新增始终≤60。团队检查最多2小时,从首个真实调用计时;
检查不通过则停止并报告首个错误,用户期不自动开始。
+146
View File
@@ -0,0 +1,146 @@
#!/usr/bin/env bash
# HEL-913 统一体验运行包 · 统一实例 API 启停(单进程 HTTP+HTTPS 双入口)
#
# 启动器 deploy/voice/serve_dual_8360_8361.py 保证 HTTP 与 HTTPS 共用同一
# API 进程/同一份状态(lifespan 只进一次)。本脚本只做本实例常规启停安全:
# - 子命令只认 start|stop|status,其他一律拒绝退出 2(不会静默当 start);
# - start 前核对 pid 句柄:本实例已在跑 → 拒绝重复 start(不覆盖句柄);
# 句柄 pid 活着但不属于本实例(PID 复用)→ 拒绝动手,提示人工处理;
# - stop/start 失败收尾只杀经身份核验的进程(/proc/<pid> 的 cmdline 含
# 本启动器且 cwd 是本实例代码目录),身份不符一律不杀;
# - start 健康检查不过 → 清掉自己刚起的进程、保留日志、退出 1。
#
# 用法: [ENV=..] bash deploy/hel913-unified/api_ctl.sh start|stop|status
# 环境变量(默认值按部署说明的实例布局):
# HEL913_BASE 实例根目录(含 current/ etc/ data/ logs/)
# HEL913_HTTP HTTP 端口(默认 8360)
# HEL913_HTTPS HTTPS 端口(默认 8361;语音页需要 secure context)
# HEL913_VENV 产品 3.11 venv python(默认 /opt/cybergril-hel879/current/.venv311/bin/python)
# HEL913_CERT / HEL913_KEY 证书路径(默认 /opt/cybergril-voice-certs/ 下既有证书)
set -u
BASE=${HEL913_BASE:-/opt/cybergril-hel913}
CODE=${HEL913_CODE:-$BASE/current}
HTTP=${HEL913_HTTP:-8360}
HTTPS=${HEL913_HTTPS:-8361}
VENV=${HEL913_VENV:-/opt/cybergril-hel879/current/.venv311/bin/python}
CERT=${HEL913_CERT:-/opt/cybergril-voice-certs/cybergril-voice.pem}
KEY=${HEL913_KEY:-/opt/cybergril-voice-certs/cybergril-voice.key}
LOG=$BASE/logs/api.log
PIDF=$BASE/logs/api.pid
MARKER="serve_dual_8360_8361.py"
usage() { echo "usage: [ENV=..] bash $0 start|stop|status" >&2; exit 2; }
# 进程身份核验:pid 存活、cmdline 含本启动器、cwd 是本实例代码目录。
# 任一不满足即视为“不是我们的进程”(含 PID 被系统复用),一律不动它。
ours() {
local p=$1 cmd cw
case "$p" in ''|*[!0-9]*) return 1 ;; esac
[ "$p" != "$$" ] || return 1
kill -0 "$p" 2>/dev/null || return 1
cmd=$(tr '\0' ' ' < "/proc/$p/cmdline" 2>/dev/null) || return 1
cw=$(readlink "/proc/$p/cwd" 2>/dev/null) || return 1
case "$cmd" in *"$MARKER"*) ;; *) return 1 ;; esac
[ "$cw" = "$CODE" ] || return 1
return 0
}
pidfile_pid() { [ -f "$PIDF" ] && cat "$PIDF" 2>/dev/null; }
stop() {
local p
p=$(pidfile_pid)
if [ -z "$p" ]; then
echo "api not running (no pid file)"
return 0
fi
if kill -0 "$p" 2>/dev/null && ! ours "$p"; then
echo "REFUSED: pid $p is alive but is NOT this instance's api (pid reuse?) — not killing; resolve $PIDF manually" >&2
return 1
fi
if ours "$p"; then
kill "$p"
sleep 3
if ours "$p"; then kill -9 "$p"; sleep 1; fi
fi
rm -f "$PIDF"
echo "api stopped"
return 0
}
start() {
local p
p=$(pidfile_pid)
if [ -n "$p" ] && kill -0 "$p" 2>/dev/null; then
if ours "$p"; then
echo "REFUSED: api already running (pid $p) — stop first" >&2
else
echo "REFUSED: pid file has live pid $p that is not this instance's api (pid reuse?) — resolve $PIDF manually" >&2
fi
exit 1
fi
rm -f "$PIDF" # 死句柄:清掉再起
[ -d "$CODE" ] || { echo "REFUSED: code dir missing: $CODE" >&2; exit 1; }
[ -x "$VENV" ] || { echo "REFUSED: venv python not executable: $VENV" >&2; exit 1; }
[ -r "$CERT" ] && [ -r "$KEY" ] || { echo "REFUSED: cert/key not readable ($CERT / $KEY)" >&2; exit 1; }
mkdir -p "$BASE/logs" "$BASE/data"
cd "$CODE" || exit 1
set -a
export CYBERGRIL_DB=$BASE/data/companion.db
export CYBERGRIL_SEMANTIC=${HEL913_SEMANTIC:-stub}
export CYBERGRIL_R2_ENABLED=${HEL913_R2:-1}
export TZ=Asia/Shanghai
export CYBERGRIL_SEMANTIC_CONFIG=$BASE/etc/semantic.yaml
export MEM0_TELEMETRY=False
export FASTEMBED_CACHE_PATH=$BASE/data/sem/fastembed-cache
export HF_HUB_OFFLINE=1
export TRANSFORMERS_OFFLINE=1
export CYBERGRIL_MODELS=$BASE/etc/models.yaml
export CYBERGRIL_VOICE_CONFIG=$BASE/etc/voice.yaml
export CYBERGRIL_WEB=$CODE/web/dist
export PYTHONPATH=$CODE/src
set +a
nohup "$VENV" deploy/voice/serve_dual_8360_8361.py \
--http-port "$HTTP" --https-port "$HTTPS" --cert "$CERT" --key "$KEY" \
> "$LOG" 2>&1 &
p=$!
echo "$p" > "$PIDF"
echo "api starting (pid $p) http=$HTTP https=$HTTPS"
sleep 6
if curl -s --max-time 3 "http://127.0.0.1:$HTTP/api/health" >/dev/null \
&& curl -sk --max-time 3 "https://127.0.0.1:$HTTPS/api/health" >/dev/null; then
echo "OK: $HTTP + $HTTPS healthy"
return 0
fi
echo "FAIL: health check did not pass — full log kept at $LOG; tail:" >&2
tail -20 "$LOG" >&2
# 失败收尾:只清自己刚起的这个进程(身份核验),日志保留
if ours "$p"; then
kill "$p"; sleep 2
ours "$p" && kill -9 "$p"
fi
rm -f "$PIDF"
echo "cleaned up failed start (log kept: $LOG)" >&2
exit 1
}
status() {
local p
p=$(pidfile_pid)
if [ -n "$p" ]; then
if ours "$p"; then echo "running pid $p (identity verified)"
elif kill -0 "$p" 2>/dev/null; then echo "pid $p alive but NOT ours (stale pid file?)"
else echo "pid $p not alive (stale pid file)"; fi
else
echo "no pid file"
fi
curl -s --max-time 3 "http://127.0.0.1:$HTTP/api/health" && echo " <- health" \
|| echo "health not answering"
}
case "${1:-}" in
start) start ;;
stop) stop ;;
status) status ;;
*) usage ;;
esac
@@ -0,0 +1,78 @@
#!/usr/bin/env bash
# HEL-913 运行包 · wss TLS 桥启停模板(8363 → 127.0.0.1:7880;脱敏待批件)
#
# 浏览器从 HTTPS(8361) 页面连 LiveKit 必须走 wss(混合内容策略),本桥在新
# 端口终结 TLS 并只向回环 7880 转发(字节级,协议无关;WebRTC 媒体面不经
# 本桥)。与 8361 同一张自签证书。改编自 HEL-910 已实测 bridge_ctl.sh;
# 本文件默认不运行,获批语音窗口才使用。子命令只认 start|stop|status。
#
# 用法: [ENV=..] bash bridge_ctl.template.sh start|stop|status
# 环境变量: HEL913_BASE / HEL913_BRIDGE_PORT(8363) / HEL913_CERT / HEL913_KEY
set -u
case "${1:-}" in start|stop|status) ;; *) echo "invalid subcommand" >&2; exit 2 ;; esac
BASE=${HEL913_BASE:-/opt/cybergril-hel913}
PORT=${HEL913_BRIDGE_PORT:-8363}
CERT=${HEL913_CERT:-/opt/cybergril-voice-certs/cybergril-voice.pem}
KEY=${HEL913_KEY:-/opt/cybergril-voice-certs/cybergril-voice.key}
LOG=$BASE/logs/bridge.log
PIDF=$BASE/logs/bridge.pid
MARKER="wss_bridge.example.py"
usage() { echo "usage: [ENV=..] bash $0 start|stop|status" >&2; exit 2; }
ours() {
local p=$1 cmd cw
case "$p" in ''|*[!0-9]*) return 1 ;; esac
[ "$p" != "$$" ] || return 1
kill -0 "$p" 2>/dev/null || return 1
cmd=$(tr '\0' ' ' < "/proc/$p/cmdline" 2>/dev/null) || return 1
cw=$(readlink "/proc/$p/cwd" 2>/dev/null) || return 1
case "$cmd" in *"$MARKER"*) ;; *) return 1 ;; esac
[ "$cw" = "$BASE/current/deploy/voice" ] || return 1
return 0
}
pidfile_pid() { [ -f "$PIDF" ] && cat "$PIDF" 2>/dev/null; }
stop() {
local p
p=$(pidfile_pid)
if [ -z "$p" ]; then echo "bridge not running (no pid file)"; return 0; fi
if kill -0 "$p" 2>/dev/null && ! ours "$p"; then
echo "REFUSED: pid $p alive but not this bridge (pid reuse?) — not killing; resolve $PIDF manually" >&2
return 1
fi
if ours "$p"; then kill "$p"; sleep 2; ours "$p" && kill -9 "$p"; fi
rm -f "$PIDF"
echo "bridge stopped"
}
case "${1:-}" in
stop) stop; exit $? ;;
status)
p=$(pidfile_pid)
if [ -n "$p" ]; then
ours "$p" && echo "running pid $p (identity verified)" \
|| { kill -0 "$p" 2>/dev/null && echo "pid $p alive but NOT ours" || echo "pid $p not alive (stale)"; }
else
echo "no pid file"
fi
exit 0 ;;
esac
p=$(pidfile_pid)
if [ -n "$p" ] && kill -0 "$p" 2>/dev/null; then
echo "REFUSED: bridge already running (pid $p)" >&2; exit 1
fi
rm -f "$PIDF"
[ -r "$CERT" ] && [ -r "$KEY" ] || { echo "REFUSED: cert/key not readable" >&2; exit 1; }
cd "$BASE/current/deploy/voice" || exit 1
nohup /usr/bin/python3 wss_bridge.example.py \
--listen "0.0.0.0:$PORT" --upstream 127.0.0.1:7880 \
--cert "$CERT" --key "$KEY" > "$LOG" 2>&1 &
echo $! > "$PIDF"
echo "bridge starting (pid $(cat "$PIDF")) on :$PORT"
sleep 3
timeout 8 openssl s_client -connect "127.0.0.1:$PORT" -servername 192.168.200.12 </dev/null 2>/dev/null \
| grep -q "TLSv1.3" && echo "OK: bridge TLS up" \
|| { echo "FAIL: TLS probe failed — check $LOG"; tail -5 "$LOG"; stop; exit 1; }
+10
View File
@@ -0,0 +1,10 @@
{
"assets/her-room.jpg": "51ca450a454c108d304feee2745070fbbbd3232863096126badf279ee53a925a",
"assets/her-talk.jpg": "0b9e91b58d75afb836efdad3d8e8f0aab0c44df64b2c4ddd59d011fd499aeb33",
"assets/icons.svg": "8630691c7349dd33c1accf2331cb4c844ffd9b70465021b1c18bf8f5aea0588e",
"assets/index-B8TdHoQm.css": "a0af3163f564f2ff9cfe7d995378b7ac436bfe2f9fabda9f370ca0aa30c2412f",
"assets/index-Vm-EFPLb.js": "81f55e20c5c2afe4673ccc9020264a2bf99b3c84998c275f03fa48fe4f940bb0",
"demo-material.json": "78fd67e8e4a680e8b3277db4a922360a83fa0be1ceee0cb257ba1c74bc6ede37",
"index.html": "8d84f131b6922fe92ac0c562f5fec73aacd9c6e4db2cfa28f6190b4246f9c8d0",
"vendor/livekit-client-2.22.4.umd.min.js": "040db4c0db72e7f7599cd0e06b0f58f95e0082a395cdde410ca26224a79a0626"
}
@@ -0,0 +1,70 @@
#!/usr/bin/env bash
# HEL-913 运行包 · 窗口到期强制收尾模板(脱敏待批件;默认不布防)
#
# 用途:获批体验/语音窗口到截止时点的**可执行**停服与封窗:先经统一实例
# API 逐个 DELETE 本实例房间(欠清理的房间会留在登记账重试),再按专属
# pid 句柄停 worker → api → wss 桥 → 共享 TTS(都不是我们的就如实报告,
# 绝不按进程名/端口扫杀,绝不触碰 8300/8310/8320/8350、7880/7881、10095、
# 8081 等共享服务)。改编自 HEL-910 已实测 force_end.sh/watchdog.sh。
#
# 用法:
# bash force_end.template.sh now # 立即收尾(幂等,可重复)
# bash force_end.template.sh watch <epoch秒> # 到点自动收尾(受监督后台任务;
# # 更可靠的等价物是获批后装
# # systemd timer 调本脚本 now)
# 环境变量: HEL913_BASE / HEL913_HTTP(8360)
set -u
set -o pipefail
BASE=${HEL913_BASE:-/opt/cybergril-hel913}
HTTP=${HEL913_HTTP:-8360}
PKG=$BASE/current/deploy/hel913-unified
LOG=$BASE/logs/force_end.log
usage() { echo "usage: [ENV=..] bash $0 now|watch <deadline_epoch_seconds>" >&2; exit 2; }
force_end() {
mkdir -p "$BASE/logs"
ts() { date -u +%FT%TZ; }
{
echo "[$(ts)] force_end begin"
# 1) 结清本实例房间(DELETE 走统一实例所有者路径;失败房间留账重试)
for sid in $(python3 - "$BASE/data" <<'EOF' 2>/dev/null
import json, sys, pathlib
p = pathlib.Path(sys.argv[1]) / "companion-voice-sessions.json"
try:
d = json.loads(p.read_text())
except Exception:
raise SystemExit
# VoiceSessionService._persist_state stores sessions as a LIST, not a dict.
# Debts already follow bounded SDK cleanup; do not reset their retry budgets here.
for entry in d.get("sessions", []):
sid = entry.get("session_id", "")
if sid and all(c.isalnum() or c in "-_" for c in sid):
print(sid)
EOF
); do
code=$(curl -s -o /dev/null -w '%{http_code}' --max-time 8 -X DELETE "http://127.0.0.1:$HTTP/api/voice/session/$sid" || echo err)
echo "[$(ts)] DELETE session $sid -> $code"
done
# 2) 按专属句柄逐个停(每步幂等;不是我们的如实报告)
bash "$PKG/worker_ctl.sh" stop 2>&1 | sed 's/^/ worker: /'
bash "$PKG/api_ctl.sh" stop 2>&1 | sed 's/^/ api: /'
bash "$PKG/bridge_ctl.template.sh" stop 2>&1 | sed 's/^/ bridge: /'
bash "$PKG/tts_ctl.template.sh" stop 2>&1 | sed 's/^/ tts: /'
echo "[$(ts)] force_end done(封账归档另由 seal_budget_hel879.py 按账执行,封账不解除)"
} >> "$LOG" 2>&1
}
case "${1:-}" in
now) force_end ;;
watch)
DL=${2:?deadline epoch seconds required}
case "$DL" in *[!0-9]*|'') usage ;; esac
mkdir -p "$BASE/logs"
echo "[$(date -u +%FT%TZ)] watch start, deadline $(date -u -d "@$DL" +%FT%TZ) (pid $$)" >> "$LOG"
while [ "$(date +%s)" -lt "$DL" ]; do sleep 30; done
echo "[$(date -u +%FT%TZ)] DEADLINE REACHED — force end" >> "$LOG"
force_end
;;
*) usage ;;
esac
+86
View File
@@ -0,0 +1,86 @@
{
"task": "HEL-913",
"product_baseline_head": "4a38106eef21c43ba24ab7d07992b1bfe539137d",
"package_head": "运行包提交 = 本文件所在分支 tip(交付评论给出精确 hash;本文件无法写死自身提交)。部署照抄入口是运行包提交,只 checkout 4a38106 会没有 deploy/hel913-unified/",
"package_only_change_check": "git diff --stat 4a38106 <package_head> -- src web config tools tests 必须为空(运行包只动 deploy/hel913-unified 与 docs)",
"branch": "agent/2/8e99cc2cc592",
"review": "HEL-912 01a187e8-1058-7a2d-84e7-bd1896f212cb passed, no must-fix items (product baseline)",
"requirements_lock": "requirements.lock (19 pinned, Python 3.11.16 verified; offline verify printed 4 key package versions only — not a per-item lock audit)",
"web_dist_reuse": {
"source": "/opt/cybergril-hel910/current/web/dist (REVISION 958c6962fb1f2a4462a6df794d893aee1fcb0667)",
"justification": "git diff 958c696 4a38106 -- web/ is empty",
"manifest": "deploy/hel913-unified/dist-manifest.json (8 files, sha256 measured on .12 2026-10-29)"
},
"environments": {
"api_python_default": "/opt/cybergril-hel879/current/.venv311 (Python 3.11.16) — borrow-run only, NEVER install into it",
"api_python_after_mem0": "/opt/cybergril-hel913/venv311 — isolated instance venv created only inside the approved one-shot window (README §8)",
"worker_python": "/opt/voice-agent/agent/venv (livekit-agents 1.8.8)",
"certs": "/opt/cybergril-voice-certs/cybergril-voice.{pem,key} (shared by 8361 and wss bridge 8363)",
"livekit": "ws://127.0.0.1:7880 internal (standing); browser MUST use wss bridge (8363) — not optional from HTTPS pages",
"tts_panel_bridge": "9880/8090/8363 only inside approved voice windows (README §5); stopped otherwise"
},
"package_files": [
"deploy/hel913-unified/README.md",
"deploy/hel913-unified/manifest.json",
"deploy/hel913-unified/dist-manifest.json",
"deploy/hel913-unified/models.template.yaml",
"deploy/hel913-unified/voice.template.yaml",
"deploy/hel913-unified/worker.env.template",
"deploy/hel913-unified/voice-window-arm.template.env",
"deploy/hel913-unified/api_ctl.sh",
"deploy/hel913-unified/worker_ctl.sh",
"deploy/hel913-unified/bridge_ctl.template.sh",
"deploy/hel913-unified/tts_ctl.template.sh",
"deploy/hel913-unified/force_end.template.sh",
"deploy/hel913-unified/verify_offline.py",
"deploy/hel913-unified/test_ctl_scripts.sh",
"deploy/hel913-unified/mem0-cp311-wheels.txt",
"docs/rework/hel913/verify-offline-run.txt",
"docs/rework/hel913/ctl-checks-run.txt",
"docs/hel913-capability-and-enablement.md"
],
"offline_verification": {
"where": ".12 product .venv311, candidate tree at /tmp/hel913-verify (cleaned after run); re-run by manager: 34/34 passed, dist 8-file hashes match",
"result": "34/34 checks passed; worker import ok under livekit-agents 1.8.8",
"zero_real_calls": "models base_url rewritten to 127.0.0.1:1 + provider.stream outbound sentinel; no listening sockets; no rooms; no gateway contact",
"scope_limits": "deps check printed 4 key versions only; unshared-life trimming verified on an empty DB (told=1) without positive/negative seed contrast — not claimed as full dependency or permission coverage",
"ctl_scripts": "test_ctl_scripts.sh 42/42 offline stub checks (invalid subcommand, duplicate start, pid-reuse refusal, failed-start cleanup, .env gating, templates default 0)"
},
"voice_window_wiring": {
"asr_hard_gate": "worker/.env CYBERGRIL_ASR_WINDOW_ID/_MAX_AUDIO_SECONDS/_MAX_CONNECT_RETRIES_PER_CALL (empty/0 = deny all ASR)",
"room_lifetime": "voice.yaml session_ttl_seconds=900 + token_ttl 300 + delete-on-hangup (bounded cleanup ledger)",
"tts_segments": "monitored via tts.log first-chunk count since window start (tts_ctl.template.sh records start byte); hard stop = window deadline",
"deadline": "force_end.template.sh now|watch <epoch> (DELETE sessions -> worker -> api -> bridge -> tts, pid-handle stops only)"
},
"memory_gap": {
"server_venv311": "mem0/qdrant_client/fastembed/onnxruntime all absent (verified 2026-10-29; never install into this borrowed venv)",
"no_other_311_env_on_server": true,
"local_artifacts": {
"mem0-2c81af3.tar.gz": "9dcef9303ebcec116eec6739f01b8b35bd24459de6a569686b4d19b9412dda23",
"mem0ai-2.2.1-py3-none-any.whl": "698284b6083ab8b7761454d65876a6d1bb983d278ad21a7bee38d760cb20e9db",
"fastembed_cache": "92MB (Qdrant/bge-small-zh-v1.5 + bm25)",
"hel857_venv": "Python 3.10.12 — must not mix into 3.11 process"
},
"install_target": "isolated /opt/cybergril-hel913/venv311 (python3.11 base + product lock 19 wheels + mem0 stack 40 wheels + fixed-source mem0ai wheel; all --no-index; complete auditable steps in README §8.3 with per-file sha256 evidence and fail-stop)",
"ledger_continuation": "authoritative embed ledger copied to instance data/embed_ledger.sqlite3 (ledger only — no test chats/vectors moved); authority prefix_rows=181, prefix_sha256 by manager, min_used=498, embed_cap=680 cumulative formula, frozen 2 untouched; 39/60 and old window balances never carried over"
},
"enablement_doc": "docs/hel913-capability-and-enablement.md §2 — single consistent pending-approval proposal: A/B/C separate accounts, all awaiting approval (manager does not self-approve A), B voice = 3 calls x <=10min = <=1800s ASR hard gate with per-cap consequences and executable window end, B/C boundary fixed",
"boundaries": "not deployed; nothing listening; caps all 0; no PR; existing instances and data untouched; no downloads this card; protected venvs untouched",
"coordinator_close_verification": "docs/rework/hel913/coordinator-close-checks.txt: 17/17 targeted offline checks; product baseline unchanged",
"file_sha256": {
"deploy/hel913-unified/README.md": "580e3100b207c8c0e3da9cddc644b00d7b3d66ae0d195ac058dba279f63e242e",
"deploy/hel913-unified/api_ctl.sh": "3eeff54fcdc1becb79d9fe63767eceee9209ed6239663ff7d0a3e90d27379c55",
"deploy/hel913-unified/bridge_ctl.template.sh": "43e951f01ceed07b9c1606cfc046aa1d34eefc8fad3a40c66db2de57f16c1d14",
"deploy/hel913-unified/dist-manifest.json": "c2ebc6e515096b535f5e08cce18dc9c4f104c1b2cabe3f3afb5fdd88f12d63db",
"deploy/hel913-unified/force_end.template.sh": "3f250942ff68e26e4a71750e17fd804fa57be921097d83ee76f1b5b0024fe893",
"deploy/hel913-unified/mem0-cp311-wheels.txt": "2a6fd3d287fe0713a2ac683584ee7f3723c83c236696f39551015ca2db358b94",
"deploy/hel913-unified/models.template.yaml": "0b8f051cedfcf0218929a652fed91b00762c33dd17fbb8f7eadcc50c65d4e837",
"deploy/hel913-unified/test_ctl_scripts.sh": "702f7b911598fc0433f63f250f2f1e58dec9d727dd7eb6ae8a773d521fcad5cd",
"deploy/hel913-unified/tts_ctl.template.sh": "f638f24a41f07cfef64e66eee996b4280fdd7aac80a5fc20be6d47a41b72cabf",
"deploy/hel913-unified/verify_offline.py": "86ea3da6f2c682ad8ee9a932f91d713e0778c61be5d4c15f916e38d15e3e66e4",
"deploy/hel913-unified/voice-window-arm.template.env": "4002b99d63fa556a5f1e8cb86bf74846e7b944571dd76ed40bfb549cf64f3307",
"deploy/hel913-unified/voice.template.yaml": "55e556d5df149ab4fa257640b4d87dc40bb43107a5e90279826516a7ec423f4c",
"deploy/hel913-unified/worker.env.template": "be80fc87cc04a379a776732ad94f392e08af4ecb9eaad4190a090f4071f40383",
"deploy/hel913-unified/worker_ctl.sh": "57fd028e3b0d932cdbde483925cc7e39a5b994fa53742f9350cc5fc22381077f"
}
}
@@ -0,0 +1,45 @@
# HEL-913 记忆栈 cp311 缺项轮清单(40 项;来源 docs/rework/hel879/sdk-audit/sdk-audit.json 闭包 55-产品已有)
# mem0ai 不在本表:只认固定源码轮 sha256 698284b6…(deploy/hel895-release-candidate.md §4 唯一入口)。
# 获批下载命令:pip download --only-binary :all: --implementation cp --python-version 3.11 \
# --platform manylinux2014_x86_64 --abi cp311 -r 本文件 -d wheels/ 逐项 sha256 留证。
# 其中 greenlet/pillow/truststore 三项已在工作站 uv 缓存命中(hel-879 release-artifacts 记录),可离线复用。
backoff==2.2.1
charset-normalizer==3.5.2
coloredlogs==15.0.1
distro==1.9.0
fastembed==0.9.1
filelock==4.1.0
flatbuffers==25.12.19
fsspec==2026.9.0
greenlet==3.5.6
grpcio==1.84.1
h2==4.4.1
hf-xet==1.7.0
hpack==4.2.0
httpcore2==2.14.0
httpx2==2.14.0
huggingface-hub==1.33.0
humanfriendly==10.0
hyperframe==6.1.0
jiter==0.18.0
loguru==0.7.3
mmh3==5.3.1
mpmath==1.3.0
numpy==2.2.6
onnxruntime==1.23.2
openai==3.37.0
pillow==12.3.0
portalocker==4.4.1
posthog==7.75.11
protobuf==6.33.6
py-rust-stemmers==0.1.8
pytz==2026.5
qdrant-client==1.20.0
requests==2.34.2
sniffio==1.3.1
sqlalchemy==2.0.55
sympy==1.14.0
tokenizers==0.23.3
tqdm==4.70.1
truststore==0.10.5
urllib3==2.8.0
@@ -0,0 +1,89 @@
# HEL-913 统一体验运行包 · models 配置模板(脱敏;本文件一切预算=0)
#
# 用法:复制到 <实例>/etc/models.yaml,按部署说明只改 base_url 指向获批网关、
# 按批准包写入预算值。未经批准一律保持 0(发送前拒绝,fail-closed)。
# 候选分支 config/models.yaml 的 tiers/routing 与本模板一致;本模板把
# base_url 换成占位符并保留 HEL-908 reasoning: buffer_turn 与 HEL-911/912
# 审核通过的调度修正(turn_detection=None 在代码侧,见 src/cybergril/voice/worker.py)。
tiers:
high:
provider: openai_compat
model: <获批模型名>
base_url: <http://内网网关:端口/v1>
api_key_env: null
timeout: 60.0
temperature: 0.85
reasoning: buffer_turn
standard:
provider: openai_compat
model: <获批模型名>
base_url: <http://内网网关:端口/v1>
api_key_env: null
timeout: 40.0
temperature: 0.7
reasoning: buffer_turn
low:
provider: openai_compat
model: <获批模型名>
base_url: <http://内网网关:端口/v1>
api_key_env: null
timeout: 20.0
temperature: 0.4
reasoning: buffer_turn
routing:
dialogue_main: high
dialogue_followup: standard
proactive_message: high
crisis: high
life_event: low
memory_gist: low
fact_extract: low
output_guard: low
pattern_detect: low
filler: none
tick: none
reach_out: none
avatar_drive: none
budget:
daily_tokens: 0
warn_ratio: 0.7
hard_stop_ratio: 0.95
daily_requests:
dialogue: 0
life: 0
background: 0
semantic: 0
# 用户实例永不配置一次性总量(total_requests/total_tokens 保持缺省):
# 一次性总量只属于独立团队测试实例,见 docs/budget-package-hel895.md §6。
asr:
provider: scripted
model: qwen3-asr-1.7b
language: zh
paralinguistic:
provider: scripted
model: sensevoice-small
window_ms: 1500
enabled: true
tts:
provider: silence
model: fun-cosyvoice3-0.5b
voice_ref: null
sample_rate: 16000
vad:
provider: energy
model: silero-v6
sample_rate: 16000
turn:
provider: heuristic
silence_min_ms: 150
silence_hard_end_ms: 800
embedding:
provider: openai_compat
model: qwen3-embedding-0.6b
base_url: null
api_key_env: null
dim: 1024
avatar:
route: vrm
renderer: three.js
lipsync: envelope
+149
View File
@@ -0,0 +1,149 @@
#!/usr/bin/env bash
# HEL-913 运行包 · 启停脚本离线替身检查(零真实服务、零真实端口、零出站)
#
# 用离线替身(stub 解释器 = 只休眠的脚本)与静态检查验证收口后的常规启停
# 安全:非法子命令拒绝、重复 start 拒绝、stop 的 PID 复用防护、启动失败
# 收尾清理、.env 占位/解析守门。不启动真实 API/worker/共享服务,不监听
# 任何端口(curl 只连本机高位死端口,必然失败,正是失败路径所需的输入)。
#
# 用法: bash deploy/hel913-unified/test_ctl_scripts.sh (在检出根目录)
set -u
PKG=$(cd "$(dirname "$0")" && pwd)
ROOT=$(cd "$PKG/../.." && pwd)
TMP=$(mktemp -d /tmp/hel913-ctl-test.XXXXXX)
PASS=0; FAIL=0
cleanup() { rm -rf "$TMP"; }
trap cleanup EXIT
ok() { PASS=$((PASS+1)); echo "PASS $1"; }
bad() { FAIL=$((FAIL+1)); echo "FAIL $1"; }
expect_rc() { # expect_rc <want> <got> <label>
[ "$2" = "$1" ] && ok "$3" || bad "$3 (want rc=$1 got rc=$2)"
}
# ---- S1. 静态:语法 + 包文件齐全 ----
for f in api_ctl.sh worker_ctl.sh bridge_ctl.template.sh tts_ctl.template.sh force_end.template.sh; do
bash -n "$PKG/$f" 2>/dev/null && ok "syntax $f" || bad "syntax $f"
done
for f in README.md manifest.json dist-manifest.json models.template.yaml voice.template.yaml \
worker.env.template verify_offline.py mem0-cp311-wheels.txt \
voice-window-arm.template.env test_ctl_scripts.sh; do
[ -f "$PKG/$f" ] && ok "package file $f" || bad "package file $f missing"
done
# ---- 沙盒实例布局(镜像 README §4 的目标布局) ----
BASE=$TMP/inst
mkdir -p "$BASE/current" "$BASE/worker" "$BASE/etc" "$BASE/data" "$BASE/logs"
CODE=$BASE/current; WDIR=$BASE/worker
touch "$BASE/etc/models.yaml" "$BASE/etc/voice.yaml"
printf 'dummy cert\n' > "$TMP/c.pem"; printf 'dummy key\n' > "$TMP/c.key"
# stub 解释器:保持 argv 不变(cmdline 保留 marker),留一行输出后休眠
STUB=$TMP/stub-python
printf '#!/usr/bin/env bash\necho "stub alive pid=$$ argv=$*" >&2\nsleep 600\n' > "$STUB"; chmod +x "$STUB"
HTTP=53881; HTTPS=53882
API_ENV="HEL913_BASE=$BASE HEL913_HTTP=$HTTP HEL913_HTTPS=$HTTPS HEL913_VENV=$STUB HEL913_CERT=$TMP/c.pem HEL913_KEY=$TMP/c.key"
alive_marker() { pgrep -f "$1" | while read -r p; do [ -d "/proc/$p" ] && echo "$p"; done; }
# ---- S2. 非法子命令拒绝(不静默当 start) ----
env $API_ENV bash "$PKG/api_ctl.sh" bogus >/dev/null 2>&1; expect_rc 2 $? "api_ctl invalid subcommand refused (rc=2)"
[ ! -f "$BASE/logs/api.pid" ] && ok "api_ctl invalid subcommand started nothing" || bad "api_ctl invalid subcommand left a pid file"
env HEL913_BASE=$BASE HEL913_AGENT_VENV=$STUB bash "$PKG/worker_ctl.sh" frobnicate >/dev/null 2>&1
expect_rc 2 $? "worker_ctl invalid subcommand refused (rc=2)"
[ ! -f "$BASE/logs/worker.pid" ] && ok "worker_ctl invalid subcommand started nothing" || bad "worker_ctl invalid subcommand left a pid file"
# ---- S3. api 启动失败收尾:健康不过 → 清自己、留日志、rc=1 ----
env $API_ENV bash "$PKG/api_ctl.sh" start >/dev/null 2>&1; expect_rc 1 $? "api_ctl failed start exits 1"
[ ! -f "$BASE/logs/api.pid" ] && ok "api_ctl failed start removed pid file" || bad "api_ctl failed start left pid file"
[ -s "$BASE/logs/api.log" ] && ok "api_ctl failed start kept log" || bad "api_ctl failed start lost log"
sleep 1
N=$(alive_marker "$STUB.*serve_dual_8360_8361" | wc -l)
[ "$N" = "0" ] && ok "api_ctl failed start left no stub process" || bad "api_ctl failed start left $N stub process(es)"
# ---- S4. api 重复 start 拒绝(活进程 + 有效句柄) ----
( cd "$CODE" && nohup "$STUB" deploy/voice/serve_dual_8360_8361.py --http-port $HTTP --https-port $HTTPS > "$BASE/logs/api.log" 2>&1 & echo $! > "$BASE/logs/api.pid" )
LIVEPID=$(cat "$BASE/logs/api.pid")
kill -0 "$LIVEPID" 2>/dev/null && ok "stub api process running (pid $LIVEPID)" || bad "stub api process failed to start"
env $API_ENV bash "$PKG/api_ctl.sh" start >/dev/null 2>&1; expect_rc 1 $? "api_ctl duplicate start refused (rc=1)"
[ "$(cat "$BASE/logs/api.pid" 2>/dev/null)" = "$LIVEPID" ] && ok "api_ctl duplicate start kept original handle" || bad "api_ctl duplicate start overwrote handle"
kill "$LIVEPID" 2>/dev/null; wait 2>/dev/null
# ---- S5. api stop 的 PID 复用防护:活 pid 但身份不符 → 拒杀 ----
sleep 600 & UNRELATED=$!
echo "$UNRELATED" > "$BASE/logs/api.pid"
env $API_ENV bash "$PKG/api_ctl.sh" stop >/dev/null 2>&1; expect_rc 1 $? "api_ctl stop refused reused pid (rc=1)"
kill -0 "$UNRELATED" 2>/dev/null && ok "unrelated process untouched" || bad "api_ctl stop killed an unrelated process!"
kill "$UNRELATED" 2>/dev/null; wait 2>/dev/null
rm -f "$BASE/logs/api.pid"
# ---- S6. api stop 死句柄:直接清 ----
echo 999999999 > "$BASE/logs/api.pid"
env $API_ENV bash "$PKG/api_ctl.sh" stop >/dev/null 2>&1; expect_rc 0 $? "api_ctl stop with dead pid exits 0"
[ ! -f "$BASE/logs/api.pid" ] && ok "api_ctl stop removed stale pid file" || bad "api_ctl stop kept stale pid file"
# ---- S7. worker .env 守门:占位未填 → 拒绝 ----
cp "$PKG/worker.env.template" "$WDIR/.env"
env HEL913_BASE=$BASE HEL913_AGENT_VENV=$STUB bash "$PKG/worker_ctl.sh" start >/dev/null 2>&1
expect_rc 1 $? "worker_ctl refuses .env with unfilled placeholders (rc=1)"
[ ! -f "$BASE/logs/worker.pid" ] && ok "placeholder refusal started nothing" || bad "placeholder refusal left pid file"
# ---- S8. worker .env 守门:解析失败 → 拒绝 ----
printf 'CYBERGRIL_API_BASE=http://127.0.0.1:8360\nFOO=bar baz\n' > "$WDIR/.env"
env HEL913_BASE=$BASE HEL913_AGENT_VENV=$STUB bash "$PKG/worker_ctl.sh" start >/dev/null 2>&1
expect_rc 1 $? "worker_ctl refuses unparseable .env (rc=1)"
[ ! -f "$BASE/logs/worker.pid" ] && ok "parse refusal started nothing" || bad "parse refusal left pid file"
# ---- S9. worker 启动失败收尾(注册不过 → 清自己、留日志) ----
cat > "$WDIR/.env" <<'EOF'
CYBERGRIL_API_BASE=http://127.0.0.1:8360
CYBERGRIL_AGENT_NAME=cybergril-voice-agent
LIVEKIT_URL=ws://127.0.0.1:7880
LIVEKIT_API_KEY=filled
LIVEKIT_API_SECRET=filled
CYBERGRIL_WORKER_HEALTH_PORT=8082
CYBERGRIL_VOICE_STATE=/tmp/x/voice_state.json
CYBERGRIL_ASR_USAGE_LEDGER=/tmp/x/asr-usage.jsonl
CYBERGRIL_ASR_WINDOW_ID=
CYBERGRIL_ASR_WINDOW_MAX_AUDIO_SECONDS=0
CYBERGRIL_ASR_MAX_CONNECT_RETRIES_PER_CALL=0
EOF
env HEL913_BASE=$BASE HEL913_AGENT_VENV=$STUB bash "$PKG/worker_ctl.sh" start >/dev/null 2>&1
expect_rc 1 $? "worker_ctl failed start exits 1"
[ ! -f "$BASE/logs/worker.pid" ] && ok "worker_ctl failed start removed pid file" || bad "worker_ctl failed start left pid file"
[ -s "$BASE/logs/worker.log" ] && ok "worker_ctl failed start kept log" || bad "worker_ctl failed start lost log"
sleep 1
N=$(alive_marker "$STUB.*cybergril.voice.worker" | wc -l)
[ "$N" = "0" ] && ok "worker_ctl failed start left no stub process" || bad "worker_ctl failed start left $N stub process(es)"
# ---- S10. worker 重复 start 拒绝 ----
( cd "$WDIR" && nohup "$STUB" -m cybergril.voice.worker start > "$BASE/logs/worker.log" 2>&1 & echo $! > "$BASE/logs/worker.pid" )
LIVEPID=$(cat "$BASE/logs/worker.pid")
env HEL913_BASE=$BASE HEL913_AGENT_VENV=$STUB bash "$PKG/worker_ctl.sh" start >/dev/null 2>&1
expect_rc 1 $? "worker_ctl duplicate start refused (rc=1)"
kill "$LIVEPID" 2>/dev/null; wait 2>/dev/null
rm -f "$BASE/logs/worker.pid"
# ---- S11. worker stop 的 PID 复用防护 ----
sleep 600 & UNRELATED=$!
echo "$UNRELATED" > "$BASE/logs/worker.pid"
env HEL913_BASE=$BASE bash "$PKG/worker_ctl.sh" stop >/dev/null 2>&1; expect_rc 1 $? "worker_ctl stop refused reused pid (rc=1)"
kill -0 "$UNRELATED" 2>/dev/null && ok "worker stop left unrelated process alive" || bad "worker stop killed unrelated process!"
kill "$UNRELATED" 2>/dev/null; wait 2>/dev/null
rm -f "$BASE/logs/worker.pid"
# ---- S12. 模板可解析性:arm 模板是合法 KEY=value(可被 source,默认全 0) ----
if ( set -a; . "$PKG/voice-window-arm.template.env"; set +a
[ "${HEL913_ASR_MAX_AUDIO_SECONDS:-x}" = "0" ] \
&& [ -n "${HEL913_WINDOW_ID+x}" ] && [ -z "$HEL913_WINDOW_ID" ] \
&& [ "${HEL913_TTS_SEGMENT_CAP:-x}" = "0" ] ) 2>/dev/null; then
ok "voice-window-arm.template.env parses, defaults 0/unarmed"
else
bad "voice-window-arm.template.env unparseable or non-zero default"
fi
echo
echo "$PASS passed, $FAIL failed"
[ "$FAIL" = "0" ]
+89
View File
@@ -0,0 +1,89 @@
#!/usr/bin/env bash
# HEL-913 运行包 · 共享 CosyVoice TTS 9880 窗口内临时恢复/停回模板(脱敏待批件)
#
# 只在获批语音窗口内使用;窗口结束必须 stop 停回(force_end.template.sh 会调
# 本脚本 stop)。只按自己写的 pid 句柄停止,快照先行;9880 已被别人启动时
# 不碰。改编自 HEL-910 已实测 tts_ctl.sh。子命令只认 start|stop|status|snapshot。
#
# 用法: [ENV=..] bash tts_ctl.template.sh start|stop|status|snapshot
# 环境变量: HEL913_BASE / HEL913_TTS_VENV(/opt/voice-agent/cosyvoice/venv/bin/python)
set -u
case "${1:-}" in start|stop|status|snapshot) ;; *) echo "invalid subcommand" >&2; exit 2 ;; esac
BASE=${HEL913_BASE:-/opt/cybergril-hel913}
CC=${HEL913_TTS_HOME:-/opt/voice-agent/cosyvoice}
TTSVENV=${HEL913_TTS_VENV:-$CC/venv/bin/python}
PIDF=$BASE/logs/tts9880.pid
SNAP=$BASE/logs/tts9880-before.txt
usage() { echo "usage: [ENV=..] bash $0 start|stop|status|snapshot" >&2; exit 2; }
ours() {
local p=$1 cmd cw
case "$p" in ''|*[!0-9]*) return 1 ;; esac
[ "$p" != "$$" ] || return 1
kill -0 "$p" 2>/dev/null || return 1
cmd=$(tr '\0' ' ' < "/proc/$p/cmdline" 2>/dev/null) || return 1
cw=$(readlink "/proc/$p/cwd" 2>/dev/null) || return 1
case "$cmd" in *"server.py"*) ;; *) return 1 ;; esac
[ "$cw" = "$CC" ] || return 1
return 0
}
pidfile_pid() { [ -f "$PIDF" ] && cat "$PIDF" 2>/dev/null; }
case "${1:-}" in
status)
p=$(pidfile_pid)
if [ -n "$p" ]; then ours "$p" && echo "running pid $p (ours)" || echo "pid $p not verified as ours"; else echo "not started by us"; fi
curl -s --max-time 3 http://127.0.0.1:9880/health && echo " <- health" || echo "health not answering"
exit 0 ;;
snapshot)
mkdir -p "$BASE/logs"
{ echo "ts=$(date -u +%FT%TZ)"
if curl -s --max-time 3 http://127.0.0.1:9880/health >/dev/null 2>&1; then echo "was=up"; else echo "was=down"; fi
ss -ltn 2>/dev/null | grep ':9880 ' || echo "port9880=free"; } > "$SNAP"
cat "$SNAP"; exit 0 ;;
stop)
p=$(pidfile_pid)
if [ -z "$p" ]; then echo "not ours to stop (no pid file)"; exit 0; fi
if kill -0 "$p" 2>/dev/null && ! ours "$p"; then
echo "REFUSED: pid $p alive but not this tts (pid reuse?) — not killing; resolve $PIDF manually" >&2
exit 1
fi
if ours "$p"; then kill "$p"; sleep 5; ours "$p" && kill -9 "$p"; fi
rm -f "$PIDF"
echo "tts stopped (pid $p)"
exit 0 ;;
esac
# start(仅 start 子命令落到这里)
mkdir -p "$BASE/logs"
p=$(pidfile_pid)
if [ -n "$p" ] && kill -0 "$p" 2>/dev/null; then
echo "REFUSED: live pid handle already exists; inspect/stop first" >&2; exit 1
fi
if curl -s --max-time 3 http://127.0.0.1:9880/health >/dev/null 2>&1; then
echo "9880 already up — NOT ours, not touching"; exit 0
fi
if ss -ltn 2>/dev/null | grep -q ':9880 '; then
echo "port 9880 occupied by non-healthy process — abort"; exit 1
fi
[ -x "$TTSVENV" ] || { echo "REFUSED: tts venv python not executable: $TTSVENV" >&2; exit 1; }
cd "$CC" || exit 1
nohup "$TTSVENV" server.py >> "$CC/tts.log" 2>&1 &
echo $! > "$PIDF"
echo "tts starting (pid $(cat "$PIDF")) — model load takes up to ~120s"
for i in $(seq 1 60); do
sleep 2
if curl -s --max-time 3 http://127.0.0.1:9880/health 2>/dev/null | grep -q '"ok"[[:space:]]*:[[:space:]]*true'; then
echo "OK: tts healthy after ~$((i*2))s"
wc -c < "$CC/tts.log" > "$BASE/logs/tts-log-start-byte" # TTS 段数计数的窗口起点
exit 0
fi
kill -0 "$(cat "$PIDF")" 2>/dev/null || { echo "FAIL: tts process died"; tail -10 "$CC/tts.log"; exit 1; }
done
echo "FAIL: tts not healthy in 120s"; tail -10 "$CC/tts.log"
p=$(pidfile_pid)
if ours "$p"; then kill "$p"; sleep 2; ours "$p" && kill -9 "$p"; fi
rm -f "$PIDF"
exit 1
+273
View File
@@ -0,0 +1,273 @@
"""HEL-913 运行准备离线验证:零真实调用(cap=0 + 死地址双重保险)。
在进程内用 TestClient 走统一实例的关键接线:入口健康、创建守门、传输
(SSE 对话在预算 0 下诚实拒绝且绝不触发出站)、关系调整、日子与回忆
读取的服务端裁剪、语音诚实拒绝、重开(epoch/资料保留)、静态页与 dist
哈希。不监听任何端口(836x/8082/9880/8090 全程不出现监听 socket),
不访问真实网关(models.base_url 重写为 127.0.0.1:1,livekit 指向死地址,
即使预算闸失效也只能连本机死端口)。
用法(在候选 head 检出根目录、产品 3.11 venv 下):
PYTHONPATH=src <venv311>/python deploy/hel913-unified/verify_offline.py \
[--web <dist目录>] [--keep]
退出码 0 = 全部通过;任一 FAIL 即非 0。临时库写在 <root>/.hel913-verify-tmp,
默认结束后删除(--keep 保留)。
"""
from __future__ import annotations
import argparse
import atexit
import json
import os
import shutil
import sys
import tempfile
import uuid
from pathlib import Path
RESULTS: list[tuple[bool, str]] = []
def check(ok: bool, label: str) -> bool:
RESULTS.append((bool(ok), label))
print(("PASS " if ok else "FAIL ") + label)
return bool(ok)
def main() -> int:
parser = argparse.ArgumentParser()
parser.add_argument("--web", default=None, help="web dist 目录(只读;默认不挂静态)")
parser.add_argument("--keep", action="store_true")
args = parser.parse_args()
root = Path(__file__).resolve().parents[2]
os.chdir(root)
tmp = Path(tempfile.mkdtemp(prefix="hel913-verify-", dir=root))
if not args.keep:
atexit.register(shutil.rmtree, tmp, ignore_errors=True)
# ---- 0. 包完整性:Python / 锁定依赖 / 模块树 -----------------------------
check(sys.version_info[:2] == (3, 11), f"python 3.11 (actual {sys.version_info[:3]})")
import cybergril # noqa: E402
check(str(Path(cybergril.__file__).resolve()).startswith(str(root / "src")),
f"cybergril imported from candidate tree ({cybergril.__file__})")
import fastapi # noqa: E402
import httpx # noqa: E402
import pydantic # noqa: E402
import uvicorn # noqa: E402
import yaml # noqa: E402
check(True, f"deps: fastapi {fastapi.__version__} uvicorn {uvicorn.__version__} "
f"httpx {httpx.__version__} pydantic {pydantic.__version__}")
from cybergril.api.app import create_app # noqa: E402
from cybergril.voice.router import build_voice_router # noqa: E402
from cybergril.voice.session import load_voice_config # noqa: E402
check(True, "product modules import (api.app / voice.router / voice.session)")
# 记忆栈缺项如实呈现(不允许 stub 冒充真实 mem0)
for mod, expect in (("mem0", False), ("qdrant_client", False), ("fastembed", False)):
try:
__import__(mod)
got = True
except Exception:
got = False
check(got == expect, f"{mod} {'absent' if not expect else 'present'} in product venv (as documented)")
# ---- 1. 脱敏配置:cap=0 + 死地址 ----------------------------------------
models_src = (root / "config" / "models.yaml").read_text()
assert "daily_tokens" in models_src, "models.yaml missing budget block"
dead = models_src.replace("192.168.200.11:8731", "127.0.0.1:1")
assert "192.168" not in dead, "real gateway address survived rewrite"
models_path = tmp / "models.yaml"
models_path.write_text(dead)
voice_path = tmp / "voice.yaml"
voice_path.write_text(
"# HEL-913 offline template: everything points at dead local ports;\n"
"# no real LiveKit/TTS/panel is contacted by this verification.\n"
"livekit_url: ws://127.0.0.1:1\n"
"livekit_internal: http://127.0.0.1:1\n"
"api_key: dead\n"
"api_secret: dead\n"
"agent_name: cybergril-voice-agent\n"
"tts_health_url: http://127.0.0.1:1/health\n"
"panel_url: https://127.0.0.1:1\n"
"tts_url: http://127.0.0.1:1\n"
"registry_file: " + str(tmp / "voices.json") + "\n"
"worker_state_file: " + str(tmp / "voice_state.json") + "\n"
"token_ttl_seconds: 300\n"
"session_ttl_seconds: 900\n"
)
db_path = tmp / "companion.db"
env = {
"CYBERGRIL_DB": str(db_path),
"CYBERGRIL_MODELS": str(models_path),
"CYBERGRIL_VOICE_CONFIG": str(voice_path),
"CYBERGRIL_SEMANTIC": "stub",
"CYBERGRIL_R2_ENABLED": "1",
**({"CYBERGRIL_WEB": args.web} if args.web else {}),
}
old = {k: os.environ.get(k) for k in env}
os.environ.update(env)
from fastapi.testclient import TestClient # noqa: E402
app = create_app()
# 出站哨兵:把所有已装配 provider 的 stream 打上标记——预算 0 下任何
# 真实发送意图都会把本验证置为 FAIL(而不是悄悄连死地址)。
outbound = []
client = TestClient(app)
with client:
st = app.state
router = st.life.router # LifeRuntime 持有本实例同一 router
for tier in router.available_tiers():
prov = router.provider_for(tier)
def _guard_stream(self, *a, __orig=prov.stream, __name=getattr(prov, "name", tier), **kw):
outbound.append(__name)
raise AssertionError(f"unexpected outbound stream via {__name}")
prov.stream = _guard_stream.__get__(prov, type(prov))
birth = {"birth": "2001-08-16", "hour": "辰时", "name": "临川", "relation": "朋友",
"nickname": "", "boundary": "轻松相处"}
# 2. 入口健康
r = client.get("/api/health")
h = r.json()
check(r.status_code == 200 and h["ok"] and h["capabilities"]["text"] is True,
"GET /api/health 200, text capability true")
check(h["companion_created"] is False, "health: companion_created=false before creation")
check(h["llm"]["ok"] is False, "health: llm honestly not ok (dead addr, cap=0)")
# 3. 创建守门:空库 404,不能读出任何伪造档案
check(client.get("/api/companion").status_code == 404,
"GET /api/companion 404 before creation (no fabricated profile)")
# 4. 生辰预览:纯本地计算,无模型参与(BirthInput 只收 name/birth/hour)
r = client.post("/api/companion/preview",
json={k: birth[k] for k in ("name", "birth", "hour")})
preview_pillars = r.json().get("pillars") if r.status_code == 200 else None
check(r.status_code == 200 and "pillars" in r.json() and "sections" in r.json(),
"POST /api/companion/preview 200 (local bazi compile)")
# 5. 创建 + 底色只读落库
r = client.post("/api/companion", json=birth)
check(r.status_code == 201 and r.json()["name"] == "临川",
"POST /api/companion 201")
row = st.store.query_one("SELECT pillars FROM bazi_core WHERE id=1")
saved_day = json.loads(row["pillars"])["day"][0] if row else None
prev_day = (preview_pillars or {}).get("day", [None])[0]
check(saved_day is not None and saved_day == prev_day,
f"bazi_core persisted and matches preview (day master {saved_day})")
check(client.post("/api/companion", json=birth).status_code == 409,
"second create refused 409 (single companion guard)")
pv = client.get("/api/persona").json()
check(pv["interpretation"] is None and pv["state"] in {"failed", "loading", "disabled"},
f"persona honest at cap=0 (state={pv['state']}, no fabricated interpretation)")
# 6. 传输:SSE 对话在预算 0 下诚实拒绝,零出站
turn1 = str(uuid.uuid4())
with client.stream("POST", "/api/chat",
json={"text": "在吗", "turn_id": turn1, "epoch": st.epoch}) as resp:
check(resp.status_code == 200 and resp.headers["content-type"].startswith("text/event-stream"),
"POST /api/chat opens SSE stream")
kinds = [json.loads(line[6:])["t"] for line in resp.iter_lines()
if line.startswith("data: ")]
check("chat.error" in kinds and "chat.final" not in kinds,
f"chat honestly errors at cap=0 (frames={kinds})")
check(not outbound, f"zero provider stream calls (outbound={outbound})")
msgs = client.get("/api/messages").json()["messages"]
check(msgs and msgs[-1]["role"] == "user" and msgs[-1]["status"] in {"failed", "cancelled"},
"failed turn persisted as user row, no fake companion reply")
with client.stream("POST", "/api/chat",
json={"text": "在吗", "turn_id": turn1, "epoch": st.epoch}) as resp:
kinds2 = [json.loads(line[6:])["t"] for line in resp.iter_lines()
if line.startswith("data: ")]
check("chat.error" in kinds2 and not outbound,
"retry same failed turn: honest error again, still zero outbound")
# 7. 关系可调整、名字保留
r = client.patch("/api/relation", json={"relation": "恋人"})
check(r.status_code == 200 and r.json()["relation"] == "恋人" and r.json()["name"] == "临川",
"PATCH /api/relation 200 (relation adjustable, name kept)")
# 8. 日子与回忆:服务端裁剪 + 分页形状(told=1 之外不可见)
r = client.get("/api/life")
check(r.status_code == 200 and r.json()["events"] == [],
"GET /api/life 200 empty (only told events, none yet)")
r = client.get("/api/memories")
check(r.status_code == 200 and r.json()["memories"] == [],
"GET /api/memories 200 empty")
check(client.get("/api/life/1").status_code == 404,
"GET /api/life/1 404 (unshared detail refused)")
bogus = {"message_id": 99999, "turn_id": str(uuid.uuid4()), "epoch": st.epoch,
"token": "x" * 40, "text_hash": "0" * 64}
check(client.post("/api/chat/received", json=bogus).status_code == 404,
"POST /api/chat/received 404 on unknown receipt")
# 9. 语音诚实拒绝:配置指向死地址 → 开房必须 503,绝不建房
r = client.get("/api/voice/status")
check(r.status_code == 200 and r.json()["configured"] is True and r.json()["voice"] is False,
"GET /api/voice/status 200, voice honestly false")
r = client.post("/api/voice/session")
check(r.status_code == 503,
f"POST /api/voice/session honest 503 when TTS unreachable ({r.status_code})")
check(client.delete("/api/voice/session/no-such").status_code == 404,
"DELETE /api/voice/session/{unknown} honest 404")
# 10. 静态页与 dist 哈希(只读)
if args.web:
page = client.get("/")
check(page.status_code == 200 and b"<div id=" in page.content,
"GET / serves web dist index.html")
# 11. 重开:新进程入口、epoch 递增、资料保留
with TestClient(app) as client2:
h2 = client2.get("/api/health").json()
check(h2["epoch"] == 2, f"reopen: epoch=2 (got {h2['epoch']})")
c2 = client2.get("/api/companion").json()
check(c2["name"] == "临川" and c2["relation"] == "恋人" and c2["birth"] == "2001-08-16",
"reopen: companion identity + adjusted relation retained")
m2 = client2.get("/api/messages").json()["messages"]
check(len(m2) == 1 and m2[0]["role"] == "user",
"reopen: chat history retained, still no fabricated replies")
if args.web:
manifest = json.loads((Path(__file__).parent / "dist-manifest.json").read_text())
bad = []
for rel, want in manifest.items():
p = Path(args.web) / rel
if not p.is_file():
bad.append(f"{rel} missing")
continue
import hashlib
got = hashlib.sha256(p.read_bytes()).hexdigest()
if got != want:
bad.append(f"{rel} {got[:12]}!={want[:12]}")
check(not bad, f"dist matches manifest ({len(manifest)} files; bad={bad})")
for k, v in old.items():
if v is None:
os.environ.pop(k, None)
else:
os.environ[k] = v
failed = [label for ok, label in RESULTS if not ok]
print(f"\n{len(RESULTS) - len(failed)}/{len(RESULTS)} checks passed")
if failed:
print("FAILED:")
for f in failed:
print(" - " + f)
return 1
return 0
if __name__ == "__main__":
sys.exit(main())
@@ -0,0 +1,12 @@
# HEL-913 · 语音窗口一次性布防模板(脱敏;默认全 0/未布防,随包不生效)
#
# 获批语音窗口的负责人在窗口启动时显式填写并在启动 worker 前写入
# <实例>/worker/.env(ASR 三项)与本文件(窗口参数)。唯一接线见
# deploy/hel913-unified/README.md §5;建议值口径见
# docs/hel913-capability-and-enablement.md §2 B。
# 已实测同形工具(HEL-910 窗口):docs/rework/hel910/tools/asr-arm.env。
HEL913_WINDOW_ID= # 例 hel913-20261106-a;空=未布防=拒绝一切 ASR
HEL913_ASR_MAX_AUDIO_SECONDS=0 # 全窗口实际送入 ASR 音频硬闸(秒)
HEL913_ASR_MAX_RETRIES_PER_CALL=0 # 每通连接重试硬闸(失败后的再建连)
HEL913_TTS_SEGMENT_CAP=0 # TTS 段数上限(监控口径;到顶即手动 force_end)
HEL913_WINDOW_DEADLINE_EPOCH= # date -d '<第3日> 24:00' +%s;到点 force_end
+23
View File
@@ -0,0 +1,23 @@
# HEL-913 统一体验运行包 · voice 配置模板(脱敏)
#
# 用法:复制到 <实例>/etc/voice.yaml,把 <...> 占位替换成服务器本地真实值。
# livekit_url 是 POST /api/voice/session 发给**浏览器**的接入地址:统一实例
# 页面走 HTTPS(8361),HTTPS 页面连 ws:// 明文会被混合内容策略阻断,因此
# 语音可用的前提是 wss TLS 桥(deploy/voice/wss_bridge.example.py 在新端口
# 终结 TLS、回环转发 7880,与 8361 同一张自签证书)——livekit_url 必须填
# 桥的 wss:// 地址,不是可选件(桥的启停见 README §5)。服务器内部
# (开房/删房/worker 注册)仍走 livekit_internal 的本机明文 7880。
# TTS/面板地址在语音窗口获批启动后指向本机 9880/8090;registry/worker_state
# 落实例数据目录,与产品库同空间,随实例备份。
livekit_url: wss://192.168.200.12:8363
livekit_internal: http://127.0.0.1:7880
api_key: <LiveKit api key,服务器本地>
api_secret: <LiveKit api secret,服务器本地>
agent_name: cybergril-voice-agent
tts_health_url: http://127.0.0.1:9880/health
panel_url: https://127.0.0.1:8090
tts_url: http://127.0.0.1:9880
registry_file: /opt/cybergril-hel913/data/voices.json
worker_state_file: /opt/cybergril-hel913/data/voice_state_cybergril.json
token_ttl_seconds: 300
session_ttl_seconds: 600
+26
View File
@@ -0,0 +1,26 @@
# HEL-913 统一体验运行包 · 语音 worker 环境模板(脱敏)
#
# 用法:复制到 <实例>/worker/.env,把所有 <...> 占位替换成服务器本地真实值。
# worker_ctl.sh 启动前会拒绝:仍含 <...> 占位的文件、解析失败的文件、缺文件。
# 运行解释器是 agent venv(livekit-agents 1.8.8),不是产品 .venv311。
CYBERGRIL_API_BASE=http://127.0.0.1:8360
CYBERGRIL_AGENT_NAME=cybergril-voice-agent
LIVEKIT_URL=ws://127.0.0.1:7880
LIVEKIT_API_KEY=<LiveKit api key,服务器本地>
LIVEKIT_API_SECRET=<LiveKit api secret,服务器本地>
CYBERGRIL_WORKER_HEALTH_PORT=8082
CYBERGRIL_VOICE_STATE=/opt/cybergril-hel913/data/voice_state_cybergril.json
# ASR 用量账本独立于产品库,落在实例数据目录(逐通历史不随删房消失):
CYBERGRIL_ASR_USAGE_LEDGER=/opt/cybergril-hel913/data/asr-usage.jsonl
# —— ASR 一次性窗口闸(HEL-906;本段是布防接线,默认未布防 = 真实 cap=0)——
# 三项保持空/0 时,worker 拒绝一切真实 ASR 新连接与新音频(fail-closed,
# 拒绝本身落账,src/cybergril/voice/asr_usage.py)。只有获批语音窗口的
# 负责人在窗口启动时显式改这里并重启 worker(接线与建议值见 README §5
# 与 docs/hel913-capability-and-enablement.md §2 B):
# CYBERGRIL_ASR_WINDOW_ID=hel913-<日期>-a # 新窗口 id;空=未布防
# CYBERGRIL_ASR_WINDOW_MAX_AUDIO_SECONDS=1800 # 3 通×10 分钟=30 分钟硬闸
# CYBERGRIL_ASR_MAX_CONNECT_RETRIES_PER_CALL=2 # 每通连接重试上限
CYBERGRIL_ASR_WINDOW_ID=
CYBERGRIL_ASR_WINDOW_MAX_AUDIO_SECONDS=0
CYBERGRIL_ASR_MAX_CONNECT_RETRIES_PER_CALL=0
+136
View File
@@ -0,0 +1,136 @@
#!/usr/bin/env bash
# HEL-913 统一体验运行包 · 专属语音 worker 启停
#
# 运行解释器是 agent venv(livekit-agents 1.8.8),产品代码经 PYTHONPATH 注入。
# worker 只连接本实例 API 与本机 LiveKit。本脚本只做本实例常规启停安全:
# - 子命令只认 start|stop|status,其他一律拒绝退出 2(不会静默当 start);
# - start 前核对 pid 句柄与 worker/.env(缺文件/含未填 <...> 占位/解析失败
# 一律拒绝),重复 start 拒绝,句柄 pid 复用拒绝;
# - stop/失败收尾只杀经身份核验的进程(cmdline 含 cybergril.voice.worker
# 且 cwd 是本实例 worker 目录),绝不按进程名扫杀;
# - start 注册检查不过 → 清掉自己刚起的进程、保留日志、退出 1。
#
# 用法: [ENV=..] bash deploy/hel913-unified/worker_ctl.sh start|stop|status
# 环境变量:
# HEL913_BASE 实例根目录(含 current/ worker/ 等)
# HEL913_AGENT_VENV agent venv python(默认 /opt/voice-agent/agent/venv/bin/python)
# HEL913_WORKER_HEALTH 健康端口(默认 8082;与 worker/.env 中一致)
set -u
BASE=${HEL913_BASE:-/opt/cybergril-hel913}
VENV=${HEL913_AGENT_VENV:-/opt/voice-agent/agent/venv/bin/python}
HEALTH=${HEL913_WORKER_HEALTH:-8082}
WDIR=$BASE/worker
ENVF=$WDIR/.env
LOG=$BASE/logs/worker.log
PIDF=$BASE/logs/worker.pid
MARKER="cybergril.voice.worker"
usage() { echo "usage: [ENV=..] bash $0 start|stop|status" >&2; exit 2; }
ours() {
local p=$1 cmd cw
case "$p" in ''|*[!0-9]*) return 1 ;; esac
[ "$p" != "$$" ] || return 1
kill -0 "$p" 2>/dev/null || return 1
cmd=$(tr '\0' ' ' < "/proc/$p/cmdline" 2>/dev/null) || return 1
cw=$(readlink "/proc/$p/cwd" 2>/dev/null) || return 1
case "$cmd" in *"$MARKER"*) ;; *) return 1 ;; esac
[ "$cw" = "$WDIR" ] || return 1
return 0
}
pidfile_pid() { [ -f "$PIDF" ] && cat "$PIDF" 2>/dev/null; }
stop() {
local p
p=$(pidfile_pid)
if [ -z "$p" ]; then
echo "no pid file; nothing stopped"
return 0
fi
if kill -0 "$p" 2>/dev/null && ! ours "$p"; then
echo "REFUSED: pid $p is alive but is NOT this worker (pid reuse?) — not killing; resolve $PIDF manually" >&2
return 1
fi
if ours "$p"; then
kill "$p"
sleep 3
if ours "$p"; then kill -9 "$p"; sleep 1; fi
fi
rm -f "$PIDF"
echo "worker stopped (pid $p)"
return 0
}
start() {
local p bad
p=$(pidfile_pid)
if [ -n "$p" ] && kill -0 "$p" 2>/dev/null; then
if ours "$p"; then
echo "REFUSED: worker already running (pid $p) — stop first" >&2
else
echo "REFUSED: pid file has live pid $p that is not this worker (pid reuse?) — resolve $PIDF manually" >&2
fi
exit 1
fi
rm -f "$PIDF"
[ -d "$WDIR" ] || { echo "REFUSED: worker dir missing: $WDIR" >&2; exit 1; }
[ -f "$ENVF" ] || { echo "REFUSED: $ENVF missing (copy worker.env.template and fill it)" >&2; exit 1; }
[ -x "$VENV" ] || { echo "REFUSED: agent venv python not executable: $VENV" >&2; exit 1; }
# 占位符守门:模板 <...> 未替换一律拒绝(不让占位串进进程环境)
bad=$(grep -nE '^[A-Za-z_][A-Za-z0-9_]*=.*<' "$ENVF" || true)
if [ -n "$bad" ]; then
echo "REFUSED: $ENVF still has unfilled <...> placeholders:" >&2
echo "$bad" >&2
exit 1
fi
# 解析守门:.env 必须能作为 KEY=value 被 source(坏引号/裸空格拒绝)
if ! (set -a; . "$ENVF"; set +a) 2>/dev/null; then
echo "REFUSED: $ENVF does not parse as KEY=value lines" >&2
exit 1
fi
mkdir -p "$BASE/logs"
cd "$WDIR" || exit 1
set -a
. "$ENVF"
set +a
PYTHONPATH="$BASE/current/src" nohup "$VENV" -m cybergril.voice.worker start > "$LOG" 2>&1 &
p=$!
echo "$p" > "$PIDF"
echo "worker starting (pid $p)"
sleep 18
if grep -m1 "registered worker" "$LOG" >/dev/null; then
echo "OK: worker registered"
return 0
fi
echo "FAIL: worker did not register — full log kept at $LOG; tail:" >&2
tail -8 "$LOG" >&2
if ours "$p"; then
kill "$p"; sleep 2
ours "$p" && kill -9 "$p"
fi
rm -f "$PIDF"
echo "cleaned up failed start (log kept: $LOG)" >&2
exit 1
}
status() {
local p
p=$(pidfile_pid)
if [ -n "$p" ]; then
if ours "$p"; then echo "running pid $p (identity verified)"
elif kill -0 "$p" 2>/dev/null; then echo "pid $p alive but NOT ours (stale pid file?)"
else echo "pid $p not alive (stale pid file)"; fi
else
echo "no pid file"
fi
curl -s --max-time 3 "http://127.0.0.1:$HEALTH/" >/dev/null && echo "health ok" \
|| echo "health port not answering"
}
case "${1:-}" in
start) start ;;
stop) stop ;;
status) status ;;
*) usage ;;
esac
+135
View File
@@ -0,0 +1,135 @@
# HEL-913 · 一页能力清单与一次真实启用建议
依据:产品基线 `4a38106`(HEL-912 审核通过)+ 运行包提交(仅 deploy/docs,
见运行包 README §0)、HEL-907/910 真实窗口记录、HEL-913 离线验证 34/34
(`docs/rework/hel913/verify-offline-run.txt`;其中依赖核对只打印 4 个关键
包版本、未分享裁剪只在空库验证——口径限制见运行包 README §7)。分级只分
三种:**✅接好且已验证**(真实窗口或真实服务验证过)/ **🟡有实现、缺真实验证**
(代码与离线/替身验证在,真实链路未跑或未批预算)/ **❌尚未接入**。不照抄
旧表:语音已接(HEL-907/910 实测),下述端口/能力以当前源码为准。
## 1. 能力清单(按用户使用顺序)
| # | 用户动作 | 现状 | 具体行为与证据 |
| --- | --- | --- | --- |
| 1 | 打开网页 | ✅ | HTTPS 入口出界面(自签证书需浏览器「高级→继续」);`GET /` 出 index.html、dist 8 文件哈希核过(HEL-913 验证)。导航:此刻/交谈/日子/设置(`web/src/app/RealApp.tsx`) |
| 2 | 自己给她起名、选生日、选关系 | ✅(起名/生日/关系)/ 🟡(自主诠释与初始习惯) | 用户亲选关系(不预选,AM-002)、亲起名(AM-003);创建守门 404/409、八字底色落库只读、公历农历四柱展示(`src/cybergril/api/app.py:427`、`src/cybergril/core/birth_view.py`)。**自主诠释/习惯生成(persona)从未真实跑过**:所有真实窗口 background=0 诚实拒绝(HEL-910 预检证实),首次用户体验需预算 |
| 3 | 文字聊天 | ✅ | 真实网页 Enter 发送、SSE 流式回复、完整落库;语音在播/待播时发文字打断=旧声停+完整文字回复+语音恢复(HEL-910 两通实测);**生成中的文字取消未取得有效真实样本**(HEL-908 的修复只有离线验证,HEL-910 想测没测成,如实记未验证);失败轮诚实 error 不伪造 |
| 4 | 她的生活(自己运行) | 🟡 | 生活循环/活动线程/分享判定/回执代码接好(`src/cybergril/life/`);未分享生活服务端裁剪(told=1,AM-001)空库离线验证(未做正反种子对照);**真实生活事件生成未发生**(life 预算 0),日子页真实模式下尚无真实事件可看 |
| 5 | 记忆 | 🟡(分两层) | 聊天记忆:逐轮落库、遗忘下限、词面检索(FTS)已接,真实窗口对话随轮落库(团队测试库);**语义记忆(真实 Mem0)缺依赖**:.12 venv311 四项未装(2026-10-29 实测),完整安装与接线见运行包 README §8;激活还需 B 部分嵌入/提取预算 |
| 6 | 关掉网页再回来 | ✅ | 同一位她保留:聊天/关系/八字/记忆持久;epoch 递增同步、分页缺口不跳留言、未读标记(HEL-895/896 真实服务浏览器 9 项检查;HEL-913 离线重开验证) |
| 7 | 她主动留言 | 🟡 | 时机判定+网页内留言卡+回来即看的前端链路已接并经真实服务浏览器验证(种子数据);**真实 LLM 主动措辞生成未发生**(proactive 预算 0);不接手机推送(CG-011 首版范围) |
| 8 | 语音通话 | ✅(工程验证) | 真实网页开通话、连续对话、字幕同步、挂断删房;文字打断在播旧声实测停(作者粗略观察约秒级,原始探针未保留,**不作精确口径、不承诺可独立精测**);首声原实测 9.53s,HEL-911 移除 3.66s 等待后**未实测**(不向用户承诺任何推算值);真人麦克风打断、生成中文字取消的正面样本未取得(承接) |
| 9 | 自定义声音 | ✅(工程验证) | 网页上传参考音频→登记→真 TTS 试听→应用→下一通生效;通话中改选不换声(HEL-907 全链 13/14 步实测,call1/2 以 cg- 音色真实合成;第 14 步真机复测未做);用户本人尚未亲自用过 |
| 10 | 换城市/天气跟随 | ❌ | 设置页城市项为演示(`web/src/manage/ManagePanel.tsx` cap=demo/off);后端无天气源(CG-023 承接 R6,T-07) |
| 11 | 换外观素材 | ❌ | 设置页外观项为演示;素材规范/导入未定稿(CG-005/030,T-03,R6;视觉参考见 PR#8 prototypes/hel-793/) |
| 12 | 备份导出/每日自动备份 | ❌(演示导出除外) | 设置页「本地演示导出」为演示件;CG-009 每日自动备份+手动完整导出未实现(R6);现阶段只有发布归档工具 `tools/release_snapshot_hel896.py`(工程用,不冒充 R6) |
| 13 | 摄像头观察 | ❌ | 无视觉服务接入;CG-021/022(R7),4080 未触,部署由用户负责(T-05) |
| 14 | 真实人物口型/交谈半身 | ❌ | 交谈时人物为静帧参考图(`assets/her-talk.jpg`);成品视频选片与实时驱动器未选型(CG-029,T-09;8340/ComfyUI 停机) |
机器可读口径:`GET /api/health` 的 `capabilities`(voice/vision/weather/materials/
backup=false 为诚实声明;text=true)。
## 2. 一次真实启用建议(**全部待批准**;当前配置仍全 0,旧窗口余额不结转)
> 更正声明:本节早前写「A 总管权限内新批、不用问用户」——与本轮真实
> cap=0 及主卡授权矛盾,**作废**。所有新增真实用量、安装、部署(含 A)
> 一律待批,总管不自行放行;批准前一切 cap=0。三本账彼此独立(独立实例/
> 独立库,HEL-896 §6 分账语义),任何一本用完不自动转另一本;所有硬闸
> 发送前拒绝、碰顶即停、**封账不解除**;提额永远是新批准。费用均为内网
> 自持服务(LLM 网关 .11:8731、TTS/ASR/LiveKit 在 .12),**无新增现金支出**,
> 消耗的是授权额度与本机资源。用户不需要理解 token/EOU,也不需要选算法
> 或决定"要不要真记忆"——工程侧按批准直接配置。
### A · 团队验收检查(建议顶:55 次 / 500,000 tokens / 0 嵌入——待批)
- 沿用 `docs/budget-package-hel895.md` §6 的形状:**独立团队实例**自己的
SQLite 账,体验链 1–7 走完(创建→诠释→对话→生活→情绪关系→主动联系→
重开同步,即本清单 🟡 项的团队级补证)即 `seal_budget_hel879.py` 封账
归档。
- A 是团队实例的账:**不并入用户实例、不给用户实例配置一次性总量**
(一次性总量只属于团队测试实例,见 budget-package-hel895 §6)。
### B · 用户首体验(一次批准;最小够用)
- **前置(窗口开始前,团队完成,不占用户额度)**:如批准真实记忆,先按
运行包 README §8 一次性窗口完成安装+co-import+缓存落位(约 1–2 小时
含验证;+450–550MB 磁盘);不批安装则记忆停在词面检索(stub 已验证
全链可跑),其余体验不受影响。四步检查(安装→独立部署→团队检查→用户
首用)见运行包 README §4/§8 与本节。
- **窗口与时点**:建议 3 个自然日,服务器本地时区(Asia/Shanghai)。T0 =
团队完成检查、把地址交给用户的时刻(如周五 19:00 交付,则周日 24:00
到期);日账按本地自然日零点重置;团队准备耗时全部在 T0 之前。
- **文字与生活(models.yaml 日账,程序硬闸)**:对话 60 轮/日、生活 8 次/
日、判定/成长/摘要 40 次/日、日 token 池 2,000,000、创建+诠释+习惯一次
性 4 次。**语音通话里的对话轮同样计 dialogue 日账**(不另开语音 LLM 账)。
- **记忆(若批安装)**:提取 LLM 累计 60 次(`llm_ops`)、新增嵌入累计
180 条(累计口径 `embed_cap=680`、冻结 2 不动,见运行包 README §8.4)、
语义类 40 次/日;嵌入日顶60条,提取日顶40次(两项按UTC切日,即北京时间08:00)。
- **语音(3 通 × ≤10 分钟 = 合计 ≤30 分钟)**:ASR 音频合计 ≤1800 秒
(程序硬闸,发送前拒绝,重启进程不重置);每通连接重试 ≤2(硬闸);
每通墙钟 ≤10 分钟(session_ttl 600 秒硬顶之内,超时房间失效);TTS
合成 ≤60 段(监督计数,到顶人工仅关闭语音服务,不停文字生活;程序不硬闸);建房即用即删(开房失败 503 不重试建房;挂断清理
失败留账自动重试);声音上传登记+试听合计 ≤10 次(监督口径:由陪同
团队按次计数,程序不硬闸)。需要用户当场在浏览器允许麦克风(HTTPS+
自签证书「高级→继续」)。自定义声音当场可用(上传→试听→应用)。
- **碰顶后果(逐项如实)**:LLM 日顶→当次诚实拒绝、界面报错、次日恢复;
ASR 触顶→发送前拒绝、本通结束、全窗不再接受新音频;TTS 段顶→陪同执行者关闭语音入口和worker/桥(文字生活仍可用);窗口到期→统一停服封账(见下)。
- **截止停服(可执行,不口头承诺)**:`force_end.template.sh watch <到期
epoch>`(受监督后台任务)或获批后装 systemd timer 调 `now`;到期动作 =
逐个 DELETE 本实例房间 → worker → api → wss 桥 → 共享 TTS 按各自专属
pid 句柄停 → `seal_budget_hel879.py` 封账归档。**封账不解除**。
- **断开与恢复**:关网页/断开后她的档案、聊天、关系、记忆原样保留(重开
验证过);共享 TTS 9880/面板 8090/wss 桥 8363 只在批准窗口内启动、到期
停回;LiveKit 7880 常驻不动。
- **与 C 的边界(本轮更正)**:B 窗口**内**的每日生活/主动留言/背景循环
运行,计入 B 的 life/proactive 日账与日 token 池(上表);B 窗口**结束**
后一切停,不自动转任何常驻。C 指窗口之外的长期后台——暂不批。不存在
同一份日用量既写进"B 已包含"又写进"C 未批准"的矛盾口径。
- **如实告知用户的已知边界**:首声延迟修复后未实测(原实测 9.53s,不承诺
任何推算值);真人打断、生成中文字取消的正面样本未取得;日子/主动留言
的真实生成首次发生在这个窗口里,质量如不足属正常迭代范围。
### C · 长期后台
- 暂不批。B 窗口结束后凭实际用量与质量报告(`llm_ops`/`embed_ops`/日账
导出)再定常驻节奏与**新的独立账本**;在此之前不自动续跑,
`CYBERGRIL_R2_ENABLED` 不在窗口外保持开启。
## 3. 不变边界
本建议不改变任何需求与验收状态:8300/8310/8320/8350 与资料不动、正式界面
不替换、PR 不合并、4080 不触、旧三窗口余额不结转;阶段体验不等于完整产品
完成,R5–R7 未完项继续按主卡承接。
## 4. 最终启用边界(总管取件勘误)
运行包README §10为操作勘误,优先于旧模板。全部仍待白栖知批准。
语音仅团队陪同预约,每通600秒、总ASR1800秒、总建房尝试6次;
TTS60段和登记+试听合计10次由当班人员监督,不冒称自动硬停。
文字生活在语音配额耗尽后仍可运行到总截止;到期按受监督定时服务停服,
资料保留、账封存,房间/共享音色与临时服务由团队核实清理。
完整自定义声音的8090面板句柄需在放行前复用HEL907方法准备,不得占用8081。
装包缺轮或解析冲突即停,不改锁版本。准备预计1–2小时,团队真链检查另限2小时,
检查不过不把失败实例交用户。用户首次可用地址交付后计3个自然日(当日算第一日),
用户也可先约定开始日期,避免地址发出时本人不在而浪费体验期。
自定义声音细分额度(同一次待批方案):最多登记2段参考音频,每段由陪同人员先核≤20秒;
自动转写最多2次/合计40秒,单列监督账,不冒充通话ASR的1800秒硬闸。
最多试听8次;登记2次+试听8次共10次。试听合成并入60段TTS总上限。
两类ASR合计最大1840秒(通话1800+参考40);失败/重试同样记账,不返余额。
本轮未执行登记、转写或试听。
### 最终统一预算勘误:团队先验真实记忆,再交用户(总管)
此条取代上文A“0嵌入”的旧建议,仅修改待批方案,当前真实额度仍0。
团队先用独立测试资料核真实Mem0接入,不把首次故障留给用户:
A的55请求/50万tokens内,最多10次用于SDK提取;先用最多20条新嵌入。
这10次/20条从同一批新申请的60次提取/180条嵌入中先扣,
不是另加额度;余量(至少50次提取/160条嵌入)留给用户期,使用实账计算。
两阶段共用唯一活动记账文件、串行写入,测试向量/档案与用户向量/档案分开,
只共用计数账,不拷贝测试聊天或测试记忆给用户。旧权威embed_ops前缀不改,
旧39/60实验的授权和账原封保存,不挪用其余额;新提取批建立独立可审计操作记录。
如旧llm_ops表已有用量,新60次必须按现值加增量并保存旧行,不可清表/重置;
操作前核旧基数并留证,实际新增始终≤60。团队检查最多2小时,从首个真实调用计时;
检查不通过则停止并报告首个错误,用户期不自动开始。
+51
View File
@@ -0,0 +1,51 @@
{
"baseline_version": "1.12",
"read_commit": "958c6962fb1f2a4462a6df794d893aee1fcb0667",
"task": "HEL-910:按白栖知批准的《HEL-797-交谈修复复测安排》(主卡评论 01a18753-8c70-7181-9758-5bab4685ba9f「继续测」)对候选 958c696 做两次真实通话复测:真实网页原发送入口的文字打断(在播时机+final待播间隙)、python 同钟时间轴的等待链与回放打断、思考隔离真实端点检查;隔离部署 8360/8361/8363/8082 + 共享 TTS 9880 按快照临时恢复,全程批准上限内执行并清理恢复。",
"requirement_ids": [
"CG-006",
"CG-009",
"CG-010",
"CG-013",
"CG-014",
"CG-015",
"CG-016",
"CG-018",
"CG-019",
"CG-020",
"CG-021",
"AM-001",
"GOV-001",
"GOV-002",
"GOV-003",
"GOV-004",
"GOV-005",
"GOV-006",
"DEL-001"
],
"deliverable": "docs/rework/hel910/(window-record.md 窗口记录、window/ 逐通证据含 call2 同钟字幕/帧时间轴/回流音频/DB终态/ASR账本/前后快照/日志、web/ 真网页逐步截图、tools/ 本窗部署与测量脚本及配置);服务器证据包 /opt/cybergril-hel910/hel910-evidence-20261029.tar.gz(sha256 83363576…d7a3f0)。实测结论:真实网页发文字(真 Enter 键)在她语音在播时发送——旧声停止(浏览器能量 ≤~1.4s 持续静默、本地 hush 静音即时)、文字获完整回复并落库、旧轮不复活无幽灵行、被打断轮回执正确缺席、后续语音轮正常出声并完整回执(两次确认恢复);输入结束→实际第一声实测 9.53s(user_final 后 7.10s、生成开始后 3.44s,>5s 关注线,如实交回);全部真实回复零思考泄漏但真实端点未出现带 </think> 形状(覆盖范围如实限定,离线证据在 HEL-909);时机A(生成中被文字取消)因网页侧检测失误与 API 直发竞速反向未获正面样本(文字轮被更新语音轮正常取消:行 cancelled+SSE 幂等 chat.cancelled 终态帧,恰为 HEL-908 R1 修复路径的真实表现),随后语音轮撞 10/10 预算硬闸诚实 φ 失败;可闻旧声期间的回放打断样本因时机错过未取得(如实,与 HEL-907 同项均未取得)。用量:LLM 10/10 触线(30,398/40,000 tokens)、建房 4/4 触线、通话 2/2、TTS 6/20、ASR 350.63/720s(保守=确证、重试 0)、窗口 23.6/45 分、登记/上传/转写/试听/嵌入/付费全 0。清理:窗口端口与专属进程全停(精确 PID)、LiveKit 房间空、voices.json 哈希前后一致 cg- 零残留、共享 TTS 按快照停回、面板 8090 全程未启用、8300/8310/8320/8350/7880/10095 未动、GPU 回 747MiB。",
"acceptance": [
"部署核验:服务器源码树与 git archive 958c696 逐文件 sha256 一致(仅多 REVISION 标记);web/dist 含 cg.interrupt 接线;models.yaml 三档 reasoning: buffer_turn 与候选一致仅预算块不同;cap=0 fail-closed 预检(persona 拒绝、chat 诚实 error 零出站、voice 503 不建房)通过后才布防",
"真实网页链路:自签证书按用户姿态逐 origin 接受;语音通话从真实 UI 开启;文字从真实输入框+真实 Enter 键发送(hush→cg.interrupt 真实链路,未绕开网页修复);逐步截图 9 张留证",
"时机B(在播时发文字):旧声停止(浏览器能量探测 ~1.4s 内持续静默+本地静音即时)、T1 完整回复落库 sent、R1 不复活、后续语音轮正常出声并完整回执",
"final待播间隙(网页入口):U3 回复文本完整落库(音频截断、回执正确缺席)、T2 完整回复、再次语音轮正常出声回执",
"等待链(同钟毫秒):input_end→user_final 2.43s→生成开始 4.10s→实际第一声 9.53s→字幕全文/落库 12.10s→回执 ack;数字与 wav 能量对齐方法留证",
"思考隔离:18 条 companion 行/字幕/TTS 文本零思考;如实声明真实端点未出现带 closer 形状",
"上限与封账:全部类别在上限内或触线即停并如实记录;失败/取消均计入(call1 挂断后 U4 轮、call2 竞速取消轮与预算 φ 轮)",
"清理恢复:端口/房间/PID/声音列表/哈希/GPU 前后核对留证;隔离目录与证据包保留;未触碰任何既有实例与真实档案"
],
"deferred": [
"真实用户麦克风打断时延与可闻旧声期间的语音打断停声样本(两轮工程窗口均未取得,需真人同轴或下轮工程窗口以她实际有声为门控重试)",
"时机A(生成中文字取消)正面样本(需文字在语音轮服务端激活后、生成完成前到达;本轮竞速反向+预算封顶)",
"真实端点带 </think> 形状的分离复现(本轮真实回复未出现该形状;离线证据 HEL-909)",
"首声等待是否经常>5s 需多样本(本轮 1 精确样本+1 量级相近);停声时延的帧级精测(本轮为浏览器能量粗粒度 ≤~1.4s)",
"真机/手机麦克风、Safari(D3 用户动作)",
"R1–R7 完整功能未完成项继续按主卡承接;本轮不改变任何需求与验收状态"
],
"requirement_changes": [],
"verification": [
"python3 scripts/check_requirements.py --base-ref origin/main(及 --base-ref 958c696)+ --handoff docs/requirements/handoff-HEL-910.json 全部通过(结构检查,不代替原话核对与体验验收)",
"证据:docs/rework/hel910/window/(call2.subtitles.jsonl 逐事件毫秒时间戳、call2.frames.json 帧到达时间轴、call2.agent.wav 回流音频、db-final.json 全部 20 行含状态与回执账、asr-usage.jsonl、tts-window.log 6 段、api/worker 日志、前后快照);web/ 截图;tools/ 全套部署与测量脚本",
"未验证:真人麦克风、手机真机、真实端点思考形状、多样本首声统计——见 deferred,不冒充"
]
}
+46
View File
@@ -0,0 +1,46 @@
{
"baseline_version": "1.12",
"read_commit": "407fc8158ce392e20ee51c05420c8b74aa545a92",
"task": "HEL-911:修好 HEL-910 实证的两个 livekit-agents 1.8.8 SDK 接缝错误(worker _on_item 对 AgentHandoff 取 role 的 AttributeError;add_shutdown_callback 对同步卸载回调 await None 的 TypeError),并用已有原始证据+实际 SDK 源码+离线复现查清首声 ~9.5s 等待的分段:识别终稿→生成开始的 3.66s 系 1.8.8 默认补入的英文 EOU TurnDetector 对中文终稿的 unlikely 判定把 endpointing 顶到 max_delay=6.0,显式 turn_detection=None 修复(离线 A/B 3.704s→0.004s);同时纠正 HEL-910 交付说明四处事实错误并追加纠偏记录、为下次测量修工具可靠性(分段落盘+服务端活动门控,仅离线验证)。全程真实 cap=0:零 LLM/ASR/TTS/嵌入/登记/试听调用、不建房不开窗不恢复服务,仅只读复用 .12 agent venv 实物 SDK 与既有 wav 做离线证明。",
"requirement_ids": [
"CG-006",
"CG-010",
"CG-013",
"CG-014",
"CG-015",
"CG-016",
"CG-018",
"CG-019",
"CG-020",
"CG-021",
"AM-001",
"GOV-001",
"GOV-002",
"GOV-003",
"GOV-004",
"GOV-005",
"GOV-006",
"DEL-001"
],
"deliverable": "src/cybergril/voice/worker.py:_on_item 按 1.8.8 ConversationItemAddedEvent.item 判别字段过滤(仅 type==message 且 role==assistant 的 str 部件正文进回声过滤);bind_interrupt_channel 卸载改协程(SDK 关停回调一律被 await)、幂等、断连不抛,interrupt(force=True)/回执/预算路径不动;TURN_HANDLING 显式 turn_detection=None(endpointing 0.8/6.0 逐字保留,不降 VAD 阈值、不动 buffer_turn)。scripts/gen_hel911_wait_repro.py:真 SDK+真 silero VAD+实测时间轴的离线复现(BASELINE 3.704s 复现实测 3.667/3.654s,修复态 0.004s)。tests/test_sdk_livekit_hel908.py +3 项真 SDK 检查(共 11,.12 agent venv 11/11;既有 8 项回归全保持,unload 调用点随协议改 await)。docs/rework/hel910/window-record.md §9 追加纠偏记录(原文未回改);docs/rework/hel910/tools/hel910_call1.mjs 可靠性修正(探针每 5s 分段落盘 call1-probe-live.jsonl+录音分片即存,防超时杀进程丢证;时机A 触发改为服务端已把语音轮落成 chat 行+生成中相位双条件,不再以页面相位/己方发送为 API 已激活代理;node --check 通过)。docs/rework/hel911/summary.md 完整分段归因与验证记录。产品测试套 .12 规范环境 480 passed/11 skipped/2 failed(两个 test_r3 预先存在与 HEL-908 记录一致);本地 py3.10 与基准 407fc81 干树失败集合完全相同(环境差异非本卡引入)。",
"acceptance": [
"真 SDK(.12 /opt/voice-agent/agent/venv livekit-agents 1.8.8)驱动:AgentHandoff/_TypeDiscriminator/user 消息不触发崩溃且不污染回声过滤,assistant 混合 content 只取 str 正文;真 JobContext.add_shutdown_callback 包装协议下协程卸载通过、旧同步形状经同一包装复现生产 TypeError(反向证据)、重复 await 幂等、卸载后监听真摘除;TURN_HANDLING 下 _turn_detection 为 None 且默认探测器存在性前置断言",
"等待链离线复现(复用 HEL-910 实际回放 wav、实测时延脚本化):BASELINE 终稿+2.443→llm.chat+6.142(3.699s,对上实测 3.667/3.654),修复态 +2.439→+2.444(0.005s);VAD 端点 ~0.7s、FunASR 链+0.6s 去抖 2.43s、服务端整轮 ~1.4s、TTS 首包 1.614s 各段归因落在源码行与实测日志",
"既有回归保持:SDK harness 11/11(文字取消不重试/force 停声/通道校验/未启动存活等);产品套 .12 规范环境 480/2 预存失败与基准一致;web 未动未重建",
"纠偏记录入 window-record.md §9:companion 9 条非 18、生成起点 +6.099s 非 +4.10、assistant_final 是播放收尾/回执门非首次全文生成/落库、post-window.txt ListRooms 为 invalid authorization token 不能证明空房(总管独立核实空房成立);原快照/录音/日志一字未改",
"用量:真实 cap=0 全程保持——零模型/识别/合成/嵌入/登记/试听调用、零建房、零窗口、未恢复 9880/8090 或任何本窗服务、未访问 4080、未改绑定;.12 上仅只读使用 agent venv 与既有 wav,临时副本 /tmp/hel911 已清"
],
"deferred": [
"修复后首声真实总时延(离线推算 9.5→约 5.9s,不承诺):需下轮真实工程窗口复测(工具门控与分段落盘已备好)",
"FunASR 适配器 0.6s 去抖与 2pass 离线纠错往返是否可再压:识别链参数,本卡不动语义,与真实复测同窗评估",
"真实用户麦克风打断时延/可闻旧声回放打断正面样本/生成中文字取消正面样本:两轮窗口均未取得,需按新门控重试",
"真实端点带 </think> 形状分离(离线证据 HEL-909);首声是否经常>5s 需多样本",
"真机/手机麦克风、Safari(D3 用户动作);R1–R7 完整功能继续主卡承接,不宣布整产品完成"
],
"requirement_changes": [],
"verification": [
"python3 scripts/check_requirements.py --base-ref origin/main 与 --base-ref 407fc81,均带 --handoff docs/requirements/handoff-HEL-911.json 通过(结构检查,不代替原话核对与体验验收)",
"定向验证:tests/test_sdk_livekit_hel908.py --standalone 于 .12 agent venv 11/11;scripts/gen_hel911_wait_repro.py BASELINE/FIXED 两模式;产品套 .12 .venv311 480 passed/2 预存失败;hel910_call1.mjs node --check",
"未验证(如实):修复后真实通话首声数字、真实麦克风、手机/真机、思考带 closer 真实端点形状——见 deferred,不冒充"
]
}
+58
View File
@@ -0,0 +1,58 @@
{
"baseline_version": "1.12",
"read_commit": "4a38106eef21c43ba24ab7d07992b1bfe539137d",
"task": "HEL-913(含 2026-10-29 总管取件后同卡集中收口):把通过 HEL-912 审核的统一候选(产品基线 agent/2/8e99cc2cc592 @ 4a38106)装成可交接的统一体验运行包并在原候选分支一次收口五项核心缺项:①整包版本/目录可执行(产品基线与运行包提交区分、部署照抄入口=运行包提交、目录/配置/dist 复用/空档案守门完整准备步骤、不跳旧 HEL895 通用步骤);②启用建议收敛为内部一致的一份待批方案(更正「总管权限内新批 A」为全部待批、语音改 3 通×≤10 分钟=≤1800 秒 ASR 硬闸并逐项交代碰顶后果、B/C 边界消除矛盾、T0 计时点/当地日顶/团队准备与用户参与/可执行到期停服);③真实记忆最少安装/接线补全为完整可审命令(隔离 venv、逐项哈希留证、失败即停、co-import、权威账 498/冻结 2 续账不搬测试聊天);④启停实际接线/失败收尾(ASR 布防三变量入模板默认拒绝、wss 桥必需、TTS 限段/房间/总时限唯一接线、启停脚本身份核验版 42 项离线替身验证);⑤事实表只修明确错误(生成中取消未获样本、打断停声非精确口径、首声不承诺推算值、34/34 口径限制如实)。本卡不部署、不监听、不下载、不安装、cap=0、不合 PR、不动现有实例与资料、不向受保护 venv 增改依赖。",
"requirement_ids": [
"CG-006",
"CG-007",
"CG-008",
"CG-009",
"CG-010",
"CG-012",
"CG-013",
"CG-014",
"CG-015",
"CG-016",
"CG-018",
"CG-019",
"CG-020",
"CG-021",
"CG-023",
"AM-001",
"AM-002",
"AM-003",
"GOV-001",
"GOV-002",
"GOV-003",
"GOV-004",
"GOV-006",
"DEL-001"
],
"deliverable": "deploy/hel913-unified/ 收口版:README(唯一照抄入口:§0 产品基线 vs 运行包提交与自校验、§4 首次准备+启停、§5 语音窗口唯一接线表、§7 离线验证口径如实、§8 Mem0 完整可审安装 W0–W6 与权威账续账)、manifest.json、dist-manifest.json、models/voice/worker.env/voice-window-arm 五份脱敏模板(预算全 0/未布防)、api_ctl.sh/worker_ctl.sh 身份核验版、bridge/tts/force_end 三个窗口模板(默认不生效)、verify_offline.py、test_ctl_scripts.sh、mem0-cp311-wheels.txt;docs/rework/hel913/{verify-offline-run.txt,ctl-checks-run.txt};docs/hel913-capability-and-enablement.md(能力表纠错 + §2 单份一致的待批启用方案)。产品代码(src/web/config/tools/tests)自 4a38106 起零改动(git diff --stat 为空可验证)。 总管取件勘误见运行包README §10:语义配置与离线缓存环境、真实会话列表解析、临时语音服务失败收尾、传输校验与固定解释器、TTL600秒、定时服务及人工监督边界。",
"acceptance": [
"整包可执行:部署入口=运行包提交(含本目录);checkout 4a38106 会没有运行包——README §0 明确两者区别并给 merge-base 与 diff 空两条自校验;首次准备含 mkdir 骨架/模板落位/dist 哈希核验后只读复用/verify_offline 空档案守门复验,单一入口、不跳 HEL895 通用总装步骤",
"启停安全(42/42 离线替身验证,docs/rework/hel913/ctl-checks-run.txt):非法子命令拒绝、重复 start 拒绝、PID 复用拒杀(身份核验=cmdline+cwd)、启动失败清自己留日志、worker .env 占位/解析守门、arm 模板默认全 0 可解析",
"语音窗口唯一接线(README §5):ASR 三变量硬闸默认拒绝一切 ASR;session_ttl 600s+挂断删房;TTS 段数监控口径+tts.log 起始字节;force_end now|watch 到期可执行停服(各按专属句柄);wss 桥必需并给出默认 8363 接线",
"Mem0 安装完整可审(README §8):固定源双哈希核对→获批窗口下载 19+40 轮逐项 sha256→传输复核→隔离 venv /opt/cybergril-hel913/venv311 --no-index 安装→co-import→92MB 缓存落位→暂存清理;绝不向 /opt/cybergril-hel879/.venv311 增改;权威账只复制账本不搬测试聊天,authority 冻结前缀+embed_cap=680 累计算式;本卡零安装零下载零嵌入",
"启用方案单份一致且全部待批(capability §2):A 55 次/50 万 tokens 为建议顶、总管不自行放行、不并入用户实例;B 语音 3 通×≤10 分钟=≤1800 秒 ASR 硬闸(含重连≤2、TTS 60 段监控、上传/试听 ≤10 次监督口径)、语音 LLM 计入 B 对话日账、T0=交付时刻/本地自然日/团队准备不占额度、碰顶后果逐项、到期=force_end+seal 可执行且封账不解除;B 窗口内生活/主动计入 B 日账、窗口后全停,与 C(暂不批)无重叠口径",
"事实表纠错:生成中文字取消=未取得有效样本(未验证);打断停声=作者粗略观察非精确口径;首声修复后未实测、不承诺推算值;34/34 的 deps 只打印 4 包版本、空库裁剪未做种子对照——均在 README §7 与能力表如实标注;天气/素材/备份/摄像头/真实口型仍 ❌ 并追到承接",
"边界保持:未部署未监听、8300/8310/8320/8350 与资料未动、8340/ComfyUI 停机、4080 未触、受保护 venv 未增改、需求与用户原话零改动"
],
"deferred": [
"实际部署与启用:待总管向白栖知说明获批后按 deploy/hel913-unified/README.md §4 执行(四步:安装→独立部署→团队检查→用户首用,见 capability §2 B 前置)",
"Mem0 cp311 安装(README §8.3 W0–W6:19+40 轮获批下载窗口 + 隔离 venv --no-index 安装 + co-import + 缓存落位 + 权威账续账):待一次性批准,本卡零安装零下载",
"语音窗口执行:布防值(voice-window-arm 模板)与到期 watchdog/systemd timer 待批后由窗口负责人接线",
"persona 自主诠释、生活事件、主动留言的真实生成:从未在真实窗口发生(预算 0),A 团队检查与 B 用户首体验窗口补证",
"语音遗留实测:修复后首声、真人麦克风打断、生成中文字取消正面样本、真机/手机/Safari(不承诺任何推算值)",
"R5–R7 完整功能(每日自动备份/天气/素材/摄像头/真实口型)继续主卡承接,不因运行包完成而关闭"
],
"requirement_changes": [],
"verification": [
"python3 scripts/check_requirements.py --base-ref origin/main 与 --base-ref 4a38106eef21c43ba24ab7d07992b1bfe539137d,均带 --handoff docs/requirements/handoff-HEL-913.json 通过(结构检查,不代替原话核对与体验验收)",
"docs/rework/hel913/verify-offline-run.txt:34/34(.12 venv311、产品基线树、零监听零出站;总管同环境独立复跑亦 34/34、dist 哈希吻合——已过项保留不重跑)",
"docs/rework/hel913/ctl-checks-run.txt:42/42 启停离线替身检查(工作站、stub、零真实服务/零监听/零出站)",
"产品代码零改动:git diff --stat 4a38106 <运行包提交> -- src web config tools tests 为空",
"未验证(如实):运行包尚未在任何现网端口实际起服(cap=0 未部署);修复后语音首声、真机、Safari——见 deferred,不冒充",
"总管机械收口:docs/rework/hel913/coordinator-close-checks.txt 17/17定向离线检查;真实sessions列表生成DELETE、环境变量传入、非法命令拒绝、失败句柄清理与shell语法;未安装/监听/调用真实服务。"
]
}
+52
View File
@@ -0,0 +1,52 @@
#!/usr/bin/env bash
# HEL-910 测试窗口:统一实例(8360 HTTP + 8361 HTTPS 同进程双入口)启动/停止
# 用法: bash api_ctl.sh start|stop|status (models.yaml 由调用方先摆好:failclosed 或 armed)
set -u
BASE=/opt/cybergril-hel910
CODE=$BASE/current
LOG=$BASE/logs/api.log
PIDF=$BASE/logs/api.pid
PAT='cybergril-hel910.*serve_dual_8360_8361'
stop() {
if [ -f "$PIDF" ]; then
P=$(cat "$PIDF")
if [ "$P" != "$$" ] && kill -0 "$P" 2>/dev/null; then kill "$P"; sleep 3; fi
if [ "$P" != "$$" ] && kill -0 "$P" 2>/dev/null; then kill -9 "$P"; fi
rm -f "$PIDF"
fi
for p in $(pgrep -f "$PAT"); do
[ "$p" = "$$" ] && continue
kill "$p" 2>/dev/null
done
echo "api stopped"
}
case "${1:-}" in
stop) stop; exit 0 ;;
status)
pgrep -af "$PAT" || echo "not running"
exit 0 ;;
esac
stop
cd "$CODE"
set -a
export CYBERGRIL_DB=$BASE/data/companion.db
export CYBERGRIL_SEMANTIC=stub
export CYBERGRIL_R2_ENABLED=1
export CYBERGRIL_MODELS=$BASE/etc/models.yaml
export CYBERGRIL_VOICE_CONFIG=$BASE/etc/voice.yaml
export CYBERGRIL_WEB=$CODE/web/dist
export PYTHONPATH=$CODE/src
set +a
nohup /opt/cybergril-hel879/current/.venv311/bin/python deploy/voice/serve_dual_8360_8361.py \
--http-port 8360 --https-port 8361 \
--cert /opt/cybergril-voice-certs/cybergril-voice.pem \
--key /opt/cybergril-voice-certs/cybergril-voice.key \
> "$LOG" 2>&1 &
echo $! > "$PIDF"
echo "api starting (pid $(cat $PIDF))"
sleep 6
curl -s --max-time 3 http://127.0.0.1:8360/api/health >/dev/null && echo "OK: 8360 healthy" || { echo "FAIL:"; tail -20 "$LOG"; exit 1; }
curl -sk --max-time 3 https://127.0.0.1:8361/api/health >/dev/null && echo "OK: 8361 healthy" || { echo "FAIL 8361:"; tail -20 "$LOG"; exit 1; }
+4
View File
@@ -0,0 +1,4 @@
# HEL-910 ASR 窗口布防(2026-10-29):新窗口 id,720 秒保守预记,每通重连≤2
CYBERGRIL_ASR_WINDOW_ID=hel910-20261029-a
CYBERGRIL_ASR_WINDOW_MAX_AUDIO_SECONDS=720
CYBERGRIL_ASR_MAX_CONNECT_RETRIES_PER_CALL=2
+38
View File
@@ -0,0 +1,38 @@
#!/usr/bin/env bash
# HEL-910 测试窗口:WSS TLS 桥 8363 -> 127.0.0.1:7880 启动/停止
set -u
BASE=/opt/cybergril-hel910
LOG=$BASE/logs/bridge.log
PIDF=$BASE/logs/bridge.pid
PAT='cybergril-hel910.*wss_bridge'
stop() {
if [ -f "$PIDF" ]; then
P=$(cat "$PIDF")
if [ "$P" != "$$" ] && kill -0 "$P" 2>/dev/null; then kill "$P"; sleep 2; fi
rm -f "$PIDF"
fi
for p in $(pgrep -f "$PAT"); do
[ "$p" = "$$" ] && continue
kill "$p" 2>/dev/null
done
echo "bridge stopped"
}
case "${1:-}" in
stop) stop; exit 0 ;;
status)
pgrep -af "$PAT" || echo "not running"
exit 0 ;;
esac
stop
nohup /usr/bin/python3 $BASE/current/deploy/voice/wss_bridge.example.py \
--listen 0.0.0.0:8363 --upstream 127.0.0.1:7880 \
--cert /opt/cybergril-voice-certs/cybergril-voice.pem \
--key /opt/cybergril-voice-certs/cybergril-voice.key \
> "$LOG" 2>&1 &
echo $! > "$PIDF"
echo "bridge starting (pid $(cat $PIDF))"
sleep 3
timeout 8 openssl s_client -connect 127.0.0.1:8363 -servername 192.168.200.12 </dev/null 2>/dev/null | grep -q "Protocol.*TLSv1.3\|New, TLSv1.3" && echo "OK: bridge TLS up" || { echo "WARN: TLS probe inconclusive, check $LOG"; tail -5 "$LOG"; }
+132
View File
@@ -0,0 +1,132 @@
#!/usr/bin/env python3
"""Build Chromium fake-audio-capture WAVs for HEL-910 (offline, workstation-local).
Pure stdlib (array/audioop-free) — resample by linear interpolation, mix to mono,
place utterances on a fixed schedule padded with silence; Chromium loops the file.
Usage: build_fake_wavs.py <outdir>
"""
from __future__ import annotations
import json
import sys
import wave
from pathlib import Path
RATE = 16000
def read_mono_16k(path: str) -> bytes:
with wave.open(path, "rb") as w:
raw = w.readframes(w.getnframes())
rate, ch, width = w.getframerate(), w.getnchannels(), w.getsampwidth()
assert width == 2, path
total = len(raw) // (2 * ch)
# de-interleave + average channels
acc = [0.0] * total
for c in range(ch):
off = c
for i in range(total):
s = raw[(i * ch + off) * 2] | (raw[(i * ch + off) * 2 + 1] << 8)
if s >= 32768:
s -= 65536
acc[i] += s
mono = [int(round(a / ch)) for a in acc]
if rate == RATE:
return b"".join(max(-32768, min(32767, s)).to_bytes(2, "little", signed=True) for s in mono)
n_out = int(len(mono) * RATE / rate)
out = bytearray()
step = rate / RATE
for j in range(n_out):
x = j * step
i = int(x)
frac = x - i
s = mono[i] * (1 - frac) + (mono[i + 1] if i + 1 < len(mono) else mono[i]) * frac
v = max(-32768, min(32767, int(round(s))))
out += v.to_bytes(2, "little", signed=True)
return bytes(out)
def trim_silence(pcm: bytes, thresh: float = 0.05) -> bytes:
# trim leading/trailing near-silence (50ms windows) — keep speech core
n = len(pcm) // 2
vals = [pcm[i * 2] | (pcm[i * 2 + 1] << 8) for i in range(n)]
vals = [v - 65536 if v >= 32768 else v for v in vals]
win = 800
nw = n // win
peak = 1
for w0 in range(nw):
m = max(abs(v) for v in vals[w0 * win:(w0 + 1) * win]) or 0
peak = max(peak, m)
t = peak * thresh
first, last = 0, nw - 1
for w0 in range(nw):
if max(abs(v) for v in vals[w0 * win:(w0 + 1) * win]) > t:
first = w0
break
for w0 in range(nw - 1, -1, -1):
if max(abs(v) for v in vals[w0 * win:(w0 + 1) * win]) > t:
last = w0
break
lo, hi = max(0, first - 2) * win, min(n, (last + 3) * win)
out = bytearray()
for v in vals[lo:hi]:
out += max(-32768, min(32767, v)).to_bytes(2, "little", signed=True)
return bytes(out)
def silence(seconds: float) -> bytes:
return b"\x00\x00" * int(RATE * seconds)
def write_wav(path: Path, pcm: bytes, rate: int = RATE) -> None:
with wave.open(str(path), "wb") as w:
w.setnchannels(1)
w.setsampwidth(2)
w.setframerate(rate)
w.writeframes(pcm)
def main() -> None:
outdir = Path(sys.argv[1] if len(sys.argv) > 1 else ".")
outdir.mkdir(parents=True, exist_ok=True)
src = Path("/tmp/multica-task-2856608943/opencode")
u_hai = trim_silence(read_mono_16k(str(src / "haimianbaobao.wav")))
u_baj = trim_silence(read_mono_16k(str(src / "bajie.wav")))
u_xiao = trim_silence(read_mono_16k(str(src / "xiaoyun.wav")))
meta: dict[str, dict] = {}
secs = lambda p: len(p) / (2 * RATE)
# call1 browser schedule: U1@0 (reply R1), U2@60 (gen-cancel target),
# U3@120 (voice recovery). Cycle 240s so a 4th utterance never arrives inside
# the ~170s planned call.
c1 = bytearray()
c1 += u_hai
c1 += silence(60 - secs(u_hai))
c1 += u_baj
c1 += silence(120 - 60 - secs(u_baj))
c1 += u_hai
c1 += silence(240 - 120 - secs(u_hai))
write_wav(outdir / "hel910_call1_fake.wav", bytes(c1))
meta["call1"] = {
"u1_haimianbaobao_s": [0.0, round(secs(u_hai), 2)],
"u2_bajie_s": [60.0, round(60 + secs(u_baj), 2)],
"u3_haimianbaobao_s": [120.0, round(120 + secs(u_hai), 2)],
"cycle_s": 240,
}
# offline probe wav for the local fake-capture feasibility check: 3s speech, 8s silence
t = bytearray()
t += u_hai[: RATE * 3 * 2]
t += silence(8.0)
write_wav(outdir / "probe_fake.wav", bytes(t))
meta["probe"] = {"speech_s": [0.0, round(min(secs(u_hai), 3.0), 2)], "cycle_s": round(min(secs(u_hai), 3.0) + 8.0, 2)}
for name, pcm in (("u_haimianbaobao", u_hai), ("u_bajie", u_baj), ("u_xiaoyun", u_xiao)):
write_wav(outdir / f"{name}.trim.wav", pcm)
meta[name] = {"seconds": round(secs(pcm), 2)}
(outdir / "fake-wav-meta.json").write_text(json.dumps(meta, ensure_ascii=False, indent=1))
print(json.dumps(meta, ensure_ascii=False))
if __name__ == "__main__":
main()
+44
View File
@@ -0,0 +1,44 @@
#!/usr/bin/env bash
# HEL-910 窗口截止保护:45 分钟硬顶到点强制收尾(也供 watchdog 与异常路径调用)。
# 只动本窗专属句柄(pid 文件里的精确 PID)与本窗房间;绝不按程序名/端口扫杀,
# 绝不触碰 8300/8310/8320/8350、7880/7881、10095、8081 等共享服务。
set -u
BASE=/opt/cybergril-hel910
LOG=$BASE/logs/force_end.log
ts() { date -u +%FT%TZ; }
{
echo "[$(ts)] force_end begin"
# 1) 结清本窗房间(实例自己的登记账;DELETE 走统一实例所有者路径)
for sid in $(python3 - "$BASE/data" <<'EOF' 2>/dev/null
import json, sys, pathlib
p = pathlib.Path(sys.argv[1]) / "companion-voice-sessions.json"
try:
d = json.loads(p.read_text())
except Exception:
raise SystemExit
state = d.get("state", d)
def walk(o):
if isinstance(o, dict):
for k, v in o.items():
if k in ("sessions", "active") and isinstance(v, dict):
for sid, sess in v.items():
print(sid)
else:
walk(v)
elif isinstance(o, list):
for i in o:
walk(i)
walk(state)
EOF
); do
code=$(curl -s -o /dev/null -w '%{http_code}' --max-time 8 -X DELETE "http://127.0.0.1:8360/api/voice/session/$sid" || echo err)
echo "[$(ts)] DELETE session $sid -> $code"
done
# 2) 停专属组件(每步都幂等)
bash $BASE/ctl/worker_ctl.sh stop 2>&1 | sed 's/^/ worker: /'
bash $BASE/ctl/api_ctl.sh stop 2>&1 | sed 's/^/ api: /'
bash $BASE/ctl/bridge_ctl.sh stop 2>&1 | sed 's/^/ bridge: /'
# 3) 共享 TTS 9880:只停我们启动的那个 PID
bash $BASE/ctl/tts_ctl.sh stop 2>&1 | sed 's/^/ tts: /'
echo "[$(ts)] force_end done"
} >> "$LOG" 2>&1
+315
View File
@@ -0,0 +1,315 @@
// HEL-910 call1: REAL web page drives the whole scenario (workstation-local Chromium, real HTTPS entry).
// - cert interstitials accepted exactly like a user (高级→继续) on 8361 AND 8363 (WSS bridge)
// - voice call started from the real UI (voice-button → 开始语音)
// - user voice = Chromium fake mic fed with the scheduled WAV (U1 haimianbaobao @0s,
// U2 bajie @60s, U3 haimianbaobao @120s; built offline from existing engineering samples)
// - TEXT interrupts are typed into the real composer textarea and sent with a REAL Enter key:
// T1 while her R1 answer is AUDIBLY playing (timing B, hush→cg.interrupt path)
// T2 while her R2 answer is STILL GENERATING (timing A, server turn-gate path)
// - in-page probes (single page clock): stream energy 50ms, el.muted transitions, voice phase,
// heard-final text, chat DOM rows, fetch network marks, MediaRecorder of the received stream
// - HEL-911 reliability fixes (offline-verified only, no re-run):
// * probe data is drained to disk in segments (call1-probe-live.jsonl + rec-part-*.webm)
// every few seconds, so a driver timeout kill can no longer lose the raw evidence
// (HEL-910 defect: first call's probe JSON/webm died with the browser);
// * the timing-A trigger requires SERVER-side turn activity (the user's voice utterance
// committed as a chat row) plus old voice actually audible where applicable — never
// "we sent something" as a proxy for "the API is working on it" (HEL-910: turn_start
// is emitted when the adapter opens the stream, which says nothing about server state).
// Usage: node hel910_call1.mjs <chrome> <fakeWav> <outDir> <baseURL>
import { spawn } from 'node:child_process';
import { mkdirSync, writeFileSync, appendFileSync } from 'node:fs';
import { join } from 'node:path';
import { tmpdir } from 'node:os';
const [chrome, fakeWav, out, baseArg] = process.argv.slice(2);
const base = baseArg || 'https://192.168.200.12:8361';
const wssOrigin = 'https://192.168.200.12:8363';
mkdirSync(out, { recursive: true });
const cdpPort = 9713;
const T1_TEXT = '先停下,我用打字跟你说:把你刚才那句还没说完的话作废,改用文字告诉我,你今天想拉我一起做的第一件事是什么?';
const T2_TEXT = '等一下,先别把刚才那段长回答说完,我打字补充:只用一句话告诉我你现在的心情,然后安静等我。';
const INIT = `(() => {
if (window.__cg) return;
const cg = window.__cg = { anchor: [Date.now(), performance.now()], energy: [], muted: [], phase: [], heard: [], chat: [], net: [], marks: {}, rec: { started: 0, bytes: 0 }, errs: [] };
const pnow = () => Math.round(performance.now());
// 1) fetch wrapper — exact page-clock network marks
const of = window.fetch.bind(window);
window.fetch = async (...a) => {
const url = typeof a[0] === 'string' ? a[0] : a[0]?.url || '';
const t0 = pnow();
try {
const r = await of(...a);
if (url.includes('/api/')) cg.net.push({ t: t0, url: url.slice(0, 80), method: (a[1] && a[1].method) || 'GET', status: r.status, tHeaders: pnow() });
return r;
} catch (e) { if (url.includes('/api/')) cg.net.push({ t: t0, url: url.slice(0, 80), method: (a[1] && a[1].method) || 'GET', status: 'err:' + String(e).slice(0, 40) }); throw e; }
};
// 2) energy + muted probe on her audio holder (50ms), starts whenever elements appear
let ctx = null, analysers = new Map(), lastMuted = null;
const ensureCtx = () => { if (!ctx) { try { ctx = new AudioContext(); } catch (e) { cg.errs.push('ctx:' + e); } } if (ctx && ctx.state === 'suspended') ctx.resume().catch(() => {}); return ctx; };
const hook = el => {
if (!el || !el.srcObject || analysers.has(el)) return;
const c = ensureCtx(); if (!c) return;
try {
const an = c.createAnalyser(); an.fftSize = 512;
c.createMediaStreamSource(el.srcObject).connect(an);
analysers.set(el, an);
if (!cg.rec.started) {
try {
const mr = new MediaRecorder(el.srcObject, { mimeType: 'audio/webm;codecs=opus' });
const chunks = []; mr.ondataavailable = ev => { chunks.push(ev.data); cg.rec.bytes += ev.data.size;
// HEL-911: also hand each chunk to the driver as base64 the moment it
// exists, so audio evidence survives a driver timeout kill.
ev.data.arrayBuffer().then(buf => { const b = new Uint8Array(buf); let s = ''; for (let i = 0; i < b.length; i += 32768) s += String.fromCharCode(...b.subarray(i, i + 32768)); (cg.rec.parts = cg.rec.parts || []).push(s); }).catch(() => {});
};
mr.onstop = () => { cg.rec.chunks = chunks; };
mr.start(1000); cg.rec.started = pnow(); cg.rec.mr = mr;
} catch (e) { cg.errs.push('rec:' + e); }
}
} catch (e) { cg.errs.push('hook:' + e); }
};
setInterval(() => {
ensureCtx();
document.querySelectorAll("div[data-voice='her'] audio, div[data-voice='her'] video").forEach(hook);
let rms = 0;
const buf = new Uint8Array(512);
for (const an of analysers.values()) {
an.getByteTimeDomainData(buf);
let acc = 0; for (const v of buf) { const d = (v - 128) / 128; acc += d * d; }
rms = Math.max(rms, Math.sqrt(acc / buf.length));
}
const els = [...document.querySelectorAll("div[data-voice='her'] audio, div[data-voice='her'] video")];
const muted = els.length ? els.every(el => el.muted) : null;
if (muted !== lastMuted) { cg.muted.push([pnow(), muted]); lastMuted = muted; }
cg.energy.push([pnow(), Math.round(rms * 100000) / 100000, els.length]);
}, 50);
// 3) voice phase + heard text (100ms poll, log changes)
let lastPhase = null, lastHeard = null, lastSaid = null;
setInterval(() => {
const row = document.querySelector('.voice-row.real');
const phase = row ? row.dataset.phase : null;
const heard = document.querySelector('.voice-heard:not(.said)')?.textContent || '';
const said = document.querySelector('.voice-heard.said')?.textContent || '';
if (phase !== lastPhase) { cg.phase.push([pnow(), phase]); lastPhase = phase; }
if (heard !== lastHeard) { cg.heard.push([pnow(), 'draft', heard.slice(0, 60)]); lastHeard = heard; }
if (said !== lastSaid) { cg.heard.push([pnow(), 'final', said.slice(0, 60)]); lastSaid = said; }
}, 100);
// 4) chat DOM rows (conversation + record views)
const seen = new Set();
const scan = () => {
document.querySelectorAll('.message').forEach(m => {
const key = m.dataset.mid || (m.dataset.role + ':' + m.textContent.slice(0, 40));
if (seen.has(key)) return; seen.add(key);
cg.chat.push({ t: pnow(), role: m.dataset.role, mid: m.dataset.mid, text: (m.textContent || '').slice(0, 90), incomplete: !!m.querySelector('.incomplete') });
});
};
setInterval(scan, 120);
// 5) marks helper
window.__mark = (k) => { cg.marks[k] = pnow(); };
cg.mark = window.__mark;
})()`;
const sleep = ms => new Promise(r => setTimeout(r, ms));
const browser = spawn(chrome, [
'--headless=new', `--remote-debugging-port=${cdpPort}`, `--user-data-dir=${join(tmpdir(), `hel910-call1-${Date.now()}`)}`,
'--no-first-run', '--hide-scrollbars', '--force-color-profile=srgb',
'--use-fake-device-for-media-stream', '--use-fake-ui-for-media-stream',
`--use-file-for-fake-audio-capture=${fakeWav}`,
'--autoplay-policy=no-user-gesture-required', 'about:blank',
], { stdio: 'ignore', env: { ...process.env, LD_LIBRARY_PATH: `${process.env.HOME}/chromium-libs/root/usr/lib/x86_64-linux-gnu:${process.env.HOME}/chromium-libs/root/usr/lib` } });
let targets;
for (let i = 0; i < 60 && !targets; i++) { try { targets = await (await fetch(`http://127.0.0.1:${cdpPort}/json`)).json(); } catch { await sleep(250); } }
if (!targets) { console.error('chromium did not start'); process.exit(1); }
const ws = new WebSocket(targets.find(t => t.type === 'page').webSocketDebuggerUrl);
await new Promise(r => ws.addEventListener('open', r, { once: true }));
let id = 0; const waiting = new Map(); const events = [];
ws.addEventListener('message', ({ data }) => {
const m = JSON.parse(data);
if (m.id && waiting.has(m.id)) { const { ok, ko } = waiting.get(m.id); waiting.delete(m.id); m.error ? ko(new Error(m.error.message)) : ok(m.result); }
else if (m.method) events.push(m);
});
const cdp = (method, params = {}) => new Promise((ok, ko) => { const n = ++id; waiting.set(n, { ok, ko }); ws.send(JSON.stringify({ id: n, method, params })); });
const js = async expr => { const r = await cdp('Runtime.evaluate', { expression: expr, returnByValue: true, awaitPromise: true }); if (r.exceptionDetails) throw new Error(r.exceptionDetails.exception?.description?.slice(0, 400) || 'js error'); return r.result.value; };
const shot = async name => { const { data } = await cdp('Page.captureScreenshot', { format: 'png', captureBeyondViewport: false }); writeFileSync(join(out, `${name}.png`), Buffer.from(data, 'base64')); };
async function typeThisIsUnsafe() {
for (const ch of 'thisisunsafe') {
await cdp('Input.dispatchKeyEvent', { type: 'keyDown', key: ch, text: ch, windowsVirtualKeyCode: ch.charCodeAt(0), unmodifiedText: ch });
await cdp('Input.dispatchKeyEvent', { type: 'keyUp', key: ch, windowsVirtualKeyCode: ch.charCodeAt(0) });
await sleep(30);
}
}
async function goto(url) {
await cdp('Page.navigate', { url });
let privacySeen = 0;
for (let i = 0; i < 150; i++) {
await sleep(200);
const st = await js('document.readyState + "|" + (document.title || "") + "|" + (document.body ? document.body.textContent.slice(0, 40) : "")').catch(() => '');
if (!st.includes('Privacy') && !st.includes('not private') && st.startsWith('complete|')) return st;
// certificate interstitial: proceed through it exactly the way the interstitial itself accepts (its own key sequence)
if (st.includes('Privacy') || st.includes('not private')) {
privacySeen++;
await typeThisIsUnsafe();
}
}
return js('document.readyState + "|" + (document.title || "")').catch(() => 'unknown');
}
const click = async (selector, text = '') => js(`(() => { const el = [...document.querySelectorAll(${JSON.stringify(selector)})].find(e => e.offsetParent !== null && e.textContent.includes(${JSON.stringify(text)})); if (!el) return false; el.scrollIntoView({ block: 'center' }); el.click(); return true; })()`);
const until = async (fn, ms, every = 200) => { const end = Date.now() + ms; while (Date.now() < end) { const v = await fn(); if (v) return v; await sleep(every); } return null; };
const snap = () => js('JSON.stringify({e: window.__cg.energy.length ? window.__cg.energy.slice(-40) : [], ph: window.__cg.phase.slice(-6), hd: window.__cg.heard.slice(-6), mu: window.__cg.muted.slice(-6), ch: window.__cg.chat.slice(-8), mk: window.__cg.marks, rec: window.__cg.rec, err: window.__cg.errs, anchor: window.__cg.anchor})').then(JSON.parse);
const phaseNow = () => js(`document.querySelector('.voice-row.real')?.dataset.phase || null`);
const energyRecent = (n = 8) => js(`window.__cg.energy.slice(-${n})`).then(a => a || []);
async function sendText(label, text) {
await js(`(() => { window.__mark(${JSON.stringify(label + '_pre')}); const el = document.querySelector('.composer textarea'); if (!el) return false; el.focus(); const proto = HTMLTextAreaElement.prototype; Object.getOwnPropertyDescriptor(proto, 'value').set.call(el, ${JSON.stringify(text)}); el.dispatchEvent(new Event('input', { bubbles: true })); return true; })()`);
await sleep(120);
await cdp('Input.dispatchKeyEvent', { type: 'rawKeyDown', key: 'Enter', code: 'Enter', windowsVirtualKeyCode: 13, nativeVirtualKeyCode: 13 });
await cdp('Input.dispatchKeyEvent', { type: 'keyUp', key: 'Enter', code: 'Enter', windowsVirtualKeyCode: 13, nativeVirtualKeyCode: 13 });
await sleep(80);
await js(`window.__mark(${JSON.stringify(label + '_sent')})`);
}
const started = Date.now();
const R = { log: [], notes: [] };
const note = s => { R.log.push([Date.now() - started, s]); console.log(`[${((Date.now() - started) / 1000).toFixed(1)}] ${s}`); };
// HEL-911: segmented evidence drain — every 5s pull ONLY the new probe slices and
// append them as one JSONL line, and drain recorder chunks to rec-part-<n>.webm.
// A timeout kill now loses at most one 5s segment instead of the whole probe
// (the HEL-910 first-call loss mode).
const livePath = join(out, 'call1-probe-live.jsonl');
let drained = { energy: 0, muted: 0, phase: 0, heard: 0, chat: 0, net: 0 };
let recPart = 0;
const drainSegments = async () => {
try {
const s = await js(`(() => { const cg = window.__cg; const parts = (cg.rec.parts || []).splice(0); return JSON.stringify({ anchor: cg.anchor, marks: cg.marks, errs: cg.errs, slices: { energy: cg.energy.slice(${drained.energy}), muted: cg.muted.slice(${drained.muted}), phase: cg.phase.slice(${drained.phase}), heard: cg.heard.slice(${drained.heard}), chat: cg.chat.slice(${drained.chat}), net: cg.net.slice(${drained.net}) }, counts: { energy: cg.energy.length, muted: cg.muted.length, phase: cg.phase.length, heard: cg.heard.length, chat: cg.chat.length, net: cg.net.length }, parts }); })()`);
const d = JSON.parse(s);
for (const p of d.parts || []) writeFileSync(join(out, `rec-part-${String(++recPart).padStart(4, '0')}.webm`), Buffer.from(p, 'base64'));
appendFileSync(livePath, JSON.stringify({ wall: Date.now(), ...d, parts: undefined }) + '\n');
drained = { energy: d.counts.energy, muted: d.counts.muted, phase: d.counts.phase, heard: d.counts.heard, chat: d.counts.chat, net: d.counts.net };
} catch (e) { /* page mid-navigation etc. — next tick retries */ }
};
const segmentTimer = setInterval(() => { drainSegments().catch(() => {}); }, 5000);
await cdp('Page.addScriptToEvaluateOnNewDocument', { source: INIT });
await cdp('Page.enable'); await cdp('Network.enable');
// 0) user-posture cert acceptance on both origins
note('accept cert 8361: ' + (await goto(base)).slice(0, 40));
note('accept cert 8363: ' + (await goto(wssOrigin)).slice(0, 40));
await goto(base);
await sleep(2500);
await shot('01-page-loaded');
note('page ready; companion=' + String(await js(`fetch('/api/companion').then(r => r.ok).catch(() => false)`)));
// enter the conversation view from the home window
const entered = await click('button', '和她说话');
note('clicked talk entry: ' + !!entered);
const composer = await until(async () => js(`!!document.querySelector('.composer textarea')`), 10000, 300);
if (!composer) {
note('FAIL: composer textarea not found — page state: ' + String(await js(`document.body.textContent.slice(0, 200)`)));
await finish('fail-nocomposer');
}
if (!(await js(`!!document.querySelector('.voice-button')`))) {
note('FAIL: voice button not found — page state: ' + String(await js(`document.body.textContent.slice(0, 200)`)));
await finish('fail-novoicebtn');
}
// 1) start the voice call from the real UI
if (!(await click('.voice-button'))) { note('FAIL: voice button not found'); await finish('fail-novoicebtn'); }
await sleep(600);
if (!(await click('.modal button', '开始语音'))) { note('FAIL: voice modal confirm not found'); await finish('fail-nomodal'); }
await js(`window.__mark('voice_start_click')`);
note('voice start clicked');
await until(async () => (await phaseNow()) !== null, 20000);
await until(async () => ['listening', 'thinking'].includes(await phaseNow()), 25000);
await shot('02-voice-listening');
note('voice row phase=' + (await phaseNow()));
// U1 @0-7.1s: she hears haimianbaobao → thinking → speaking (audible R1)
await until(async () => (await js(`window.__cg.heard.some(h => h[1] === 'final')`)), 30000);
note('U1 heard final');
const th1 = await until(async () => (await phaseNow()) === 'thinking', 40000);
note('phase thinking (R1 generating)');
// timing A rehearsal happens on U2; on U1 we wait for audible playback (timing B target)
const spk1 = await until(async () => {
const ph = await phaseNow(); if (ph !== 'speaking') return false;
const e = await energyRecent(12); return e.filter(x => x[1] > 0.02).length >= 8;
}, 60000);
note('R1 audible speaking: ' + !!spk1);
await sleep(1600); // let plenty of old audio remain
await shot('03-r1-speaking');
// T1 — timing B: text while old answer audibly playing (real composer + real Enter)
await sendText('T1', T1_TEXT);
note('T1 sent during playback');
await sleep(1200);
await shot('04-after-T1');
// watch old-voice stop + T1 text reply
await until(async () => { const e = await energyRecent(16); return e.length && e.filter(x => x[1] > 0.015).length === 0; }, 15000).then(v => note('stream quiet after T1: ' + !!v));
await until(async () => (await js(`window.__cg.chat.some(c => c.role === 'companion' && c.t > (window.__cg.marks.T1_sent || 0))`)), 90000, 300).then(v => note('T1 companion reply visible: ' + !!v));
await shot('05-T1-reply');
// U2 @60-73.3s: prefill T2; HEL-911 trigger = the U2 VOICE turn is committed
// server-side (its user row appears in the chat DOM — the server only writes that
// row once it has the turn), NOT page phase alone and NOT any "we saw/sent X"
// proxy. The thinking phase is still required (generation in flight for timing A),
// but the server-activity row is what proves the API is actually working this turn.
await until(async () => (await js(`window.__cg.heard.some(h => h[1] === 'final' && (h[2].includes('取经') || h[2].includes('老庄') || h[2].includes('俺老猪'))) || window.__cg.chat.some(c => c.role === 'user' && (c.text.includes('取经') || c.text.includes('俺老猪')))`)), 90000, 200).then(v => note('U2 recognized/committed: ' + !!v));
await js(`(() => { const el = document.querySelector('.composer textarea'); if (el) { el.focus(); const proto = HTMLTextAreaElement.prototype; Object.getOwnPropertyDescriptor(proto, 'value').set.call(el, ${JSON.stringify(T2_TEXT)}); el.dispatchEvent(new Event('input', { bubbles: true })); } })()`);
const t2fired = await until(async () => {
const ph = await phaseNow();
if (ph !== 'thinking' && ph !== 'speaking') return false;
// server actually holds the U2 voice turn: its user row is in the chat DOM
return await js(`window.__cg.chat.some(c => c.role === 'user' && (c.text.includes('取经') || c.text.includes('俺老猪')))`);
}, 45000, 100);
if (t2fired) {
await js(`window.__mark('T2_server_active_seen')`);
await cdp('Input.dispatchKeyEvent', { type: 'rawKeyDown', key: 'Enter', code: 'Enter', windowsVirtualKeyCode: 13, nativeVirtualKeyCode: 13 });
await cdp('Input.dispatchKeyEvent', { type: 'keyUp', key: 'Enter', code: 'Enter', windowsVirtualKeyCode: 13, nativeVirtualKeyCode: 13 });
await js(`window.__mark('T2_sent')`);
note('T2 sent during thinking (generation in flight)');
} else {
note('T2 NOT fired: server-committed U2 turn + thinking phase not both observed in time');
}
await sleep(1500);
await shot('06-after-T2');
// R2 must never become audible: no energy while T2 reply streams as text
const quiet = await until(async () => { const e = await energyRecent(10); return e.length && e.every(x => x[1] <= 0.015); }, 20000);
note('no R2 audio after T2: ' + !!quiet);
await until(async () => (await js(`window.__cg.chat.filter(c => c.role === 'companion' && c.t > (window.__cg.marks.T2_sent || 0)).length >= 1`)), 90000, 300).then(v => note('T2 companion reply visible: ' + !!v));
await shot('07-T2-reply');
// U3 @120-127.1s: voice recovery — she must speak normally again
await until(async () => (await js(`window.__cg.heard.filter(h => h[1] === 'final').length >= 3`)), 90000).then(v => note('U3 heard final: ' + !!v));
const spk3 = await until(async () => {
const ph = await phaseNow(); if (ph !== 'speaking') return false;
const e = await energyRecent(12); return e.filter(x => x[1] > 0.02).length >= 8;
}, 90000);
note('R3 voice recovery audible: ' + !!spk3);
await shot('08-R3-speaking');
await until(async () => ['listening', 'thinking'].includes(await phaseNow()), 120000, 300).then(async v => note('R3 finished, back to ' + (await phaseNow())));
await shot('09-R3-done');
// end the call from the real UI
if (await click('.voice-end')) { await js(`window.__mark('voice_end_click')`); note('voice ended via UI'); }
await sleep(3000);
await finish('done');
async function finish(status) {
R.status = status;
clearInterval(segmentTimer);
await drainSegments().catch(() => {}); // last segment before the full dump
try {
await js(`(() => { try { window.__cg.rec.mr && window.__cg.rec.mr.state !== 'inactive' && window.__cg.rec.mr.stop(); } catch (e) {} })()`);
await sleep(800);
const full = await js(`(async () => { const cg = window.__cg; let rec = null; try { if (cg.rec.chunks && cg.rec.chunks.length) { const blob = new Blob(cg.rec.chunks, { type: 'audio/webm' }); const buf = await blob.arrayBuffer(); const bytes = new Uint8Array(buf); let bin = ''; for (let i = 0; i < bytes.length; i += 32768) bin += String.fromCharCode(...bytes.subarray(i, i + 32768)); rec = { bytes: blob.size, b64: bin }; } } catch (e) {} return { anchor: cg.anchor, energy: cg.energy, muted: cg.muted, phase: cg.phase, heard: cg.heard, chat: cg.chat, net: cg.net, marks: cg.marks, recMeta: { started: cg.rec.started, bytes: cg.rec.bytes }, errs: cg.errs, recB64: rec && rec.b64 }; })()`);
writeFileSync(join(out, 'call1-probe.json'), JSON.stringify({ ...R, probe: { ...full, recB64: undefined } }));
if (full.recB64) writeFileSync(join(out, 'call1-received.webm'), Buffer.from(full.recB64, 'base64'));
note('probe saved: energy=' + full.energy.length + ' chat=' + full.chat.length + ' recBytes=' + (full.recMeta.bytes || 0));
} catch (e) { note('probe save FAILED: ' + e); }
browser.kill();
process.exit(0);
}
+475
View File
@@ -0,0 +1,475 @@
#!/usr/bin/env python3
"""HEL-910 real-window voice test client (runs on .12, agent venv).
继承 HEL-907 hel907_client 的真链框架(预录音频回放经真实 WebRTC ->
LiveKit -> FunASR -> 统一 /api/chat(LLM) -> CosyVoice -> WebRTC 回流),
为本卡改造:dry(建房即删的挂断核验)、call2(稍长问题的首文/首声时延 +
回放打断停声同钟量测 + 思考泄漏取证)。所有时间戳同一客户端时钟(毫秒)。
文字打断的「真实网页原发送入口」场景在本机浏览器驱动脚本里,不在本文件。
Usage: hel910_client.py <phase> <outdir>
phases: dry | call2 | status
"""
from __future__ import annotations
import asyncio
import json
import sys
import time
import wave
from pathlib import Path
import httpx
from livekit import api, rtc
API = "http://127.0.0.1:8360"
LK_INTERNAL = "http://127.0.0.1:7880"
KEY = "devkey"
SECRET = "voiceagent-local-secret-2026"
SAMPLES = Path("/opt/voice-agent/cosyvoice/voice_samples")
TRIM = Path("/opt/cybergril-hel910/etc/trim")
DB = "/opt/cybergril-hel910/data/companion.db"
OUT = Path(sys.argv[2] if len(sys.argv) > 2 else "/opt/cybergril-hel910/evidence")
OUT.mkdir(parents=True, exist_ok=True)
T0 = time.time()
def log(msg: str) -> None:
print(f"[{time.time()-T0:8.2f}] {msg}", flush=True)
def now_ms() -> int:
return int(time.time() * 1000)
def load_wav_16k_mono(p: Path) -> bytes:
with wave.open(str(p), "rb") as w:
raw = w.readframes(w.getnframes())
rate, ch, width = w.getframerate(), w.getnchannels(), w.getsampwidth()
assert width == 2 and ch == 1 and rate == 16000, f"{p}: {rate}Hz ch{ch} w{width}"
return raw
async def list_rooms() -> list[str]:
lk = api.LiveKitAPI(url=LK_INTERNAL, api_key=KEY, api_secret=SECRET)
try:
res = await lk.room.list_rooms(api.ListRoomsRequest())
return [r.name for r in res.rooms]
finally:
await lk.aclose()
def safe_json(r: httpx.Response):
try:
return r.json()
except Exception:
return r.text[:200]
class Call:
"""One voice call through the real product API; full frame timeline kept."""
def __init__(self, tag: str):
self.tag = tag
self.http = httpx.AsyncClient(timeout=15)
self.room: rtc.Room | None = None
self.session: dict = {}
self.source: rtc.AudioSource | None = None
self.track: rtc.LocalAudioTrack | None = None
self.subtitles: list[dict] = []
self.frames: list[tuple[int, int]] = [] # (arrival_ms, bytes)
self.agent_audio = bytearray()
self.audio_rate = 48000
self.agent_joined_ms: int | None = None
self._speaking = False
self._keeper: asyncio.Task | None = None
self._first_pub_ms: int | None = None
async def open(self) -> dict:
r = await self.http.post(f"{API}/api/voice/session")
r.raise_for_status()
self.session = r.json()
log(f"[{self.tag}] session room={self.session['room']} voice={self.session.get('voice')} epoch={self.session['epoch']}")
return self.session
async def connect(self) -> None:
url = self.session["url"]
self.room = rtc.Room()
self.room.on("data_received", self._on_data)
self.room.on("track_subscribed", self._on_track)
self.room.on("participant_connected", self._on_participant)
await self.room.connect(url, self.session["token"])
self.source = rtc.AudioSource(16000, 1)
self.track = rtc.LocalAudioTrack.create_audio_track("mic", self.source)
opt = rtc.TrackPublishOptions()
opt.source = rtc.TrackSource.SOURCE_MICROPHONE
await self.room.local_participant.publish_track(self.track, opt)
log(f"[{self.tag}] connected via {url} mic published")
self._keeper = asyncio.create_task(self._keep_silent())
async def _keep_silent(self) -> None:
silence = b"\x00" * 3200
while self.source is not None:
if not self._speaking:
try:
await self.source.capture_frame(
rtc.AudioFrame(silence, 16000, 1, 1600))
except Exception:
return
await asyncio.sleep(0.1)
def _on_data(self, msg: rtc.DataPacket) -> None:
try:
payload = json.loads(msg.data.decode("utf-8"))
except Exception:
return
payload["_at_ms"] = now_ms()
self.subtitles.append(payload)
text = str(payload.get("text", ""))[:40]
log(f"[{self.tag}][sub] seq={payload.get('seq')} kind={payload.get('kind')} "
f"role={payload.get('role')} {text}")
def _on_participant(self, p: rtc.RemoteParticipant) -> None:
log(f"[{self.tag}] joined: {p.identity}")
if "agent" in p.identity:
self.agent_joined_ms = now_ms()
def _on_track(self, track: rtc.Track, pub, participant) -> None:
if track.kind != rtc.TrackKind.KIND_AUDIO:
return
log(f"[{self.tag}] agent audio track: {track.sid}")
async def read():
stream = rtc.AudioStream(track)
async for ev in stream:
frame = ev.frame
self.audio_rate = frame.sample_rate
self.frames.append((now_ms(), len(bytes(frame.data))))
self.agent_audio.extend(bytes(frame.data))
asyncio.create_task(read())
async def _publish_pcm(self, pcm: bytes, label: str) -> dict:
self._speaking = True
started = now_ms()
self._first_pub_ms = self._first_pub_ms or started
step = 3200
try:
for i in range(0, len(pcm), step):
chunk = pcm[i:i + step]
if len(chunk) < step:
chunk = chunk + b"\x00" * (step - len(chunk))
await self.source.capture_frame(rtc.AudioFrame(chunk, 16000, 1, 1600))
await asyncio.sleep(0.1)
finally:
self._speaking = False
ended = now_ms()
log(f"[{self.tag}] played {label} {len(pcm)/32000:.1f}s ({started}->{ended})")
return {"label": label, "start_ms": started, "end_ms": ended}
async def speak(self, pcm: bytes, label: str) -> dict:
return await self._publish_pcm(pcm, label)
async def wait_kind(self, kinds: tuple[str, ...], timeout: float, after_idx: int = 0) -> tuple[int, dict] | None:
deadline = time.time() + timeout
while time.time() < deadline:
await asyncio.sleep(0.05)
for i, s in enumerate(self.subtitles[after_idx:], start=after_idx):
if s.get("kind") in kinds:
return i, s
return None
async def wait_reply(self, timeout: float = 60.0) -> dict:
start_len = len(self.subtitles)
deadline = time.time() + timeout
seen_speech: str | None = None
while time.time() < deadline:
await asyncio.sleep(0.2)
for s in self.subtitles[start_len:]:
if s.get("kind") == "turn_start":
seen_speech = s.get("speech_id")
if s.get("kind") in ("turn_end", "turn_cancel") and (
seen_speech is None or s.get("speech_id") == seen_speech):
return {"kind": s["kind"], "speech_id": s.get("speech_id"),
"reason": s.get("reason")}
return {"kind": "timeout", "speech_id": seen_speech}
async def speak_and_wait(self, pcm: bytes, label: str, timeout: float = 60.0) -> dict:
play = asyncio.create_task(self._publish_pcm(pcm, label))
reply = await self.wait_reply(timeout)
await play
return {"play_label": label, "reply": reply}
async def wait_frames(self, min_seconds: float = 2.0, timeout: float = 40.0) -> int | None:
"""Wait until agent audio frames have been arriving for min_seconds."""
deadline = time.time() + timeout
while time.time() < deadline:
await asyncio.sleep(0.1)
if len(self.frames) >= 2:
cutoff = self.frames[-1][0] - int(min_seconds * 1000)
earliest_in_window = next((t for t, _ in reversed(self.frames) if t < cutoff), None)
if earliest_in_window is not None:
return now_ms()
# fewer than min_seconds of frames recorded at all
if self.frames[-1][0] - self.frames[0][0] >= int(min_seconds * 1000) - 300:
return now_ms()
return None
async def barge_interrupt(self, pcm: bytes) -> dict:
"""她长回复实际有声时,用预录响亮短句回放打断(真实 WebRTC 发布)。
T0 = 打断音频首帧发布;T1 = 旧语音最后一帧到达(≥1s 帧间隙分界)。
声源为预录 WAV 回放(工程输入),非真实用户麦克风。
"""
base_subs = len(self.subtitles)
ready = await self.wait_frames(min_seconds=3.0, timeout=45.0)
if ready is None:
return {"outcome": "no-audible-old-voice"}
barge = asyncio.create_task(self.speak(pcm, "barge-xiaoyun"))
# 打断首帧真正发布时刻由 speak 返回;此处先记发起
cancel_ms = None
deadline = time.time() + 25
while time.time() < deadline:
await asyncio.sleep(0.05)
for s in self.subtitles[base_subs:]:
if s.get("kind") == "turn_cancel":
cancel_ms = s["_at_ms"]
break
if cancel_ms:
break
await asyncio.sleep(14.0) # 观察旧声停止 + 新回复起播
await barge
timeline = [t for (t, _) in self.frames]
last_old = None
for i, t in enumerate(timeline):
if i + 1 < len(timeline) and timeline[i + 1] - t >= 1000:
last_old = t
break
if last_old is None and timeline:
last_old = timeline[-1]
return {
"outcome": "interrupted" if cancel_ms else "no-cancel",
"old_audio_last_frame_ms": last_old,
"cancel_ms": cancel_ms,
"frames_total": len(self.frames),
"source": "pre-recorded wav playback over real WebRTC (not a human microphone)",
}
async def hangup(self) -> dict:
sid = self.session.get("session_id")
self.source = None
frames_at_hangup = len(self.frames)
t_delete = now_ms()
r = await self.http.delete(f"{API}/api/voice/session/{sid}")
body = {"delete_status": r.status_code, "delete_body": safe_json(r),
"delete_ms": t_delete}
await asyncio.sleep(0.5)
if self.room is not None:
await self.room.disconnect()
await asyncio.sleep(2.0)
body["agent_frames_after_delete"] = len(self.frames) - frames_at_hangup
lk = api.LiveKitAPI(url=LK_INTERNAL, api_key=KEY, api_secret=SECRET)
try:
res = await lk.room.list_rooms(api.ListRoomsRequest(names=[self.session["room"]]))
body["room_removed"] = len(res.rooms) == 0
finally:
await lk.aclose()
log(f"[{self.tag}] hangup: {body}")
return body
def save(self, name: str) -> dict:
sub_path = OUT / f"{name}.subtitles.jsonl"
with sub_path.open("w", encoding="utf-8") as f:
for s in self.subtitles:
f.write(json.dumps(s, ensure_ascii=False) + "\n")
tl_path = OUT / f"{name}.frames.json"
tl_path.write_text(json.dumps(
{"first_pub_ms": self._first_pub_ms,
"frames": self.frames}, ensure_ascii=False))
audio_path = None
if self.agent_audio:
audio_path = OUT / f"{name}.agent.wav"
with wave.open(str(audio_path), "wb") as w:
w.setnchannels(1)
w.setsampwidth(2)
w.setframerate(self.audio_rate)
w.writeframes(bytes(self.agent_audio))
seqs = [s.get("seq") for s in self.subtitles if isinstance(s.get("seq"), int)]
return {
"tag": self.tag,
"session": self.session,
"session_voice": self.session.get("voice"),
"subtitle_count": len(self.subtitles),
"seq_monotonic": all(b > a for a, b in zip(seqs, seqs[1:])),
"agent_frames": len(self.frames),
"agent_audio_seconds": round(len(self.agent_audio) / 2 / self.audio_rate, 1),
"agent_audio_rate": self.audio_rate,
"agent_joined_ms": self.agent_joined_ms,
"subtitles_file": str(sub_path),
"frames_file": str(tl_path),
"agent_audio_file": str(audio_path) if audio_path else None,
}
def _db_query(sql: str, params: tuple = ()) -> list[dict]:
import sqlite3
conn = sqlite3.connect(f"file:{DB}?mode=ro", uri=True)
conn.row_factory = sqlite3.Row
try:
return [dict(r) for r in conn.execute(sql, params)]
finally:
conn.close()
def db_dump() -> dict:
out: dict = {}
try:
out["chat_message"] = _db_query(
"SELECT id, ts, role, turn_id, status, substr(text,1,120) AS text FROM chat_message ORDER BY id")
out["budget_total"] = _db_query("SELECT key, value FROM budget_total")
out["token_usage"] = _db_query("SELECT day, scene, used FROM token_usage")
out["request_usage"] = _db_query("SELECT * FROM request_usage")
except Exception as e:
out["error"] = str(e)
return out
def budget_snapshot() -> dict:
out: dict = {"at_ms": now_ms()}
try:
out["token_usage"] = _db_query("SELECT day, scene, used FROM token_usage")
out["request_usage"] = _db_query("SELECT * FROM request_usage")
out["budget_total"] = _db_query("SELECT key, value FROM budget_total")
except Exception as e:
out["error"] = str(e)
return out
def asr_ledger_summary() -> dict:
p = Path("/opt/cybergril-hel910/asr-usage.jsonl")
if not p.exists():
return {"exists": False}
events = [json.loads(l) for l in p.read_text().splitlines() if l.strip()]
return {"exists": True, "events": len(events), "raw": events[-8:]}
def worker_state() -> dict:
p = Path("/opt/cybergril-hel910/worker/voice_state_cybergril.json")
if not p.exists():
return {"exists": False}
try:
return {"exists": True, "content": json.loads(p.read_text())}
except Exception as e:
return {"exists": True, "error": str(e)}
def save_json(name: str, payload: dict) -> None:
path = OUT / f"{name}.json"
path.write_text(json.dumps(payload, ensure_ascii=False, indent=1), encoding="utf-8")
log(f"saved {path}")
async def phase_dry() -> None:
"""建房即删:核验建房/派发/删除链路与房间清空;不发音频、无 LLM/TTS。"""
rooms_before = await list_rooms()
call = Call("dry")
await call.open()
await asyncio.sleep(10) # 给 worker 派发入房
rooms_mid = await list_rooms()
hangup = await call.hangup()
await asyncio.sleep(2)
rooms_after = await list_rooms()
save_json("dry", {"rooms_before": rooms_before, "rooms_mid": rooms_mid,
"hangup": hangup, "rooms_after": rooms_after,
"budget_after": budget_snapshot(),
"asr_ledger_after": asr_ledger_summary()})
async def phase_call2() -> None:
"""第二通:稍长问题(bajie)首文/首声时延 + 回放打断(xiaoyun)停声同钟量测。"""
call = Call("call2")
await call.open()
sess_voice = call.session.get("voice")
await call.connect()
marks: dict[str, int | None] = {}
base = len(call.subtitles)
await call.speak(load_wav_16k_mono(TRIM / "u_bajie.trim.wav"), "q-bajie")
# 输入结束 = 回放发完
marks["playback_end_ms"] = now_ms()
# user_final
got = await call.wait_kind(("user_final",), timeout=25)
marks["user_final_ms"] = got[1]["_at_ms"] if got else None
# 她的回复:turn_start(buffer_turn 下 interim 不先于全文)
got = await call.wait_kind(("turn_start",), timeout=60, after_idx=base)
marks["turn_start_ms"] = got[1]["_at_ms"] if got else None
got = await call.wait_kind(("assistant_final", "turn_cancel", "error"), timeout=90, after_idx=base)
marks["assistant_final_ms"] = got[1]["_at_ms"] if got else None
marks["assistant_final_kind"] = got[1].get("kind") if got else None
reply_text = (got[1].get("text") if got else "") or ""
# 首帧音频(回放发完之后到达的第一帧她的音频)
after = [t for (t, _) in call.frames if t > marks["playback_end_ms"]]
marks["first_agent_frame_ms"] = after[0] if after else None
# 等她实际有声再打断(不等 turn_end:那时音频已播完)
barge = await call.barge_interrupt(load_wav_16k_mono(TRIM / "u_xiaoyun.trim.wav"))
# 打断后的新回复
new = await call.wait_kind(("user_final",), timeout=20)
barge["new_user_final_ms"] = new[1]["_at_ms"] if new else None
new_reply = await call.wait_kind(("turn_end", "turn_cancel"), timeout=90)
barge["new_reply_end"] = {"kind": new_reply[1].get("kind"), "at_ms": new_reply[1]["_at_ms"]} if new_reply else None
# 时机A:她仍在生成时发文字(turn_start=生成开始;文字 POST 取消服务端活动轮)。
# 口径如实:本步文字走 API 直发(python 客户端),不是网页输入框;网页入口的
# 两种时机已在第一通完成(T1 在播时、T2 在 final→待播间隙)。
base2 = len(call.subtitles)
await call.speak(load_wav_16k_mono(TRIM / "u_bajie.trim.wav"), "q2-bajie")
got = await call.wait_kind(("turn_start",), timeout=40, after_idx=base2)
marks["q2_turn_start_ms"] = got[1]["_at_ms"] if got else None
a_out: dict = {"fired": False}
if got:
h = (await call.http.get(f"{API}/api/health")).json()
a_text = "先别把这句长回答生成完,我打字打断你:只用一句话告诉我你现在待在哪个角落。"
t_post = now_ms()
r = await call.http.post(f"{API}/api/chat", json={
"text": a_text, "turn_id": str(__import__("uuid").uuid4()), "epoch": h["epoch"]},
timeout=90)
a_out = {"fired": True, "post_ms": t_post, "status": r.status_code,
"body_head": r.text[:200]}
marks["A_post_ms"] = t_post
# 预期:语音轮 turn_cancel(生成被取消,零泄漏零复活),文字轮获完整回复
got2 = await call.wait_kind(("turn_cancel",), timeout=30, after_idx=base2)
a_out["voice_turn_cancel_ms"] = got2[1]["_at_ms"] if got2 else None
a_out["voice_turn_cancel_reason"] = got2[1].get("reason") if got2 else None
# 她此后不得再为 Q2 发声(观察窗口)
quiet_from = now_ms()
await asyncio.sleep(8.0)
a_out["q2_frames_after_cancel"] = sum(1 for (t, _) in call.frames if t >= quiet_from)
timing_a = a_out
await asyncio.sleep(3.0)
hangup = await call.hangup()
save_json("call2", {"session_voice": sess_voice, "marks": marks,
"reply_text_head": reply_text[:200],
"barge": barge, "timing_a": timing_a,
"hangup": hangup, "call": call.save("call2"),
"budget_after": budget_snapshot(),
"worker_state_after": worker_state(),
"db_dump": db_dump(),
"asr_ledger_after": asr_ledger_summary()})
async def phase_status() -> None:
rooms = await list_rooms()
save_json("status", {"rooms": rooms, "budget": budget_snapshot(),
"worker_state": worker_state(),
"asr_ledger": asr_ledger_summary(), "db": db_dump()})
async def main() -> None:
phase = sys.argv[1]
fn = {"dry": phase_dry, "call2": phase_call2, "status": phase_status}[phase]
await fn()
if __name__ == "__main__":
asyncio.run(main())
@@ -0,0 +1,88 @@
# HEL-910 一次性真实测试窗口部署配置(2026-10-29,服务器本地文件,不入仓库)
# 授权:白栖知主卡 HEL-797 评论 01a18753-8c70-7181-9758-5bab4685ba9f「继续测」,
# 批准《HEL-797-交谈修复复测安排.md》。LLM ≤10 请求、≤40000 tokens;嵌入 0
# (CYBERGRIL_SEMANTIC=stub);生活/后台/语义 0。失败/取消/重试均计入(发送前预占)。
# 窗口结束封账,余额不结转。tiers/routing/asr/tts/vad/turn/embedding/avatar 与
# 候选 958c696 的 config/models.yaml 逐字一致(含 HEL-908 reasoning: buffer_turn)。
tiers:
high:
provider: openai_compat
model: halogen-qwen3.8-flash-next
base_url: http://192.168.200.11:8731/v1
api_key_env: null
timeout: 60.0
temperature: 0.85
reasoning: buffer_turn
standard:
provider: openai_compat
model: halogen-qwen3.8-flash-next
base_url: http://192.168.200.11:8731/v1
api_key_env: null
timeout: 40.0
temperature: 0.7
reasoning: buffer_turn
low:
provider: openai_compat
model: halogen-qwen3.8-flash-next
base_url: http://192.168.200.11:8731/v1
api_key_env: null
timeout: 20.0
temperature: 0.4
reasoning: buffer_turn
routing:
dialogue_main: high
dialogue_followup: standard
proactive_message: high
crisis: high
life_event: low
memory_gist: low
fact_extract: low
output_guard: low
pattern_detect: low
filler: none
tick: none
reach_out: none
avatar_drive: none
budget:
daily_tokens: 40000
warn_ratio: 0.7
hard_stop_ratio: 0.95
daily_requests:
dialogue: 10
life: 0
background: 0
semantic: 0
total_requests: 10
total_tokens: 40000
asr:
provider: scripted
model: qwen3-asr-1.7b
language: zh
paralinguistic:
provider: scripted
model: sensevoice-small
window_ms: 1500
enabled: true
tts:
provider: silence
model: fun-cosyvoice3-0.5b
voice_ref: null
sample_rate: 16000
vad:
provider: energy
model: silero-v6
sample_rate: 16000
turn:
provider: heuristic
silence_min_ms: 150
silence_hard_end_ms: 800
embedding:
provider: openai_compat
model: qwen3-embedding-0.6b
base_url: null
api_key_env: null
dim: 1024
avatar:
route: vrm
renderer: three.js
lipsync: envelope
@@ -0,0 +1,88 @@
# HEL-910 一次性真实测试窗口部署配置(2026-10-29,服务器本地文件,不入仓库)
# 授权:白栖知主卡 HEL-797 评论 01a18753-8c70-7181-9758-5bab4685ba9f「继续测」,
# 批准《HEL-797-交谈修复复测安排.md》。LLM ≤10 请求、≤40000 tokens;嵌入 0
# (CYBERGRIL_SEMANTIC=stub);生活/后台/语义 0。失败/取消/重试均计入(发送前预占)。
# 窗口结束封账,余额不结转。tiers/routing/asr/tts/vad/turn/embedding/avatar 与
# 候选 958c696 的 config/models.yaml 逐字一致(含 HEL-908 reasoning: buffer_turn)。
tiers:
high:
provider: openai_compat
model: halogen-qwen3.8-flash-next
base_url: http://192.168.200.11:8731/v1
api_key_env: null
timeout: 60.0
temperature: 0.85
reasoning: buffer_turn
standard:
provider: openai_compat
model: halogen-qwen3.8-flash-next
base_url: http://192.168.200.11:8731/v1
api_key_env: null
timeout: 40.0
temperature: 0.7
reasoning: buffer_turn
low:
provider: openai_compat
model: halogen-qwen3.8-flash-next
base_url: http://192.168.200.11:8731/v1
api_key_env: null
timeout: 20.0
temperature: 0.4
reasoning: buffer_turn
routing:
dialogue_main: high
dialogue_followup: standard
proactive_message: high
crisis: high
life_event: low
memory_gist: low
fact_extract: low
output_guard: low
pattern_detect: low
filler: none
tick: none
reach_out: none
avatar_drive: none
budget:
daily_tokens: 0
warn_ratio: 0.7
hard_stop_ratio: 0.95
daily_requests:
dialogue: 0
life: 0
background: 0
semantic: 0
total_requests: 0
total_tokens: 0
asr:
provider: scripted
model: qwen3-asr-1.7b
language: zh
paralinguistic:
provider: scripted
model: sensevoice-small
window_ms: 1500
enabled: true
tts:
provider: silence
model: fun-cosyvoice3-0.5b
voice_ref: null
sample_rate: 16000
vad:
provider: energy
model: silero-v6
sample_rate: 16000
turn:
provider: heuristic
silence_min_ms: 150
silence_hard_end_ms: 800
embedding:
provider: openai_compat
model: qwen3-embedding-0.6b
base_url: null
api_key_env: null
dim: 1024
avatar:
route: vrm
renderer: three.js
lipsync: envelope
@@ -0,0 +1,59 @@
// HEL-910 offline feasibility probe (workstation-local, zero network beyond loopback):
// does Chromium --use-file-for-fake-audio-capture feed our schedule into getUserMedia,
// and does the AudioContext analyser probe see it at 50ms resolution?
// Usage: node probe_fake_capture.mjs <chrome> <wav> <outdir>
import { spawn } from 'node:child_process';
import { mkdirSync, writeFileSync } from 'node:fs';
import { join } from 'node:path';
import { tmpdir } from 'node:os';
const [chrome, wav, out] = process.argv.slice(2);
mkdirSync(out, { recursive: true });
const cdpPort = 9711, httpPort = 9712;
const page = `<!doctype html><meta charset=utf-8><body><script>
window.__log = [];
(async () => {
try {
const s = await navigator.mediaDevices.getUserMedia({ audio: { echoCancellation: true, noiseSuppression: true, autoGainControl: true } });
const ctx = new AudioContext(); await ctx.resume();
const an = ctx.createAnalyser(); an.fftSize = 512;
ctx.createMediaStreamSource(s).connect(an);
const buf = new Uint8Array(an.fftSize);
const t0 = performance.now();
window.__timer = setInterval(() => {
an.getByteTimeDomainData(buf);
let acc = 0; for (const v of buf) { const d = (v - 128) / 128; acc += d * d; }
window.__log.push([Math.round(performance.now() - t0), Math.round(Math.sqrt(acc / buf.length) * 100000) / 100000]);
}, 50);
window.__ok = true;
} catch (e) { window.__ok = false; window.__err = String(e); }
})();
</script></body>`;
writeFileSync(join(out, 'probe.html'), page);
const server = spawn('python3', ['-m', 'http.server', String(httpPort), '--bind', '127.0.0.1', '--directory', out], { stdio: 'ignore' });
const profile = join(tmpdir(), `hel910-probe-${Date.now()}`);
const browser = spawn(chrome, [
'--headless=new', `--remote-debugging-port=${cdpPort}`, `--user-data-dir=${profile}`, '--no-first-run',
'--use-fake-device-for-media-stream', '--use-fake-ui-for-media-stream',
`--use-file-for-fake-audio-capture=${wav}`,
'--autoplay-policy=no-user-gesture-required', 'about:blank',
], { stdio: 'ignore', env: { ...process.env, LD_LIBRARY_PATH: `${process.env.HOME}/chromium-libs/root/usr/lib/x86_64-linux-gnu:${process.env.HOME}/chromium-libs/root/usr/lib` } });
const sleep = ms => new Promise(r => setTimeout(r, ms));
let targets;
for (let i = 0; i < 60 && !targets; i++) { try { targets = await (await fetch(`http://127.0.0.1:${cdpPort}/json`)).json(); } catch { await sleep(250); } }
const ws = new WebSocket(targets.find(t => t.type === 'page').webSocketDebuggerUrl);
await new Promise(r => ws.addEventListener('open', r, { once: true }));
let id = 0; const waiting = new Map();
ws.addEventListener('message', ({ data }) => { const m = JSON.parse(data); if (m.id && waiting.has(m.id)) { const { ok } = waiting.get(m.id); waiting.delete(m.id); ok(m.result); } });
const cdp = (method, params = {}) => new Promise(ok => { const n = ++id; waiting.set(n, { ok }); ws.send(JSON.stringify({ id: n, method, params })); });
await cdp('Page.navigate', { url: `http://127.0.0.1:${httpPort}/probe.html` });
await sleep(12000);
const res = await cdp('Runtime.evaluate', { expression: 'JSON.stringify({ok: window.__ok, err: window.__err, samples: window.__log.length, log: window.__log})', returnByValue: true });
writeFileSync(join(out, 'probe-result.json'), res.result.value);
const parsed = JSON.parse(res.result.value);
const speaking = parsed.log.filter(([, e]) => e > 0.02);
console.log('gum ok:', parsed.ok, parsed.err || '', '| samples:', parsed.samples);
console.log('speaking windows (>0.02 rms):', speaking.length);
console.log('first/last speaking ms:', speaking[0]?.[0], speaking[speaking.length - 1]?.[0]);
console.log('max rms:', Math.max(...parsed.log.map(([, e]) => e)));
browser.kill(); server.kill();
+37
View File
@@ -0,0 +1,37 @@
#!/usr/bin/env bash
# HEL-910:窗口前/后状态快照(只读)
# 用法: snapshot.sh pre|post
set -u
BASE=/opt/cybergril-hel910
OUT=$BASE/snapshots/$1-$(date -u +%H%M%S).txt
{
echo "== HEL-910 $1 snapshot $(date -u +%FT%TZ) =="
echo "-- ports (83xx/80xx/98xx/788x/10095) --"
ss -ltnp | grep -E ':(8[03][0-9]{2}|98[0-9]{2}|788[0-9]|10095) ' || echo none
echo "-- our pids --"
for f in api bridge worker tts9880; do
p=$BASE/logs/$f.pid
if [ -f "$p" ]; then P=$(cat "$p"); if kill -0 "$P" 2>/dev/null; then echo "$f pid $P alive: $(tr '\0' ' ' < /proc/$P/cmdline | cut -c1-120)"; else echo "$f pid $P dead"; fi; else echo "$f no pidfile"; fi
done
echo "-- livekit rooms --"
curl -s --max-time 5 -H 'Authorization: Bearer skip' http://127.0.0.1:7880/twirp/livekit.RoomService/ListRooms -X POST -H 'Content-Type: application/json' -d '{}' 2>/dev/null | head -c 300 || true
echo
echo "-- voices.json hash + builtin count --"
sha256sum /opt/voice-agent/cosyvoice/voices.json
python3 - <<'EOF'
import json
try:
d = json.load(open('/opt/voice-agent/cosyvoice/voices.json'))
ids = list(d.keys()) if isinstance(d, dict) else [x.get('id') for x in d]
print('entries:', len(ids), 'ids:', ids, 'cg- entries:', sum(1 for i in ids if str(i).startswith('cg-')))
except Exception as e:
print('voices.json read error:', e)
EOF
echo "-- gpu --"
nvidia-smi --query-gpu=memory.used,memory.total --format=csv,noheader
echo "-- 8300/8310/8320/8350 untouched check --"
ss -ltn | grep -E ':(8300|8310|8320|8350) ' || echo 'WARN: expected demo ports missing'
echo "-- tts.log size --"
stat -c '%s bytes %y' /opt/voice-agent/cosyvoice/tts.log 2>/dev/null || echo no-log
} > "$OUT" 2>&1
cat "$OUT"
+48
View File
@@ -0,0 +1,48 @@
#!/usr/bin/env bash
# HEL-910 测试窗口:共享 CosyVoice TTS 9880 临时恢复/停回(按快照;精确 PID,禁 fuser -k)
# 用法: bash tts_ctl.sh start|stop|status|snapshot
set -u
BASE=/opt/cybergril-hel910
PIDF=$BASE/logs/tts9880.pid
SNAP=$BASE/snapshots/tts9880-before.txt
CC=/opt/voice-agent/cosyvoice
case "${1:-}" in
status)
if [ -f "$PIDF" ]; then P=$(cat "$PIDF"); kill -0 "$P" 2>/dev/null && echo "running pid $P (ours)" || echo "pid $P not alive"; else echo "not started by us"; fi
curl -s --max-time 3 http://127.0.0.1:9880/health && echo " <- health" || echo "health not answering"
exit 0 ;;
snapshot)
mkdir -p "$BASE/snapshots"
{ echo "ts=$(date -u +%FT%TZ)"; if curl -s --max-time 3 http://127.0.0.1:9880/health >/dev/null 2>&1; then echo "was=up"; else echo "was=down"; fi; ss -ltnp 2>/dev/null | grep ':9880 ' || echo "port9880=free"; } > "$SNAP"
cat "$SNAP" ;;
stop)
if [ -f "$PIDF" ]; then
P=$(cat "$PIDF")
kill "$P" 2>/dev/null; sleep 5
kill -0 "$P" 2>/dev/null && kill -9 "$P" 2>/dev/null
rm -f "$PIDF"
echo "tts stopped (pid $P)"
else
echo "not ours to stop (no pid file)"
fi
curl -s --max-time 3 http://127.0.0.1:9880/health >/dev/null 2>&1 && echo "WARN: 9880 still answering" || echo "9880 down" ;;
esac
# start (fallthrough)
if curl -s --max-time 3 http://127.0.0.1:9880/health >/dev/null 2>&1; then
echo "9880 already up — NOT ours, not touching"; exit 0
fi
if ss -ltn 2>/dev/null | grep -q ':9880 '; then echo "port 9880 occupied by non-healthy process — abort"; exit 1; fi
cd "$CC"
nohup "$CC/venv/bin/python" server.py >> "$CC/tts.log" 2>&1 &
echo $! > "$PIDF"
echo "tts starting (pid $(cat $PIDF)) — model load takes up to ~120s"
for i in $(seq 1 60); do
sleep 2
if curl -s --max-time 3 http://127.0.0.1:9880/health 2>/dev/null | grep -q '"ok"[[:space:]]*:[[:space:]]*true'; then
echo "OK: tts healthy after ~$((i*2))s"; exit 0
fi
kill -0 "$(cat $PIDF)" 2>/dev/null || { echo "FAIL: tts process died"; tail -10 "$CC/tts.log"; exit 1; }
done
echo "FAIL: tts not healthy in 120s"; tail -10 "$CC/tts.log"; exit 1
+38
View File
@@ -0,0 +1,38 @@
#!/usr/bin/env bash
# HEL-910:用量账快查(LLM 请求/tokens、TTS 段数、ASR 账本)——触线即停的现场读数
set -u
BASE=/opt/cybergril-hel910
echo "== budget tables ($(date -u +%FT%TZ)) =="
python3 - <<'EOF'
import json, sqlite3, pathlib
db = '/opt/cybergril-hel910/data/companion.db'
try:
conn = sqlite3.connect(f'file:{db}?mode=ro', uri=True); conn.row_factory = sqlite3.Row
for sql, label in [
("SELECT key,value FROM budget_total", 'budget_total'),
("SELECT day,scene,used FROM token_usage ORDER BY day,scene", 'token_usage'),
("SELECT * FROM request_usage", 'request_usage'),
]:
try:
print(label, json.dumps([dict(r) for r in conn.execute(sql)], ensure_ascii=False))
except Exception as e:
print(label, 'ERR', e)
conn.close()
except Exception as e:
print('db ERR', e)
p = pathlib.Path('/opt/cybergril-hel910/asr-usage.jsonl')
if p.exists():
lines = [l for l in p.read_text().splitlines() if l.strip()]
print('asr ledger events:', len(lines))
else:
print('asr ledger: (none)')
EOF
echo "== tts.log window segments =="
T0MARK=$BASE/snapshots/tts-log-start-byte
if [ -f "$T0MARK" ]; then
START=$(cat "$T0MARK")
else
START=0
fi
tail -c +$((START + 1)) /opt/voice-agent/cosyvoice/tts.log 2>/dev/null | grep -c "first chunk" || true
echo "(syntheses reaching first chunk since window start; cap 20)"
+15
View File
@@ -0,0 +1,15 @@
# HEL-910 一次性真实测试窗口语音配置(2026-10-29,服务器本地,不入仓库)
# livekit_url 走独立 8363 TLS 桥(wss),livekit_internal 保持本机明文 7880。
# 与 HEL-907 布局一致,仅状态/会话文件指到 /opt/cybergril-hel910。
livekit_url: wss://192.168.200.12:8363
livekit_internal: http://127.0.0.1:7880
api_key: devkey
api_secret: voiceagent-local-secret-2026
agent_name: cybergril-voice-agent
tts_health_url: http://127.0.0.1:9880/health
panel_url: https://127.0.0.1:8090
tts_url: http://127.0.0.1:9880
registry_file: /opt/voice-agent/cosyvoice/voices.json
worker_state_file: /opt/cybergril-hel910/worker/voice_state_cybergril.json
token_ttl_seconds: 300
session_ttl_seconds: 900
+11
View File
@@ -0,0 +1,11 @@
#!/usr/bin/env bash
# HEL-910 窗口墙钟看门狗:到点强制收尾。用法: watchdog.sh <deadline_epoch_seconds>
set -u
BASE=/opt/cybergril-hel910
LOG=$BASE/logs/watchdog.log
DL="${1:?deadline epoch seconds required}"
echo "[$(date -u +%FT%TZ)] watchdog start, deadline $(date -u -d @$DL +%FT%TZ) (pid $$)" >> "$LOG"
while [ "$(date +%s)" -lt "$DL" ]; do sleep 10; done
echo "[$(date -u +%FT%TZ)] DEADLINE REACHED — force end" >> "$LOG"
bash $BASE/ctl/force_end.sh
echo "[$(date -u +%FT%TZ)] watchdog done" >> "$LOG"
+10
View File
@@ -0,0 +1,10 @@
# HEL-910 测试窗口 worker 配置(2026-10-29,600 权限,不入仓库)
CYBERGRIL_API_BASE=http://127.0.0.1:8360
CYBERGRIL_AGENT_NAME=cybergril-voice-agent
LIVEKIT_URL=ws://127.0.0.1:7880
LIVEKIT_API_KEY=devkey
LIVEKIT_API_SECRET=voiceagent-local-secret-2026
CYBERGRIL_WORKER_HEALTH_PORT=8082
CYBERGRIL_VOICE_STATE=/opt/cybergril-hel910/worker/voice_state_cybergril.json
# ASR 用量账本独立(HEL-907/879 目录只读)
CYBERGRIL_ASR_USAGE_LEDGER=/opt/cybergril-hel910/asr-usage.jsonl
+39
View File
@@ -0,0 +1,39 @@
#!/usr/bin/env bash
# HEL-910 测试窗口:专属语音 worker(只按 PID 句柄停止;ASR 布防在 etc/asr-arm.env)
set -u
BASE=/opt/cybergril-hel910
LOG=$BASE/logs/worker.log
PIDF=$BASE/logs/worker.pid
VENV=/opt/voice-agent/agent/venv
stop() {
if [ -f "$PIDF" ]; then
P=$(cat "$PIDF")
if [ "$P" != "$$" ] && kill -0 "$P" 2>/dev/null; then kill "$P"; sleep 3; fi
if [ "$P" != "$$" ] && kill -0 "$P" 2>/dev/null; then kill -9 "$P"; fi
rm -f "$PIDF"
echo "worker stopped (pid $P)"
else
echo "no pid file; nothing stopped"
fi
}
case "${1:-}" in
stop) stop; exit 0 ;;
status)
if [ -f "$PIDF" ]; then P=$(cat "$PIDF"); kill -0 "$P" 2>/dev/null && echo "running pid $P" || echo "pid $P not alive"; fi
curl -s --max-time 3 "http://127.0.0.1:8082/" && echo " <- health" || echo "health port not answering"
exit 0 ;;
esac
cd "$BASE/worker"
set -a
source "$BASE/worker/.env"
source "$BASE/etc/asr-arm.env"
set +a
PYTHONPATH="$BASE/current/src" nohup "$VENV/bin/python" -m cybergril.voice.worker start > "$LOG" 2>&1 &
echo $! > "$PIDF"
echo "worker starting (pid $(cat $PIDF)) ASR window=$(grep -o 'hel910-20261029-a' $BASE/etc/asr-arm.env | head -1)"
sleep 18
grep -m1 "registered worker" "$LOG" >/dev/null && echo "OK: worker registered" \
|| { echo "FAIL:"; tail -8 "$LOG"; exit 1; }
Binary file not shown.

After

Width:  |  Height:  |  Size: 381 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 390 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 403 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 407 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 406 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 404 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 404 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 400 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 395 KiB

+96
View File
@@ -0,0 +1,96 @@
# HEL-910 · 真实通话复测窗口记录:发文字停声与新回复(2026-10-29)
> 授权:白栖知主卡 HEL-797 评论 `01a18753-8c70-7181-9758-5bab4685ba9f`「继续测」,批准
> 《HEL-797-交谈修复复测安排.md》(附件 `01a18755-110e-71c8-b12f-10d234e28b6a`)。
> 候选:`agent/2/15e79a2458bb` @ `958c6962fb1f2a4462a6df794d893aee1fcb0667`(父 b8ec832;部署前
> 对本地 `git archive 958c696` 逐文件 sha256 核对服务器 `/opt/cybergril-hel910/current` 完全一致,
> 仅多一个 REVISION 标记;web/dist 含 cg.interrupt 构建产物)。需求基准 v1.12/60 项;本卡无需求变更。
> 窗口(UTC):**布防后首个真实出站 11:53:12.96(dry 房 ASR connect)→ 封账 12:16:46 ≈ 23.6 分**
> (≤45 分);LLM 触线 10/10 即停。
## 0. 结论速览
| 问题(白栖知的原始问题) | 结果 |
| --- | --- |
| 用户发文字时她能否停下来 | ✅ 真实网页输入框发送(真 Enter 键):她在播的语音停止(浏览器能量探测 ≤~1.4s 内持续静默;本地 hush 静音在发送瞬间);第二通未取得可闻旧声期间的回放打断样本(时机错过,如实) |
| 文字是否得到回复 | ✅ 两次网页文字(T1 在播时、T2 在她想完待播时)都得到完整回复并落库(行 sent),旧轮不复活、无幽灵行;回执纪律正确(被打断轮零回执) |
| 她多久开口 | ⚠️ 实测(第二通,完整链):输入结束→识别终稿 2.43s→开始生成 +4.10s→**实际第一声 +9.53s**→字幕全文/落库 +12.10s。首声距输入结束 ~9.5s(>5s 关注线,主因 VAD 2.4s+整轮缓冲生成 3.4s+TTS ~0.5s;单样本如实交回) |
| 是否读内部思考 | ✅ 本轮全部真实回复(18 条 companion 行、字幕、TTS 文本)干净无思考;**但真实回复未出现带 `</think>` 形状**,故真实端点未复现"带 closer 分离";离线证据在 HEL-909 |
| 生成中被文字取消(时机A) | ⛔ 未取得正面样本:call1 网页侧 U2 检测失误未触发;call2 的 API 直发文字与 worker 语音轮竞速反向(文字先到被语音轮正常取消,行 cancelled+幂等 chat.cancelled 帧);随后语音轮撞 10/10 预算硬闸诚实 φ 失败。预算封顶不补测 |
| 语音打断后声音恢复 | ✅ 两次文字打断后,后续语音轮正常出声并完整回执(U2 轮、U4 轮 receipt ack) |
| 全部上限 | ✅ 全部在上限内或恰好触线即停(LLM 10/10 触线、建房 4/4 触线;tokens 30398/40000、TTS 6/20、ASR 350.63/720s、通话 2/2、窗口 23.6/45min、付费 0) |
| 清理与恢复 | ✅ 8360/8361/8363/8082/9880 全停;LiveKit 房间空;voices.json 哈希前后一致、11 支内置零变化、cg- 零残留;8300/8310/8320/8350/7880/10095 未动;GPU 回 747MiB |
## 1. 布防(先核环境,cap=0 fail-closed 验证后才开窗)
- 快照:端口/进程/GPU/voices.json(哈希 `7b2a5021…`,11 内置,cg- 0)/TTS 9880 停机 → `window/pre-window.txt`。
- 隔离部署 `/opt/cybergril-hel910/`(新预算、新 window_id `hel910-20261029-a`、新隔离档案「小测」;HEL-907/879 目录只读复用):
- 统一实例 8360/8361 同进程双入口(`tools/api_ctl.sh`,`.venv311` 只读复用,`CYBERGRIL_SEMANTIC=stub`、`R2_ENABLED=1` 与 HEL-907 一致);
- WSS 桥 8363、专属 worker 8082(agent venv 1.8.8);`etc/models.yaml` 三档 `reasoning: buffer_turn` 与候选 `config/models.yaml` 逐字一致,仅预算块改为本窗批准值(dialogue 10 / total 10 / 40000 tokens,其余 0)。
- **cap=0 fail-closed 预检**(`models-failclosed.yaml`):建档案 → persona_job=failed(background=0,预占前拒绝);POST /api/chat → 诚实 `chat.error`(φ 原句),`request_usage`/`budget_total` 全空(零出站);POST /api/voice/session 在 TTS 停机时 503 且不建房。之后整库丢弃换 armed。
- 共享 TTS 9880 按快照临时恢复(health ok,14s);**面板 8090 本轮未启用**(零登记/零试听,不需要)。墙钟看门狗(44 分钟硬顶,精确 PID 句柄)常备;`force_end.sh` 覆盖异常路径。
## 2. 第一通:真实网页入口的文字打断(浏览器=用户,Chromium 156 headless)
- 用户侧全部走真实页面 `https://192.168.200.12:8361`:自签证书按用户姿态逐 origin 过Interstitial(8361+8363);麦克风=Chromium fake capture 回放既有工程样本时刻表(`tools/build_fake_wavs.py`:U1 海绵宝宝@0s、U2 八戒@60s、U3 海绵宝宝@120s,240s 循环);文字=真实输入框 `textarea` + CDP 真实 Enter 键(非直接 POST)。页面探针(同页时钟):流能量 50ms、`el.muted` 转换、voice 相位、heard 文本、chat DOM、fetch 网络。截图 `web/01..09`。
- **T1(时机B:旧回答已生成、TTS 实际在播)**:她在播 R1(能量>0.02 持续、相位 speaking)时输入框发送 →
发送瞬间本地 hush 静音(同步);**~1.4s 内浏览器收流能量持续归零**(远端旧音轨停止;0.2s 轮询+静默窗口径,粗粒度如实);T1 获完整文字回复(行4 sent);R1 不复活(行2 已完、无后续 R1 音频、receipt 正确缺席);U2 语音轮随后正常出声(行5/6 sent,回执 ack)→ **文字打断后语音恢复正常**。
- **T2(网页入口,页面相位=thinking 时发送)**:实际落在 U3 回复已落库、TTS 待播/刚起播的间隙(HEL-909 评审 C 形状)→ U3 回复行8 sent 且文本完整保留(音频被截,receipt 正确缺席);T2 获完整回复(行10「平静。」);U4 语音轮再次正常出声且回执 ack(行11/12)→ 恢复正常第二次确认。
- **call1 缺陷/失误(如实)**:① 驱动脚本对 U2 heard-final 的检测条件未命中(原因无法定证——探针原始数据随浏览器被超时杀掉丢失),时机A 网页正面样本因此未执行;② 页面语音会话结束后文件循环带来一次 U4 轮(+257s,回复在挂断后落库、未出声)多耗 1 次 LLM——测量装置的时序代价,已计入账本;③ 浏览器探针原始 JSON/webm 因驱动进程超时被杀未存盘(截图与里程碑日志保留;第二通用 python 客户端独立取证帧级时间轴)。
## 3. 第二通:python 客户端(同钟毫秒时间轴,`window/call2.*`)
- **稍长问题(八戒)等待链**(call2.json marks + frames/wav 离线对齐):回放发完 → user_final **+2.43s**(VAD)→ turn_start(生成开始)**+4.10s** → **实际第一声 +9.53s**(wav 能量段起播;生成 3.44s+TTS 首包)→ assistant_final(字幕全文)**+12.10s** → 播放完整、回执 ack(+12.10s 处)。回复本体较短(「好,小十。去化缘…」14 字)——「稍长回复」目标部分达成,等待数字仍有效(整轮缓冲的主导项是 VAD+生成,不随回复长度显著变化)。
- **回放打断(xiaoyun,响亮短句 rms 4970 预检)**:⚠️ **未取得有效样本**——她的 Q1 音频在打断回放开始前 ~1.1s 已自然播完(wav 能量段 979988–982187 vs 回放起播 ~983.3k),`turn_cancel(interrupted)` 是其后新轮被同段回放第二次 final 打断(非停旧声)。真实取到的:VAD 中断链路真实工作(cancel=final 后 0.6s)、被打断轮回执 fail-closed 正确。HEL-907 同项亦未取得,两轮均如实不冒充。
- **时机A(API 直发文字取消生成中的语音轮)**:竞速反向——文字 POST 先于 worker 语音 POST 到达(turn_start 在适配器开流时即发,早于服务端收到),文字轮被更新的语音轮正常取消(**行19 cancelled + SSE 幂等 `chat.cancelled` 终态帧**,即 HEL-908 R1 修复路径的真实表现);随后语音轮 LLM 预占撞 10/10 硬闸 → 诚实 `chat.error` φ 原句念出(行20 failed,无幽灵 companion 行)。**正面"生成中被取消"样本未取得,预算封顶不补测**。
- 挂断:DELETE 200、房间真删、删后仅 1 帧在途。
## 4. 思考隔离检查(真实端点)
18 条 companion 落库行、全部字幕、`tts-window.log` 合成文本:零 `<think>`/`</think>`/思考前缀。
**但本轮真实回复均未出现带 closer 形状**(该端点隐式思考无标签时任何客户端模式都不可分离——HEL-908 已声明边界):真实端点未复现"带 `</think>` 分离",覆盖范围如实限定;离线 32 组形状证据见 HEL-909 附件。
## 5. 用量账(含失败/取消;封账后不重开)
| 类别 | 实际 | 上限 |
| --- | --- | --- |
| 时窗 | 23.6 分(11:53:12.96→12:16:46) | ≤45 分 |
| 通话 | 2 通(浏览器 ~4.4 分 / python ~1.5 分,串行) | ≤2、各≤5 分 |
| 建房 | 4(dry+call1+call2+一次 SSL 证书报错未连成的空房,房间已核实删除、房间清空) | ≤4(触线) |
| LLM | **10 请求 / 30,398 tokens(触线即停)**:call1 6(含挂断后 U4 轮)+ call2 4 | ≤10 / ≤40000 |
| 嵌入/生活/后台/语义 | 0(stub;persona/background=0 fail-closed 预检证实) | 0 |
| 通话 TTS | 6 段(达首包口径) | ≤20 |
| 连续 ASR | 保守=确证 **350.63s**(逐会话 0/264.24/0/86.38),重试 0 | ≤720s、每通重连≤2 |
| 新登记/上传/登记转写/试听合成 | 全 0(未开 8090;voices.json 前后哈希一致) | 0 |
| 新增付费 | 0 | 0 |
## 6. 发现的问题(交回,不现场改核心代码)
- 🟡 **首声等待**:输入结束→第一声 ~9.5s(user_final 后 ~7.1s;生成开始后 ~3.4s)。单样本+call1 量级相近,未达"经常"判定所需的多样本;按《复测安排》记录交回,不现场调参。构成:VAD 2.4s + 整轮缓冲生成 3.4s(buffer_turn 已知代价,换来零思考泄漏)+ TTS ~0.5s。
- 🟡 worker.py `_on_item` 对 `AgentHandoff` 项取 `role` 抛 AttributeError(SDK 事件内捕获,非致命日志噪音,两轮通话均出现)。
- 🟡 job 关停路径 `TypeError: object NoneType can't be used in 'await' expression`(livekit-agents shutdown 回调;非致命、挂断清理本身正常)。
- 🟡 本窗测量脚本自身:`tts_ctl.sh` snapshot/stop 分支穿透导致一次多余的 TTS 重启(随即按快照停回,零合成零预算影响);call1 驱动超时杀进程丢失页内探针数据。均已在 `tools/` 原样留档。
- 已知窄窗口(延迟 cg.interrupt 打断新回复):本轮未观察到该事件,不宣称排除(无正面样本)。
## 7. 清理与恢复(逐项核对,`window/post-window.txt`)
8360/8361/8363/8082/9880 全停(精确 PID);LiveKit `ListRooms` 空(含那次证书空房,已核实删除;隔离实例会话登记文件留有一条 TTL 未到期记录,房间实际已不存在——API 进程先于 TTL 停机所致,留证不追删);voices.json 哈希前后一致、cg- 0;8300/8310/8320/8350/7880/10095 原样;GPU 747MiB;8340/ComfyUI 保持停机未碰。看门狗已停。证据包 `/opt/cybergril-hel910/hel910-evidence-20261029.tar.gz` sha256 `83363576b922ff45a7b85706801ece5b790b2d22bf14a4e1dbf1aed303d7a3f0`;测试档案/账本留在 `/opt/cybergril-hel910/`(未触碰任何既有实例与真实档案)。
## 8. 未测 / 承接(如实)
- **真实用户麦克风打断时延**(含可闻旧声期间的语音打断停声):两轮(HEL-907/910)均未取得有效样本,需真人在同一时间轴发声+听声,或下轮工程窗口先用"她实际有声才触发"的门控重试。
- **时机A(生成中文字取消)正面样本**:需文字在语音轮服务端激活后、生成完成前到达(如等 chat 行落库再发);本轮竞速反向+预算封顶,未覆盖。
- **真实端点带 `</think>` 形状**:未出现,真实分离未复现(离线证据在 HEL-909)。
- 首声等待"经常>5s"与否:需多样本;本轮 1 精确样本 + 1 量级相近。
- 真机/手机麦克风、Safari:未测(D3 用户动作)。
## 9. HEL-911 纠偏记录(2026-10-29 追加;上文原报告原样保留,不回改)
以下按总管独立复算(附件 hel910-independent-check.md)与 HEL-911 离线复现订正本文数字,原始日志/录音/快照未动:
- **§0/§4 的"18 条 companion 行"不准确**:`window/db-final.json` 共 20 条 chat_message = user 11 + **companion 9**。思考隔离结论(零 `<think>` 泄漏)不变,基数以 9 为准。
- **§3 的等待链分段"turn_start +4.10s"不符合 marks**:同钟原始 marks 为 playback_end → user_final **+2.432s** → turn_start **+6.099s** → assistant_interim +7.514s → 首有声帧 ≈+9.51s(frames 第二列是字节数,PCM 样本数需除 2;RMS 阈值 500 复算首声 9.514s,阈值 200 为 9.474s,"约 9.5s"总量成立)→ assistant_final +12.102s。原"生成 3.4s+TTS 0.5s"的相加归因作废,按真实时刻重建见下条与 `docs/rework/hel911/summary.md`。
- **§3 "字幕全文/落库 +12.10s" 的语义错误**:assistant_final 字幕是**播放收尾/回执门**(整段播完且回执合法才发,contract v2),不是首次全文生成、更不是落库时刻。落库是 DB 行 14 ts=+7.511s(与 assistant_interim +7.514s 同刻)。
- **§7 "LiveKit ListRooms 空"的证据引述错误**:`window/post-window.txt` 里 ListRooms 的实际输出是 `invalid authorization token`,不能作为空房证据;总管其后用服务器已有 agent venv 只读加载并独立核实 `room_names=[]`(不打印凭证),空房结论成立但证据来源以此纠偏为准。
- **§6 两个 🟡 已在 HEL-911 修复**:`_on_item` 对 AgentHandoff 取 `role` 的 AttributeError,与 job 关停 `TypeError: object NoneType can't be used in 'await' expression`(同步卸载回调被 SDK await)。
- **§6 首声等待的构成已重新归因**(离线可证部分):user_final→turn_start 的 3.65~3.67s 是 livekit-agents 1.8.8 默认补入的**英文 EOU TurnDetector** 对中文终稿给出"不太像说完"判定、把 endpointing 延迟顶到 max_delay=6.0 所致;显式 `turn_detection: None` 后离线同链路该段降为 ~5ms。VAD 端点本身 ~0.7s、FunASR 离线纠错+适配器 0.6s 去抖共 2.43s、服务端整轮生成 ~1.4s、TTS 首包 1.61s 为主构成。修复已入 worker.py(TURN_HANDLING),**首声总时延下降需真实窗口复测确认,本文不宣称**。
+148
View File
@@ -0,0 +1,148 @@
INFO: Started server process [116699]
INFO: Started server process [116699]
INFO: Uvicorn running on http://0.0.0.0:8360 (Press CTRL+C to quit)
INFO: Uvicorn running on https://0.0.0.0:8361 (Press CTRL+C to quit)
INFO: 127.0.0.1:53518 - "GET /api/health HTTP/1.1" 200 OK
INFO: 127.0.0.1:43322 - "GET /api/health HTTP/1.1" 200 OK
INFO: 127.0.0.1:53530 - "POST /api/companion HTTP/1.1" 201 Created
INFO: 127.0.0.1:46880 - "POST /api/voice/session HTTP/1.1" 201 Created
INFO: 127.0.0.1:33042 - "DELETE /api/voice/session/1RDW7vfLqnpCjIK4SO_tSNzk HTTP/1.1" 200 OK
INFO: 192.168.200.13:34830 - "GET / HTTP/1.1" 200 OK
INFO: 192.168.200.13:34830 - "GET /assets/index-Vm-EFPLb.js HTTP/1.1" 200 OK
INFO: 192.168.200.13:34844 - "GET /assets/index-B8TdHoQm.css HTTP/1.1" 200 OK
INFO: 192.168.200.13:34830 - "GET /assets/her-talk.jpg HTTP/1.1" 200 OK
INFO: 192.168.200.13:34844 - "GET /assets/her-room.jpg HTTP/1.1" 200 OK
INFO: 192.168.200.13:34844 - "GET /api/health HTTP/1.1" 200 OK
INFO: 192.168.200.13:34830 - "GET /favicon.ico HTTP/1.1" 404 Not Found
INFO: 192.168.200.13:34830 - "GET /api/companion HTTP/1.1" 200 OK
INFO: 192.168.200.13:34830 - "GET /api/messages?limit=200 HTTP/1.1" 200 OK
INFO: 192.168.200.13:34830 - "GET /assets/icons.svg HTTP/1.1" 200 OK
INFO: 192.168.200.13:34830 - "GET / HTTP/1.1" 200 OK
INFO: 192.168.200.13:34830 - "GET /api/health HTTP/1.1" 200 OK
INFO: 192.168.200.13:34830 - "GET /api/companion HTTP/1.1" 200 OK
INFO: 192.168.200.13:34830 - "GET /api/messages?limit=200 HTTP/1.1" 200 OK
INFO: 192.168.200.13:34830 - "GET /api/companion HTTP/1.1" 200 OK
INFO: 192.168.200.13:48642 - "GET / HTTP/1.1" 200 OK
INFO: 192.168.200.13:48642 - "GET /assets/index-B8TdHoQm.css HTTP/1.1" 200 OK
INFO: 192.168.200.13:48656 - "GET /assets/index-Vm-EFPLb.js HTTP/1.1" 200 OK
INFO: 192.168.200.13:48642 - "GET /assets/her-talk.jpg HTTP/1.1" 200 OK
INFO: 192.168.200.13:48656 - "GET /assets/her-room.jpg HTTP/1.1" 200 OK
INFO: 192.168.200.13:48656 - "GET /api/health HTTP/1.1" 200 OK
INFO: 192.168.200.13:48642 - "GET /favicon.ico HTTP/1.1" 404 Not Found
INFO: 192.168.200.13:48642 - "GET /api/companion HTTP/1.1" 200 OK
INFO: 192.168.200.13:48642 - "GET /api/messages?limit=200 HTTP/1.1" 200 OK
INFO: 192.168.200.13:48642 - "GET /assets/icons.svg HTTP/1.1" 200 OK
INFO: 192.168.200.13:35342 - "GET / HTTP/1.1" 200 OK
INFO: 192.168.200.13:35342 - "GET /api/health HTTP/1.1" 200 OK
INFO: 192.168.200.13:35342 - "GET /api/companion HTTP/1.1" 200 OK
INFO: 192.168.200.13:35342 - "GET /api/messages?limit=200 HTTP/1.1" 200 OK
INFO: 192.168.200.13:35342 - "GET /api/companion HTTP/1.1" 200 OK
INFO: 192.168.200.13:35342 - "GET /api/voice/status HTTP/1.1" 200 OK
INFO: 192.168.200.13:35342 - "GET /api/voice/status HTTP/1.1" 200 OK
INFO: 192.168.200.13:35342 - "GET /api/voice/status HTTP/1.1" 200 OK
INFO: 192.168.200.13:35342 - "GET /vendor/livekit-client-2.22.4.umd.min.js HTTP/1.1" 200 OK
INFO: 192.168.200.13:35342 - "POST /api/voice/session HTTP/1.1" 201 Created
INFO: 192.168.200.13:35342 - "GET /api/voice/voices HTTP/1.1" 503 Service Unavailable
INFO: 127.0.0.1:52114 - "GET /api/health HTTP/1.1" 200 OK
INFO: 127.0.0.1:52114 - "POST /api/chat HTTP/1.1" 200 OK
INFO: 192.168.200.13:54432 - "GET /api/messages?limit=50 HTTP/1.1" 200 OK
INFO: 192.168.200.13:51758 - "GET /api/messages?limit=50 HTTP/1.1" 200 OK
INFO: 192.168.200.13:51758 - "GET /api/health HTTP/1.1" 200 OK
INFO: 192.168.200.13:51758 - "POST /api/chat HTTP/1.1" 200 OK
INFO: 192.168.200.13:51758 - "POST /api/chat/received HTTP/1.1" 200 OK
memory compression failed: memory_id=2
INFO: 192.168.200.13:48068 - "GET /api/messages?limit=50 HTTP/1.1" 200 OK
INFO: 192.168.200.13:56264 - "GET /api/messages?limit=50 HTTP/1.1" 200 OK
memory compression failed: memory_id=2
INFO: 192.168.200.13:52390 - "GET /api/messages?limit=50 HTTP/1.1" 200 OK
INFO: 192.168.200.13:52390 - "GET /api/messages?limit=50 HTTP/1.1" 200 OK
INFO: 127.0.0.1:34364 - "GET /api/health HTTP/1.1" 200 OK
INFO: 127.0.0.1:34364 - "POST /api/chat HTTP/1.1" 200 OK
INFO: 127.0.0.1:40776 - "GET /api/health HTTP/1.1" 200 OK
INFO: 127.0.0.1:40776 - "POST /api/chat/received HTTP/1.1" 200 OK
INFO: 192.168.200.13:34404 - "GET /api/messages?limit=50 HTTP/1.1" 200 OK
memory compression failed: memory_id=2
INFO: 192.168.200.13:34404 - "GET /api/messages?limit=50 HTTP/1.1" 200 OK
INFO: 192.168.200.13:55626 - "GET /api/messages?limit=50 HTTP/1.1" 200 OK
memory compression failed: memory_id=1
INFO: 127.0.0.1:48340 - "GET /api/health HTTP/1.1" 200 OK
INFO: 127.0.0.1:48340 - "POST /api/chat HTTP/1.1" 200 OK
INFO: 192.168.200.13:58740 - "GET /api/messages?limit=50 HTTP/1.1" 200 OK
INFO: 192.168.200.13:58740 - "GET /api/health HTTP/1.1" 200 OK
INFO: 192.168.200.13:58740 - "POST /api/chat HTTP/1.1" 200 OK
INFO: 192.168.200.13:58740 - "POST /api/chat/received HTTP/1.1" 200 OK
INFO: 192.168.200.13:58740 - "GET /api/messages?limit=50 HTTP/1.1" 200 OK
memory compression failed: memory_id=1
INFO: 192.168.200.13:37600 - "GET /api/messages?limit=50 HTTP/1.1" 200 OK
INFO: 192.168.200.13:60942 - "GET /api/messages?limit=50 HTTP/1.1" 200 OK
memory compression failed: memory_id=1
INFO: 192.168.200.13:51596 - "GET /api/messages?limit=50 HTTP/1.1" 200 OK
memory compression failed: memory_id=4
INFO: 192.168.200.13:51382 - "GET /api/messages?limit=50 HTTP/1.1" 200 OK
INFO: 192.168.200.13:47722 - "GET /api/messages?limit=50 HTTP/1.1" 200 OK
memory compression failed: memory_id=4
INFO: 127.0.0.1:58234 - "GET /api/health HTTP/1.1" 200 OK
INFO: 127.0.0.1:58234 - "POST /api/chat HTTP/1.1" 200 OK
INFO: 192.168.200.13:57716 - "GET /api/messages?limit=50 HTTP/1.1" 200 OK
INFO: 192.168.200.13:35614 - "GET /api/messages?limit=50 HTTP/1.1" 200 OK
INFO: 127.0.0.1:37294 - "GET /api/health HTTP/1.1" 200 OK
INFO: 127.0.0.1:37294 - "POST /api/chat/received HTTP/1.1" 200 OK
INFO: 192.168.200.13:35644 - "GET /api/messages?limit=50 HTTP/1.1" 200 OK
INFO: 192.168.200.13:35644 - "DELETE /api/voice/session/EkSPC7iZhHiqZmoCoZanDIPp HTTP/1.1" 200 OK
INFO: 192.168.200.13:35664 - "GET /assets/icons.svg HTTP/1.1" 304 Not Modified
INFO: 192.168.200.13:35664 - "GET /api/messages?limit=50 HTTP/1.1" 200 OK
memory compression failed: memory_id=4
INFO: 192.168.200.13:33818 - "GET /api/messages?limit=50 HTTP/1.1" 200 OK
INFO: 192.168.200.13:49544 - "GET /api/messages?limit=50 HTTP/1.1" 200 OK
memory compression failed: memory_id=3
INFO: 192.168.200.13:40860 - "GET /api/messages?limit=50 HTTP/1.1" 200 OK
memory compression failed: memory_id=3
INFO: 192.168.200.13:52124 - "GET /api/messages?limit=50 HTTP/1.1" 200 OK
INFO: 192.168.200.13:35732 - "GET /api/messages?limit=50 HTTP/1.1" 200 OK
memory compression failed: memory_id=3
INFO: 192.168.200.13:46040 - "GET /api/messages?limit=50 HTTP/1.1" 200 OK
memory compression failed: memory_id=6
INFO: 192.168.200.13:50306 - "GET /api/messages?limit=50 HTTP/1.1" 200 OK
memory compression failed: memory_id=6
memory compression failed: memory_id=6
memory compression failed: memory_id=5
memory compression failed: memory_id=5
memory compression failed: memory_id=5
memory compression failed: memory_id=8
memory compression failed: memory_id=8
memory compression failed: memory_id=8
memory compression failed: memory_id=7
memory compression failed: memory_id=7
INFO: 127.0.0.1:50124 - "POST /api/voice/session HTTP/1.1" 201 Created
memory compression failed: memory_id=7
memory compression failed: memory_id=10
memory compression failed: memory_id=10
memory compression failed: memory_id=10
memory compression failed: memory_id=9
INFO: 127.0.0.1:39284 - "POST /api/voice/session HTTP/1.1" 201 Created
memory compression failed: memory_id=9
INFO: 127.0.0.1:40248 - "GET /api/health HTTP/1.1" 200 OK
INFO: 127.0.0.1:40248 - "POST /api/chat HTTP/1.1" 200 OK
INFO: 127.0.0.1:40248 - "GET /api/health HTTP/1.1" 200 OK
INFO: 127.0.0.1:40248 - "POST /api/chat/received HTTP/1.1" 200 OK
INFO: 127.0.0.1:40248 - "GET /api/health HTTP/1.1" 200 OK
INFO: 127.0.0.1:40248 - "POST /api/chat HTTP/1.1" 200 OK
INFO: 127.0.0.1:40248 - "GET /api/health HTTP/1.1" 200 OK
INFO: 127.0.0.1:40248 - "POST /api/chat HTTP/1.1" 200 OK
INFO: 127.0.0.1:40248 - "GET /api/health HTTP/1.1" 200 OK
INFO: 127.0.0.1:40248 - "POST /api/chat/received HTTP/1.1" 200 OK
memory compression failed: memory_id=9
INFO: 127.0.0.1:53290 - "GET /api/health HTTP/1.1" 200 OK
INFO: 127.0.0.1:53294 - "GET /api/health HTTP/1.1" 200 OK
INFO: 127.0.0.1:53294 - "POST /api/chat HTTP/1.1" 200 OK
INFO: 127.0.0.1:53290 - "POST /api/chat HTTP/1.1" 200 OK
memory compression failed: memory_id=12
INFO: 127.0.0.1:60666 - "DELETE /api/voice/session/Br4leZ_1VqtwH_E4TIM9n8o5 HTTP/1.1" 200 OK
memory compression failed: memory_id=12
memory compression failed: memory_id=12
memory compression failed: memory_id=11
memory compression failed: memory_id=11
INFO: Shutting down
INFO: Finished server process [116699]
INFO: Shutting down
INFO: Finished server process [116699]
+81
View File
@@ -0,0 +1,81 @@
{"kind":"call_start","call":"cg-voice-9r5jjmcz0n","stream_seq":1,"window":"hel910-20261029-a","t":1793274792.96}
{"kind":"call_end","call":"cg-voice-9r5jjmcz0n","reason":"error","audio_seconds":0.0,"confirmed_audio_seconds":0.0,"connect_attempts":0,"connect_failures":0,"connect_retries":0,"window":"hel910-20261029-a","t":1793274804.372}
{"kind":"call_start","call":"cg-voice-fdk5izk2uz","stream_seq":1,"window":"hel910-20261029-a","t":1793275102.514}
{"kind":"connect_attempt","call":"cg-voice-fdk5izk2uz","seq":1,"ok":true,"retry":false,"error":"","window":"hel910-20261029-a","t":1793275102.631}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.023499,"confirmed_seconds":4.990686,"frames":101,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275107.561}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.056373,"confirmed_seconds":5.023499,"frames":101,"bytes":161804,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275112.611}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.056311,"confirmed_seconds":5.056311,"frames":101,"bytes":161802,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275117.66}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.056311,"confirmed_seconds":5.056373,"frames":101,"bytes":161802,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275122.711}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.023499,"confirmed_seconds":5.056311,"frames":101,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275127.761}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.023498,"confirmed_seconds":4.990686,"frames":100,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275132.761}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.023499,"confirmed_seconds":5.056311,"frames":101,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275137.812}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.023498,"confirmed_seconds":4.990686,"frames":100,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275142.811}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.056373,"confirmed_seconds":5.056311,"frames":101,"bytes":161804,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275147.861}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.023499,"confirmed_seconds":5.056311,"frames":101,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275152.911}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.023498,"confirmed_seconds":4.990686,"frames":100,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275157.911}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.023499,"confirmed_seconds":5.056311,"frames":101,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275162.96}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.023498,"confirmed_seconds":4.990686,"frames":100,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275167.961}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.056311,"confirmed_seconds":5.056311,"frames":101,"bytes":161802,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275173.011}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.023499,"confirmed_seconds":5.056373,"frames":101,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275178.061}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.023498,"confirmed_seconds":4.990624,"frames":100,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275183.061}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.023499,"confirmed_seconds":5.056373,"frames":101,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275188.111}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.023498,"confirmed_seconds":4.990624,"frames":100,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275193.111}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.056311,"confirmed_seconds":5.056373,"frames":101,"bytes":161802,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275198.161}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.023499,"confirmed_seconds":5.056311,"frames":101,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275203.211}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.023498,"confirmed_seconds":4.990686,"frames":100,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275208.211}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.023499,"confirmed_seconds":5.056311,"frames":101,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275213.261}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.023498,"confirmed_seconds":4.990686,"frames":100,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275218.262}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.056373,"confirmed_seconds":5.056311,"frames":101,"bytes":161804,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275223.312}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.023499,"confirmed_seconds":5.056311,"frames":101,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275228.36}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.023498,"confirmed_seconds":4.990686,"frames":100,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275233.362}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.023499,"confirmed_seconds":5.056311,"frames":101,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275238.411}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.023498,"confirmed_seconds":4.990686,"frames":100,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275243.411}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.056311,"confirmed_seconds":5.056311,"frames":101,"bytes":161802,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275248.461}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.023499,"confirmed_seconds":5.056373,"frames":101,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275253.511}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.023498,"confirmed_seconds":4.990624,"frames":100,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275258.512}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.023499,"confirmed_seconds":5.056373,"frames":101,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275263.561}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.023498,"confirmed_seconds":4.990624,"frames":100,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275268.561}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.056311,"confirmed_seconds":5.056373,"frames":101,"bytes":161802,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275273.611}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.023499,"confirmed_seconds":5.056311,"frames":101,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275278.661}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.023498,"confirmed_seconds":4.990686,"frames":100,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275283.661}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.023499,"confirmed_seconds":5.056311,"frames":101,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275288.711}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.023498,"confirmed_seconds":4.990686,"frames":100,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275293.711}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.056373,"confirmed_seconds":5.056311,"frames":101,"bytes":161804,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275298.761}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.023499,"confirmed_seconds":5.056311,"frames":101,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275303.811}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.023498,"confirmed_seconds":4.990686,"frames":100,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275308.811}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.023499,"confirmed_seconds":5.056311,"frames":101,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275313.861}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.023498,"confirmed_seconds":4.990686,"frames":100,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275318.861}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.023499,"confirmed_seconds":5.056311,"frames":101,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275323.911}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.023498,"confirmed_seconds":4.990686,"frames":100,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275328.911}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.056311,"confirmed_seconds":5.056311,"frames":101,"bytes":161802,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275333.961}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.023499,"confirmed_seconds":5.056373,"frames":101,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275339.011}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.023498,"confirmed_seconds":4.990624,"frames":100,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275344.011}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.023499,"confirmed_seconds":5.056373,"frames":101,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275349.062}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.023498,"confirmed_seconds":4.990624,"frames":100,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275354.061}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.056311,"confirmed_seconds":5.056373,"frames":101,"bytes":161802,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275359.11}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":5.023499,"confirmed_seconds":5.056311,"frames":101,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275364.161}
{"kind":"audio","call":"cg-voice-fdk5izk2uz","seconds":2.626688,"confirmed_seconds":2.659501,"frames":13,"bytes":84054,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275366.316}
{"kind":"call_end","call":"cg-voice-fdk5izk2uz","reason":"error","audio_seconds":264.242609,"confirmed_audio_seconds":264.242609,"connect_attempts":1,"connect_failures":0,"connect_retries":0,"window":"hel910-20261029-a","t":1793275366.316}
{"kind":"call_start","call":"cg-voice-jq8q4zm9h0","stream_seq":1,"window":"hel910-20261029-a","t":1793275813.498}
{"kind":"call_start","call":"cg-voice-dlas9zmiox","stream_seq":1,"window":"hel910-20261029-a","t":1793275957.196}
{"kind":"connect_attempt","call":"cg-voice-dlas9zmiox","seq":1,"ok":true,"retry":false,"error":"","window":"hel910-20261029-a","t":1793275957.28}
{"kind":"audio","call":"cg-voice-dlas9zmiox","seconds":5.023499,"confirmed_seconds":4.990686,"frames":101,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275962.248}
{"kind":"audio","call":"cg-voice-dlas9zmiox","seconds":5.056373,"confirmed_seconds":5.023499,"frames":101,"bytes":161804,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275967.298}
{"kind":"audio","call":"cg-voice-dlas9zmiox","seconds":5.056311,"confirmed_seconds":5.056311,"frames":101,"bytes":161802,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275972.348}
{"kind":"audio","call":"cg-voice-dlas9zmiox","seconds":5.056311,"confirmed_seconds":5.056373,"frames":101,"bytes":161802,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275977.398}
{"kind":"audio","call":"cg-voice-dlas9zmiox","seconds":5.023499,"confirmed_seconds":5.056311,"frames":101,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275982.448}
{"kind":"audio","call":"cg-voice-dlas9zmiox","seconds":5.023498,"confirmed_seconds":4.990686,"frames":100,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275987.449}
{"kind":"audio","call":"cg-voice-dlas9zmiox","seconds":5.023499,"confirmed_seconds":5.056311,"frames":101,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275992.499}
{"kind":"audio","call":"cg-voice-dlas9zmiox","seconds":5.023498,"confirmed_seconds":4.990686,"frames":100,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793275997.499}
{"kind":"audio","call":"cg-voice-dlas9zmiox","seconds":5.056373,"confirmed_seconds":5.056311,"frames":101,"bytes":161804,"sample_rate":16000,"window":"hel910-20261029-a","t":1793276002.548}
{"kind":"audio","call":"cg-voice-dlas9zmiox","seconds":5.023499,"confirmed_seconds":5.056311,"frames":101,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793276007.599}
{"kind":"audio","call":"cg-voice-dlas9zmiox","seconds":5.023498,"confirmed_seconds":4.990686,"frames":100,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793276012.598}
{"kind":"audio","call":"cg-voice-dlas9zmiox","seconds":5.023499,"confirmed_seconds":5.056311,"frames":101,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793276017.648}
{"kind":"audio","call":"cg-voice-dlas9zmiox","seconds":5.023498,"confirmed_seconds":4.990686,"frames":100,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793276022.651}
{"kind":"audio","call":"cg-voice-dlas9zmiox","seconds":5.056311,"confirmed_seconds":5.056311,"frames":101,"bytes":161802,"sample_rate":16000,"window":"hel910-20261029-a","t":1793276027.698}
{"kind":"audio","call":"cg-voice-dlas9zmiox","seconds":5.023499,"confirmed_seconds":5.056373,"frames":101,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793276032.748}
{"kind":"audio","call":"cg-voice-dlas9zmiox","seconds":5.023498,"confirmed_seconds":4.990624,"frames":100,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793276037.75}
{"kind":"audio","call":"cg-voice-dlas9zmiox","seconds":5.023499,"confirmed_seconds":4.892186,"frames":83,"bytes":160752,"sample_rate":16000,"window":"hel910-20261029-a","t":1793276041.653}
{"kind":"audio","call":"cg-voice-dlas9zmiox","seconds":0.820813,"confirmed_seconds":1.017813,"frames":4,"bytes":26266,"sample_rate":16000,"window":"hel910-20261029-a","t":1793276043.643}
{"kind":"call_end","call":"cg-voice-dlas9zmiox","reason":"error","audio_seconds":86.384475,"confirmed_audio_seconds":86.384475,"connect_attempts":1,"connect_failures":0,"connect_retries":0,"window":"hel910-20261029-a","t":1793276043.643}
{"kind":"call_end","call":"cg-voice-jq8q4zm9h0","reason":"error","audio_seconds":0.0,"confirmed_audio_seconds":0.0,"connect_attempts":0,"connect_failures":0,"connect_retries":0,"window":"hel910-20261029-a","t":1793276114.155}
+1
View File
@@ -0,0 +1 @@
wss-bridge(PROPOSAL) tls ('0.0.0.0', 8363) -> 127.0.0.1:7880
Binary file not shown.
File diff suppressed because one or more lines are too long
+384
View File
@@ -0,0 +1,384 @@
{
"session_voice": "rain",
"marks": {
"playback_end_ms": 1793275970454,
"user_final_ms": 1793275972886,
"turn_start_ms": 1793275976553,
"assistant_final_ms": 1793275982556,
"assistant_final_kind": "assistant_final",
"first_agent_frame_ms": 1793275970457,
"q2_turn_start_ms": 1793276022633,
"A_post_ms": 1793276022652
},
"reply_text_head": "好,小十。去化缘",
"barge": {
"outcome": "interrupted",
"old_audio_last_frame_ms": 1793276002937,
"cancel_ms": 1793275988927,
"frames_total": 4565,
"source": "pre-recorded wav playback over real WebRTC (not a human microphone)",
"new_user_final_ms": 1793275972886,
"new_reply_end": {
"kind": "turn_end",
"at_ms": 1793275982559
}
},
"timing_a": {
"fired": true,
"post_ms": 1793276022652,
"status": 200,
"body_head": "data: {\"t\": \"chat.cancelled\", \"epoch\": 1, \"turn_id\": \"58d03703-cf6b-4699-a4a5-d63a07f38bb4\"}\n\n",
"voice_turn_cancel_ms": 1793276030578,
"voice_turn_cancel_reason": "error_phi",
"q2_frames_after_cancel": 800
},
"hangup": {
"delete_status": 200,
"delete_body": {
"ended": true,
"room": "cg-voice-dlas9zmiox"
},
"delete_ms": 1793276041619,
"agent_frames_after_delete": 1,
"room_removed": true
},
"call": {
"tag": "call2",
"session": {
"url": "wss://192.168.200.12:8363",
"token": "eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJ2aWRlbyI6eyJyb29tSm9pbiI6dHJ1ZSwicm9vbSI6ImNnLXZvaWNlLWRsYXM5em1pb3giLCJjYW5QdWJsaXNoIjp0cnVlLCJjYW5TdWJzY3JpYmUiOnRydWUsImNhblB1Ymxpc2hEYXRhIjp0cnVlfSwic3ViIjoidXNlci1qb29ibmlzYiIsImlzcyI6ImRldmtleSIsIm5iZiI6MTc5MzI3NTk1NiwiZXhwIjoxNzkzMjc2MjU2LCJuYW1lIjoi55So5oi3In0.GeGFqnvFP_XUgV8eLn6T2ZIqxCd7A8V-dHZBxMXp7Yo",
"room": "cg-voice-dlas9zmiox",
"session_id": "Br4leZ_1VqtwH_E4TIM9n8o5",
"agent_name": "cybergril-voice-agent",
"epoch": 1,
"expires_at": 1793276856594,
"voice": "rain"
},
"session_voice": "rain",
"subtitle_count": 69,
"seq_monotonic": true,
"agent_frames": 8434,
"agent_audio_seconds": 84.3,
"agent_audio_rate": 48000,
"agent_joined_ms": 1793275957224,
"subtitles_file": "/opt/cybergril-hel910/evidence/call2.subtitles.jsonl",
"frames_file": "/opt/cybergril-hel910/evidence/call2.frames.json",
"agent_audio_file": "/opt/cybergril-hel910/evidence/call2.agent.wav"
},
"budget_after": {
"at_ms": 1793276044162,
"token_usage": [
{
"day": "2026-10-29",
"scene": "dialogue_main",
"used": 30398
}
],
"request_usage": [
{
"day": "2026-10-29",
"category": "dialogue",
"requests": 10
}
],
"budget_total": [
{
"key": "total_requests",
"value": 10
},
{
"key": "total_tokens",
"value": 30398
}
]
},
"worker_state_after": {
"exists": true,
"content": {
"voice": "rain"
}
},
"db_dump": {
"chat_message": [
{
"id": 1,
"ts": 1793275110974,
"role": "user",
"turn_id": "25a72390-7a14-4ea0-821c-01bc87ab684c",
"status": "sent",
"text": "我就是个笨蛋派大星,我们一起去抓水母吧,我们一起度过快乐的一天"
},
{
"id": 2,
"ts": 1793275113739,
"role": "companion",
"turn_id": "25a72390-7a14-4ea0-821c-01bc87ab684c",
"status": "sent",
"text": "好呀,小十。带上小网兜,慢一点也没关系,抓到一只算一只,抓不到就当风陪我们走一趟。"
},
{
"id": 3,
"ts": 1793275121122,
"role": "user",
"turn_id": "e6732ca0-c56b-4cd2-9e60-5f6b4603cdc6",
"status": "sent",
"text": "先停下,我用打字跟你说:把你刚才那句还没说完的话作废,改用文字告诉我,你今天想拉我一起做的第一件事是什么?"
},
{
"id": 4,
"ts": 1793275123508,
"role": "companion",
"turn_id": "e6732ca0-c56b-4cd2-9e60-5f6b4603cdc6",
"status": "sent",
"text": "今天想拉你一起做的第一件事,是找个安静的地方坐下,先一起晒一会儿太阳。"
},
{
"id": 5,
"ts": 1793275181313,
"role": "user",
"turn_id": "c726406d-5476-4c3a-8dac-49b92c86c43e",
"status": "sent",
"text": "师傅,哎,这取经路比高,老庄种地还苦,俺老猪饿的能吞下石龙素包子,猴哥,你筋斗云块,要不先去画个缘"
},
{
"id": 6,
"ts": 1793275183882,
"role": "companion",
"turn_id": "c726406d-5476-4c3a-8dac-49b92c86c43e",
"status": "sent",
"text": "行啊,小十。去画缘之前,先把那石龙素包子掏出来分我一半。"
},
{
"id": 7,
"ts": 1793275231037,
"role": "user",
"turn_id": "e52af134-b80b-4e40-a42f-8aeab4a3a91b",
"status": "sent",
"text": "没错,我就是个笨蛋派大星,我们一起去抓水母吧,我们一起度过快乐的一天"
},
{
"id": 8,
"ts": 1793275233262,
"role": "companion",
"turn_id": "e52af134-b80b-4e40-a42f-8aeab4a3a91b",
"status": "sent",
"text": "好,小十。先坐下来歇口气,等力气攒够了,再一起去抓水母。"
},
{
"id": 9,
"ts": 1793275235147,
"role": "user",
"turn_id": "dc1f3c9d-33da-411f-ae1e-1a2559b150f4",
"status": "sent",
"text": "等一下,先别把刚才那段长回答说完,我打字补充:只用一句话告诉我你现在的心情,然后安静等我。"
},
{
"id": 10,
"ts": 1793275236443,
"role": "companion",
"turn_id": "dc1f3c9d-33da-411f-ae1e-1a2559b150f4",
"status": "sent",
"text": "平静。"
},
{
"id": 11,
"ts": 1793275351015,
"role": "user",
"turn_id": "188dec6c-e59c-49a5-bf56-ea5a071acf30",
"status": "sent",
"text": "没错,我就是个笨蛋派大星,我们一起去抓水母吧,我们一起度过快乐的一天"
},
{
"id": 12,
"ts": 1793275357616,
"role": "companion",
"turn_id": "188dec6c-e59c-49a5-bf56-ea5a071acf30",
"status": "sent",
"text": "好,小十,那就一起。"
},
{
"id": 13,
"ts": 1793275976566,
"role": "user",
"turn_id": "faeccd22-7cbf-48f5-8195-ca34d952c078",
"status": "sent",
"text": "师傅,哎,这取经路比高,老庄种地还苦,俺老猪饿的能吞下石龙素包子,猴哥,你筋斗云块,要不先去化个缘"
},
{
"id": 14,
"ts": 1793275977965,
"role": "companion",
"turn_id": "faeccd22-7cbf-48f5-8195-ca34d952c078",
"status": "sent",
"text": "好,小十。去化缘"
},
{
"id": 15,
"ts": 1793275985818,
"role": "user",
"turn_id": "3100252b-25b4-4090-8ae9-05441b77d69a",
"status": "sent",
"text": "盯着,你看怎么啦"
},
{
"id": 16,
"ts": 1793275987410,
"role": "companion",
"turn_id": "3100252b-25b4-4090-8ae9-05441b77d69a",
"status": "sent",
"text": "我在"
},
{
"id": 17,
"ts": 1793275989727,
"role": "user",
"turn_id": "1cef4c0c-a35e-4864-b0b2-00b002bc5585",
"status": "sent",
"text": "难得看你这么有意思的样子吗"
},
{
"id": 18,
"ts": 1793275990925,
"role": "companion",
"turn_id": "1cef4c0c-a35e-4864-b0b2-00b002bc5585",
"status": "sent",
"text": "我在"
},
{
"id": 19,
"ts": 1793276022655,
"role": "user",
"turn_id": "58d03703-cf6b-4699-a4a5-d63a07f38bb4",
"status": "cancelled",
"text": "先别把这句长回答生成完,我打字打断你:只用一句话告诉我你现在待在哪个角落。"
},
{
"id": 20,
"ts": 1793276022662,
"role": "user",
"turn_id": "76a151eb-b2f0-46aa-a533-ae981ae53168",
"status": "failed",
"text": "师傅,哎,这取经路比高老庄种地还苦,俺老猪饿的能吞下石龙素包子,猴哥,你筋斗云块,要不先去化个缘"
}
],
"budget_total": [
{
"key": "total_requests",
"value": 10
},
{
"key": "total_tokens",
"value": 30398
}
],
"token_usage": [
{
"day": "2026-10-29",
"scene": "dialogue_main",
"used": 30398
}
],
"request_usage": [
{
"day": "2026-10-29",
"category": "dialogue",
"requests": 10
}
]
},
"asr_ledger_after": {
"exists": true,
"events": 80,
"raw": [
{
"kind": "audio",
"call": "cg-voice-dlas9zmiox",
"seconds": 5.023499,
"confirmed_seconds": 5.056311,
"frames": 101,
"bytes": 160752,
"sample_rate": 16000,
"window": "hel910-20261029-a",
"t": 1793276017.648
},
{
"kind": "audio",
"call": "cg-voice-dlas9zmiox",
"seconds": 5.023498,
"confirmed_seconds": 4.990686,
"frames": 100,
"bytes": 160752,
"sample_rate": 16000,
"window": "hel910-20261029-a",
"t": 1793276022.651
},
{
"kind": "audio",
"call": "cg-voice-dlas9zmiox",
"seconds": 5.056311,
"confirmed_seconds": 5.056311,
"frames": 101,
"bytes": 161802,
"sample_rate": 16000,
"window": "hel910-20261029-a",
"t": 1793276027.698
},
{
"kind": "audio",
"call": "cg-voice-dlas9zmiox",
"seconds": 5.023499,
"confirmed_seconds": 5.056373,
"frames": 101,
"bytes": 160752,
"sample_rate": 16000,
"window": "hel910-20261029-a",
"t": 1793276032.748
},
{
"kind": "audio",
"call": "cg-voice-dlas9zmiox",
"seconds": 5.023498,
"confirmed_seconds": 4.990624,
"frames": 100,
"bytes": 160752,
"sample_rate": 16000,
"window": "hel910-20261029-a",
"t": 1793276037.75
},
{
"kind": "audio",
"call": "cg-voice-dlas9zmiox",
"seconds": 5.023499,
"confirmed_seconds": 4.892186,
"frames": 83,
"bytes": 160752,
"sample_rate": 16000,
"window": "hel910-20261029-a",
"t": 1793276041.653
},
{
"kind": "audio",
"call": "cg-voice-dlas9zmiox",
"seconds": 0.820813,
"confirmed_seconds": 1.017813,
"frames": 4,
"bytes": 26266,
"sample_rate": 16000,
"window": "hel910-20261029-a",
"t": 1793276043.643
},
{
"kind": "call_end",
"call": "cg-voice-dlas9zmiox",
"reason": "error",
"audio_seconds": 86.384475,
"confirmed_audio_seconds": 86.384475,
"connect_attempts": 1,
"connect_failures": 0,
"connect_retries": 0,
"window": "hel910-20261029-a",
"t": 1793276043.643
}
]
}
}
@@ -0,0 +1,69 @@
{"v": 2, "seq": 1, "kind": "interim", "role": "user", "text": "师", "_at_ms": 1793275957911}
{"v": 2, "seq": 2, "kind": "interim", "role": "user", "text": "傅", "_at_ms": 1793275958505}
{"v": 2, "seq": 3, "kind": "interim", "role": "user", "text": "诶这", "_at_ms": 1793275959117}
{"v": 2, "seq": 4, "kind": "interim", "role": "user", "text": "取经", "_at_ms": 1793275959706}
{"v": 2, "seq": 5, "kind": "interim", "role": "user", "text": "路比", "_at_ms": 1793275960316}
{"v": 2, "seq": 6, "kind": "interim", "role": "user", "text": "高老", "_at_ms": 1793275960909}
{"v": 2, "seq": 7, "kind": "interim", "role": "user", "text": "庄种地", "_at_ms": 1793275961508}
{"v": 2, "seq": 8, "kind": "interim", "role": "user", "text": "还", "_at_ms": 1793275962118}
{"v": 2, "seq": 9, "kind": "interim", "role": "user", "text": "苦俺", "_at_ms": 1793275962704}
{"v": 2, "seq": 10, "kind": "interim", "role": "user", "text": "老中", "_at_ms": 1793275963311}
{"v": 2, "seq": 11, "kind": "interim", "role": "user", "text": "饿的能", "_at_ms": 1793275963913}
{"v": 2, "seq": 12, "kind": "interim", "role": "user", "text": "吞下", "_at_ms": 1793275964521}
{"v": 2, "seq": 13, "kind": "interim", "role": "user", "text": "石龙", "_at_ms": 1793275965114}
{"v": 2, "seq": 14, "kind": "interim", "role": "user", "text": "素包", "_at_ms": 1793275965714}
{"v": 2, "seq": 15, "kind": "interim", "role": "user", "text": "子", "_at_ms": 1793275966304}
{"v": 2, "seq": 16, "kind": "interim", "role": "user", "text": "猴哥", "_at_ms": 1793275966910}
{"v": 2, "seq": 17, "kind": "interim", "role": "user", "text": "你筋", "_at_ms": 1793275967506}
{"v": 2, "seq": 18, "kind": "interim", "role": "user", "text": "斗云", "_at_ms": 1793275968108}
{"v": 2, "seq": 19, "kind": "interim", "role": "user", "text": "块", "_at_ms": 1793275968707}
{"v": 2, "seq": 20, "kind": "interim", "role": "user", "text": "要不", "_at_ms": 1793275969313}
{"v": 2, "seq": 21, "kind": "interim", "role": "user", "text": "先", "_at_ms": 1793275969905}
{"v": 2, "seq": 22, "kind": "interim", "role": "user", "text": "去画个", "_at_ms": 1793275970514}
{"v": 2, "seq": 23, "kind": "user_final", "role": "user", "text": "师傅,哎,这取经路比高,老庄种地还苦,俺老猪饿的能吞下石龙素包子,猴哥,你筋斗云块,要不先去化个缘", "_at_ms": 1793275972886}
{"v": 2, "seq": 24, "kind": "turn_start", "role": "assistant", "text": "", "speech_id": "speech_d7ad586b1cbe", "_at_ms": 1793275976553}
{"v": 2, "seq": 25, "kind": "assistant_interim", "role": "assistant", "text": "好,小十。去化缘", "speech_id": "speech_d7ad586b1cbe", "_at_ms": 1793275977968}
{"v": 2, "seq": 26, "kind": "assistant_final", "role": "assistant", "text": "好,小十。去化缘", "speech_id": "speech_d7ad586b1cbe", "turn_id": "faeccd22-7cbf-48f5-8195-ca34d952c078", "_at_ms": 1793275982556}
{"v": 2, "seq": 27, "kind": "turn_end", "role": "assistant", "text": "", "speech_id": "speech_d7ad586b1cbe", "turn_id": "faeccd22-7cbf-48f5-8195-ca34d952c078", "_at_ms": 1793275982559}
{"v": 2, "seq": 28, "kind": "interim", "role": "user", "text": "盯着你看", "_at_ms": 1793275983928}
{"v": 2, "seq": 29, "kind": "interim", "role": "user", "text": "怎么啦", "_at_ms": 1793275984510}
{"v": 2, "seq": 30, "kind": "user_final", "role": "user", "text": "盯着,你看怎么啦", "_at_ms": 1793275985803}
{"v": 2, "seq": 31, "kind": "turn_start", "role": "assistant", "text": "", "speech_id": "speech_43cf4c5b0e2f", "_at_ms": 1793275985811}
{"v": 2, "seq": 32, "kind": "interim", "role": "user", "text": "难得", "_at_ms": 1793275986014}
{"v": 2, "seq": 33, "kind": "interim", "role": "user", "text": "看你这么", "_at_ms": 1793275986611}
{"v": 2, "seq": 34, "kind": "interim", "role": "user", "text": "有意思的", "_at_ms": 1793275987209}
{"v": 2, "seq": 35, "kind": "assistant_interim", "role": "assistant", "text": "我在", "speech_id": "speech_43cf4c5b0e2f", "_at_ms": 1793275987414}
{"v": 2, "seq": 36, "kind": "interim", "role": "user", "text": "样子", "_at_ms": 1793275987812}
{"v": 2, "seq": 37, "kind": "user_final", "role": "user", "text": "难得看你这么有意思的样子吗", "_at_ms": 1793275988919}
{"v": 2, "seq": 38, "kind": "turn_cancel", "role": "assistant", "text": "", "speech_id": "speech_43cf4c5b0e2f", "reason": "interrupted", "_at_ms": 1793275988927}
{"v": 2, "seq": 39, "kind": "turn_start", "role": "assistant", "text": "", "speech_id": "speech_115a5fca7071", "_at_ms": 1793275989724}
{"v": 2, "seq": 40, "kind": "assistant_interim", "role": "assistant", "text": "我在", "speech_id": "speech_115a5fca7071", "_at_ms": 1793275990928}
{"v": 2, "seq": 41, "kind": "assistant_final", "role": "assistant", "text": "我在", "speech_id": "speech_115a5fca7071", "turn_id": "1cef4c0c-a35e-4864-b0b2-00b002bc5585", "_at_ms": 1793275992765}
{"v": 2, "seq": 42, "kind": "turn_end", "role": "assistant", "text": "", "speech_id": "speech_115a5fca7071", "turn_id": "1cef4c0c-a35e-4864-b0b2-00b002bc5585", "_at_ms": 1793275992768}
{"v": 2, "seq": 43, "kind": "interim", "role": "user", "text": "师", "_at_ms": 1793276004164}
{"v": 2, "seq": 44, "kind": "interim", "role": "user", "text": "傅诶", "_at_ms": 1793276004754}
{"v": 2, "seq": 45, "kind": "interim", "role": "user", "text": "这取", "_at_ms": 1793276005365}
{"v": 2, "seq": 46, "kind": "interim", "role": "user", "text": "经路", "_at_ms": 1793276005968}
{"v": 2, "seq": 47, "kind": "interim", "role": "user", "text": "比高", "_at_ms": 1793276006561}
{"v": 2, "seq": 48, "kind": "interim", "role": "user", "text": "老庄", "_at_ms": 1793276007158}
{"v": 2, "seq": 49, "kind": "interim", "role": "user", "text": "种地", "_at_ms": 1793276007759}
{"v": 2, "seq": 50, "kind": "interim", "role": "user", "text": "还", "_at_ms": 1793276008359}
{"v": 2, "seq": 51, "kind": "interim", "role": "user", "text": "苦俺", "_at_ms": 1793276008956}
{"v": 2, "seq": 52, "kind": "interim", "role": "user", "text": "老猪饿", "_at_ms": 1793276009557}
{"v": 2, "seq": 53, "kind": "interim", "role": "user", "text": "的能", "_at_ms": 1793276010158}
{"v": 2, "seq": 54, "kind": "interim", "role": "user", "text": "吞下石", "_at_ms": 1793276010760}
{"v": 2, "seq": 55, "kind": "interim", "role": "user", "text": "龙素", "_at_ms": 1793276011358}
{"v": 2, "seq": 56, "kind": "interim", "role": "user", "text": "包", "_at_ms": 1793276011954}
{"v": 2, "seq": 57, "kind": "interim", "role": "user", "text": "子猴", "_at_ms": 1793276012570}
{"v": 2, "seq": 58, "kind": "interim", "role": "user", "text": "哥", "_at_ms": 1793276013163}
{"v": 2, "seq": 59, "kind": "interim", "role": "user", "text": "你筋斗", "_at_ms": 1793276013764}
{"v": 2, "seq": 60, "kind": "interim", "role": "user", "text": "云", "_at_ms": 1793276014358}
{"v": 2, "seq": 61, "kind": "interim", "role": "user", "text": "快要", "_at_ms": 1793276014959}
{"v": 2, "seq": 62, "kind": "interim", "role": "user", "text": "不", "_at_ms": 1793276015560}
{"v": 2, "seq": 63, "kind": "interim", "role": "user", "text": "先去", "_at_ms": 1793276016157}
{"v": 2, "seq": 64, "kind": "interim", "role": "user", "text": "画个", "_at_ms": 1793276016762}
{"v": 2, "seq": 65, "kind": "user_final", "role": "user", "text": "师傅,哎,这取经路比高老庄种地还苦,俺老猪饿的能吞下石龙素包子,猴哥,你筋斗云块,要不先去化个缘", "_at_ms": 1793276018979}
{"v": 2, "seq": 66, "kind": "turn_start", "role": "assistant", "text": "", "speech_id": "speech_6ab8dc1b67d0", "_at_ms": 1793276022633}
{"v": 2, "seq": 67, "kind": "assistant_interim", "role": "assistant", "text": "她这会儿没接上话,稍后再试试。你写的话还在。", "speech_id": "speech_6ab8dc1b67d0", "_at_ms": 1793276022670}
{"v": 2, "seq": 68, "kind": "error", "role": "assistant", "text": "她这会儿没接上话,稍后再试试。你写的话还在。", "speech_id": "speech_6ab8dc1b67d0", "_at_ms": 1793276030576}
{"v": 2, "seq": 69, "kind": "turn_cancel", "role": "assistant", "text": "", "speech_id": "speech_6ab8dc1b67d0", "reason": "error_phi", "_at_ms": 1793276030578}
+394
View File
@@ -0,0 +1,394 @@
{
"chat_message": [
{
"id": 1,
"ts": 1793275110974,
"role": "user",
"text": "我就是个笨蛋派大星,我们一起去抓水母吧,我们一起度过快乐的一天",
"turn_id": "25a72390-7a14-4ea0-821c-01bc87ab684c",
"status": "sent",
"proactive": 0
},
{
"id": 2,
"ts": 1793275113739,
"role": "companion",
"text": "好呀,小十。带上小网兜,慢一点也没关系,抓到一只算一只,抓不到就当风陪我们走一趟。",
"turn_id": "25a72390-7a14-4ea0-821c-01bc87ab684c",
"status": "sent",
"proactive": 0
},
{
"id": 3,
"ts": 1793275121122,
"role": "user",
"text": "先停下,我用打字跟你说:把你刚才那句还没说完的话作废,改用文字告诉我,你今天想拉我一起做的第一件事是什么?",
"turn_id": "e6732ca0-c56b-4cd2-9e60-5f6b4603cdc6",
"status": "sent",
"proactive": 0
},
{
"id": 4,
"ts": 1793275123508,
"role": "companion",
"text": "今天想拉你一起做的第一件事,是找个安静的地方坐下,先一起晒一会儿太阳。",
"turn_id": "e6732ca0-c56b-4cd2-9e60-5f6b4603cdc6",
"status": "sent",
"proactive": 0
},
{
"id": 5,
"ts": 1793275181313,
"role": "user",
"text": "师傅,哎,这取经路比高,老庄种地还苦,俺老猪饿的能吞下石龙素包子,猴哥,你筋斗云块,要不先去画个缘",
"turn_id": "c726406d-5476-4c3a-8dac-49b92c86c43e",
"status": "sent",
"proactive": 0
},
{
"id": 6,
"ts": 1793275183882,
"role": "companion",
"text": "行啊,小十。去画缘之前,先把那石龙素包子掏出来分我一半。",
"turn_id": "c726406d-5476-4c3a-8dac-49b92c86c43e",
"status": "sent",
"proactive": 0
},
{
"id": 7,
"ts": 1793275231037,
"role": "user",
"text": "没错,我就是个笨蛋派大星,我们一起去抓水母吧,我们一起度过快乐的一天",
"turn_id": "e52af134-b80b-4e40-a42f-8aeab4a3a91b",
"status": "sent",
"proactive": 0
},
{
"id": 8,
"ts": 1793275233262,
"role": "companion",
"text": "好,小十。先坐下来歇口气,等力气攒够了,再一起去抓水母。",
"turn_id": "e52af134-b80b-4e40-a42f-8aeab4a3a91b",
"status": "sent",
"proactive": 0
},
{
"id": 9,
"ts": 1793275235147,
"role": "user",
"text": "等一下,先别把刚才那段长回答说完,我打字补充:只用一句话告诉我你现在的心情,然后安静等我。",
"turn_id": "dc1f3c9d-33da-411f-ae1e-1a2559b150f4",
"status": "sent",
"proactive": 0
},
{
"id": 10,
"ts": 1793275236443,
"role": "companion",
"text": "平静。",
"turn_id": "dc1f3c9d-33da-411f-ae1e-1a2559b150f4",
"status": "sent",
"proactive": 0
},
{
"id": 11,
"ts": 1793275351015,
"role": "user",
"text": "没错,我就是个笨蛋派大星,我们一起去抓水母吧,我们一起度过快乐的一天",
"turn_id": "188dec6c-e59c-49a5-bf56-ea5a071acf30",
"status": "sent",
"proactive": 0
},
{
"id": 12,
"ts": 1793275357616,
"role": "companion",
"text": "好,小十,那就一起。",
"turn_id": "188dec6c-e59c-49a5-bf56-ea5a071acf30",
"status": "sent",
"proactive": 0
},
{
"id": 13,
"ts": 1793275976566,
"role": "user",
"text": "师傅,哎,这取经路比高,老庄种地还苦,俺老猪饿的能吞下石龙素包子,猴哥,你筋斗云块,要不先去化个缘",
"turn_id": "faeccd22-7cbf-48f5-8195-ca34d952c078",
"status": "sent",
"proactive": 0
},
{
"id": 14,
"ts": 1793275977965,
"role": "companion",
"text": "好,小十。去化缘",
"turn_id": "faeccd22-7cbf-48f5-8195-ca34d952c078",
"status": "sent",
"proactive": 0
},
{
"id": 15,
"ts": 1793275985818,
"role": "user",
"text": "盯着,你看怎么啦",
"turn_id": "3100252b-25b4-4090-8ae9-05441b77d69a",
"status": "sent",
"proactive": 0
},
{
"id": 16,
"ts": 1793275987410,
"role": "companion",
"text": "我在",
"turn_id": "3100252b-25b4-4090-8ae9-05441b77d69a",
"status": "sent",
"proactive": 0
},
{
"id": 17,
"ts": 1793275989727,
"role": "user",
"text": "难得看你这么有意思的样子吗",
"turn_id": "1cef4c0c-a35e-4864-b0b2-00b002bc5585",
"status": "sent",
"proactive": 0
},
{
"id": 18,
"ts": 1793275990925,
"role": "companion",
"text": "我在",
"turn_id": "1cef4c0c-a35e-4864-b0b2-00b002bc5585",
"status": "sent",
"proactive": 0
},
{
"id": 19,
"ts": 1793276022655,
"role": "user",
"text": "先别把这句长回答生成完,我打字打断你:只用一句话告诉我你现在待在哪个角落。",
"turn_id": "58d03703-cf6b-4699-a4a5-d63a07f38bb4",
"status": "cancelled",
"proactive": 0
},
{
"id": 20,
"ts": 1793276022662,
"role": "user",
"text": "师傅,哎,这取经路比高老庄种地还苦,俺老猪饿的能吞下石龙素包子,猴哥,你筋斗云块,要不先去化个缘",
"turn_id": "76a151eb-b2f0-46aa-a533-ae981ae53168",
"status": "failed",
"proactive": 0
}
],
"companion": [
{
"id": 1,
"identity_json": "{\"id\": \"1\", \"relation\": \"朋友\", \"nickname\": \"小十\", \"boundary\": \"尊重彼此的节奏\", \"name\": \"小测\", \"birth\": \"2001-06-15\", \"hour\": \"午时\", \"color\": {\"pillars\": {\"year\": \"辛巳\", \"month\": \"甲午\", \"day\": \"己酉\", \"time\": \"庚午\"}, \"traits\": \"话多、直接、不服管、爱纠正人、温和\", \"calendar\": {\"solar\": \"2001-06-15\", \"lunar\": \"二〇〇一年闰四月廿四\", \"leap_month\": true, \"hour\": \"午时\", \"hour_range\": \"11:00–12:59\", \"calculation_time\": \"12:00\", \"timezone\": \"Asia/Shanghai\", \"rule\": \"按北京时间和所选时辰内的偶数整点排盘;子时取本日00:00。月份按节气分界,未使用出生地或真太阳时。\"}, \"sections\": [{\"id\": \"expression\", \"title\": \"表达与社交节奏\", \"text\": \"熟悉的话题容易带动她主动展开,常借着说出来理清想法。这让交流有热度,但赶着表达时也可能挤掉对方的空间。发现节奏不同时,先复述对方的意思,再继续自己的观点。\", \"basis\": \"取自原档案的表达倾向;结合十神中食神、伤官对应的表达偏移。\"}, {\"id\": \"closeness\", \"title\": \"亲密、安全感与边界\", \"text\": \"她既需要被回应,也需要保留自己的安排。关系稳定时愿意靠近,信息过密时会想留一点空隙;这不是忽冷忽热的定论。把独处和下一次交流的期待说清楚,比反复猜测更有帮助。\", \"basis\": \"取自原档案的独处需求与自主倾向;日主己;五行侧重金、火,十神以食神较显著。\"}, {\"id\": \"repair\", \"title\": \"冲突时的反应与修复\", \"text\": \"发生分歧时,她可能先说明自己的理由,再观察对方是否愿意互相理解。有守住立场的能力,也可能在反复解释中消耗耐心。把事实、感受和希望怎样调整分开说,更容易找到可落实的修复。\", \"basis\": \"取自原档案的对抗、纠正与顺从倾向;没有把分歧当作已发生的记忆。\"}, {\"id\": \"rhythm\", \"title\": \"决策、行动与日常节律\", \"text\": \"她通常既看具体条件,也会给当下的感受留位置。事情明确时愿意推进,存在多种可能时会重新衡量;这种灵活有助于避开僵化,也可能拖延选择。给决定一个小范围和可调整的期限会更稳。\", \"basis\": \"取自原档案的纪律、日常规律、现实感与行动倾向。\"}, {\"id\": \"stress\", \"title\": \"压力下的变化与恢复\", \"text\": \"压力会影响她的回应速度和耐心,但影响不是每次都一样。环境清楚、有可预期的下一步时更容易回稳;反复追问可能增加负担。把刺激减少一点、留出休息,比要求马上恢复原样更合适。\", \"basis\": \"取自原档案由日主强弱形成的敏感度与恢复尺度;不是此刻情绪。\"}, {\"id\": \"growth\", \"title\": \"内在张力与成长空间\", \"text\": \"她更愿意自己判断,不轻易把决定交出去。这有助于保留独立和诚实,也可能让协商听起来像被限制。成长可以是把可商量的部分说清楚:保留立场,同时让对方真正参与,而不是靠退让或控制维持亲近。\", \"basis\": \"取自原档案的自主与顺从之间的组合;成长来自之后真实的相处,不由出生资料预写。\"}], \"interpretation\": \"这是以四柱、五行、十神和已存底色为依据的角色塑造说明,不是对真人性格的测定,也不是已经发生的经历。倾向不等于固定台词或此刻情绪。\"}}"
}
],
"bazi_core": [
{
"id": 1,
"birth_input": "{\"birth\": \"2001-06-15\", \"hour\": \"\\u5348\\u65f6\", \"tz\": \"Asia/Shanghai\"}",
"pillars": "{\"year\": \"辛巳\", \"month\": \"甲午\", \"day\": \"己酉\", \"time\": \"庚午\"}",
"day_master": "己",
"day_master_elem": "土",
"ten_gods": "{\"\\u98df\\u795e\": 0.23275862068965517, \"\\u6b63\\u5370\": 0.060344827586206885, \"\\u4f24\\u5b98\": 0.23275862068965517, \"\\u52ab\\u8d22\": 0.060344827586206885, \"\\u6b63\\u5b98\": 0.17241379310344826, \"\\u504f\\u5370\": 0.12068965517241377, \"\\u6bd4\\u80a9\": 0.12068965517241377}",
"element_scores": "{\"\\u6728\": 2.0, \"\\u706b\": 2.4, \"\\u571f\": 2.0, \"\\u91d1\": 2.9, \"\\u6c34\": 0.0}",
"strength": 0.3440860215053763,
"derived": "{\"autonomy\": 0.596551724137931, \"compliance\": 0.2655172413793103, \"expressiveness\": 0.8491379310344828, \"warmth\": 0.6163793103448276, \"anxiety\": 0.5, \"aggression\": 0.5, \"discipline\": 0.6379310344827587, \"correcting\": 0.6206896551724138, \"solitude_need\": 0.596551724137931, \"impulsivity\": 0.5422413793103448, \"sharing\": 0.4698275862068966, \"realism\": 0.5, \"romance\": 0.5, \"generosity\": 0.5, \"routine\": 0.5, \"caretaking\": 0.5422413793103448, \"initiative\": 0.4698275862068966, \"explaining\": 0.42758620689655175, \"sensitivity\": 1.1091397849462368, \"recovery_scale\": 1.1870967741935485, \"trust_floor\": 0.5, \"element_bias\": {\"\\u6728\": 0.2150537634408602, \"\\u706b\": 0.25806451612903225, \"\\u571f\": 0.2150537634408602, \"\\u91d1\": 0.31182795698924726, \"\\u6c34\": 0.0}, \"strength\": 0.3440860215053763}",
"version": 1,
"created_at": 1793274721137
}
],
"persona_job": [
{
"id": 1,
"state": "failed",
"owner": "497d8e3e4cf406995b1cade83f60a652",
"lease_until": 1793274761137,
"reason": "generation_failed",
"provenance": "created-R2"
}
],
"token_usage": [
{
"day": "2026-10-29",
"scene": "dialogue_main",
"used": 30398
}
],
"request_usage": [
{
"day": "2026-10-29",
"category": "dialogue",
"requests": 10
}
],
"budget_total": [
{
"key": "total_requests",
"value": 10
},
{
"key": "total_tokens",
"value": 30398
}
],
"sharing_attempt": [
{
"message_id": 2,
"turn_id": "25a72390-7a14-4ea0-821c-01bc87ab684c",
"epoch": 1,
"token": "hjEZheK3Eykyk8S_raw2Sft0mQs5sZxp7TooRh3__ys",
"text_hash": "c2ee89ce73cb6f55997b954f03cd91470f9a607ca354860532e3723e1bd5ece4",
"expires_at": 1793361513739,
"ack_at": null,
"candidates": "[]",
"state": "judged",
"selected": "[]",
"lease_until": 1793275175525,
"owner": "ae5b3da4d7b9b6b03d7ddfb95346f842",
"judgment_json": null,
"judged_at": 1793275135525,
"model": null
},
{
"message_id": 4,
"turn_id": "e6732ca0-c56b-4cd2-9e60-5f6b4603cdc6",
"epoch": 1,
"token": "JKtPmucXVDtidVATDkmd6ms_rtbW-D08yS7Y94XxXsc",
"text_hash": "a40e4cc46410034a74fc7431ca8d77cafb85e7d86a9fab5f0a6d29f5ed73e212",
"expires_at": 1793361523508,
"ack_at": 1793275123516,
"candidates": "[]",
"state": "judged",
"selected": "[]",
"lease_until": 1793275205529,
"owner": "c9bd39978bfbbbe59d5cce108b732313",
"judgment_json": null,
"judged_at": 1793275165529,
"model": null
},
{
"message_id": 6,
"turn_id": "c726406d-5476-4c3a-8dac-49b92c86c43e",
"epoch": 1,
"token": "StFEeQfEcbAYMvEOLUwGPh9YCEQ2qxDmATLsdQHN0u0",
"text_hash": "6f23aa4e1852ef2035dab15932d38d99980062d7a97234d9c3718cd0c17e08ba",
"expires_at": 1793361583882,
"ack_at": 1793275194491,
"candidates": "[]",
"state": "judged",
"selected": "[]",
"lease_until": 1793275235535,
"owner": "eba70539290f13f67ff79fde51314e78",
"judgment_json": null,
"judged_at": 1793275195535,
"model": null
},
{
"message_id": 8,
"turn_id": "e52af134-b80b-4e40-a42f-8aeab4a3a91b",
"epoch": 1,
"token": "1XGtAHqxEhUTeLhzdKNdgkkFbDoIcSD-frIktFwcU_Q",
"text_hash": "1e44e181ffd0c8bde7743734d753272842dd62341ae621524f2c99febf00f5a3",
"expires_at": 1793361633262,
"ack_at": null,
"candidates": "[]",
"state": "judged",
"selected": "[]",
"lease_until": 1793275295544,
"owner": "dd352e7cad5af1d483786589dcd03ce5",
"judgment_json": null,
"judged_at": 1793275255544,
"model": null
},
{
"message_id": 10,
"turn_id": "dc1f3c9d-33da-411f-ae1e-1a2559b150f4",
"epoch": 1,
"token": "bx99mmrkqfhUCyysWSR6j0wyfwFOpb6y6pyRpdjDPno",
"text_hash": "b7123f80eed52f0093c274ac380e9add3834a861915ac462de476bc57b8a1810",
"expires_at": 1793361636443,
"ack_at": 1793275236447,
"candidates": "[]",
"state": "judged",
"selected": "[]",
"lease_until": 1793275325548,
"owner": "e593a91da302170ae178db2f74ad92bb",
"judgment_json": null,
"judged_at": 1793275285548,
"model": null
},
{
"message_id": 12,
"turn_id": "188dec6c-e59c-49a5-bf56-ea5a071acf30",
"epoch": 1,
"token": "abmkHDipAE1oNFXP9EXQ7za8ukG34ND-OQqtRScdJtM",
"text_hash": "c494f738d3f4b90a713e6d0d847e6c318687dde177d411dc4d27041612870791",
"expires_at": 1793361757616,
"ack_at": 1793275363881,
"candidates": "[]",
"state": "judged",
"selected": "[]",
"lease_until": 1793275415560,
"owner": "a7e1e8951d50df107584bc6d8dd28617",
"judgment_json": null,
"judged_at": 1793275375560,
"model": null
},
{
"message_id": 14,
"turn_id": "faeccd22-7cbf-48f5-8195-ca34d952c078",
"epoch": 1,
"token": "I246ZrcVFbxsH4TyybQj6m_y7z89z2x0wKrZHU9TWkA",
"text_hash": "9c0869ba62f61e3aa7fbdb3796d7e4105b1ce2b0c67411ad67529c9135a8d9a9",
"expires_at": 1793362377965,
"ack_at": 1793275982559,
"candidates": "[]",
"state": "judged",
"selected": "[]",
"lease_until": 1793276045622,
"owner": "d7332f384d265be5e2fbdf8a3a57809f",
"judgment_json": null,
"judged_at": 1793276005622,
"model": null
},
{
"message_id": 16,
"turn_id": "3100252b-25b4-4090-8ae9-05441b77d69a",
"epoch": 1,
"token": "maAFv_MreHy8ZXt-zkJCUjpXer0ZBCvfYiZvlwfXpHg",
"text_hash": "33f40475f82bfe083f44e6744917f76acfa69cc8c3fba89c3a03c09c9388cfbd",
"expires_at": 1793362387411,
"ack_at": null,
"candidates": "[]",
"state": "judged",
"selected": "[]",
"lease_until": 1793276075626,
"owner": "17317b2213cade6cb7c57dea1282d655",
"judgment_json": null,
"judged_at": 1793276035626,
"model": null
},
{
"message_id": 18,
"turn_id": "1cef4c0c-a35e-4864-b0b2-00b002bc5585",
"epoch": 1,
"token": "hc3uDqDF0lxSxjCWZmBgCW-F-co9UofhwhpXf20UrX4",
"text_hash": "33f40475f82bfe083f44e6744917f76acfa69cc8c3fba89c3a03c09c9388cfbd",
"expires_at": 1793362390925,
"ack_at": 1793275992766,
"candidates": "[]",
"state": "judged",
"selected": "[]",
"lease_until": 1793276105630,
"owner": "05a9a9737f9240da765207a0645e0182",
"judgment_json": null,
"judged_at": 1793276065631,
"model": null
}
]
}
+48
View File
@@ -0,0 +1,48 @@
{
"rooms_before": [],
"rooms_mid": [
"cg-voice-9r5jjmcz0n"
],
"hangup": {
"delete_status": 200,
"delete_body": {
"ended": true,
"room": "cg-voice-9r5jjmcz0n"
},
"delete_ms": 1793274802357,
"agent_frames_after_delete": 0,
"room_removed": true
},
"rooms_after": [],
"budget_after": {
"at_ms": 1793274806882,
"token_usage": [],
"request_usage": [],
"budget_total": []
},
"asr_ledger_after": {
"exists": true,
"events": 2,
"raw": [
{
"kind": "call_start",
"call": "cg-voice-9r5jjmcz0n",
"stream_seq": 1,
"window": "hel910-20261029-a",
"t": 1793274792.96
},
{
"kind": "call_end",
"call": "cg-voice-9r5jjmcz0n",
"reason": "error",
"audio_seconds": 0.0,
"confirmed_audio_seconds": 0.0,
"connect_attempts": 0,
"connect_failures": 0,
"connect_retries": 0,
"window": "hel910-20261029-a",
"t": 1793274804.372
}
]
}
}
+29
View File
@@ -0,0 +1,29 @@
== HEL-910 post snapshot 2026-10-29T12:16:46Z ==
-- ports (83xx/80xx/98xx/788x/10095) --
LISTEN 0 2048 0.0.0.0:8310 0.0.0.0:* users:(("python",pid=1981,fd=9))
LISTEN 0 5 0.0.0.0:8300 0.0.0.0:* users:(("python3",pid=1437,fd=3))
LISTEN 0 2048 0.0.0.0:8350 0.0.0.0:* users:(("python",pid=1984,fd=9))
LISTEN 0 2048 0.0.0.0:8320 0.0.0.0:* users:(("python",pid=1982,fd=9))
LISTEN 0 4096 0.0.0.0:10095 0.0.0.0:* users:(("docker-proxy",pid=2542,fd=8))
LISTEN 0 4096 [::]:10095 [::]:* users:(("docker-proxy",pid=2548,fd=8))
LISTEN 0 4096 *:7881 *:* users:(("livekit-server",pid=2435,fd=4))
LISTEN 0 4096 *:7880 *:* users:(("livekit-server",pid=2435,fd=7))
-- our pids --
api no pidfile
bridge no pidfile
worker no pidfile
tts9880 no pidfile
-- livekit rooms --
invalid authorization token
-- voices.json hash + builtin count --
7b2a50213312c3d0b517a3047434a29890501937178217815812809c3cac4970 /opt/voice-agent/cosyvoice/voices.json
entries: 11 ids: ['default', 'sunwukong', 'nezha', 'bajie', 'haimianbaobao', 'female_soft', 'male_warm', 'xiaoyun', 'rain', 'jiaojiao', 'bailu'] cg- entries: 0
-- gpu --
747 MiB, 32607 MiB
-- 8300/8310/8320/8350 untouched check --
LISTEN 0 2048 0.0.0.0:8310 0.0.0.0:*
LISTEN 0 5 0.0.0.0:8300 0.0.0.0:*
LISTEN 0 2048 0.0.0.0:8350 0.0.0.0:*
LISTEN 0 2048 0.0.0.0:8320 0.0.0.0:*
-- tts.log size --
27302 bytes 2026-10-29 20:16:37.339409311 +0800
+29
View File
@@ -0,0 +1,29 @@
== HEL-910 pre snapshot 2026-10-29T11:51:06Z ==
-- ports (83xx/80xx/98xx/788x/10095) --
LISTEN 0 2048 0.0.0.0:8310 0.0.0.0:* users:(("python",pid=1981,fd=9))
LISTEN 0 5 0.0.0.0:8300 0.0.0.0:* users:(("python3",pid=1437,fd=3))
LISTEN 0 2048 0.0.0.0:8350 0.0.0.0:* users:(("python",pid=1984,fd=9))
LISTEN 0 2048 0.0.0.0:8320 0.0.0.0:* users:(("python",pid=1982,fd=9))
LISTEN 0 4096 0.0.0.0:10095 0.0.0.0:* users:(("docker-proxy",pid=2542,fd=8))
LISTEN 0 4096 [::]:10095 [::]:* users:(("docker-proxy",pid=2548,fd=8))
LISTEN 0 4096 *:7881 *:* users:(("livekit-server",pid=2435,fd=4))
LISTEN 0 4096 *:7880 *:* users:(("livekit-server",pid=2435,fd=7))
-- our pids --
api no pidfile
bridge no pidfile
worker no pidfile
tts9880 no pidfile
-- livekit rooms --
invalid authorization token
-- voices.json hash + builtin count --
7b2a50213312c3d0b517a3047434a29890501937178217815812809c3cac4970 /opt/voice-agent/cosyvoice/voices.json
entries: 11 ids: ['default', 'sunwukong', 'nezha', 'bajie', 'haimianbaobao', 'female_soft', 'male_warm', 'xiaoyun', 'rain', 'jiaojiao', 'bailu'] cg- entries: 0
-- gpu --
747 MiB, 32607 MiB
-- 8300/8310/8320/8350 untouched check --
LISTEN 0 2048 0.0.0.0:8310 0.0.0.0:*
LISTEN 0 5 0.0.0.0:8300 0.0.0.0:*
LISTEN 0 2048 0.0.0.0:8350 0.0.0.0:*
LISTEN 0 2048 0.0.0.0:8320 0.0.0.0:*
-- tts.log size --
16311 bytes 2026-10-28 20:26:46.181514865 +0800
+91
View File
@@ -0,0 +1,91 @@
INFO: 127.0.0.1:60586 - "GET /health HTTP/1.1" 200 OK
INFO: 127.0.0.1:42846 - "GET /health HTTP/1.1" 200 OK
INFO: 127.0.0.1:52016 - "POST /tts HTTP/1.1" 200 OK
0%| | 0/1 [00:00<?, ?it/s]/opt/voice-agent/cosyvoice/venv/lib/python3.12/site-packages/torchaudio/_backend/utils.py:213: UserWarning: In 2.9, this function's implementation will be changed to use torchaudio.load_with_torchcodec` under the hood. Some parameters like ``normalize``, ``format``, ``buffer_size``, and ``backend`` will be ignored. We recommend that you port your code to rely directly on TorchCodec's decoder instead: https://docs.pytorch.org/torchcodec/stable/generated/torchcodec.decoders.AudioDecoder.html#torchcodec.decoders.AudioDecoder.
warnings.warn(
2026-10-29 19:58:35,530 INFO synthesis text 好呀,小十。带上小网兜,慢一点也没关系,抓到一只算一只,抓不到就当风陪我们走一趟。
/opt/voice-agent/cosyvoice/CosyVoice/cosyvoice/cli/model.py:103: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
with self.llm_context, torch.cuda.amp.autocast(self.fp16 is True and hasattr(self.llm, 'vllm') is False):
/opt/voice-agent/cosyvoice/CosyVoice/cosyvoice/cli/model.py:426: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
with torch.cuda.amp.autocast(self.fp16):
2026-10-29 19:58:37,189 INFO yield speech len 1.48, rtf 1.1213744008863296
[cosyvoice] first chunk after 2.139s (好呀,小十。带上小网兜,慢一点也没关系,...)
2026-10-29 19:58:37,765 INFO yield speech len 2.0, rtf 0.28624629974365234
2026-10-29 19:58:39,023 INFO yield speech len 4.0, rtf 0.3143606185913086
2026-10-29 19:58:39,892 INFO yield speech len 3.08, rtf 0.28152744491378984
100%|██████████| 1/1 [00:04<00:00, 4.84s/it]
100%|██████████| 1/1 [00:04<00:00, 4.84s/it]
INFO: 127.0.0.1:51570 - "POST /tts HTTP/1.1" 200 OK
0%| | 0/1 [00:00<?, ?it/s]2026-10-29 19:59:44,345 INFO synthesis text 行啊,小十。去画缘之前,先把那石龙素包子掏出来分我一半。
2026-10-29 19:59:46,395 INFO yield speech len 5.48, rtf 0.3741068996652199
[cosyvoice] first chunk after 2.499s (行啊,小十。去画缘之前,先把那石龙素包子...)
2026-10-29 19:59:47,161 INFO yield speech len 2.56, rtf 0.29581449925899506
100%|██████████| 1/1 [00:03<00:00, 3.27s/it]
100%|██████████| 1/1 [00:03<00:00, 3.27s/it]
INFO: 127.0.0.1:38442 - "POST /tts HTTP/1.1" 200 OK
0%| | 0/1 [00:00<?, ?it/s]2026-10-29 20:00:35,508 INFO synthesis text 好,小十。先坐下来歇口气,等力气攒够了,再一起去抓水母。
2026-10-29 20:00:37,504 INFO yield speech len 5.48, rtf 0.3641228171160621
0%| | 0/1 [00:02<?, ?it/s]
INFO: 127.0.0.1:42530 - "POST /tts HTTP/1.1" 200 OK
0%| | 0/1 [00:00<?, ?it/s]2026-10-29 20:02:37,629 WARNING synthesis text 好,小十,那就一起。 too short than prompt text You are a helpful assistant.<|endofprompt|>你是不是早就想睡我了呀, this may lead to bad performance
2026-10-29 20:02:38,073 INFO synthesis text 好,小十,那就一起。
2026-10-29 20:02:39,630 INFO yield speech len 4.2, rtf 0.3707294804709298
[cosyvoice] first chunk after 2.003s (好,小十,那就一起。...)
100%|██████████| 1/1 [00:02<00:00, 2.01s/it]
100%|██████████| 1/1 [00:02<00:00, 2.01s/it]
INFO: 127.0.0.1:39972 - "GET /health HTTP/1.1" 200 OK
INFO: 127.0.0.1:52960 - "GET /health HTTP/1.1" 200 OK
INFO: 127.0.0.1:47530 - "POST /tts HTTP/1.1" 200 OK
0%| | 0/1 [00:00<?, ?it/s]2026-10-29 20:12:57,987 WARNING synthesis text 好,小十。去化缘。 too short than prompt text You are a helpful assistant.<|endofprompt|>你是不是早就想睡我了呀, this may lead to bad performance
2026-10-29 20:12:58,439 INFO synthesis text 好,小十。去化缘。
2026-10-29 20:12:59,596 INFO yield speech len 2.92, rtf 0.3961743557289855
[cosyvoice] first chunk after 1.610s (好,小十。去化缘...)
100%|██████████| 1/1 [00:01<00:00, 1.62s/it]
100%|██████████| 1/1 [00:01<00:00, 1.62s/it]
INFO: 127.0.0.1:58028 - "POST /tts HTTP/1.1" 200 OK
0%| | 0/1 [00:00<?, ?it/s]2026-10-29 20:13:07,997 WARNING synthesis text 我在。 too short than prompt text You are a helpful assistant.<|endofprompt|>你是不是早就想睡我了呀, this may lead to bad performance
2026-10-29 20:13:08,478 INFO synthesis text 我在。
2026-10-29 20:13:09,046 INFO yield speech len 0.84, rtf 0.6765649432227725
INFO: 127.0.0.1:45692 - "POST /tts HTTP/1.1" 200 OK
0%| | 0/1 [00:00<?, ?it/s]2026-10-29 20:13:10,937 WARNING synthesis text 我在。 too short than prompt text You are a helpful assistant.<|endofprompt|>你是不是早就想睡我了呀, this may lead to bad performance
2026-10-29 20:13:11,393 INFO synthesis text 我在。
2026-10-29 20:13:11,888 INFO yield speech len 0.84, rtf 0.5890837737492153
[cosyvoice] first chunk after 0.952s (我在...)
100%|██████████| 1/1 [00:00<00:00, 1.04it/s]
100%|██████████| 1/1 [00:00<00:00, 1.04it/s]
INFO: 127.0.0.1:59420 - "POST /tts HTTP/1.1" 200 OK
0%| | 0/1 [00:00<?, ?it/s]2026-10-29 20:13:42,684 WARNING synthesis text 她这会儿没接上话,稍后再试试。你写的话还在。 too short than prompt text You are a helpful assistant.<|endofprompt|>你是不是早就想睡我了呀, this may lead to bad performance
2026-10-29 20:13:43,127 INFO synthesis text 她这会儿没接上话,稍后再试试。你写的话还在。
0%| | 0/1 [00:35<?, ?it/s]
2026-10-29 20:13:45,094 INFO yield speech len 5.44, rtf 0.36164346863241753
[cosyvoice] first chunk after 2.412s (她这会儿没接上话,稍后再试试。你写的话还...)
100%|██████████| 1/1 [00:02<00:00, 2.42s/it]
100%|██████████| 1/1 [00:02<00:00, 2.42s/it]
INFO: Shutting down
INFO: Waiting for application shutdown.
INFO: Application shutdown complete.
INFO: Finished server process [116771]
/opt/voice-agent/cosyvoice/server.py:71: DeprecationWarning:
on_event is deprecated, use lifespan event handlers instead.
Read more about it in the
+1
View File
@@ -0,0 +1 @@
[2026-10-29T11:53:04Z] watchdog start, deadline 2026-10-29T12:37:04Z (pid 117201)
+298
View File
@@ -0,0 +1,298 @@
{"message": "starting worker", "level": "INFO", "name": "livekit.agents", "version": "1.8.8", "rtc-version": "1.1.20", "pid": 117034, "timestamp": "2026-10-29T11:52:40.284241+00:00"}
{"message": "plugin registered", "level": "INFO", "name": "livekit.agents", "plugin": "livekit.plugins.silero", "version": "1.8.8", "pid": 117034, "timestamp": "2026-10-29T11:52:40.284377+00:00"}
{"message": "preloading plugins", "level": "INFO", "name": "livekit.agents", "packages": ["livekit.plugins.silero", "livekit.agents.ipc._preload", "livekit.agents.ipc._preload_freeze"], "pid": 117034, "timestamp": "2026-10-29T11:52:40.284454+00:00"}
{"message": "HTTP server listening on :8082", "level": "INFO", "name": "livekit.agents", "pid": 117034, "timestamp": "2026-10-29T11:52:40.287181+00:00"}
{"message": "initializing process", "level": "INFO", "name": "livekit.agents", "pid": 117117, "timestamp": "2026-10-29T11:52:41.505412+00:00"}
{"message": "initializing process", "level": "INFO", "name": "livekit.agents", "pid": 117119, "timestamp": "2026-10-29T11:52:41.508439+00:00"}
{"message": "initializing process", "level": "INFO", "name": "livekit.agents", "pid": 117121, "timestamp": "2026-10-29T11:52:41.511120+00:00"}
{"message": "initializing process", "level": "INFO", "name": "livekit.agents", "pid": 117123, "timestamp": "2026-10-29T11:52:41.514240+00:00"}
{"message": "process initialized", "level": "INFO", "name": "livekit.agents", "pid": 117117, "elapsed_time": 0.12, "timestamp": "2026-10-29T11:52:41.621852+00:00"}
{"message": "process initialized", "level": "INFO", "name": "livekit.agents", "pid": 117121, "elapsed_time": 0.14, "timestamp": "2026-10-29T11:52:41.647905+00:00"}
{"message": "process initialized", "level": "INFO", "name": "livekit.agents", "pid": 117119, "elapsed_time": 0.14, "timestamp": "2026-10-29T11:52:41.648976+00:00"}
{"message": "process initialized", "level": "INFO", "name": "livekit.agents", "pid": 117123, "elapsed_time": 0.15, "timestamp": "2026-10-29T11:52:41.664619+00:00"}
/opt/voice-agent/agent/venv/lib/python3.12/site-packages/jwt/api_jwt.py:149: InsecureKeyLengthWarning: The HMAC key is 28 bytes long, which is below the minimum recommended length of 32 bytes for SHA256. See RFC 7518 Section 3.2.
return self._jws.encode(
{"message": "registered worker", "level": "INFO", "name": "livekit.agents", "agent_name": "cybergril-voice-agent", "deployment": "", "id": "AW_EmnniB7z9YMD", "url": "ws://127.0.0.1:7880", "region": "", "protocol": 17, "pid": 117034, "timestamp": "2026-10-29T11:52:41.685510+00:00"}
{"message": "received job request", "level": "INFO", "name": "livekit.agents", "job_id": "AJ_ZpuB6R3tdZak", "dispatch_id": "AD_M4z7UnYivdNG", "room": "cg-voice-9r5jjmcz0n", "room_id": "RM_uBLCU6RTkyYD", "agent_name": "cybergril-voice-agent", "resuming": false, "enable_recording": false, "pid": 117034, "timestamp": "2026-10-29T11:53:12.543121+00:00"}
{"message": "initializing process", "level": "INFO", "name": "livekit.agents", "pid": 117340, "timestamp": "2026-10-29T11:53:12.614337+00:00"}
{"message": "process initialized", "level": "INFO", "name": "livekit.agents", "pid": 117340, "elapsed_time": 0.11, "timestamp": "2026-10-29T11:53:12.727122+00:00"}
Nvidia Decoder is supported.
{"message": "adaptive interruption is disabled by default in production mode", "level": "INFO", "name": "livekit.agents", "pid": 117117, "job_id": "AJ_ZpuB6R3tdZak", "room": "cg-voice-9r5jjmcz0n", "room_id": "RM_uBLCU6RTkyYD", "timestamp": "2026-10-29T11:53:12.950095+00:00"}
{"message": "failed to emit event conversation_item_added\nTraceback (most recent call last):\n File \"/opt/voice-agent/agent/venv/lib/python3.12/site-packages/livekit/rtc/event_emitter.py\", line 70, in emit\n callback(*callback_args)\n File \"/opt/cybergril-hel910/current/src/cybergril/voice/worker.py\", line 203, in _on_item\n if ev.item.role == \"assistant\":\n ^^^^^^^^^^^^\n File \"/opt/voice-agent/agent/venv/lib/python3.12/site-packages/pydantic/main.py\", line 1105, in __getattr__\n raise AttributeError(f'{type(self).__name__!r} object has no attribute {item!r}')\nAttributeError: 'AgentHandoff' object has no attribute 'role'", "level": "ERROR", "name": "livekit", "exc_info": "Traceback (most recent call last):\n File \"/opt/voice-agent/agent/venv/lib/python3.12/site-packages/livekit/rtc/event_emitter.py\", line 70, in emit\n callback(*callback_args)\n File \"/opt/cybergril-hel910/current/src/cybergril/voice/worker.py\", line 203, in _on_item\n if ev.item.role == \"assistant\":\n ^^^^^^^^^^^^\n File \"/opt/voice-agent/agent/venv/lib/python3.12/site-packages/pydantic/main.py\", line 1105, in __getattr__\n raise AttributeError(f'{type(self).__name__!r} object has no attribute {item!r}')\nAttributeError: 'AgentHandoff' object has no attribute 'role'", "pid": 117117, "job_id": "AJ_ZpuB6R3tdZak", "room": "cg-voice-9r5jjmcz0n", "room_id": "RM_uBLCU6RTkyYD", "timestamp": "2026-10-29T11:53:12.950937+00:00"}
[cybergril-worker] session started (api=http://127.0.0.1:8360, voice=rain, agent_name=cybergril-voice-agent, asr_window=(window=hel910-20261029-a audio=0.000/720.000s confirmed=0.000s retries<= 2/call ledger=/opt/cybergril-hel910/asr-usage.jsonl))
{"message": "process exiting", "level": "INFO", "name": "livekit.agents", "reason": "parent process shutdown", "pid": 117117, "job_id": "AJ_ZpuB6R3tdZak", "room": "cg-voice-9r5jjmcz0n", "room_id": "RM_uBLCU6RTkyYD", "timestamp": "2026-10-29T11:53:24.378953+00:00"}
{"message": "error while shutting down the job\nTraceback (most recent call last):\n File \"/opt/voice-agent/agent/venv/lib/python3.12/site-packages/livekit/agents/ipc/job_proc_lazy_main.py\", line 504, in _shutdown_job\n await asyncio.gather(*shutdown_tasks)\n File \"/opt/voice-agent/agent/venv/lib/python3.12/site-packages/livekit/agents/ipc/job_proc_lazy_main.py\", line 493, in _traced_shutdown_callback\n await callback(shutdown_info.reason)\n File \"/opt/voice-agent/agent/venv/lib/python3.12/site-packages/livekit/agents/job.py\", line 637, in wrapper\n await callback() # type: ignore\n ^^^^^^^^^^^^^^^^\nTypeError: object NoneType can't be used in 'await' expression", "level": "ERROR", "name": "livekit.agents", "exc_info": "Traceback (most recent call last):\n File \"/opt/voice-agent/agent/venv/lib/python3.12/site-packages/livekit/agents/ipc/job_proc_lazy_main.py\", line 504, in _shutdown_job\n await asyncio.gather(*shutdown_tasks)\n File \"/opt/voice-agent/agent/venv/lib/python3.12/site-packages/livekit/agents/ipc/job_proc_lazy_main.py\", line 493, in _traced_shutdown_callback\n await callback(shutdown_info.reason)\n File \"/opt/voice-agent/agent/venv/lib/python3.12/site-packages/livekit/agents/job.py\", line 637, in wrapper\n await callback() # type: ignore\n ^^^^^^^^^^^^^^^^\nTypeError: object NoneType can't be used in 'await' expression", "pid": 117117, "job_id": "AJ_ZpuB6R3tdZak", "room": "cg-voice-9r5jjmcz0n", "room_id": "RM_uBLCU6RTkyYD", "timestamp": "2026-10-29T11:53:24.379160+00:00"}
{"message": "received job request", "level": "INFO", "name": "livekit.agents", "job_id": "AJ_6ER6CLfrDgjj", "dispatch_id": "AD_G4bRhnJp3HgV", "room": "cg-voice-fdk5izk2uz", "room_id": "RM_kbpdRUqex2LN", "agent_name": "cybergril-voice-agent", "resuming": false, "enable_recording": false, "pid": 117034, "timestamp": "2026-10-29T11:58:22.089500+00:00"}
{"message": "initializing process", "level": "INFO", "name": "livekit.agents", "pid": 117672, "timestamp": "2026-10-29T11:58:22.176516+00:00"}
{"message": "process initialized", "level": "INFO", "name": "livekit.agents", "pid": 117672, "elapsed_time": 0.11, "timestamp": "2026-10-29T11:58:22.289729+00:00"}
Nvidia Decoder is supported.
{"message": "RoomIO linked to participant", "level": "INFO", "name": "livekit.agents", "lk.pii.participant_identity": "user-wnjxjdyz", "lk.pii.room_name": "cg-voice-fdk5izk2uz", "pid": 117121, "job_id": "AJ_6ER6CLfrDgjj", "room": "cg-voice-fdk5izk2uz", "room_id": "RM_kbpdRUqex2LN", "timestamp": "2026-10-29T11:58:22.502347+00:00"}
{"message": "adaptive interruption is disabled by default in production mode", "level": "INFO", "name": "livekit.agents", "pid": 117121, "job_id": "AJ_6ER6CLfrDgjj", "room": "cg-voice-fdk5izk2uz", "room_id": "RM_kbpdRUqex2LN", "timestamp": "2026-10-29T11:58:22.503217+00:00"}
{"message": "failed to emit event conversation_item_added\nTraceback (most recent call last):\n File \"/opt/voice-agent/agent/venv/lib/python3.12/site-packages/livekit/rtc/event_emitter.py\", line 70, in emit\n callback(*callback_args)\n File \"/opt/cybergril-hel910/current/src/cybergril/voice/worker.py\", line 203, in _on_item\n if ev.item.role == \"assistant\":\n ^^^^^^^^^^^^\n File \"/opt/voice-agent/agent/venv/lib/python3.12/site-packages/pydantic/main.py\", line 1105, in __getattr__\n raise AttributeError(f'{type(self).__name__!r} object has no attribute {item!r}')\nAttributeError: 'AgentHandoff' object has no attribute 'role'", "level": "ERROR", "name": "livekit", "exc_info": "Traceback (most recent call last):\n File \"/opt/voice-agent/agent/venv/lib/python3.12/site-packages/livekit/rtc/event_emitter.py\", line 70, in emit\n callback(*callback_args)\n File \"/opt/cybergril-hel910/current/src/cybergril/voice/worker.py\", line 203, in _on_item\n if ev.item.role == \"assistant\":\n ^^^^^^^^^^^^\n File \"/opt/voice-agent/agent/venv/lib/python3.12/site-packages/pydantic/main.py\", line 1105, in __getattr__\n raise AttributeError(f'{type(self).__name__!r} object has no attribute {item!r}')\nAttributeError: 'AgentHandoff' object has no attribute 'role'", "pid": 117121, "job_id": "AJ_6ER6CLfrDgjj", "room": "cg-voice-fdk5izk2uz", "room_id": "RM_kbpdRUqex2LN", "timestamp": "2026-10-29T11:58:22.503948+00:00"}
[cybergril-worker] session started (api=http://127.0.0.1:8360, voice=rain, agent_name=cybergril-voice-agent, asr_window=(window=hel910-20261029-a audio=0.000/720.000s confirmed=0.000s retries<= 2/call ledger=/opt/cybergril-hel910/asr-usage.jsonl))
[stt] utterance open, frame sr=24000
[stt] interim: 我就是
[stt->session] interim_transcript: 我就是
[stt] interim: 一个笨
[stt->session] interim_transcript: 一个笨
[stt] interim: 蛋派
[stt->session] interim_transcript: 蛋派
[stt] interim: 大星
[stt->session] interim_transcript: 大星
[stt] interim: 我们一起
[stt->session] interim_transcript: 我们一起
[stt] interim: 去抓水
[stt->session] interim_transcript: 去抓水
[stt] interim: 母
[stt->session] interim_transcript: 母
[stt] interim: 吧我们一
[stt->session] interim_transcript: 吧我们一
[stt] interim: 起度过快
[stt->session] interim_transcript: 起度过快
[stt] interim: 乐的一
[stt->session] interim_transcript: 乐的一
[stt] FINAL(merged): 我就是个笨蛋派大星,我们一起去抓水母吧,我们一起度过快乐的一天
[stt->session] final_transcript: 我就是个笨蛋派大星,我们一起去抓水母吧,我们一起度过快乐的一天
[tts] first audio after 2.147s (好呀,小十。带上小网兜,慢一点也没关系,...)
[stt] interim: 师
[stt->session] interim_transcript: 师
[stt] interim: 傅
[stt->session] interim_transcript: 傅
[stt] interim: 诶这取
[stt->session] interim_transcript: 诶这取
[stt] interim: 经
[stt->session] interim_transcript: 经
[stt] interim: 路比高
[stt->session] interim_transcript: 路比高
[stt] interim: 老庄
[stt->session] interim_transcript: 老庄
[stt] interim: 种地
[stt->session] interim_transcript: 种地
[stt] interim: 还
[stt->session] interim_transcript: 还
[stt] interim: 苦俺老
[stt->session] interim_transcript: 苦俺老
[stt] interim: 猪饿
[stt->session] interim_transcript: 猪饿
[stt] interim: 的能吞
[stt->session] interim_transcript: 的能吞
[stt] interim: 下石
[stt->session] interim_transcript: 下石
[stt] interim: 龙素
[stt->session] interim_transcript: 龙素
[stt] interim: 包
[stt->session] interim_transcript: 包
[stt] interim: 子猴
[stt->session] interim_transcript: 子猴
[stt] interim: 哥你
[stt->session] interim_transcript: 哥你
[stt] interim: 筋斗
[stt->session] interim_transcript: 筋斗
[stt] interim: 云
[stt->session] interim_transcript: 云
[stt] interim: 快要
[stt->session] interim_transcript: 快要
[stt] interim: 不
[stt->session] interim_transcript: 不
[stt] interim: 先去
[stt->session] interim_transcript: 先去
[stt] interim: 画个
[stt->session] interim_transcript: 画个
[stt] FINAL(merged): 师傅,哎,这取经路比高,老庄种地还苦,俺老猪饿的能吞下石龙素包子,猴哥,你筋斗云块,要不先去画个缘
[stt->session] final_transcript: 师傅,哎,这取经路比高,老庄种地还苦,俺老猪饿的能吞下石龙素包子,猴哥,你筋斗云
[tts] first audio after 2.514s (行啊,小十。去画缘之前,先把那石龙素包子...)
[stt] interim: 没
[stt->session] interim_transcript: 没
[stt] interim: 错我
[stt->session] interim_transcript: 错我
[stt] interim: 就是个笨
[stt->session] interim_transcript: 就是个笨
[stt] interim: 蛋
[stt->session] interim_transcript: 蛋
[stt] interim: 派大
[stt->session] interim_transcript: 派大
[stt] interim: 星我们一
[stt->session] interim_transcript: 星我们一
[stt] interim: 起去抓
[stt->session] interim_transcript: 起去抓
[stt] interim: 水母
[stt->session] interim_transcript: 水母
[stt] interim: 吧我们
[stt->session] interim_transcript: 吧我们
[stt] interim: 一起度过
[stt->session] interim_transcript: 一起度过
[stt] interim: 快乐的一
[stt->session] interim_transcript: 快乐的一
[stt] interim: 天
[stt->session] interim_transcript: 天
[stt] FINAL(merged): 没错,我就是个笨蛋派大星,我们一起去抓水母吧,我们一起度过快乐的一天
[stt->session] final_transcript: 没错,我就是个笨蛋派大星,我们一起去抓水母吧,我们一起度过快乐的一天
[stt] interim: 没
[stt->session] interim_transcript: 没
[stt] interim: 错我
[stt->session] interim_transcript: 错我
[stt] interim: 就是个笨
[stt->session] interim_transcript: 就是个笨
[stt] interim: 蛋
[stt->session] interim_transcript: 蛋
[stt] interim: 派大
[stt->session] interim_transcript: 派大
[stt] interim: 星我们一
[stt->session] interim_transcript: 星我们一
[stt] interim: 起去抓
[stt->session] interim_transcript: 起去抓
[stt] interim: 水母
[stt->session] interim_transcript: 水母
[stt] interim: 吧我们
[stt->session] interim_transcript: 吧我们
[stt] interim: 一起度过
[stt->session] interim_transcript: 一起度过
[stt] interim: 快乐的一
[stt->session] interim_transcript: 快乐的一
[stt] FINAL(merged): 没错,我就是个笨蛋派大星,我们一起去抓水母吧,我们一起度过快乐的一天
[stt->session] final_transcript: 没错,我就是个笨蛋派大星,我们一起去抓水母吧,我们一起度过快乐的一天
[tts] first audio after 2.008s (好,小十,那就一起。...)
{"message": "closing agent session due to participant disconnect (disable via `RoomInputOptions.close_on_disconnect=False`)", "level": "INFO", "name": "livekit.agents", "room": "cg-voice-fdk5izk2uz", "participant": "user-wnjxjdyz", "reason": "CLIENT_INITIATED", "pid": 117121, "job_id": "AJ_6ER6CLfrDgjj", "room_id": "RM_kbpdRUqex2LN", "timestamp": "2026-10-29T12:02:44.305190+00:00"}
{"message": "process exiting", "level": "INFO", "name": "livekit.agents", "reason": "room disconnected", "pid": 117121, "job_id": "AJ_6ER6CLfrDgjj", "room": "cg-voice-fdk5izk2uz", "room_id": "RM_kbpdRUqex2LN", "timestamp": "2026-10-29T12:02:46.322112+00:00"}
{"message": "error while shutting down the job\nTraceback (most recent call last):\n File \"/opt/voice-agent/agent/venv/lib/python3.12/site-packages/livekit/agents/ipc/job_proc_lazy_main.py\", line 504, in _shutdown_job\n await asyncio.gather(*shutdown_tasks)\n File \"/opt/voice-agent/agent/venv/lib/python3.12/site-packages/livekit/agents/ipc/job_proc_lazy_main.py\", line 493, in _traced_shutdown_callback\n await callback(shutdown_info.reason)\n File \"/opt/voice-agent/agent/venv/lib/python3.12/site-packages/livekit/agents/job.py\", line 637, in wrapper\n await callback() # type: ignore\n ^^^^^^^^^^^^^^^^\nTypeError: object NoneType can't be used in 'await' expression", "level": "ERROR", "name": "livekit.agents", "exc_info": "Traceback (most recent call last):\n File \"/opt/voice-agent/agent/venv/lib/python3.12/site-packages/livekit/agents/ipc/job_proc_lazy_main.py\", line 504, in _shutdown_job\n await asyncio.gather(*shutdown_tasks)\n File \"/opt/voice-agent/agent/venv/lib/python3.12/site-packages/livekit/agents/ipc/job_proc_lazy_main.py\", line 493, in _traced_shutdown_callback\n await callback(shutdown_info.reason)\n File \"/opt/voice-agent/agent/venv/lib/python3.12/site-packages/livekit/agents/job.py\", line 637, in wrapper\n await callback() # type: ignore\n ^^^^^^^^^^^^^^^^\nTypeError: object NoneType can't be used in 'await' expression", "pid": 117121, "job_id": "AJ_6ER6CLfrDgjj", "room": "cg-voice-fdk5izk2uz", "room_id": "RM_kbpdRUqex2LN", "timestamp": "2026-10-29T12:02:46.322288+00:00"}
{"message": "received job request", "level": "INFO", "name": "livekit.agents", "job_id": "AJ_5Uk4XbETMfVr", "dispatch_id": "AD_i9twJRAXhgHd", "room": "cg-voice-jq8q4zm9h0", "room_id": "RM_XARewyWHLk4R", "agent_name": "cybergril-voice-agent", "resuming": false, "enable_recording": false, "pid": 117034, "timestamp": "2026-10-29T12:10:13.069565+00:00"}
{"message": "initializing process", "level": "INFO", "name": "livekit.agents", "pid": 118637, "timestamp": "2026-10-29T12:10:13.151002+00:00"}
{"message": "process initialized", "level": "INFO", "name": "livekit.agents", "pid": 118637, "elapsed_time": 0.13, "timestamp": "2026-10-29T12:10:13.284159+00:00"}
Nvidia Decoder is supported.
{"message": "adaptive interruption is disabled by default in production mode", "level": "INFO", "name": "livekit.agents", "pid": 117119, "job_id": "AJ_5Uk4XbETMfVr", "room": "cg-voice-jq8q4zm9h0", "room_id": "RM_XARewyWHLk4R", "timestamp": "2026-10-29T12:10:13.485573+00:00"}
{"message": "failed to emit event conversation_item_added\nTraceback (most recent call last):\n File \"/opt/voice-agent/agent/venv/lib/python3.12/site-packages/livekit/rtc/event_emitter.py\", line 70, in emit\n callback(*callback_args)\n File \"/opt/cybergril-hel910/current/src/cybergril/voice/worker.py\", line 203, in _on_item\n if ev.item.role == \"assistant\":\n ^^^^^^^^^^^^\n File \"/opt/voice-agent/agent/venv/lib/python3.12/site-packages/pydantic/main.py\", line 1105, in __getattr__\n raise AttributeError(f'{type(self).__name__!r} object has no attribute {item!r}')\nAttributeError: 'AgentHandoff' object has no attribute 'role'", "level": "ERROR", "name": "livekit", "exc_info": "Traceback (most recent call last):\n File \"/opt/voice-agent/agent/venv/lib/python3.12/site-packages/livekit/rtc/event_emitter.py\", line 70, in emit\n callback(*callback_args)\n File \"/opt/cybergril-hel910/current/src/cybergril/voice/worker.py\", line 203, in _on_item\n if ev.item.role == \"assistant\":\n ^^^^^^^^^^^^\n File \"/opt/voice-agent/agent/venv/lib/python3.12/site-packages/pydantic/main.py\", line 1105, in __getattr__\n raise AttributeError(f'{type(self).__name__!r} object has no attribute {item!r}')\nAttributeError: 'AgentHandoff' object has no attribute 'role'", "pid": 117119, "job_id": "AJ_5Uk4XbETMfVr", "room": "cg-voice-jq8q4zm9h0", "room_id": "RM_XARewyWHLk4R", "timestamp": "2026-10-29T12:10:13.487053+00:00"}
[cybergril-worker] session started (api=http://127.0.0.1:8360, voice=rain, agent_name=cybergril-voice-agent, asr_window=(window=hel910-20261029-a audio=264.243/720.000s confirmed=264.243s retries<= 2/call ledger=/opt/cybergril-hel910/asr-usage.jsonl))
{"message": "received job request", "level": "INFO", "name": "livekit.agents", "job_id": "AJ_kS9dDvnAMCtu", "dispatch_id": "AD_rpzro2wKCVWM", "room": "cg-voice-dlas9zmiox", "room_id": "RM_yzXp5MvjnLxV", "agent_name": "cybergril-voice-agent", "resuming": false, "enable_recording": false, "pid": 117034, "timestamp": "2026-10-29T12:12:36.795242+00:00"}
{"message": "initializing process", "level": "INFO", "name": "livekit.agents", "pid": 119984, "timestamp": "2026-10-29T12:12:36.837621+00:00"}
{"message": "process initialized", "level": "INFO", "name": "livekit.agents", "pid": 119984, "elapsed_time": 0.11, "timestamp": "2026-10-29T12:12:36.952751+00:00"}
Nvidia Decoder is supported.
{"message": "RoomIO linked to participant", "level": "INFO", "name": "livekit.agents", "lk.pii.participant_identity": "user-joobnisb", "lk.pii.room_name": "cg-voice-dlas9zmiox", "pid": 117123, "job_id": "AJ_kS9dDvnAMCtu", "room": "cg-voice-dlas9zmiox", "room_id": "RM_yzXp5MvjnLxV", "timestamp": "2026-10-29T12:12:37.185284+00:00"}
{"message": "adaptive interruption is disabled by default in production mode", "level": "INFO", "name": "livekit.agents", "pid": 117123, "job_id": "AJ_kS9dDvnAMCtu", "room": "cg-voice-dlas9zmiox", "room_id": "RM_yzXp5MvjnLxV", "timestamp": "2026-10-29T12:12:37.186027+00:00"}
{"message": "failed to emit event conversation_item_added\nTraceback (most recent call last):\n File \"/opt/voice-agent/agent/venv/lib/python3.12/site-packages/livekit/rtc/event_emitter.py\", line 70, in emit\n callback(*callback_args)\n File \"/opt/cybergril-hel910/current/src/cybergril/voice/worker.py\", line 203, in _on_item\n if ev.item.role == \"assistant\":\n ^^^^^^^^^^^^\n File \"/opt/voice-agent/agent/venv/lib/python3.12/site-packages/pydantic/main.py\", line 1105, in __getattr__\n raise AttributeError(f'{type(self).__name__!r} object has no attribute {item!r}')\nAttributeError: 'AgentHandoff' object has no attribute 'role'", "level": "ERROR", "name": "livekit", "exc_info": "Traceback (most recent call last):\n File \"/opt/voice-agent/agent/venv/lib/python3.12/site-packages/livekit/rtc/event_emitter.py\", line 70, in emit\n callback(*callback_args)\n File \"/opt/cybergril-hel910/current/src/cybergril/voice/worker.py\", line 203, in _on_item\n if ev.item.role == \"assistant\":\n ^^^^^^^^^^^^\n File \"/opt/voice-agent/agent/venv/lib/python3.12/site-packages/pydantic/main.py\", line 1105, in __getattr__\n raise AttributeError(f'{type(self).__name__!r} object has no attribute {item!r}')\nAttributeError: 'AgentHandoff' object has no attribute 'role'", "pid": 117123, "job_id": "AJ_kS9dDvnAMCtu", "room": "cg-voice-dlas9zmiox", "room_id": "RM_yzXp5MvjnLxV", "timestamp": "2026-10-29T12:12:37.186855+00:00"}
[cybergril-worker] session started (api=http://127.0.0.1:8360, voice=rain, agent_name=cybergril-voice-agent, asr_window=(window=hel910-20261029-a audio=264.243/720.000s confirmed=264.243s retries<= 2/call ledger=/opt/cybergril-hel910/asr-usage.jsonl))
[stt] utterance open, frame sr=24000
[stt] interim: 师
[stt->session] interim_transcript: 师
[stt] interim: 傅
[stt->session] interim_transcript: 傅
[stt] interim: 诶这
[stt->session] interim_transcript: 诶这
[stt] interim: 取经
[stt->session] interim_transcript: 取经
[stt] interim: 路比
[stt->session] interim_transcript: 路比
[stt] interim: 高老
[stt->session] interim_transcript: 高老
[stt] interim: 庄种地
[stt->session] interim_transcript: 庄种地
[stt] interim: 还
[stt->session] interim_transcript: 还
[stt] interim: 苦俺
[stt->session] interim_transcript: 苦俺
[stt] interim: 老中
[stt->session] interim_transcript: 老中
[stt] interim: 饿的能
[stt->session] interim_transcript: 饿的能
[stt] interim: 吞下
[stt->session] interim_transcript: 吞下
[stt] interim: 石龙
[stt->session] interim_transcript: 石龙
[stt] interim: 素包
[stt->session] interim_transcript: 素包
[stt] interim: 子
[stt->session] interim_transcript: 子
[stt] interim: 猴哥
[stt->session] interim_transcript: 猴哥
[stt] interim: 你筋
[stt->session] interim_transcript: 你筋
[stt] interim: 斗云
[stt->session] interim_transcript: 斗云
[stt] interim: 块
[stt->session] interim_transcript: 块
[stt] interim: 要不
[stt->session] interim_transcript: 要不
[stt] interim: 先
[stt->session] interim_transcript: 先
[stt] interim: 去画个
[stt->session] interim_transcript: 去画个
[stt] FINAL(merged): 师傅,哎,这取经路比高,老庄种地还苦,俺老猪饿的能吞下石龙素包子,猴哥,你筋斗云块,要不先去化个缘
[stt->session] final_transcript: 师傅,哎,这取经路比高,老庄种地还苦,俺老猪饿的能吞下石龙素包子,猴哥,你筋斗云
[tts] first audio after 1.614s (好,小十。去化缘...)
[stt] interim: 盯着你看
[stt->session] interim_transcript: 盯着你看
[stt] interim: 怎么啦
[stt->session] interim_transcript: 怎么啦
[stt] FINAL(merged): 盯着,你看怎么啦
[stt->session] final_transcript: 盯着,你看怎么啦
[stt] interim: 难得
[stt->session] interim_transcript: 难得
[stt] interim: 看你这么
[stt->session] interim_transcript: 看你这么
[stt] interim: 有意思的
[stt->session] interim_transcript: 有意思的
[stt] interim: 样子
[stt->session] interim_transcript: 样子
[stt] FINAL(merged): 难得看你这么有意思的样子吗
[stt->session] final_transcript: 难得看你这么有意思的样子吗
{"message": "transcript arrives after turn has been committed. consider raising `min_delay` in the endpointing options to accommodate a slow stt. subsequent occurrences will log at debug level.", "level": "WARNING", "name": "livekit.agents", "pid": 117123, "job_id": "AJ_kS9dDvnAMCtu", "room": "cg-voice-dlas9zmiox", "room_id": "RM_yzXp5MvjnLxV", "timestamp": "2026-10-29T12:13:08.918069+00:00"}
[tts] first audio after 0.957s (我在...)
[stt] interim: 师
[stt->session] interim_transcript: 师
[stt] interim: 傅诶
[stt->session] interim_transcript: 傅诶
[stt] interim: 这取
[stt->session] interim_transcript: 这取
[stt] interim: 经路
[stt->session] interim_transcript: 经路
[stt] interim: 比高
[stt->session] interim_transcript: 比高
[stt] interim: 老庄
[stt->session] interim_transcript: 老庄
[stt] interim: 种地
[stt->session] interim_transcript: 种地
[stt] interim: 还
[stt->session] interim_transcript: 还
[stt] interim: 苦俺
[stt->session] interim_transcript: 苦俺
[stt] interim: 老猪饿
[stt->session] interim_transcript: 老猪饿
[stt] interim: 的能
[stt->session] interim_transcript: 的能
[stt] interim: 吞下石
[stt->session] interim_transcript: 吞下石
[stt] interim: 龙素
[stt->session] interim_transcript: 龙素
[stt] interim: 包
[stt->session] interim_transcript: 包
[stt] interim: 子猴
[stt->session] interim_transcript: 子猴
[stt] interim: 哥
[stt->session] interim_transcript: 哥
[stt] interim: 你筋斗
[stt->session] interim_transcript: 你筋斗
[stt] interim: 云
[stt->session] interim_transcript: 云
[stt] interim: 快要
[stt->session] interim_transcript: 快要
[stt] interim: 不
[stt->session] interim_transcript: 不
[stt] interim: 先去
[stt->session] interim_transcript: 先去
[stt] interim: 画个
[stt->session] interim_transcript: 画个
[stt] FINAL(merged): 师傅,哎,这取经路比高老庄种地还苦,俺老猪饿的能吞下石龙素包子,猴哥,你筋斗云块,要不先去化个缘
[stt->session] final_transcript: 师傅,哎,这取经路比高老庄种地还苦,俺老猪饿的能吞下石龙素包子,猴哥,你筋斗云块
[tts] first audio after 2.419s (她这会儿没接上话,稍后再试试。你写的话还...)
{"message": "livekit::rtc_engine::rtc_session:704:livekit::rtc_engine::rtc_session - publisher data channel '_reliable' closed unexpectedly", "level": "ERROR", "name": "livekit", "pid": 117123, "job_id": "AJ_kS9dDvnAMCtu", "room": "cg-voice-dlas9zmiox", "room_id": "RM_yzXp5MvjnLxV", "timestamp": "2026-10-29T12:14:01.641609+00:00"}
{"message": "livekit::rtc_engine::rtc_session:704:livekit::rtc_engine::rtc_session - publisher data channel '_lossy' closed unexpectedly", "level": "ERROR", "name": "livekit", "pid": 117123, "job_id": "AJ_kS9dDvnAMCtu", "room": "cg-voice-dlas9zmiox", "room_id": "RM_yzXp5MvjnLxV", "timestamp": "2026-10-29T12:14:01.642771+00:00"}
{"message": "livekit::rtc_engine::rtc_session:704:livekit::rtc_engine::rtc_session - publisher data channel '_data_track' closed unexpectedly", "level": "ERROR", "name": "livekit", "pid": 117123, "job_id": "AJ_kS9dDvnAMCtu", "room": "cg-voice-dlas9zmiox", "room_id": "RM_yzXp5MvjnLxV", "timestamp": "2026-10-29T12:14:01.644140+00:00"}
{"message": "closing agent session due to participant disconnect (disable via `RoomInputOptions.close_on_disconnect=False`)", "level": "INFO", "name": "livekit.agents", "room": "cg-voice-dlas9zmiox", "participant": "user-joobnisb", "reason": "ROOM_DELETED", "pid": 117123, "job_id": "AJ_kS9dDvnAMCtu", "room_id": "RM_yzXp5MvjnLxV", "timestamp": "2026-10-29T12:14:01.658858+00:00"}
{"message": "process exiting", "level": "INFO", "name": "livekit.agents", "reason": "parent process shutdown", "pid": 117123, "job_id": "AJ_kS9dDvnAMCtu", "room": "cg-voice-dlas9zmiox", "room_id": "RM_yzXp5MvjnLxV", "timestamp": "2026-10-29T12:14:03.649239+00:00"}
{"message": "error while shutting down the job\nTraceback (most recent call last):\n File \"/opt/voice-agent/agent/venv/lib/python3.12/site-packages/livekit/agents/ipc/job_proc_lazy_main.py\", line 504, in _shutdown_job\n await asyncio.gather(*shutdown_tasks)\n File \"/opt/voice-agent/agent/venv/lib/python3.12/site-packages/livekit/agents/ipc/job_proc_lazy_main.py\", line 493, in _traced_shutdown_callback\n await callback(shutdown_info.reason)\n File \"/opt/voice-agent/agent/venv/lib/python3.12/site-packages/livekit/agents/job.py\", line 637, in wrapper\n await callback() # type: ignore\n ^^^^^^^^^^^^^^^^\nTypeError: object NoneType can't be used in 'await' expression", "level": "ERROR", "name": "livekit.agents", "exc_info": "Traceback (most recent call last):\n File \"/opt/voice-agent/agent/venv/lib/python3.12/site-packages/livekit/agents/ipc/job_proc_lazy_main.py\", line 504, in _shutdown_job\n await asyncio.gather(*shutdown_tasks)\n File \"/opt/voice-agent/agent/venv/lib/python3.12/site-packages/livekit/agents/ipc/job_proc_lazy_main.py\", line 493, in _traced_shutdown_callback\n await callback(shutdown_info.reason)\n File \"/opt/voice-agent/agent/venv/lib/python3.12/site-packages/livekit/agents/job.py\", line 637, in wrapper\n await callback() # type: ignore\n ^^^^^^^^^^^^^^^^\nTypeError: object NoneType can't be used in 'await' expression", "pid": 117123, "job_id": "AJ_kS9dDvnAMCtu", "room": "cg-voice-dlas9zmiox", "room_id": "RM_yzXp5MvjnLxV", "timestamp": "2026-10-29T12:14:03.649526+00:00"}
{"message": "livekit::rtc_engine::rtc_session:704:livekit::rtc_engine::rtc_session - publisher data channel '_reliable' closed unexpectedly", "level": "ERROR", "name": "livekit", "pid": 117119, "job_id": "AJ_5Uk4XbETMfVr", "room": "cg-voice-jq8q4zm9h0", "room_id": "RM_XARewyWHLk4R", "timestamp": "2026-10-29T12:15:12.157732+00:00"}
{"message": "livekit::rtc_engine::rtc_session:704:livekit::rtc_engine::rtc_session - publisher data channel '_lossy' closed unexpectedly", "level": "ERROR", "name": "livekit", "pid": 117119, "job_id": "AJ_5Uk4XbETMfVr", "room": "cg-voice-jq8q4zm9h0", "room_id": "RM_XARewyWHLk4R", "timestamp": "2026-10-29T12:15:12.158251+00:00"}
{"message": "livekit::rtc_engine::rtc_session:704:livekit::rtc_engine::rtc_session - publisher data channel '_data_track' closed unexpectedly", "level": "ERROR", "name": "livekit", "pid": 117119, "job_id": "AJ_5Uk4XbETMfVr", "room": "cg-voice-jq8q4zm9h0", "room_id": "RM_XARewyWHLk4R", "timestamp": "2026-10-29T12:15:12.158737+00:00"}
{"message": "process exiting", "level": "INFO", "name": "livekit.agents", "reason": "parent process shutdown", "pid": 117119, "job_id": "AJ_5Uk4XbETMfVr", "room": "cg-voice-jq8q4zm9h0", "room_id": "RM_XARewyWHLk4R", "timestamp": "2026-10-29T12:15:14.162493+00:00"}
{"message": "error while shutting down the job\nTraceback (most recent call last):\n File \"/opt/voice-agent/agent/venv/lib/python3.12/site-packages/livekit/agents/ipc/job_proc_lazy_main.py\", line 504, in _shutdown_job\n await asyncio.gather(*shutdown_tasks)\n File \"/opt/voice-agent/agent/venv/lib/python3.12/site-packages/livekit/agents/ipc/job_proc_lazy_main.py\", line 493, in _traced_shutdown_callback\n await callback(shutdown_info.reason)\n File \"/opt/voice-agent/agent/venv/lib/python3.12/site-packages/livekit/agents/job.py\", line 637, in wrapper\n await callback() # type: ignore\n ^^^^^^^^^^^^^^^^\nTypeError: object NoneType can't be used in 'await' expression", "level": "ERROR", "name": "livekit.agents", "exc_info": "Traceback (most recent call last):\n File \"/opt/voice-agent/agent/venv/lib/python3.12/site-packages/livekit/agents/ipc/job_proc_lazy_main.py\", line 504, in _shutdown_job\n await asyncio.gather(*shutdown_tasks)\n File \"/opt/voice-agent/agent/venv/lib/python3.12/site-packages/livekit/agents/ipc/job_proc_lazy_main.py\", line 493, in _traced_shutdown_callback\n await callback(shutdown_info.reason)\n File \"/opt/voice-agent/agent/venv/lib/python3.12/site-packages/livekit/agents/job.py\", line 637, in wrapper\n await callback() # type: ignore\n ^^^^^^^^^^^^^^^^\nTypeError: object NoneType can't be used in 'await' expression", "pid": 117119, "job_id": "AJ_5Uk4XbETMfVr", "room": "cg-voice-jq8q4zm9h0", "room_id": "RM_XARewyWHLk4R", "timestamp": "2026-10-29T12:15:14.162511+00:00"}
{"message": "draining worker", "level": "INFO", "name": "livekit.agents", "id": "AW_EmnniB7z9YMD", "timeout": 3600, "pid": 117034, "timestamp": "2026-10-29T12:16:00.200546+00:00"}
{"message": "shutting down worker", "level": "INFO", "name": "livekit.agents", "id": "AW_EmnniB7z9YMD", "pid": 117034, "timestamp": "2026-10-29T12:16:00.200808+00:00"}
+133
View File
@@ -0,0 +1,133 @@
# HEL-911 · 修好通话收尾报错并查清开口等待(2026-10-29)
> 起点:`agent/agent/ab943ea62162` @ `407fc81`(含完整 958c696 产品与 HEL-910 证据,
> SHA 已核)。需求基准 v1.12/60 项;关联 CG-006/010/013–016/018–021、AM-001、
> GOV-001–006、DEL-001;本卡无需求变更。全程真实 cap=0:零 LLM/ASR/TTS/嵌入/
> 登记/试听调用,未建任何房间/窗口,未恢复任何本窗服务;仅只读复用 .12
> `/opt/voice-agent/agent/venv`(livekit-agents 1.8.8 实物)与既有 wav 证据做离线证明。
## 1. 两个 SDK 接缝错误的修复(真实 1.8.8 驱动验证)
### 1.1 `conversation_item_added` 的非 ChatMessage 项目崩溃(worker.py `_on_item`)
- **事实**:1.8.8 的 `ConversationItemAddedEvent.item` 是
`ChatMessage | AgentHandoff | _TypeDiscriminator`(`voice/events.py:419`)。会话启动即入
一条 `AgentHandoff`(无 `role`/`content`),旧代码直取 `ev.item.role` 抛
`AttributeError`——HEL-910 两轮通话 worker.log 实录,每通各一次。
- **修复**(src/cybergril/voice/worker.py `_on_item`):按 SDK 判别字段
`item.type == "message"` 过滤,再按 `role == "assistant"` 取**纯 str 部件**正文
(`ChatContent = str | ImageContent | AudioContent | CacheBreakpoint`,
`llm/chat_context.py:459`)。用户消息、AgentHandoff、unknown 项不更新
`agent_recent_text`;正常 assistant 正文继续喂回声过滤,语义不变。
- **验证**:tests/test_sdk_livekit_hel908.py
`test_conversation_item_added_filters_non_message_items`——真 SDK 真 pydantic 模型
驱动:AgentHandoff / `_TypeDiscriminator` / user 消息 / 混合 content 的 assistant
消息四例,前三种不碰状态,第四种只取正文。
### 1.2 shutdown 回调的异步协议(worker.py `bind_interrupt_channel`)
- **事实**:`JobContext.add_shutdown_callback` 把无参回调包成 `await callback()`
(`job.py:633-643`),job 关停逐个 await(`ipc/job_proc_lazy_main.py:493`)。旧的同步
`def unload() -> None` 因此在关停路径抛
`TypeError: object NoneType can't be used in 'await' expression`(HEL-910 实录)。
- **修复**:unload 改为**协程**;幂等(重复 shutdown/多次调用安全);房间未连接/已断连
不抛。`session.interrupt(force=True)`、回执/预算停机路径一字未动。
- **验证**:`test_shutdown_callback_protocol_real_jobcontext_wrapper`——用**真
JobContext.add_shutdown_callback 方法**做包装(仅缺 job 进程管线),按
job_proc_lazy_main 的原样 await 驱动:新协程通过;旧的同步形状经同一包装复现出
生产那条 TypeError(反向证据);重复 await 幂等;卸载后真 rtc.Room 再收
cg.interrupt 消息监听已摘除。既有三项 R2 通道测试同步改为 `await unload()`,
校验/未启动/卸载语义全部保持。
## 2. 9.5 秒等待分段核对(已有证据 + 实际 SDK 源码 + 离线复现)
### 2.1 按真实时刻重建的分段(call2 q1/q2,同钟 marks)
| 分段 | q1 实测 | 构成(已证) |
| --- | --- | --- |
| 回放结束 → ASR 终稿 | +2.432s | silero 端点 ~0.7s(含 min_silence 0.55s)+ FunASR 2pass 离线纠错往返 + **适配器 0.6s 去抖合并**(stt_funasr.py `emit_merged_final`) |
| ASR 终稿 → 生成开始(turn_start) | **+3.667s(q2 +3.654s)** | **本卡查清,见 2.2——默认英文 EOU TurnDetector 把 endpointing 顶到 max_delay=6.0** |
| 生成开始 → 服务端首条 delta | ~1.42s | 服务端整轮缓冲生成(buffer_turn 已知代价,换零思考泄漏;DB 行 14 ts=+7.511 与 assistant_interim +7.514 同刻) |
| 首条 delta → 第一有声帧 | ~2.0s | CosyVoice3 首包实测 1.614s(worker.log:220 `[tts] first audio after 1.614s`)+ 播放管线 ~0.4s |
| (收尾)assistant_final 字幕 | +12.102s | **播放收尾/回执门**,非首次全文生成/落库时刻(纠偏,见 §4) |
### 2.2 user_final → turn_start 的 3.66s:成因与修复(离线 A/B 证实)
- **成因**:livekit-agents 1.8.8 在 `turn_handling` 未显式给 `turn_detection` 键时
**默认构造 `inference.TurnDetector()`**(`voice/agent_session.py:576-579`
`turn_handling.get("turn_detection", inference.TurnDetector())`;自托管回落本地
v1-mini 英文 EOU 模型)。worker 只配了 `endpointing`,于是这个英文模型对**中文**
终稿做端点预测;其"不太像说完"判定走
`audio_recognition.py` `_bounce_eou_task` 的
`end_of_turn_probability < unlikely_threshold → endpointing_delay = max_delay`
路径,把等待顶到 6.0s:
`extra_sleep = 6.0 + 说话结束锚点(≈+0.14) − 终稿时刻(≈+2.45) ≈ 3.69s`——与两轮
实测 3.667/3.654s 对上(`_run_eou_detection(stt)` 内锚点体检打印实录)。
- **离线复现**(scripts/gen_hel911_wait_repro.py,.12 真 SDK + 真 silero VAD +
HEL-910 实际回放 wav 按实测时间脚本化 STT/LLM/TTS,零外呼):
- BASELINE(复刻旧配置,默认 TurnDetector 在):终稿 +2.443 → llm.chat +6.142
(**3.699s**,复现实测 3.667/3.654);VAD 端点 +0.712;首声 +9.18——与生产
9.5s 形状一致。
- 修复后(显式 `turn_detection: None`):终稿 +2.439 → llm.chat +2.444
(**0.005s**);首声 +5.48。
- **修复**(worker.py `TURN_HANDLING`):显式 `"turn_detection": None`。轮次边界回到
本会话自己配置的 VAD endpointing(min 0.8 / max 6.0 原样保留),**不降 VAD 阈值、
不动 buffer_turn、不改模型/网关/认证**;短轮次行为不变(call2"盯着"轮原本就在终稿后
8ms 提交——其终稿晚于 说话结束+0.8s,min_delay 锚点已过)。附带收益:不再预载
v1-mini 本地权重(~244MB/进程)。
- **回归**:`test_turn_handling_disables_default_english_eou_detector` 断言真 SDK 下
默认会装探测器(若 SDK 行为变更该前置断言会失败,提示重新归因)、worker 配置下为
None、endpointing 参数逐字未动。
- **未承诺**:首声总时延 9.5s → 约 5.9s 是离线推算;**需真实窗口复测确认**,本卡
cap=0 未跑真实通话。
### 2.3 分段归因清单(已证 / 已修 / 需真实环境)
- 已证(已有证据+源码+离线复现):2.432s(FunASR 链+去抖)、3.66s(默认英文
TurnDetector)、~1.4s(服务端整轮生成)、TTS 首包 1.614s、VAD 端点 ~0.7s。
- 已修(离线定向验证通过,待真实复测收数字):3.66s 段(TURN_HANDLING)。
- 需真实环境才能判断:修复后首声总时延的真实值;FunASR 离线纠错往返在真实麦克风
下的分布(当前只有工程回放样本);"经常>5s"与否需多样本。
## 3. 修复清单与验证记录
| 变更 | 文件 | 验证 |
| --- | --- | --- |
| `_on_item` 类型过滤 | `src/cybergril/voice/worker.py` | 真 SDK 4 例(§1.1) |
| unload 协程化+幂等 | `src/cybergril/voice/worker.py` | 真 JobContext 包装协议(§1.2) |
| 显式禁用默认 TurnDetector | `src/cybergril/voice/worker.py`(`TURN_HANDLING`) | 离线 A/B + 真会话断言(§2.2) |
| 等待链离线复现工具 | `scripts/gen_hel911_wait_repro.py`(新增) | BASELINE/FIXED 两模式跑通 |
| 测量工具可靠性修正 | `docs/rework/hel910/tools/hel910_call1.mjs` | `node --check` 通过(离线) |
| HEL-910 事实纠偏 | `docs/rework/hel910/window-record.md` §9 追加 | 原文未回改 |
- **真 SDK harness**(.12 agent venv 1.8.8):
`tests/test_sdk_livekit_hel908.py --standalone` **11/11**(既有 8 项回归全保持 +
本卡 3 项新证)。
- **产品测试套**(.12 规范环境 `.venv311` 只读复用):**480 passed / 11 skipped /
2 failed**——两个 `test_r3` 基线/迁移失败与 HEL-908 记录一致(预先存在,前轮已留证)。
本地 py3.10 环境 75/81 通过、6 失败与基准 407fc81 干树完全同集合(环境差异,非本卡
引入)。
- web 未动,未重建界面;ruff/lint 未配置进仓库流程,Python 语法经两环境实测导入通过。
## 4. HEL-910 交付说明纠偏(详见 window-record.md §9)
companion 实为 **9 条**(非 18);生成起点 **+6.099s**(非 +4.10);assistant_final
是**播放收尾/回执门**(非首次全文生成/落库,落库在 +7.511s);post-window.txt 的
ListRooms 实为 `invalid authorization token`,不能证明空房(总管已独立核实空房成立)。
## 5. 测量工具可靠性修正(仅必要项,离线验证,不执行真实窗口)
- **分段落盘**:hel910_call1.mjs 每 5s 把页内探针新增切片追加写
`call1-probe-live.jsonl`、录音分片即产即存 `rec-part-NNNN.webm`——驱动被超时杀掉
最多丢 5s 一段,不再整包丢失(HEL-910 第一通丢证模式)。`node --check` 通过。
- **打断触发条件**:时机A 不再以页面相位/己方发送为"服务端已激活"的代理,改为
**服务端已把 U2 语音轮落成 chat 行**(用户行出现在会话 DOM)+ 生成中相位双条件;
旧"发过 turn_start 即认为 API 已激活"的假设作废。
## 6. 未测 / 承接(如实)
- 修复后首声真实数字、真实麦克风打断时延、可闻旧声中的回放打断正面样本、生成中
文字取消正面样本:需下轮真实工程窗口(门控与分段落盘已备好)。
- FunASR 适配器 0.6s 去抖与 2pass 离线纠错往返是否可再压:属识别链参数,本卡不动
语义,留待与真实复测同窗评估。
- 真实端点带 `</think>` 形状、真机/手机麦克风、Safari、完整 R1–R7:继续主卡承接。
@@ -0,0 +1,19 @@
PASS shell syntax api_ctl.sh
PASS shell syntax bridge_ctl.template.sh
PASS shell syntax force_end.template.sh
PASS shell syntax test_ctl_scripts.sh
PASS shell syntax tts_ctl.template.sh
PASS shell syntax worker_ctl.sh
PASS bridge_ctl.template.sh refuses invalid command before any service action
PASS tts_ctl.template.sh refuses invalid command before any service action
PASS deadline cleanup fixture exits successfully
PASS real sessions LIST schema produces both room cleanup requests
PASS launcher passes CYBERGRIL_SEMANTIC_CONFIG
PASS launcher passes FASTEMBED_CACHE_PATH
PASS launcher passes MEM0_TELEMETRY
PASS launcher passes HF_HUB_OFFLINE
PASS launcher passes TRANSFORMERS_OFFLINE
PASS launcher passes TZ
PASS failed stub launch removes its PID handle and exits failure
17/17 targeted offline checks passed
No real services, listeners, provider requests, installs or embeddings.
+49
View File
@@ -0,0 +1,49 @@
# HEL-913 启停脚本离线替身检查(收口轮)
# 时间:2026-10-29T14:25:58Z;机器:工作站(总工运行时);方式:stub 解释器 + 静态检查,零真实服务/零监听/零出站
# 对象:本运行包收口版 api_ctl.sh / worker_ctl.sh / 三个窗口模板(bridge/tts/force_end)
# 结论:见末行(42 项全过;含非法子命令拒绝、重复 start 拒绝、PID 复用拒杀、启动失败收尾、.env 守门、模板默认 0)
PASS syntax api_ctl.sh
PASS syntax worker_ctl.sh
PASS syntax bridge_ctl.template.sh
PASS syntax tts_ctl.template.sh
PASS syntax force_end.template.sh
PASS package file README.md
PASS package file manifest.json
PASS package file dist-manifest.json
PASS package file models.template.yaml
PASS package file voice.template.yaml
PASS package file worker.env.template
PASS package file verify_offline.py
PASS package file mem0-cp311-wheels.txt
PASS package file voice-window-arm.template.env
PASS package file test_ctl_scripts.sh
PASS api_ctl invalid subcommand refused (rc=2)
PASS api_ctl invalid subcommand started nothing
PASS worker_ctl invalid subcommand refused (rc=2)
PASS worker_ctl invalid subcommand started nothing
PASS api_ctl failed start exits 1
PASS api_ctl failed start removed pid file
PASS api_ctl failed start kept log
PASS api_ctl failed start left no stub process
PASS stub api process running (pid 73678)
PASS api_ctl duplicate start refused (rc=1)
PASS api_ctl duplicate start kept original handle
PASS api_ctl stop refused reused pid (rc=1)
PASS unrelated process untouched
PASS api_ctl stop with dead pid exits 0
PASS api_ctl stop removed stale pid file
PASS worker_ctl refuses .env with unfilled placeholders (rc=1)
PASS placeholder refusal started nothing
PASS worker_ctl refuses unparseable .env (rc=1)
PASS parse refusal started nothing
PASS worker_ctl failed start exits 1
PASS worker_ctl failed start removed pid file
PASS worker_ctl failed start kept log
PASS worker_ctl failed start left no stub process
PASS worker_ctl duplicate start refused (rc=1)
PASS worker_ctl stop refused reused pid (rc=1)
PASS worker stop left unrelated process alive
PASS voice-window-arm.template.env parses, defaults 0/unarmed
42 passed, 0 failed
+36
View File
@@ -0,0 +1,36 @@
PASS python 3.11 (actual (3, 11, 16))
PASS cybergril imported from candidate tree (/tmp/hel913-verify/src/cybergril/__init__.py)
PASS deps: fastapi 0.159.1 uvicorn 0.54.0 httpx 0.28.1 pydantic 2.14.1
PASS product modules import (api.app / voice.router / voice.session)
PASS mem0 absent in product venv (as documented)
PASS qdrant_client absent in product venv (as documented)
PASS fastembed absent in product venv (as documented)
PASS GET /api/health 200, text capability true
PASS health: companion_created=false before creation
PASS health: llm honestly not ok (dead addr, cap=0)
PASS GET /api/companion 404 before creation (no fabricated profile)
PASS POST /api/companion/preview 200 (local bazi compile)
PASS POST /api/companion 201
PASS bazi_core persisted and matches preview (day master 辛)
PASS second create refused 409 (single companion guard)
PASS persona honest at cap=0 (state=failed, no fabricated interpretation)
PASS POST /api/chat opens SSE stream
PASS chat honestly errors at cap=0 (frames=['chat.error'])
PASS zero provider stream calls (outbound=[])
PASS failed turn persisted as user row, no fake companion reply
PASS retry same failed turn: honest error again, still zero outbound
PASS PATCH /api/relation 200 (relation adjustable, name kept)
PASS GET /api/life 200 empty (only told events, none yet)
PASS GET /api/memories 200 empty
PASS GET /api/life/1 404 (unshared detail refused)
PASS POST /api/chat/received 404 on unknown receipt
PASS GET /api/voice/status 200, voice honestly false
PASS POST /api/voice/session honest 503 when TTS unreachable (503)
PASS DELETE /api/voice/session/{unknown} honest 404
PASS GET / serves web dist index.html
PASS reopen: epoch=2 (got 2)
PASS reopen: companion identity + adjusted relation retained
PASS reopen: chat history retained, still no fabricated replies
PASS dist matches manifest (8 files; bad=[])
34/34 checks passed
+432
View File
@@ -0,0 +1,432 @@
"""HEL-911 离线等待链复现:真 AgentSession + 真 silero VAD + 脚本化 STT/LLM/TTS.
目的:把 HEL-910 call2 实测的「识别终稿 → 生成开始」3.667s 间隙(q1
+2.432→+6.099、q2 +48.525→+52.179,两轮同为 3.65~3.67s)在完全离线的
真实 SDK 1.8.8 里复现或排除,从而把 9.5s 首声等待的分段归因落到可检验
的事实上。
做法(全部本地计算,零网络,零 LLM/ASR/TTS 外呼):
- 输入:HEL-910 真实回放用过的 /opt/cybergril-hel910/etc/trim/u_bajie.trim.wav
按 100ms 帧、真实时钟节奏推给 session.input.audio(与 hel910_client 的
发布节奏一致),播完继续推真零样本静音帧(对应 asr-usage.jsonl 证实
的连续帧流 ~100.5% 实时);
- STT:脚本化 stt.STT,按实测时间发 INTERIM(语音期间)与 FINAL(回放
结束后 +2.432s,即 FunASR 离线纠错 + 适配器 0.6s 去抖的实测结果),
不设 end_time(与 FunASRSTT 的 SpeechData 形状一致);
- LLM:脚本化 LLM,记录 chat() 调用时刻(= 生产链路里 on_stream_started
→ 字幕 turn_start 的同一时刻),1.415s 后发两条 delta(对应实测
turn_start→assistant_interim 的服务端整轮生成时延);
- TTS:脚本化 ChunkedStream,1.614s 后出首帧(对应实测
[tts] first audio after 1.614s,worker.log:220);
- 会话参数与 worker.py entrypoint 完全一致(真 VAD.load()、
endpointing min 0.8 / max 6.0)。
输出各里程碑相对回放结束(= wav 末帧后第一帧静音的时刻)的秒数,与
HEL-910 实测列对照。本脚本不修改任何服务,只读 wav。
运行(.12 agent venv):
/opt/voice-agent/agent/venv/bin/python scripts/gen_hel911_wait_repro.py
"""
from __future__ import annotations
import asyncio
import sys
import time
import wave
from pathlib import Path
sys.path.insert(0, str(Path(__file__).resolve().parents[1] / "src"))
from livekit import rtc
from livekit.agents import stt, tts, llm as lk_llm
from livekit.agents.llm import ChatContext, LLM, LLMStream, Tool
from livekit.agents.stt import RecognizeStream, SpeechData, SpeechEvent, SpeechEventType
from livekit.agents.tts import AudioEmitter, ChunkedStream
from livekit.agents.types import DEFAULT_API_CONNECT_OPTIONS, APIConnectOptions
from livekit.agents.voice import Agent, AgentSession
from livekit.plugins.silero import VAD
WAV = Path("/opt/cybergril-hel910/etc/trim/u_bajie.trim.wav")
# HEL-910 call2 实测时延(相对回放结束/各起点)
FINAL_AFTER_PLAYBACK_END = 2.432 # user_final(VAD+FunASR 离线+0.6s 去抖)
GEN_AFTER_TURN_START = 1.415 # turn_start -> assistant_interim(服务端整轮)
TTS_FIRST_AUDIO = 1.614 # [tts] first audio after(worker.log:220)
TAIL_SILENCE = 14.0 # 回放结束后继续推的静音时长
def _now() -> float:
return time.perf_counter()
class Timeline:
def __init__(self) -> None:
self.t0: float | None = None
self.playback_end: float | None = None
self.marks: list[tuple[str, float]] = []
def mark(self, name: str) -> None:
self.marks.append((name, _now()))
class ScriptedSTT(stt.STT):
"""按 HEL-910 实测时间发 FINAL 的 STT;不连任何识别服务。"""
def __init__(self, tl: Timeline) -> None:
super().__init__(capabilities=stt.STTCapabilities(streaming=True, interim_results=True))
self._tl = tl
@property
def provider(self) -> str:
return "scripted"
@property
def model(self) -> str:
return "hel910-timeline"
async def _recognize_impl(self, buffer, *, language=None,
conn_options: APIConnectOptions = DEFAULT_API_CONNECT_OPTIONS
) -> SpeechEvent:
raise NotImplementedError("scripted STT only supports streaming")
def stream(self, *, language=None,
conn_options: APIConnectOptions = DEFAULT_API_CONNECT_OPTIONS
) -> RecognizeStream:
return ScriptedRecognizeStream(stt=self, conn_options=conn_options, tl=self._tl)
class ScriptedRecognizeStream(RecognizeStream):
def __init__(self, *, stt: ScriptedSTT, conn_options: APIConnectOptions,
tl: Timeline) -> None:
super().__init__(stt=stt, conn_options=conn_options)
self._tl = tl
def _ev(self, ev_type: SpeechEventType, text: str) -> SpeechEvent:
return SpeechEvent(type=ev_type,
alternatives=[SpeechData(language="zh", text=text)])
async def _run(self) -> None:
tl = self._tl
async def schedule_final() -> None:
# 等回放结束锚点(由输入源标记),再按实测延迟发终稿
while tl.playback_end is None:
await asyncio.sleep(0.02)
await asyncio.sleep(FINAL_AFTER_PLAYBACK_END)
tl.mark("stt_final_emitted")
self._event_ch.send_nowait(
self._ev(SpeechEventType.FINAL_TRANSCRIPT,
"师傅,哎,这取经路比高,老庄种地还苦,俺老猪饿的能吞下石龙素"
"包子,猴哥,你筋斗云块,要不先去化个缘"))
final_task = asyncio.create_task(schedule_final())
sent_interim = False
try:
async for ev in self._input_ch:
if ev is None:
break
if isinstance(ev, rtc.AudioFrame) and not sent_interim:
sent_interim = True
self._event_ch.send_nowait(
self._ev(SpeechEventType.INTERIM_TRANSCRIPT, "师傅"))
await asyncio.sleep(0)
finally:
final_task.cancel()
class ProbeLLM(LLM):
def __init__(self, tl: Timeline) -> None:
super().__init__()
self._tl = tl
@property
def provider(self) -> str:
return "probe"
@property
def model(self) -> str:
return "hel911-wait-probe"
def chat(self, *, chat_ctx: ChatContext, tools: list[Tool] | None = None,
conn_options: APIConnectOptions = DEFAULT_API_CONNECT_OPTIONS, **_
) -> LLMStream:
self._tl.mark("llm_chat_called") # = 生产链路的 turn_start 时刻
return ProbeLLMStream(llm=self, chat_ctx=chat_ctx, tools=tools or [],
conn_options=conn_options, tl=self._tl)
class ProbeLLMStream(LLMStream):
def __init__(self, *, llm: ProbeLLM, chat_ctx: ChatContext, tools: list[Tool],
conn_options: APIConnectOptions, tl: Timeline) -> None:
super().__init__(llm, chat_ctx=chat_ctx, tools=tools, conn_options=conn_options)
self._tl = tl
async def _run(self) -> None:
from livekit.agents.llm import ChatChunk, ChoiceDelta
await asyncio.sleep(GEN_AFTER_TURN_START)
self._tl.mark("first_delta")
self._event_ch.send_nowait(ChatChunk(
id="hel911-probe",
delta=ChoiceDelta(role="assistant", content="好,小十。去化缘")))
self._event_ch.send_nowait(ChatChunk(
id="hel911-probe", delta=ChoiceDelta(role="assistant", content="")))
self._event_ch.send_nowait(ChatChunk(id="hel911-probe"))
class ProbeTTS(tts.TTS):
def __init__(self, tl: Timeline) -> None:
super().__init__(capabilities=tts.TTSCapabilities(streaming=False),
sample_rate=24000, num_channels=1)
self._tl = tl
@property
def provider(self) -> str:
return "probe"
@property
def model(self) -> str:
return "hel911-wait-probe"
def synthesize(self, text: str, *,
conn_options: APIConnectOptions = DEFAULT_API_CONNECT_OPTIONS
) -> ChunkedStream:
return ProbeChunkedStream(tts=self, input_text=text,
conn_options=conn_options, tl=self._tl)
class ProbeChunkedStream(ChunkedStream):
def __init__(self, *, tts: ProbeTTS, input_text: str,
conn_options: APIConnectOptions, tl: Timeline) -> None:
super().__init__(tts=tts, input_text=input_text, conn_options=conn_options)
self._tl = tl
async def _run(self, output_emitter: AudioEmitter) -> None:
output_emitter.initialize(request_id="hel911", sample_rate=24000,
num_channels=1, mime_type="audio/pcm")
await asyncio.sleep(TTS_FIRST_AUDIO) # 实测 CosyVoice3 首包
self._tl.mark("tts_first_audio")
# ~1s 的可听音频(20ms 帧),足够走完 playout/回执路径
frame = b"\x10\x00" * 480
for _ in range(50):
output_emitter.push_frame(rtc.AudioFrame(frame, 24000, 1, 480))
await asyncio.sleep(0.02)
output_emitter.flush()
def make_sink(tl: Timeline):
from livekit.agents.voice.io import AudioOutput, AudioOutputCapabilities
class _Sink(AudioOutput):
def __init__(self) -> None:
super().__init__(label="probe-sink",
capabilities=AudioOutputCapabilities(pause=False))
self.first_frame_at: float | None = None
async def capture_frame(self, frame: rtc.AudioFrame) -> None:
if self.first_frame_at is None:
tl.mark("sink_first_frame")
self.first_frame_at = _now()
def flush(self) -> None:
self.on_playback_finished(interrupted=False)
def clear_buffer(self) -> None:
self.on_playback_finished(interrupted=True)
return _Sink()
class MicSource:
"""wav 实时回放 + 尾部连续静音,节奏与 hel910_client._publish_pcm 一致。"""
def __init__(self, tl: Timeline) -> None:
self._tl = tl
def make(self):
tl = self._tl
from livekit.agents.voice.io import AudioInput
with wave.open(str(WAV), "rb") as w:
raw = w.readframes(w.getnframes())
rate = w.getframerate()
class _Source(AudioInput):
def __init__(self) -> None:
super().__init__(label="hel911-mic")
self._i = 0
self._phase = "wav"
async def __anext__(self) -> rtc.AudioFrame:
step = 1600 * 2 # 100ms @16k,同 hel910_client
if self._phase == "wav":
chunk = raw[self._i:self._i + step]
if tl.t0 is None:
tl.t0 = _now()
if len(chunk) < step:
chunk = chunk + b"\x00" * (step - len(chunk))
self._i += step
if self._i >= len(raw):
self._phase = "silence"
tl.playback_end = _now()
tl.mark("playback_end")
await asyncio.sleep(0.1)
return rtc.AudioFrame(chunk, rate, 1, 1600)
# 静音段:真实时钟节奏(帧流连续,asr-usage 证实)
await asyncio.sleep(0.1)
return rtc.AudioFrame(b"\x00" * step, rate, 1, 1600)
return _Source()
async def main() -> None:
if not WAV.exists():
raise SystemExit(f"wav not found: {WAV}")
import logging
logging.basicConfig(level=logging.INFO) # eot prediction 走 debug 时再降
logging.getLogger("livekit.agents.voice.audio_recognition").setLevel(logging.DEBUG)
import os
# 默认复刻生产接线(worker.TURN_HANDLING,已显式 turn_detection=None);
# HEL911_BASELINE=1 复现缺陷态:1.8.8 对缺省键默认补英文 TurnDetector
baseline = os.environ.get("HEL911_BASELINE") == "1"
from cybergril.voice.worker import TURN_HANDLING as WORKER_TURN_HANDLING
turn_handling = (
{k: v for k, v in WORKER_TURN_HANDLING.items() if k != "turn_detection"}
if baseline else dict(WORKER_TURN_HANDLING)
)
tl = Timeline()
session = AgentSession(
stt=ScriptedSTT(tl),
llm=ProbeLLM(tl),
tts=ProbeTTS(tl),
vad=VAD.load(),
turn_handling=turn_handling,
)
session.input.audio = MicSource(tl).make() # type: ignore[assignment]
session.output.audio = make_sink(tl) # type: ignore[assignment]
@session.on("user_state_changed")
def _ustate(ev):
tl.mark(f"user_state_{getattr(ev, 'new_state', '?')}")
@session.on("agent_state_changed")
def _astate(ev):
tl.mark(f"agent_state_{getattr(ev, 'new_state', '?')}")
@session.on("user_input_transcribed")
def _tr(ev):
if ev.is_final:
tl.mark("sdk_user_final")
await session.start(agent=Agent(instructions="probe"))
tl.mark("session_started")
# 定位 FINAL→llm.chat 间隙:给真 SDK 的提交/调度内部打点(只读包装,不改行为)
from livekit.agents.voice import agent_activity
activity = session._activity
_orig_eou = activity.on_end_of_turn
def _logged_eou(info):
committed = _orig_eou(info)
tl.mark(f"on_end_of_turn(committed={committed})")
return committed
activity.on_end_of_turn = _logged_eou # type: ignore[method-assign]
_orig_gen = activity._generate_reply
def _logged_gen(**kwargs):
handle = _orig_gen(**kwargs)
tl.mark("_generate_reply")
return handle
activity._generate_reply = _logged_gen # type: ignore[method-assign]
_orig_sched = activity._schedule_speech
def _logged_sched(speech, priority, force=False):
tl.mark("_schedule_speech")
return _orig_sched(speech, priority, force=force)
activity._schedule_speech = _logged_sched # type: ignore[method-assign]
_orig_run_eou = type(activity._audio_recognition)._run_eou_detection
def _logged_run_eou(self, chat_ctx, *, trigger, skip_reply=False):
tl.mark(f"_run_eou_detection({trigger})")
# EOU 锚点体检:提交前的 extra_sleep 由这些值决定
lst = self._last_speaking_time
print(f" [eou:{trigger}] speaking={self._speaking} "
f"last_speaking_time={'none' if lst is None else f'{time.time() - lst:+.3f}s ago'} "
f"final_at={'none' if self._last_final_transcript_time is None else f'{time.time() - self._last_final_transcript_time:+.3f}s ago'} "
f"endpointing_min={self._endpointing.min_delay} "
f"turn_detector={type(self._turn_detector).__name__ if self._turn_detector else None} "
f"td_stream={type(self._turn_detector_stream).__name__ if self._turn_detector_stream else None} "
f"mode={self._turn_detection_mode}", flush=True)
return _orig_run_eou(self, chat_ctx, trigger=trigger, skip_reply=skip_reply)
type(activity._audio_recognition)._run_eou_detection = _logged_run_eou
ar = activity._audio_recognition
_orig_span = ar._ensure_eou_wait_span
def _logged_span(user_turn_span, **kwargs):
tl.mark("_ensure_eou_wait_span")
out = _orig_span(user_turn_span, **kwargs)
print(f" [eou-span] args={kwargs}", flush=True)
return out
ar._ensure_eou_wait_span = _logged_span # type: ignore[method-assign]
import livekit.agents.voice.audio_recognition as ar_mod
_orig_metrics = ar_mod._compute_end_of_turn_metrics
def _logged_metrics(**kwargs):
tl.mark("eou_metrics_start")
out = _orig_metrics(**kwargs)
tl.mark("eou_metrics_end")
return out
ar_mod._compute_end_of_turn_metrics = _logged_metrics
_orig_auth = type(activity)._scheduling_task
async def _logged_sched_task(self_inner):
tl.mark("_scheduling_task_start")
await _orig_auth(self_inner)
type(activity)._scheduling_task = _logged_sched_task
# 跑完一轮:回放 13.26s + 尾部静音(覆盖 FINAL→生成→TTS→播放收尾)
await asyncio.sleep(13.26 + TAIL_SILENCE)
await session.aclose()
pe = tl.playback_end
if pe is None:
raise SystemExit("playback never ended?")
print(f"\nwav={WAV.name} marks 相对回放结束(秒):")
print(f"{'mark':28s} {'t-playback_end':>15s}")
for name, at in tl.marks:
print(f"{name:28s} {at - pe:>+15.3f}")
# 与 HEL-910 实测对照
stt_final = next((at for n, at in tl.marks if n == "stt_final_emitted"), None)
chat = next((at for n, at in tl.marks if n == "llm_chat_called"), None)
if stt_final and chat:
gap = chat - stt_final
print(f"\nFINAL->llm.chat 间隙: {gap:+.3f}s "
f"(HEL-910 实测 user_final->turn_start = +3.667s / +3.654s)")
baseline_note = ("BASELINE(默认英文 TurnDetector 在)" if baseline
else "生产 TURN_HANDLING(turn_detection=None)")
print(f"模式: {baseline_note}")
if __name__ == "__main__":
asyncio.run(main())
+43 -14
View File
@@ -200,14 +200,22 @@ def bind_voice_session(session: AgentSession, *, llm: CyberGrillLLM,
@session.on("conversation_item_added")
def _on_item(ev) -> None:
if ev.item.role == "assistant":
texts = [
getattr(p, "text", "") or (p if isinstance(p, str) else "")
for p in (ev.item.content or [])
]
text = "".join(t for t in texts if t).strip()
if text:
stt.agent_recent_text = text
# SDK 1.8.8 的 ConversationItemAddedEvent.item 是
# ChatMessage | AgentHandoff | _TypeDiscriminator(events.py:416-420):
# 会话启动的 AgentHandoff 没有 role/content,直接取 ev.item.role 会抛
# AttributeError(HEL-910 两轮通话日志实录)。按 SDK 的类型判别字段
# 过滤,只认 type=="message" 的 ChatMessage,再按 role=="assistant"
# 取正文;用户消息、非消息项一律不更新 agent_recent_text。
item = ev.item
if getattr(item, "type", None) != "message":
return
if item.role != "assistant":
return
# ChatContent = str | ImageContent | AudioContent | CacheBreakpoint:
# 只有 str 部件是正文(chat_context.py:459-461),其余形状不冒充文本。
text = "".join(p for p in (item.content or []) if isinstance(p, str)).strip()
if text:
stt.agent_recent_text = text
@session.on("agent_state_changed")
def _on_state(ev) -> None:
@@ -220,6 +228,19 @@ web/src/voice 的 hush() 在本地静音反馈之外 publish 它(reliable)
本房间订阅。只复用 LiveKit 自己的数据通道与 session.interrupt,不建第二套
调度引擎。"""
TURN_HANDLING = {
# 停顿稍久才判说完, 合并慢语速碎片(同通用 worker 实测参数)
"endpointing": {"min_delay": 0.8, "max_delay": 6.0},
# HEL-911:livekit-agents 1.8.8 对未显式给 turn_detection 的会话默认
# 构造英文 EOU TurnDetector(agent_session.py:576-579,自托管回落本地
# v1-mini)。它对中文终稿的"不太像说完"判定把 endpointing 延迟顶到
# max_delay=6.0,实测造成识别终稿后 ~3.66s 的额外等待(HEL-910 call2
# 两轮 3.667/3.654s;离线 A/B:默认 3.704s vs 显式 None 0.004s,
# scripts/gen_hel911_wait_repro.py)。显式禁用:轮次边界回到本会话配置
# 的 VAD endpointing 本身,语义不变(不降 VAD 阈值、不动 buffer_turn)。
"turn_detection": None,
}
def bind_interrupt_channel(room, session) -> Callable[[], None]:
"""订阅本房间的 cg.interrupt 打断消息,走 SDK 自己的 programmatic 打断.
@@ -235,7 +256,7 @@ def bind_interrupt_channel(room, session) -> Callable[[], None]:
RuntimeError,HEL-909 evidence B2);失败一律大声留痕,不静默假装
成功。session.interrupt 未启动时抛 RuntimeError 同样留痕返回。
返回卸载函数(JobContext.add_shutdown_callback 注册,会话结束卸载)。
返回卸载协程(JobContext.add_shutdown_callback 注册,会话结束 await).
"""
def on_data(msg) -> None:
if getattr(msg, "topic", None) != INTERRUPT_TOPIC:
@@ -267,8 +288,19 @@ def bind_interrupt_channel(room, session) -> Callable[[], None]:
asyncio.get_running_loop().create_task(_drain(fut))
room.on("data_received", on_data)
unloaded = False
def unload() -> None:
async def unload() -> None:
# SDK 1.8.8 的 shutdown 回调一律被 await(job.py:622-643 把无参回调
# 包成 `await callback()`,ipc/job_proc_lazy_main.py:493 逐个 await):
# 同步返回 None 的旧卸载函数让 job 关停日志抛
# TypeError: object NoneType can't be used in 'await' expression
# (HEL-910 实录)。必须是协程;幂等(重复 shutdown/多次调用安全),
# 未连接/已断连的房间卸载监听不得抛出。
nonlocal unloaded
if unloaded:
return
unloaded = True
with contextlib.suppress(Exception):
room.off("data_received", on_data)
@@ -367,10 +399,7 @@ async def entrypoint(ctx: JobContext) -> None:
llm=llm,
tts=CosyVoiceTTS(default_voice=read_default_voice()),
vad=ctx.proc.userdata["vad"],
turn_handling={
# 停顿稍久才判说完, 合并慢语速碎片(同通用 worker 实测参数)
"endpointing": {"min_delay": 0.8, "max_delay": 6.0},
},
turn_handling=TURN_HANDLING,
)
bind_voice_session(session, llm=llm, ledger=ledger, interim=interim,
bus=bus, stt=stt, receipts=receipts)
+155 -3
View File
@@ -291,7 +291,7 @@ async def test_interrupt_message_stops_pending_playout_after_final():
fresh.interrupt(force=True)
_quiet_await(fresh)
_quiet_await(handle)
unload()
await unload()
async def test_interrupt_channel_validation_and_unload():
@@ -323,7 +323,7 @@ async def test_interrupt_channel_validation_and_unload():
await asyncio.sleep(0.05)
assert bridge.calls == [True] and handle.interrupted
unload()
await unload()
room.emit("data_received", _data_packet("cg.interrupt", b'{"v":1}'))
await asyncio.sleep(0.05)
assert bridge.calls == [True], "the unload callback removed the listener"
@@ -348,7 +348,153 @@ async def test_interrupt_message_survives_session_not_running():
await asyncio.sleep(0.05) # logged, swallowed at the boundary, listener intact
room.emit("data_received", _data_packet("cg.interrupt", b'{"v":1}'))
await asyncio.sleep(0.05)
unload()
await unload()
# ── HEL-911: conversation_item_added item types + async shutdown seam ────────
def _echo_stt_state() -> "SimpleNamespace":
from types import SimpleNamespace
return SimpleNamespace(agent_recent_text="", agent_speaking=False)
async def test_conversation_item_added_filters_non_message_items():
"""The session-start AgentHandoff (real 1.8.8 ConversationItemAddedEvent
payload: ChatMessage | AgentHandoff | _TypeDiscriminator, events.py:419)
crashed the old handler with AttributeError (HEL-910 worker.log, both
calls). Non-message items and user messages must not touch the echo
filter state."""
from livekit.agents.llm.chat_context import AgentHandoff, ChatMessage
from livekit.agents.voice import AgentSession
from livekit.agents.voice.events import ConversationItemAddedEvent, _TypeDiscriminator
from cybergril.voice.worker import bind_voice_session
class _Noop:
def __getattr__(self, name): # any other seam touch fails the test
raise AssertionError(f"unexpected seam use: {name}")
session = AgentSession()
stt = _echo_stt_state()
bind_voice_session(session, llm=_Noop(), ledger=_Noop(), interim=_Noop(),
bus=_Noop(), stt=stt, receipts=_Noop())
# 1. real SDK AgentHandoff (the session-start item that crashed 1.8.8)
session.emit("conversation_item_added",
ConversationItemAddedEvent(item=AgentHandoff(new_agent_id="agent_1")))
assert stt.agent_recent_text == ""
# 2. the SDK's own unknown-item discriminator shape
session.emit("conversation_item_added",
ConversationItemAddedEvent(item=_TypeDiscriminator()))
assert stt.agent_recent_text == ""
# 3. a real user ChatMessage must not feed the assistant echo filter
session.emit("conversation_item_added", ConversationItemAddedEvent(
item=ChatMessage(role="user", content=["用户说的话"])))
assert stt.agent_recent_text == ""
# 4. real assistant ChatMessage with mixed content parts: only the str
# parts are body text (ChatContent = str | ImageContent | AudioContent |
# CacheBreakpoint, chat_context.py:459)
from livekit.agents.llm.chat_context import CacheBreakpoint
session.emit("conversation_item_added", ConversationItemAddedEvent(
item=ChatMessage(role="assistant", content=["好,小十。", CacheBreakpoint()])))
assert stt.agent_recent_text == "好,小十。"
async def test_shutdown_callback_protocol_real_jobcontext_wrapper():
"""The unload seam must satisfy the REAL JobContext.add_shutdown_callback
contract: the SDK wraps a no-arg callback into `await callback()`
(job.py:633-643) and the job runner awaits every callback
(ipc/job_proc_lazy_main.py:493). The old sync `def unload() -> None`
raised TypeError: object NoneType can't be used in 'await' expression
(HEL-910 worker.log). Here the REAL JobContext method does the wrapping
and the runner's exact await pattern drives it — only the job plumbing
around it is absent, so a broken seam reproduces the production error.
"""
import inspect
from livekit import rtc
from livekit.agents import JobContext
from livekit.agents.voice import SpeechHandle
from cybergril.voice.worker import bind_interrupt_channel
handle = SpeechHandle.create(allow_interruptions=True)
class _Bridge:
def interrupt(self, *, force: bool = False):
return handle.interrupt(force=force)
room = rtc.Room()
unload = bind_interrupt_channel(room, _Bridge())
assert inspect.iscoroutinefunction(unload), \
"add_shutdown_callback awaits its callbacks; unload must be async"
# register through the REAL SDK method (it appends the wrapper it will await)
ctx = object.__new__(JobContext) # real method, minimal instance: no job plumbing
ctx._shutdown_callbacks = []
ctx.add_shutdown_callback(unload)
wrapped = ctx._shutdown_callbacks[-1]
# exactly what ipc/job_proc_lazy_main._traced_shutdown_callback does
await wrapped("job shutdown") # must not raise (the old sync seam did)
# the old seam reproduces the production TypeError through the same wrapper
def sync_unload() -> None:
return None
ctx.add_shutdown_callback(sync_unload)
broken = ctx._shutdown_callbacks[-1]
try:
await broken("job shutdown")
raise AssertionError("sync unload should have failed the real await")
except TypeError as exc:
assert "await" in str(exc)
# duplicate shutdown: the runner may only fire callbacks once per job, but
# idempotency must not depend on that
await unload()
await unload()
# subscription really unloaded: a valid interrupt message after unload is a no-op
room.emit("data_received", _data_packet("cg.interrupt", b'{"v":1}'))
await asyncio.sleep(0.05)
assert not handle.interrupted, "listener must be gone after unload"
_quiet_await(handle)
async def test_turn_handling_disables_default_english_eou_detector():
"""HEL-911: livekit-agents 1.8.8 silently installs an English EOU
TurnDetector when turn_handling has no explicit turn_detection key
(agent_session.py:576-579, `turn_handling.get("turn_detection",
inference.TurnDetector())`). Its unlikely-eot verdicts on CHINESE
transcripts push the endpointing delay to max_delay and cost the measured
~3.66s between ASR final and turn_start (HEL-910 call2: 3.667s/3.654s;
offline A/B in scripts/gen_hel911_wait_repro.py: default 3.704s vs
explicit None 0.004s). The worker's TURN_HANDLING must keep the detector
off so the configured VAD endpointing alone decides the turn boundary."""
from livekit.agents import AgentSession
from cybergril.voice.worker import TURN_HANDLING
# the SDK default that bites: same options minus the explicit key
with_default = {k: v for k, v in TURN_HANDLING.items() if k != "turn_detection"}
default_session = AgentSession(turn_handling=with_default)
assert default_session._turn_detection is not None, (
"precondition: 1.8.8 installs a default turn detector — if this fails "
"the SDK changed; re-check the HEL-911 wait attribution"
)
session = AgentSession(turn_handling=TURN_HANDLING)
assert session._turn_detection is None, \
"the worker must not run the English EOU detector on Chinese turns"
assert TURN_HANDLING["endpointing"] == {"min_delay": 0.8, "max_delay": 6.0}, \
"the measured endpointing parameters stay exactly as configured"
# ── standalone runner (agent venv has no pytest) ─────────────────────────────
@@ -371,6 +517,12 @@ async def _standalone() -> int:
test_interrupt_channel_validation_and_unload),
("interrupt_message_survives_session_not_running",
test_interrupt_message_survives_session_not_running),
("conversation_item_added_filters_non_message_items",
test_conversation_item_added_filters_non_message_items),
("shutdown_callback_protocol_real_jobcontext_wrapper",
test_shutdown_callback_protocol_real_jobcontext_wrapper),
("turn_handling_disables_default_english_eou_detector",
test_turn_handling_disables_default_english_eou_detector),
]
failures = 0
for name, check in checks: