Files
CyberGril/docs/requirements/handoff-HEL-857.json
T
zonggongandmultica-agent e31ae2d946 HEL-857: approved Mem0 isolation spike - zero-model gates all pass, A/B synthetic scenarios within 26/60 real-call budget
- Fixed mem0 source commit 2c81af3 (2.2.1) in isolated venv, qdrant embedded + fastembed local zh embeddings (95.3MB, within 500MB cap)
- Gate0 transport-level persistent debit ledger: 61st call blocked pre-send, failures count, cross-process persistence, retries disabled+counted (fake transport, zero network)
- Gate1 qdrant embedded checks: keyword_search functional (Chinese segmentation gap recorded honestly), restart subprocess, clean-copy restore, no telemetry collections
- Gate2 privacy with stub LLM: P1-P5 zero leak, first-share timing F1-F6 (failed/cancel/unconfirmed no migration, ack+judged migrates told content with anchors, duplicate receipt idempotent), full backup incl. unshared internal memories restores clean
- A/B same-material same-criteria: Mem0 paraphrase recall strictly better than current lexical path (S3, model answers in Chinese), S1-S9 all pass, no regression
- Headline findings: Chinese input extracted as English memories (default upstream prompt), BM25 lexical channel inert for Chinese, ADD-only infer confirmed with our update orchestration, custom metadata needs direct payload read
- 26/60 real outbound via persistent ledger (incl. one parse-failure retry), usage/latency per row; embeddings 28/500; HEL-835 quota untouched
- Experiment branch only: no merge to main/product, no deploy, no real-profile access; handoff JSON + dual-base requirement checks pass

Co-authored-by: multica-agent <github@multica.ai>
2026-10-25 23:19:26 +08:00

29 lines
2.6 KiB
JSON
Raw Blame History

This file contains ambiguous Unicode characters
This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.
{
"baseline_version": "1.11",
"read_commit": "bb9cbe915ecdc5d7dd3393ad45a6c4152e76900a",
"task": "HEL-857 隔离测试Mem0中文记忆与隐私备份",
"requirement_ids": ["CG-008", "CG-009", "CG-011", "CG-013", "CG-014", "CG-015", "CG-016", "CG-021", "AM-001", "UX-004", "UX-006", "GOV-001", "GOV-002", "GOV-003", "GOV-004", "GOV-005", "GOV-006", "DEL-001"],
"deliverable": "已批准的一次性 Mem0 隔离验证:固定源提交 2c81af3 在独立 venv 安装,qdrant 嵌入式+fastembed 本地中文嵌入;零真实模型门禁全过(传输层持久扣账假传输验证、qdrant 三查、隐私 P1-P5 与首次分享 F1-F6 stub 验证、完整备份恢复复检);门禁过后 A/B 合成场景(现状生产语义重放 vs Mem0,同资料同查询同评判,26/60 次真实出站经持久扣账)。",
"acceptance": [
"本地 SDK 检查与隐私零泄漏全部通过(gate0 T1-T5、gate1 Q0a-Q0e、gate2 P1-P5/F1-F6 全 pass,见 spike/hel857/results/)",
"恢复后内部与公开记忆完整、来源可回查、公开出口仍不泄漏(P5 含未分享内部记忆保留断言)",
"Mem0 换说法召回严格优于现状(S3:现状词面 0 命中、Mem0 命中且模型中文问答答出'蓝色'),其他既有成功项未退化(S1-S9 全 pass)",
"真实出站 26/60 全部经传输层持久扣账(含重试计数),usage 与耗时逐次留账;本地嵌入 28≤500;模型资源 95,254,651 字节≤500MB(含逐文件 SHA256)",
"检索命中、细节进入上下文、模型实际使用分开判定(S2/S3 分列记录)"
],
"deferred": [
"正式采用 Mem0 或迁移产品:待用户拍板,本卡结果不构成采用决定",
"中文提取提示词定制(现提取为英文,双语判据已如实记录)与复测",
"八字情绪、连续生活、主动联系的产品接线卡(本卡明确不做)",
"真实语料'记住昨日细节'验收(另行申请额度)",
"M5/M6 产品接线(v2 §8 三接线)",
"未测的完整产品要求继续承接,不以 SDK 实验代替整产品验收"
],
"requirement_changes": [],
"verification": [
"spike/hel857/results/gate0_ledger.json、gate1_backend.json、gate2_privacy.json、ab_scenarios.json(含 _ledger_rows 原始请求账)、ab_scenarios_run1.json(run1 证据)、preflight.json、resource_manifest_pre.json、lock-notes.md",
"spike/hel857/README.md:逐场景通过/失败表、关键发现、归责表、资源与边界",
"合成实验不冒充真实伴侣体验验收;未验证真机/现网/真实档案(本卡范围禁止触达)"
]
}