- Fixed mem0 source commit 2c81af3 (2.2.1) in isolated venv, qdrant embedded + fastembed local zh embeddings (95.3MB, within 500MB cap) - Gate0 transport-level persistent debit ledger: 61st call blocked pre-send, failures count, cross-process persistence, retries disabled+counted (fake transport, zero network) - Gate1 qdrant embedded checks: keyword_search functional (Chinese segmentation gap recorded honestly), restart subprocess, clean-copy restore, no telemetry collections - Gate2 privacy with stub LLM: P1-P5 zero leak, first-share timing F1-F6 (failed/cancel/unconfirmed no migration, ack+judged migrates told content with anchors, duplicate receipt idempotent), full backup incl. unshared internal memories restores clean - A/B same-material same-criteria: Mem0 paraphrase recall strictly better than current lexical path (S3, model answers in Chinese), S1-S9 all pass, no regression - Headline findings: Chinese input extracted as English memories (default upstream prompt), BM25 lexical channel inert for Chinese, ADD-only infer confirmed with our update orchestration, custom metadata needs direct payload read - 26/60 real outbound via persistent ledger (incl. one parse-failure retry), usage/latency per row; embeddings 28/500; HEL-835 quota untouched - Experiment branch only: no merge to main/product, no deploy, no real-profile access; handoff JSON + dual-base requirement checks pass Co-authored-by: multica-agent <github@multica.ai>
29 lines
2.6 KiB
JSON
29 lines
2.6 KiB
JSON
{
|
||
"baseline_version": "1.11",
|
||
"read_commit": "bb9cbe915ecdc5d7dd3393ad45a6c4152e76900a",
|
||
"task": "HEL-857 隔离测试Mem0中文记忆与隐私备份",
|
||
"requirement_ids": ["CG-008", "CG-009", "CG-011", "CG-013", "CG-014", "CG-015", "CG-016", "CG-021", "AM-001", "UX-004", "UX-006", "GOV-001", "GOV-002", "GOV-003", "GOV-004", "GOV-005", "GOV-006", "DEL-001"],
|
||
"deliverable": "已批准的一次性 Mem0 隔离验证:固定源提交 2c81af3 在独立 venv 安装,qdrant 嵌入式+fastembed 本地中文嵌入;零真实模型门禁全过(传输层持久扣账假传输验证、qdrant 三查、隐私 P1-P5 与首次分享 F1-F6 stub 验证、完整备份恢复复检);门禁过后 A/B 合成场景(现状生产语义重放 vs Mem0,同资料同查询同评判,26/60 次真实出站经持久扣账)。",
|
||
"acceptance": [
|
||
"本地 SDK 检查与隐私零泄漏全部通过(gate0 T1-T5、gate1 Q0a-Q0e、gate2 P1-P5/F1-F6 全 pass,见 spike/hel857/results/)",
|
||
"恢复后内部与公开记忆完整、来源可回查、公开出口仍不泄漏(P5 含未分享内部记忆保留断言)",
|
||
"Mem0 换说法召回严格优于现状(S3:现状词面 0 命中、Mem0 命中且模型中文问答答出'蓝色'),其他既有成功项未退化(S1-S9 全 pass)",
|
||
"真实出站 26/60 全部经传输层持久扣账(含重试计数),usage 与耗时逐次留账;本地嵌入 28≤500;模型资源 95,254,651 字节≤500MB(含逐文件 SHA256)",
|
||
"检索命中、细节进入上下文、模型实际使用分开判定(S2/S3 分列记录)"
|
||
],
|
||
"deferred": [
|
||
"正式采用 Mem0 或迁移产品:待用户拍板,本卡结果不构成采用决定",
|
||
"中文提取提示词定制(现提取为英文,双语判据已如实记录)与复测",
|
||
"八字情绪、连续生活、主动联系的产品接线卡(本卡明确不做)",
|
||
"真实语料'记住昨日细节'验收(另行申请额度)",
|
||
"M5/M6 产品接线(v2 §8 三接线)",
|
||
"未测的完整产品要求继续承接,不以 SDK 实验代替整产品验收"
|
||
],
|
||
"requirement_changes": [],
|
||
"verification": [
|
||
"spike/hel857/results/gate0_ledger.json、gate1_backend.json、gate2_privacy.json、ab_scenarios.json(含 _ledger_rows 原始请求账)、ab_scenarios_run1.json(run1 证据)、preflight.json、resource_manifest_pre.json、lock-notes.md",
|
||
"spike/hel857/README.md:逐场景通过/失败表、关键发现、归责表、资源与边界",
|
||
"合成实验不冒充真实伴侣体验验收;未验证真机/现网/真实档案(本卡范围禁止触达)"
|
||
]
|
||
}
|