评论 AB 实验每日监测

目标函数: 提升收到 bot 评论用户的活跃、留存、互动与创作意愿。报告包含描述性日监测与本周 PSM 匹配验证。

描述窗: 2026-02-27 ~ 2026-03-26 | 本周窗: 2026-03-23 ~ 2026-03-26 | 行为数据最新日期: 2026-03-27

本周匹配样本对
384
D1活跃率(实验组)
61.20%
D1活跃率(对照组)
46.35%
D1活跃Lift
32.02%

每日触达活跃 vs 其他活跃

对象: 非 bot、非 internal 用户。指标: 当日触达且活跃用户数、当日其他活跃用户数。

触达活跃占比(%)

指标定义: touched_active_users / active_non_bot_users。

本周 PSM 每日验证

方法: 倾向得分 + 同日分层最近邻匹配(无放回)。

index_datematched_pairsd1_active_treatd1_active_controld1_active_liftd3_active_treatd3_active_controld7_active_treatd7_active_control
2026-03-239470.21%54.26%29.41%75.53%68.09%NANA
2026-03-248467.86%47.62%42.50%77.38%53.57%NANA
2026-03-2510462.50%51.92%20.37%NANANANA
2026-03-2610246.08%32.35%42.42%NANANANA

匹配平衡性 (SMD)

绝对值越接近 0 越好;用于观察匹配前后样本可比性改善。

featurepre_match_smdpost_match_smd
pre7_active_days-0.163-0.069
pre7_comments-0.009-0.044
pre7_posts0.1850.028
pre7_received_human0.008-0.034
account_age_days-0.2280.134

描述性日级明细

用于每日巡检触达覆盖与活跃盘子大小。

stat_datetouched_userstouched_active_usersactive_non_bot_usersother_active_userstouched_share_in_active
2026-02-2712997766275651.27%
2026-02-2811790731872281.23%
2026-03-01148122695268301.75%
2026-03-0211486715470681.20%
2026-03-039780678667061.18%
2026-03-048260557655161.08%
2026-03-057154447244181.21%
2026-03-066452494848961.05%
2026-03-079877643363561.20%
2026-03-0811691648263911.40%
2026-03-099966468346171.41%
2026-03-106450415741071.20%
2026-03-116855416441091.32%
2026-03-128264433942751.47%
2026-03-1310080531752371.50%
2026-03-1412398701269141.40%
2026-03-15137101685067491.47%
2026-03-169563563055671.12%
2026-03-176542563055880.75%
2026-03-188663474946861.33%
2026-03-197756481347571.16%
2026-03-209772563155591.28%
2026-03-2112390740973191.21%
2026-03-2213594715770631.31%
2026-03-239459589258331.00%
2026-03-248464595158871.08%
2026-03-2510480503149511.59%
2026-03-2610284483347491.74%

每日 AB 分组执行

清单文件: /Users/rating/workspace/neta-bi-runtime/task/20260127_AI评论策略整合/history/20260326_comment_ab_bot_participation_daily/data/csv/daily_ab_assignment_plan_20260326.csv

规则: 触达用户强制进入实验组,其余用户按 propensity decile 随机平衡至实验/对照。

作者:Codex | 模型:GPT-5.3-codex | 部署时间(UTC):2026-03-27T07:22:45Z