目标函数: 提升收到 bot 评论用户的活跃、留存、互动与创作意愿。报告包含描述性日监测与本周 PSM 匹配验证。
对象: 非 bot、非 internal 用户。指标: 当日触达且活跃用户数、当日其他活跃用户数。
指标定义: touched_active_users / active_non_bot_users。
方法: 倾向得分 + 同日分层最近邻匹配(无放回)。
| index_date | matched_pairs | d1_active_treat | d1_active_control | d1_active_lift | d3_active_treat | d3_active_control | d7_active_treat | d7_active_control |
|---|---|---|---|---|---|---|---|---|
| 2026-03-23 | 94 | 70.21% | 54.26% | 29.41% | 75.53% | 68.09% | NA | NA |
| 2026-03-24 | 84 | 67.86% | 47.62% | 42.50% | 77.38% | 53.57% | NA | NA |
| 2026-03-25 | 104 | 62.50% | 51.92% | 20.37% | NA | NA | NA | NA |
| 2026-03-26 | 102 | 46.08% | 32.35% | 42.42% | NA | NA | NA | NA |
绝对值越接近 0 越好;用于观察匹配前后样本可比性改善。
| feature | pre_match_smd | post_match_smd |
|---|---|---|
| pre7_active_days | -0.163 | -0.069 |
| pre7_comments | -0.009 | -0.044 |
| pre7_posts | 0.185 | 0.028 |
| pre7_received_human | 0.008 | -0.034 |
| account_age_days | -0.228 | 0.134 |
用于每日巡检触达覆盖与活跃盘子大小。
| stat_date | touched_users | touched_active_users | active_non_bot_users | other_active_users | touched_share_in_active |
|---|---|---|---|---|---|
| 2026-02-27 | 129 | 97 | 7662 | 7565 | 1.27% |
| 2026-02-28 | 117 | 90 | 7318 | 7228 | 1.23% |
| 2026-03-01 | 148 | 122 | 6952 | 6830 | 1.75% |
| 2026-03-02 | 114 | 86 | 7154 | 7068 | 1.20% |
| 2026-03-03 | 97 | 80 | 6786 | 6706 | 1.18% |
| 2026-03-04 | 82 | 60 | 5576 | 5516 | 1.08% |
| 2026-03-05 | 71 | 54 | 4472 | 4418 | 1.21% |
| 2026-03-06 | 64 | 52 | 4948 | 4896 | 1.05% |
| 2026-03-07 | 98 | 77 | 6433 | 6356 | 1.20% |
| 2026-03-08 | 116 | 91 | 6482 | 6391 | 1.40% |
| 2026-03-09 | 99 | 66 | 4683 | 4617 | 1.41% |
| 2026-03-10 | 64 | 50 | 4157 | 4107 | 1.20% |
| 2026-03-11 | 68 | 55 | 4164 | 4109 | 1.32% |
| 2026-03-12 | 82 | 64 | 4339 | 4275 | 1.47% |
| 2026-03-13 | 100 | 80 | 5317 | 5237 | 1.50% |
| 2026-03-14 | 123 | 98 | 7012 | 6914 | 1.40% |
| 2026-03-15 | 137 | 101 | 6850 | 6749 | 1.47% |
| 2026-03-16 | 95 | 63 | 5630 | 5567 | 1.12% |
| 2026-03-17 | 65 | 42 | 5630 | 5588 | 0.75% |
| 2026-03-18 | 86 | 63 | 4749 | 4686 | 1.33% |
| 2026-03-19 | 77 | 56 | 4813 | 4757 | 1.16% |
| 2026-03-20 | 97 | 72 | 5631 | 5559 | 1.28% |
| 2026-03-21 | 123 | 90 | 7409 | 7319 | 1.21% |
| 2026-03-22 | 135 | 94 | 7157 | 7063 | 1.31% |
| 2026-03-23 | 94 | 59 | 5892 | 5833 | 1.00% |
| 2026-03-24 | 84 | 64 | 5951 | 5887 | 1.08% |
| 2026-03-25 | 104 | 80 | 5031 | 4951 | 1.59% |
| 2026-03-26 | 102 | 84 | 4833 | 4749 | 1.74% |
清单文件: /Users/rating/workspace/neta-bi-runtime/task/20260127_AI评论策略整合/history/20260326_comment_ab_bot_participation_daily/data/csv/daily_ab_assignment_plan_20260326.csv
规则: 触达用户强制进入实验组,其余用户按 propensity decile 随机平衡至实验/对照。