目标函数: 提升收到 bot 评论用户的活跃、留存、互动与创作意愿。报告包含描述性日监测与本周 PSM 匹配验证。
对象: 非 bot、非 internal 用户。指标: 当日触达且活跃用户数、当日其他活跃用户数。
指标定义: touched_active_users / active_non_bot_users。
方法: 倾向得分 + 同日分层最近邻匹配(无放回)。
| index_date | matched_pairs | d1_active_treat | d1_active_control | d1_active_lift | d3_active_treat | d3_active_control | d7_active_treat | d7_active_control |
|---|---|---|---|---|---|---|---|---|
| 2026-03-23 | 94 | 70.21% | 52.13% | 34.69% | 74.47% | 63.83% | NA | NA |
| 2026-03-24 | 84 | 67.86% | 57.14% | 18.75% | NA | NA | NA | NA |
| 2026-03-25 | 104 | 45.19% | 35.58% | 27.03% | NA | NA | NA | NA |
绝对值越接近 0 越好;用于观察匹配前后样本可比性改善。
| feature | pre_match_smd | post_match_smd |
|---|---|---|
| pre7_active_days | -0.220 | -0.119 |
| pre7_comments | 0.023 | -0.031 |
| pre7_posts | 0.179 | -0.000 |
| pre7_received_human | 0.019 | -0.071 |
| account_age_days | -0.205 | 0.101 |
用于每日巡检触达覆盖与活跃盘子大小。
| stat_date | touched_users | touched_active_users | active_non_bot_users | other_active_users | touched_share_in_active |
|---|---|---|---|---|---|
| 2026-02-26 | 152 | 122 | 7987 | 7865 | 1.53% |
| 2026-02-27 | 129 | 97 | 7666 | 7569 | 1.27% |
| 2026-02-28 | 117 | 90 | 7319 | 7229 | 1.23% |
| 2026-03-01 | 148 | 122 | 6952 | 6830 | 1.75% |
| 2026-03-02 | 114 | 86 | 7155 | 7069 | 1.20% |
| 2026-03-03 | 97 | 80 | 6787 | 6707 | 1.18% |
| 2026-03-04 | 82 | 60 | 5577 | 5517 | 1.08% |
| 2026-03-05 | 71 | 54 | 4472 | 4418 | 1.21% |
| 2026-03-06 | 64 | 52 | 4948 | 4896 | 1.05% |
| 2026-03-07 | 98 | 77 | 6433 | 6356 | 1.20% |
| 2026-03-08 | 116 | 91 | 6482 | 6391 | 1.40% |
| 2026-03-09 | 99 | 66 | 4683 | 4617 | 1.41% |
| 2026-03-10 | 64 | 50 | 4157 | 4107 | 1.20% |
| 2026-03-11 | 68 | 55 | 4164 | 4109 | 1.32% |
| 2026-03-12 | 82 | 64 | 4340 | 4276 | 1.47% |
| 2026-03-13 | 100 | 80 | 5318 | 5238 | 1.50% |
| 2026-03-14 | 123 | 98 | 7012 | 6914 | 1.40% |
| 2026-03-15 | 137 | 101 | 6850 | 6749 | 1.47% |
| 2026-03-16 | 95 | 63 | 5630 | 5567 | 1.12% |
| 2026-03-17 | 65 | 42 | 5630 | 5588 | 0.75% |
| 2026-03-18 | 86 | 63 | 4750 | 4687 | 1.33% |
| 2026-03-19 | 77 | 56 | 4815 | 4759 | 1.16% |
| 2026-03-20 | 97 | 72 | 5632 | 5560 | 1.28% |
| 2026-03-21 | 123 | 90 | 7413 | 7323 | 1.21% |
| 2026-03-22 | 135 | 94 | 7161 | 7067 | 1.31% |
| 2026-03-23 | 94 | 59 | 5895 | 5836 | 1.00% |
| 2026-03-24 | 84 | 64 | 5958 | 5894 | 1.07% |
| 2026-03-25 | 104 | 80 | 5039 | 4959 | 1.59% |
清单文件: /Users/rating/workspace/neta-bi-runtime/task/20260127_AI评论策略整合/history/20260326_comment_ab_bot_participation_daily/data/csv/daily_ab_assignment_plan_20260325.csv
规则: 触达用户强制进入实验组,其余用户按 propensity decile 随机平衡至实验/对照。