
A/B Test Traffic Splitting: Statistical Validity at Low Volume
Low-traffic tests fail on peeking and weak MDE budgets, not on sample size alone. Fix the split, pre-commit to an MDE, and use methods that survive monitoring.
Tengence Team2026-11-15

Low-traffic tests fail on peeking and weak MDE budgets, not on sample size alone. Fix the split, pre-commit to an MDE, and use methods that survive monitoring.

MTA and MMM answer different questions. Incrementality tests give the causal anchor, while a metric dictionary and dashboards align both views on one metric.