Batch Sizing

Generally, a batch size of 100-200 recipients per variation is recommended 13.

The correct batch size for testing messaging in a cold email campaign depends on balancing statistical significance with practical constraints. Generally, a batch size of 100-200 recipients per variation is recommended

1⁠

⁠

3⁠

Here's why this range is suitable:

Statistical significance: While not fully statistically significant, this sample size provides enough data to identify trends and patterns in recipient behavior

1⁠

⁠

2⁠

Qualitative insights: Even with a smaller batch, you can gather valuable qualitative feedback from responses, which can inform future campaign improvements

2⁠

⁠

Risk mitigation: Testing with smaller batches allows you to identify potential issues before scaling to larger audiences, reducing the risk of damaging your sender reputation

1⁠

Continuous optimization: Running multiple small tests (2-5 concurrent A/B tests) allows for ongoing refinement of your messaging

2⁠

Resource efficiency: Smaller batch sizes are more manageable for analysis and don't exhaust your entire prospect list

3⁠

Remember that cold email testing is an iterative process. While you may not achieve full statistical significance with smaller batches, the insights gained can still significantly improve your campaign performance over time

1⁠

⁠

2⁠

Want to print your doc?
This is not the way.

Try clicking the ⋯ next to your doc name or using a keyboard shortcut (

CtrlP

) instead.