Spreadsheet: 41786ed7-82a3-4a3f-9ac7-771309d981bb
Sheet: Validation

 |  |  | Validation Information |  |  |  |  |  |  |  |  |  |  |  | MECLABS LLC © - All Rights Reserved
 |  |  | TEST PLANNING
 | 1 |  | Minimum Sample Size Calculation (based on projected data)
 |  |  | What is the expected conversion rate (or success rate) for the control? |  |  |  | ?
 |  |  | What is the minimum relative difference you wish to detect? |  |  |  | ?
 |  |  | What is your desired level of confidence? |  |  |  | ?
 |  |  | Number of standard deviations for this confidence level:
 |  |  | Required standard deviation:
 |  |  | Expected p(1-p):
 |  |  | Number of observations per treatment:
 |  |  | How many treatments will you have (including the control)? |  |  |  | ?
 |  |  | Projected Minimum Sample Size: |  |  |  | ?
 | 2 |  | Test Duration Calculation (based on projected data)
 |  |  | What is your estimated traffic to the test (i.e. arrivals or visits per day)? |  |  |  | ?
 |  |  | Number of treatments (including the control):
 |  |  | Estimated number of conversions per day:
 |  |  | Estimated minimum acceptable sample size (# obs.)
 |  |  | Projected Minimum Test Duration (days) |  |  |  | ?
 |  |  | POST-LAUNCH ANALYSIS
 | 3 |  | Test Data & Results
 |  |  | Control/Treatment Description |  | Samples |  | Conversions (Successes) |  |  | Failures |  | Conv Rate%
 |  |  | Control - [enter the control description here] |  |  |  |  |  |  |  |  |  |  | ?
 |  |  | Treatment 1 - [enter the treatment description here] |  |  |  |  |  |  |  |  |  |  | ?
 |  |  | Treatment 2 - [enter the treatment description here]
 |  |  | Treatment 3 - [enter the treatment description here]
 |  |  | Treatment 4 - [enter the treatment description here]
 |  |  | Totals:
 |  |  |  |  | [NAME]? |  |  |  |  |  |  |  |  | ?
 | 4 |  | Determination of Significant Variation
 |  |  | Control/Treatment Description |  | Samples |  | % Traffic |  |  | Conversions (Successes) |  | Conversion Rate
 |  |  | Baseline Treatment [select from dropdown menu] |  |  |  |  |  |  |  |  |  |  | ?
 |  |  | Comparative Treatment [select from dropdown menu]
 |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  | Baseline Treatment [select from dropdown menu]
 |  |  | Totals: |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  | Comparative Treatment [select from dropdown menu]
 |  |  |  |  | Conversion Rate Standard Error:
 |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  | Baseline: [select from dropdown menu]
 |  |  |  |  | Conversion Rate Difference: |  |  |  |  |  |  |  |  |  |  |  |  | Comparative Treatment: [select from dropdown menu]
 |  |  |  |  | p-Value:
 |  |  |  |  | Conversion Rate % Diff: |  |  |  |  |  |  |  |  | ?
 |  |  |  |  | Conversion Rate Test Statistic:
 |  |  |  |  | [NAME] of the Diff in Conv Proportions: |  |  |  |  |  |  |  |  | (sample size is sufficient when less than d-Critical, below)
 |  |  |  |  | Stat Sig Threshold for the Diff in Proportions: |  |  |  |  |  |  |  |  | (d-Critical)
 |  |  |  |  | Actual Level of Confidence: |  |  |  |  |  |  |  |  | ?
 |  |  |  |  | Significant Variation: |  |  |  |  |  |  |  |  | ?
 | 5 |  | Do You Have Conclusive Results for This Pair of Treatments? |  |  |  |  |  |  |  |  |  |  | ?