ab-lab: a versatile platform for A/B experimentationÂ
ab-lab: a versatile platform for A/B experimentationÂ
Description: There are two classes of questions that we ask ourselves during an experimentation observation:
Pre-test:
What is the thing I am testing (hypothesis test)?
Are my A and B groups distinct enough to be tested?
What should be the experiment duration?
What is the sample size that is required?
Post-test:
Do the observations QC pass?
Accept/reject the Null hypothesis?
More insights on the statistical differences?