Alex RaineyAlex is an experienced CTO and founder who largely focuses on all the technical areas of My AskAI, from AI Engineering, Technical Product Management and overall Platform Development.
Created time
Jul 15, 2024 11:44 AM
Author
Tags
Image
Publish date
Oct 24, 2023
Slug
quick-testing-for-startups-time-based-conversion-comparison
Featured
Featured
Type
Article
Ready to Publish
Ready to Publish
A Good Option if You're Too Time or Resource Constrained to Run a Proper A/B Test
Run a time-based comparison. Conversion from the previous 2 weeks without the change, then 2 weeks with the new change.
It's not perfect (I know). But it's better than not testing.
You want a culture of testing at your startup!
- Ensure conversion was fairly stable for the previous period, e.g. 2 weeks
- Ensure lots of things aren't changing that will impact the chosen metric
- If the results are really surprising, consider a proper A/B test
At a startup, we don't have the luxury of time or infinite engineering resources.
Your job as a founder is to make good decisions with limited information, that push the company and product forward.
Written by
Alex Rainey
Alex is an experienced CTO and founder who largely focuses on all the technical areas of My AskAI, from AI Engineering, Technical Product Management and overall Platform Development.
