Quick Testing for Startups: Time-Based Conversion Comparison

Short on time or resources for A/B testing? Try a time-based comparison! Measure conversions over 2 weeks before and after changes. It's not perfect, but it's better than no testing. Foster a testing culture at your startup and make informed decisions with limited resources.

Quick Testing for Startups: Time-Based Conversion Comparison
Created time
Jul 15, 2024 11:44 AM
Image
Group 1000004248.png
Publish date
Oct 24, 2023
Slug
quick-testing-for-startups-time-based-conversion-comparison
Featured
Featured
Type
Article
Ready to Publish
Ready to Publish

A Good Option if You're Too Time or Resource Constrained to Run a Proper A/B Test

Run a time-based comparison. Conversion from the previous 2 weeks without the change, then 2 weeks with the new change.
It's not perfect (I know). But it's better than not testing.
You want a culture of testing at your startup!
  • Ensure conversion was fairly stable for the previous period, e.g. 2 weeks
  • Ensure lots of things aren't changing that will impact the chosen metric
  • If the results are really surprising, consider a proper A/B test
At a startup, we don't have the luxury of time or infinite engineering resources.
Your job as a founder is to make good decisions with limited information, that push the company and product forward.

Start using AI customer support in your business today

Create free AI agent

Written by

Alex Rainey
Alex Rainey

Alex is an experienced CTO and founder who largely focuses on all the technical areas of My AskAI, from AI Engineering, Technical Product Management and overall Platform Development.