Showing Related Products A/B Test Results



Last updated: January 28th, 2024

I'm always trying to help people stop snoring and protect their teeth on The Mouthguard Store. One of the best ways in doing that is A/B testing the most effective product page. At first people told me that having related products under a product was a good idea so for a long time there were related products. My theory was that having related products under the product video was actually worse than showing them. My reasoning was that they are a distraction.

The results from the experiment are finally 90% certain so I'm going to implement them. The break down was as follows:

  • 4601 unique visitors
  • 2270 subjected to showing related products (26 converted at 1.15%)
  • 2331 subjected to no related products (38 converted at 1.63%)

I'm happy to know that I'm two for two on my assumptions. I've increased the conversion rate from 0% to 1.63% after running the two tests, previously I thought autoplay was more effective on videos and I was right. It's a great feeling to see the improvement.

My next test will be with the button text being "Buy Now" or "Add To Cart". Currently it says "Add To Cart" and I've read that this is a really tricky test because "Buy Now" is more effective on Monday and Tuesday and less effective on other days. If I had to bet on it, I'd say "Buy Now" is more effective on Monday and Tuesday but less effective during the rest of the week. Either way, I'm going to see what it's like when running 100% of the time first. If it's not overall more effective than I'll try it just on Monday and Tuesday.


Comments

No Comments

Post Comment

Prove you are human 13 + 9 =

Tagged: A/B Testing


Join my email list!



ryan
About Me

With over 15 years in tech, I've excelled as a senior software engineer, specializing in ASP.NET, C#, SQL, Azure, and front-end technologies. I've led diverse projects across various sectors, from startups to global corporations, particularly during my decade in the San Francisco Bay Area.


Sign Up With SoftSys Hosting! (My host)