Comments on: An Introduction to A/B Testing

By: amit02

amit02 — Fri, 26 Feb 2010 07:41:45 +0000

its really informative !!
is there any tool where i can get download …

By: Dog G

Dog G — Fri, 28 Aug 2009 16:22:56 +0000

Thank you – I've learnt a lot from your article.
Now, I've just got to implement it…

By: nicmarson

nicmarson — Fri, 31 Jul 2009 23:01:15 +0000

I enjoyed this article, very well presented and great examples. I'll be watching for the follow-ups. By the way, I found it from Ryan Carson's article, “How to do A/B Testing in WordPress”.

By: nicmarson

nicmarson — Fri, 31 Jul 2009 23:00:20 +0000

I enjoyed this article, very well presented and great examples. I'll be watching for the follow-ups. By the way, I found it from Ryan Carson's article, “How to do A/B Testing in WordPress”.

By: Tim Cederman

Tim Cederman — Thu, 23 Oct 2008 06:16:25 +0000

Great article as always (and the preamble and follow up ones). As someone with a qualitative research background, I’ve really come around to the importance of data-driven design and taking the bias out of design decisions. However, while you qualified your statement “the landing page with the higher conversion rate is better”, I think it’s more than just unsustainable incentives (and the like) that need to be taken into account.

Two pages may yield the exact same conversion rate – however they may offer a vastly different quality of the conversion (demographic of the user) and experience for the user. I’m not sure why there is often a rift between qualitative and quantitative research as they are really powerful when used in a complementary fashion. Without being able to actually talk to the user and getting a sense of who they are and what their experience was like it’s difficult to infer this information otherwise.

Looking forward to the next two articles!

By: Jesse

Jesse — Wed, 15 Oct 2008 17:24:52 +0000

Frank,

Give GWO a try, it might do what you need. I usually write my own.

By: Frank Licht

Frank Licht — Wed, 15 Oct 2008 10:13:33 +0000

Nice article :) Really helped me with the basics. You allready stated the Google Website Optizer is farly limited, but which tool would you recommend then? Thanks in advance!

By: Jesse

Jesse — Sun, 12 Oct 2008 00:25:04 +0000

Prakash,

Google has the Google Website Optimizer, which supports both A/B and multivariate testing, but it’s fairly limited. It only measures “conversion” events.

You can’t, say, segment Google Analytics reports based on GWO experiments.

By: Prakash S

Prakash S — Sat, 11 Oct 2008 22:34:43 +0000

Does google analytics/ other analytics tool help you with A/B testing? Good intro to A/B testing.

By: Jesse

Jesse — Mon, 06 Oct 2008 20:44:50 +0000

Douglas,

Thanks for the kind words. Will do!