People keep hearing about A/B testing, but not a lot of people understand it. Rather than focusing on what your software does, it helps you focus on what your customers do. This talk will introduce some basic concepts of A/B testing, explain some common mistakes people make, and (if I'm lucky), will introduce the first open-source A/B testing module for Perl (I've already written it, but it needs to be renamed and have a better interface).