Spammers do A/B testing
I’m a regular reader of Linda Bustos’ excellent Get Elastic blog. Ecommerce isn’t my specialty but it’s something that affects all of us who shop online so I find it very interesting to see just how much work goes into the tiniest of details.
One of the subjects that came up recently and intrigued me was A/B testing. To perform an A/B test, an online retailer makes a change to their website and supplies the changed pages to some but not all of their visitors while the remainder see the original pages. By monitoring the statistics from both groups separately, the retailer can determine whether the change is a good thing or not. For instance you might change the colour of the “add to cart” button. A casual observer might think a change like that makes no difference at all… but test with enough people and it seems that there can actually be a measurable variation from something this small. And if you don’t A/B test then you’ll never find out. The world of online retailers appears to be full of folks fretting over whether they’d get a 0.3% increase in conversion rate if they reduced the width of their checkout button by 2 pixels. And while you might laugh, they have every right to fret – that’s money they could be making… or losing.
I was looking through my email spam folder the other day and noticed something interesting. Spammers are doing A/B testing too.
Look at this extract from my junk mail folder. This isn’t showing all my spam but it is showing an interesting subset of the spam that arrives to various usernames on a domain that I’ve owned for nearly 10 years now.
From the subject lines it’s easy to see that there are two usernames which are receiving this spam. This is backed up by the emails appearing in pairs. But the most interesting feature is that the duplicated emails frequently have different subject lines. So, for example, the baby laundry detergent spammer is sending out (say) 5,000,000 emails seeing if it’s dermatologist testing that helps make the sale, and another 5,000,000 seeing if it’s the stain removal powers (and, for all we know, another 50,000,000 emails trying out other variations). Of course it goes without saying that the links embedded in the two emails are slightly different so the spammer can check the different response rates.
Other amusing things I noticed…
- the use of famous brands to increase recipient trust (that’s not really from Dell)
- one spammer selling both Rolex and Viagra (might as well hit all the spam stereotypes)
- he didn’t really have a job for me (the lying spamming b&%!#*d)