Article: How we lost (and found) millions by not A/B testing

Over at Signal vs Noise:

We’ve always felt strongly that we should share our lessons in business and technology with the world, and that includes both our successes and our failures. We’ve written about some great successes: how we’ve improved support response time, sped up applications, and improved reliability. Today I want to share an experience that wasn’t a success.

This is the story of how we made a change to the site that ended up costing us millions of dollars, how we found our way back from that, and what we learned in the process.

Pretty enlightening. The next time you think you don't need A/B testing? Well, think again.