Looks like Optimizely defaults to 1 tail tests, which only show that a variation is not worse than the control. Seems very misleading to market their tool as a product that helps you make data based business decisions.

I have never used Optimizely -- instead I developed my own software for A/B testing -- but if this blog post is true, that's pretty sloppy.