Optimizely Web Experimentation Reviews & Product Details - Page 11

Having a switchboard for controlling experiments Review collected by and hosted on G2.com.

Rather limited integration to our user metadata which makes the readouts really one dimensional Review collected by and hosted on G2.com.

Honestly, I wish I had never purchased this product. It use to have this easy-to-use drag and drop feature that no longer is available - I did not know when purchasing it. I feel like I was sold on ease-of-use - feel misled. Review collected by and hosted on G2.com.

The tool is clunky and non-intuitive. It was not like this in previous iterations. I also dislike how the SVP of N. American Sales treated me - not willing to field my calls or concerns when I reached out to them. It's this kind of poor leadership that has taken this company in a different direction than I had previously experienced. Terrible product and a terrible team. Review collected by and hosted on G2.com.

Visual editor real time testing good support Review collected by and hosted on G2.com.

The code editor is hard to sue sometimes, Review collected by and hosted on G2.com.

Optimizely has allowed our product management, design and marketing teams to create A/B tests without involvement from our developer team. There is only a small learning curve but then you are off to the races. Review collected by and hosted on G2.com.

Resources for getting started can be a bit confusing and not as straightforward as they could be - I ended up needing to learn how to use the tool from someone at my company instead of the Optimizely docs. This was a while ago, so not sure if this has improved recently. Review collected by and hosted on G2.com.

Optimizely has a great user-friendly interface for managing and reporting on customers in a database. Review collected by and hosted on G2.com.

In specific one-off scenarios, Optimizely can be limited in capabilities. Review collected by and hosted on G2.com.

Very easy to install. Add the snippet into your website and you can start experimenting. Thevisual editor is pretty easy and intuitive to use. After a few weeks, we made a tweak to our plp and re-ordered a filter. this improved my sales by 11% and paid for the license. Very easy to use with react.js Review collected by and hosted on G2.com.

There could be better controls within the editor to centre text and align boxes. You also need to pay for a higher subscription to get the multi-arm bandit testing feature. Review collected by and hosted on G2.com.

Deployment of experiments and segmentation of audiences are made easy while using optimizely. Review collected by and hosted on G2.com.

Creating and tracking custom events through deployments of tag managers can get complicated. The support is helpful. Review collected by and hosted on G2.com.

Easy to use, can track multiple elements - can paint a full picture on impact across the board

Edge is slightly better for page performance Review collected by and hosted on G2.com.

Impact on CWV, sometimes dubious about results

I am sure that sometimes Optimizely "fails" and some users aren't seeing control or variant. When this happens, I have some reason to believe that their actions are still tracked by metrics - if true this would basically completely hinder the validity of the results

Also now using Edge. It is so so slow to QA, which seems crazy, considering everyone will be QAing their experiment. Any small changes to code takes ages to upload to becoming live Review collected by and hosted on G2.com.

You can update DOM on the fly and tailor your experiment for your user needs. It has good analytics and you can use it to analyise your application to see how it is behaving and if your A/B testing is successful or not. If it is successful you can implement the solution to all your users permenently see the good version of your application. Optimizely UI is also very user firnedly and easy to use. It also forces you to sue to factor authentication so your account is secure and less likely to get hacked. There are also a lot of user permisisons so you can decide which user should have which kind of access. I would recommend using optimizely. Review collected by and hosted on G2.com.

Sometimes the UI doesn't work on optimizely if you don't have the correct optimizely plugin installed and configured. It is also difficult to reset two factor authentication by the user. For example if you get a new phone and get a new authentication app then you need to contact the adminsitrator of your account to reset the two factor authentication so you can set it up and log in again otherwise you will be stuck and not able to log in to optimizely. Review collected by and hosted on G2.com.

Optimizely is being used by our dev team as well as our client's marketing team to conduct A/B tests and Personalization test on client e-commerce website to help increase conversion, average order value and other key metrics, as well as to quickly and easily make cosmetic changes until the development team can catch up and implement them on the back-end. Prior to using Optimizely, we had other tool (should I mentioned it or not; not sure) but it had so many issues working with new technologies, very hard to use by marketing team and super costly. This tools solve all of these issue. A few key features that really attracts us to work with this tool.

1. Optimizely's user interface and WYSIWYG editor are easy to use and don't require coding experience, but allows you to get dirty in JavaScript and CSS if necessary. This makes it easy for anyone to pick up and start working with it. One of the great feature is extensions where in a Dev can create sort-of prototype template for certain feature(example Popup/Lightbox) and any non-dev person or marketing team can quickly utilize that by just feeding required information (Popup/Lightbox text content). So easy and quick. Reduce the pain for dev and no support required.

2. They provide excellent and attentive support. My team have called in to their support line a few times to raise issue or ask questions on understating of tool in-depth and they were always very easy to work with and helped my team solve their problems.

3. Test results are clear and easy to read. They have great graphs and tables to help you see how different variations performed, how likely a variation is to beat the baseline, and how well that stacks up against other variations. Even with multivariate tests, the results are clear and concise.

4. The ability to add custom JavaScript and CSS per test is very convenient and makes it easy to make more detailed changes right from within Optimizely. The concept of "Shared Code" specific to test or globally is an awesome feature. Dev can split their code to keep at right place and hence load efficiently, reduces code size, execution time and device load.

5. Traffic allocation options are convenient and allow you to easily split traffic to different variations.

6. Prioritization between two experiences is also a nice feature and helps when two experiences are trying to manipulate same element to decide the order of changes taking place

7. Optimizely integration is super easy. With one line of JavaScript, you are able to install Optimizely on your website and start testing. Minor configurations may be required within the tool based on product specific requirements but never takes much time.

8. Doumentation is excellent and very helpful. Review collected by and hosted on G2.com.

Well, this tool cover mostly all the feature you require to run a test quickly. But with new technologies and product architecture, there is always a scope to make little-little improvements. Here are some of my observations so far.

1. Depending on the page scenario, it sometimes loads pages very slowly.

2. Linting feature in this tool for JavaScript and CSS is excellent. But sometimes, it takes little time (~15-30 Sec) to load large code and switch between CSS to JavaScript editor and vice-versa. Since developers tend to have their boilerplate setup with all linting and validation, there should be a toggle to ON/OFF linting feature to increase load time.

3. Concept of profile scripting wherein we can divide an audience into two buckets randomly or based on some JavaScript logic. A feature like this will help businesses to run two A/B test parallel due to their reasons. This kind of requirement is not rare and keeps coming often. Ideally, running two A/B tests in parallel is not recommended. Review collected by and hosted on G2.com.