Creating Side-by-Side Evaluations

What is a Side-by-Side Evaluation?

A side-by-side (SxS) evaluation places two experiences next to each other so evaluators can rate them on the same dimensions. This is the most common evaluation type for design comparisons, A/B testing, and competitive analysis.

Creating an SxS Evaluation

1. Navigate to the Evaluations page and click "New Evaluation".
2. Select "Side-by-Side" as the evaluation type.
3. Enter a name and optional description for your evaluation.
4. For Experience A, provide a URL or upload a screenshot. Do the same for Experience B.
5. Select the rating dimensions you want to include. You can choose from default dimensions or select a template.
6. Configure optional settings like randomized presentation order and evaluator blinding.
7. Click "Create" to save your evaluation.

Using URLs vs Screenshots

When you provide URLs, Autousers captures a live screenshot of each page for the evaluation. This works well for publicly accessible pages. For pages behind login walls or for static designs, upload screenshots directly.

Choosing Dimensions

Dimensions define what aspects of UX you are evaluating. Common choices include Visual Design, Usability, Information Architecture, and Content Quality. You can also create custom dimensions with specific rubrics tailored to your needs.