Evaluation Settings
Configure evaluation options including randomization, blinding, and display preferences.
Available Settings
Evaluation settings let you control how experiences are presented to evaluators and how ratings are collected.
Randomized Presentation Order
When enabled, the left-right position of Experience A and B is randomized for each evaluator. This helps eliminate position bias, where evaluators might unconsciously favor whichever experience appears on a particular side.
Evaluator Blinding
Blinding hides the labels of Experience A and B from evaluators. Instead of seeing named labels, evaluators see neutral identifiers. This reduces bias when evaluators might have preconceptions about one of the experiences.
Rating Scale
Choose between a 5-point or 7-point rating scale. The 5-point scale is simpler and works well for most evaluations. The 7-point scale provides more granularity for nuanced assessments.