Running Autousers

Running Autousers on an Evaluation

1. Open the evaluation you want to run Autousers on.
2. Click the "Run Autousers" button.
3. Select one or more autouser personas to run.
4. Click "Run" to start the evaluation.
5. Wait for the Autousers to complete. This typically takes 10-30 seconds per Autouser.
6. Results appear automatically in the Results tab once complete.

Running Multiple Autousers

You can run multiple Autousers on the same evaluation. Each Autouser provides an independent set of ratings. This is useful for getting diverse perspectives and measuring agreement between different AI personas.

Autouser Results

Autouser ratings include both numerical scores and written justifications explaining why each score was given. These justifications appear in the Results tab alongside the scores.