Skip to main content

Choosing What Evaluators See (Evaluator Preview and Blind Evaluation)

Hide questions such as names or organizations from judges, hide the submission title for blind review, and set the order in which they see answers.

You choose which answers from the submission form your evaluators can see, and in what order. Use this to run a blind evaluation, for example by hiding each applicant's name, email and organisation.

Customize the evaluator preview

  1. Open the round and go to the Submission Form tab.

  2. In Select Track, choose the track.

  3. Click Evaluator Preview. The Customize Evaluator Preview window opens.

  4. Switch off Visible for each field evaluators shouldn't see.

  5. Drag fields to change the order evaluators see them in.

  6. Click Confirm Preview.

Hide the submission title

Each submission can show a title taken from one of its form answers, such as the applicant's full name or team name. Evaluator Preview only lists form questions, so hiding the name question there doesn't remove it from the title. There's no on/off switch for the title. Instead, you change which answer is used, or clear it.

  1. Open the round and go to the Submission Form tab.

  2. Click the Set Submission Title(s) icon next to the form selector. (You can also open it from the Submissions tab: ⋯ More options → Set Submission Title(s).)

  3. In the Set Submission Title(s) dialog, find the form or track. Click the Clear (x) button on its dropdown to remove the title, or pick an answer that doesn't identify the applicant (for example a project name).

  4. Repeat for each form or track listed.

  5. Click Save.

With no title set, submissions show their ID instead. This setting is for the whole round, so your Submissions table shows the same title or ID.

Tips

  • For a blind evaluation, hide every field that identifies the applicant: name, email, phone, organisation, website, and any uploaded files that include their name. Then check the submission title too.

  • Each track has its own form, so repeat these steps for every track.

  • You and other admins still see the full submission.

  • To hide the whole submission from evaluators instead, use Settings → Evaluation Settings → Disable submission preview for evaluators. Most programs don't need this.

Did this answer your question?