Skip to main content

Judges' Point of View

Understand the judge experience, from accessing accounts to reviewing and scoring submissions.

See your program through your evaluators' (judges') eyes. This guide walks through how they log in, find their assigned submissions, and score them.

Accessing the program

1. Setting a password and logging in

Evaluators get their login details in the invitation email.

  1. They open the invitation email and click Set Password.

  2. They create and confirm a password.

After that, they can log in in either of two ways:

  • With a password: on the program's login page, using their email and new password.

  • With an instant login link: by clicking Instant Login in the email, with no password needed.

Tip: instant login links expire. Evaluators can request a fresh link from the program's login page. As an admin, you can also send one from the round's Evaluators tab: open the evaluator's ⋮ menu and choose Send Instant Login.

2. The My Evaluations page

Once logged in, evaluators land on My Evaluations. For each program, they see:

  • the program name

  • the round they're assigned to

  • how many evaluations are Completed and Pending


Evaluating submissions

1. Starting the review

  1. The evaluator clicks the round name to open their list of assigned submissions.

  2. They click Evaluate next to a submission to start scoring.

Good to know: you set up the evaluation form and criteria. See Building Your Evaluation Form.

2. Choosing a view

If you've turned on more than one view, evaluators can switch between them with the Table, Card and Live buttons above the list:

  • Table: a compact list with scores, progress and quick actions.

  • Card: a visual grid of submission cards with status badges and actions.

  • Live: live judging, where evaluators score several submissions on one screen.

Tip: you choose which views are available, and the default one, in the round's Settings → Evaluation Settings.

3. Viewing and scoring a submission

Evaluate mode (side by side). When an evaluator clicks Evaluate, the evaluation form (criteria, choices and comments) appears on one side and the participant's answers and attachments on the other.

Submission details only. Clicking a submission's title opens Submission Details with the participant's answers only. Evaluators can click Expand to read full answers, then Start Evaluation when they're ready to score.

4. Finishing the evaluation

Evaluators can use the left and right arrows at the edges of the page (or in Submission Details) to move to the previous or next submission.

  1. When scoring is done, they click Submit.

  2. They choose what to do next:
    • Next Submission: keep evaluating.
    • All Submissions: go back to the list.
    • Edit: change their evaluation, if you allow editing.

Tip: to let evaluators change their scores later, turn on Allow evaluators to edit their evaluations until evaluation deadline in the round's Settings → Evaluation Settings.


What's Next?

Now that you've seen the evaluator's side, learn how to send bulk emails to all your users.

Did this answer your question?