In the dashboard, judges are called Evaluators. Each round has its own Evaluators tab.
I. Adding Evaluators to Your Program
You can add evaluators one by one, in bulk, or by moving them from a previous round. All methods start by clicking + Add Evaluator in the round's Evaluators tab. To add many at once from a file, you can also use the Import icon in the toolbar.
A. Invitation Methods
Add a single evaluator: enter First Name, Last Name and Email.
Add multiple evaluators: paste emails (separated by commas) or upload a CSV (two columns, email and name, no headers).
Add evaluators from another round: select the source round from the dropdown, then select specific evaluators or choose "Move all judges from the previous round."
B. Invitation Options
These options are available with every method:
Automate judges assignment: automatically assigns submissions when evaluators log in.
Send an instant login link: sends a one-time "magic link" so evaluators can log in without a password (expires in 60 minutes).
Customize message: overrides the default invitation template for this round. The default template is Evaluator Invitation in the round's Messages tab.
Note: Evaluators receive an email with login options. If the magic link expires, they can request a new one from the program's login page. Always share the program link (use the Copy URL icon at the top of the Evaluators tab), never the admin dashboard link.
II. Managing Evaluators
The Evaluators tab shows each evaluator's Progress, Assigned Track, Assigned, Evaluated and Remaining submissions, average, highest and lowest scores, time spent, and any Assigned Rules.
All actions are available from either:
the ⋮ Actions menu on an evaluator's row, or
the toolbar above the table (when one or more rows are selected).
A. Quick Actions
Action | Purpose |
Add Star / Add Tag | Mark an evaluator as a favourite or add labels (for example "AI" or "Senior") for filtering. |
Add Note | Store context such as an evaluator's expertise or availability. |
Send Message | Email the selected evaluators from within the round. |
Export | Download the evaluator list with their progress and scores. |
Assign Submissions / Unassign | Give or remove submissions for the selected evaluators (see below). |
Edit | Update an evaluator's name, email, panel or other details. |
Reset Password / Change Password | Send a reset link, or set a new password yourself. |
Send Instant Login | Email a one-time magic link (expires in 60 minutes) so the evaluator can log in without a password. |
Remove | Remove the evaluator from the round (you'll be asked to confirm). |
B. Assigning Submissions
Use Assign Submissions to control how submissions are allocated:
Default (Manual): pick specific submissions yourself from the Submissions tab.
By Submission Tracks: submissions are assigned automatically based on the tracks the evaluator reviews.
By Participant Tags: submissions are assigned automatically based on tags on the participant.
Rule-based assignment applies to submissions that arrive after the rule is set. For submissions you already have, see Assigning Existing Submissions to Evaluators in Bulk.
III. Creating and Managing Panels
Panels are groups of evaluators that you can manage and assign submissions to together.
A. Creating a Panel
In the Evaluators tab, switch to Panels.
Click Add Panel.
Enter the Panel Name and select the evaluators to include.
(Optional) Turn on Automate judges assignment for the whole panel.
Save the panel.
B. Managing Panels
Assign submissions: use the panel's ⋮ Actions menu, or select submissions in the Submissions tab and choose Assign evaluators/panels.
Track progress: the Panels table shows each panel's progress, scores and time spent.
Troubleshooting Tips
Evaluator can't log in? Use Send Instant Login or Reset Password, check the email address, and make sure they use the program link.
No submissions after login? Check the Assigned column, the round's evaluation dates (Settings → General Settings), and that the program is published. See Troubleshooting: Evaluators Can't See or Evaluate Submissions.
What's Next?
With your evaluators assigned, your focus shifts to tracking and reviewing submissions.