Your judges are called Evaluators in the dashboard, and each round has its own Evaluators tab. Here's how to add them, keep track of their progress and help them get started.
I. Add evaluators to a round
You can add evaluators one by one, in bulk, or from another program or round.
Open your program and click the round's tab.
Click the Evaluators tab.
Click + Add Evaluator. The Add Evaluators(s)/Panel dialog opens on Add Evaluator.
Choose an option (see below) and fill in the details.
Click Add.
Judging as an admin? Don't add your own admin email as an evaluator. Turn on Enable admin judging in the round's Settings → Evaluation Settings instead. See Judging Submissions as an Admin.
A. Ways to add evaluators
Add a single evaluator: enter First Name, Last Name and Email.
Add multiple evaluators: add up to 50 at once. Paste their emails (separated by commas), or upload a CSV file with emails and names in two columns, without headers.
Add evaluators from other programs/rounds: select the source round from the dropdown, then pick specific evaluators or tick the option to move all evaluators from the previous round.
B. Invitation options
These checkboxes are available with every option:
Automate assignment: assigns submissions automatically when evaluators log in.
Send an instant login link (expires in 60min): sends a one-time link so evaluators can log in without a password. The link expires after 60 minutes.
Customize message: write your own invitation for this round. It replaces the default Evaluator Invitation template from the round's Messages tab.
Good to know: share your program URL with evaluators (click the copy icon on the far right of the banner at the top of the Evaluators tab). Evaluators log in through the program, not the admin dashboard.
II. Manage evaluators
The Evaluators tab shows each evaluator's Progress, Assigned Track, Assigned, Evaluated and Remaining submissions, average, highest and lowest scores, time spent, and any Assigned Rules.
You'll find every action in two places:
the ⋮ menu on an evaluator's row, or
the toolbar above the table, once you've selected one or more rows.
A. Quick actions
Action | Purpose |
Add Star / Add Tag | Mark an evaluator as a favorite or add labels (for example "AI" or "Senior") for filtering. |
Add Note | Store context such as an evaluator's expertise or availability. |
Send Message | Email the selected evaluators from within the round. |
Export | Download the evaluator list with their progress and scores. |
Assign Submissions / Unassign | Give or remove submissions for the selected evaluators (see below). |
Edit | Update an evaluator's name, email, panel or other details. |
Reset Password / Change Password | Send a reset link, or set a new password yourself. |
Send Instant Login | Email a one-time login link (it expires after 60 minutes) so the evaluator can log in without a password. |
Remove | Remove the evaluator from the round (you'll be asked to confirm). |
Collected scores outside Untap? You can import evaluations. See Importing Evaluations.
B. Assign submissions
Select one or more evaluators and click Assign Submissions in the toolbar. In the Assign Evaluators dialog, you can assign by hand or by rule: under Assign evaluators based on, choose Assign based on submission tracks or Assign based on participant tag(s), then click Assign to evaluator/panel. See Assigning Judges to Submissions for the full steps.
III. Group evaluators into panels
Panels are groups of evaluators that you can manage and assign submissions to together.
In the Evaluators tab, switch to Panels.
Click Add Panel.
Each panel shows its evaluators, progress, scores, time spent and assigned rules.
Troubleshooting tips
Evaluator can't log in? Open the evaluator's ⋮ menu and use Send Instant Login, Reset Password or Change Password. Make sure they're using the program URL.
Did the evaluator log in? Click the Gear icon → Users → Evaluators and check the Last Seen column. If it's empty, they haven't logged in yet.
No submissions after login? Check that the program is published, the round's Evaluation Dates are open (Settings → General Settings, including the Timezone), the evaluator is in this round's Evaluators tab with Assigned above 0, and Disable submission preview for evaluators is off.
Seeing "User exists. Remove from users to add as a jury"? If it's your own admin email, turn on Enable admin judging instead (see above). Otherwise, that person is already a participant. Go to Gear icon → Users → Participants, remove them there, then add them as an evaluator.
Need a hand? Message us in chat.
What's next?
With your evaluators assigned, your focus shifts to tracking and reviewing submissions.