How do I hold a multi-round review process?

Some organizations use a multi-round review process, in which reviewers judge submissions through two or more rounds of reviews. Below are two common ways that multi-round review processes are held using Submittable.

--------------------------------------------

A. A multi-round review process in which the first round uses our basic Yes/No/Maybe rating system and the second round uses a Custom Review form:

  1. Log in to Submittable at https://manager.submittable.com/login

  2. Go to More > Account > Profile and scroll down to the Enable Voting checkbox. This checkbox is checked by default. If it is unselected, check it and click Update Profile.

  3. Create a submission category by following the steps in our help article. Because this first round of reviews uses our Yes/No/Maybe rating system, you can disregard the Review Designer tab when you’re creating your category.

  4. If you haven’t already, send invitations to your team members, or reviewers, to join your organization’s account by going to More > Team. After team members have accepted their invitations, go to your Categories page and click the name of the category you created above in step 3. Go to the Assignments & Notifications tab to select the names of any team members whom you’d like to automatically assign to submissions in this category. The selected team members will be auto-assigned to submissions in the category as the submissions are received. (Note: You can also batch assign submissions to team members at any time.)

  5. As your reviewers rate the submissions, you’ll see the score for each submission on the left-hand side of your Submissions list and in each submission’s Details page. If you click on a score in the Submissions list, you can see each reviewer’s individual rating for that submission. Read more about Yes/No/Maybe scoring here.

  6. To track your reviewers’ progress, use our Team Progress Report to see how many submissions a team member has not yet completed. You can also send Reminders to team members who have not yet completed their assignments.

  7. When your reviewers have rated all of their assigned submissions, label the submissions that are moving to the second round of reviews (e.g. by creating a label called “Round 2”).

  8. Create a custom review form for the second round of reviews by editing the category and following our help article here. When you make the review form live by checking the Make Review Form LIVE checkbox, scores from your first round of reviews will be hidden.

  9. Go to your Submissions list and use the Search Filter panel to filter by the second round label and batch assign the labeled submissions. If the second round of reviews will have new team members, or reviewers, who did not take part in the first round of reviews, you can invite and assign the new team members while batch assigning the second round of submissions. Your team members will now be able to complete this second round of reviews.

  --------------------------------------------  

B. A multi-round review process in which both rounds of reviews use a Custom Review form.

  1. Log in to Submittable at https://manager.submittable.com/login

  2. Go to More > Account > Profile and scroll down to the Enable Voting checkbox. This checkbox is checked by default. If it is unselected, check it and click Update Profile.

  3. Create a submission category by following the steps in our help article. For information on how to create a custom review form, follow the steps here.

  4. If you haven’t already, send invitations to your team members, or reviewers, to join your organization’s account by going to More > Team. After team members have accepted their invitations, go to your Categories page and click the name of the category you created above in step 3. Go to the Assignments & Notifications tab to select the names of any team members whom you’d like to automatically assign to submissions in this category. The selected team members will be auto-assigned to submissions in the category as the submissions are received. (Note: You can also batch assign submissions to team members at any time.)

  5. As your reviewers review the submissions, you’ll see the score for each submission on the left-hand side of your Submissions list and in each submission’s Details page. If you click on a score in the Submissions list, you can see each reviewer’s individual rating for that submission.

  6. To track your reviewers’ progress, use our Team Progress Report to see how many submissions a team member has not yet completed. You can also send Reminders to team members who have not yet completed their assignments.

  7. When your reviewers have reviewed all of their assigned submissions, label submissions that are moving to the second round of reviews (e.g. by creating a label called “Round 2”).

  8. Export your review data by going to your Categories list and clicking the download downloadbuttonpng button on the right-hand side of the appropriate category. The CSV file you download will list each team member’s review scores and the overall submission scores.

  9. Before you can begin the second round of reviews, you will need to email our support team to request that your review data be deleted. Please email your request to support@submittable.com and specify the submission category for which you would like to delete review data. Make sure you have exported your review data in step 8, so that you have a record of it; once our staff has deleted your review data, this data can no longer be retrieved from your account.

  10. After your review data has been deleted, you can edit the first-round custom review form as needed for the second round of reviews by following our help article here.

  11. Go to your Submissions list and use the Search Filter panel to filter by the second-round label. Then, batch assign the labeled submissions. If the second round of reviews will have new team members, or reviewers, who did not take part in the first round of reviews, you can invite and assign the new team members while batch assigning the second round of submissions. Your team members will now be able to complete this second round of reviews.

  --------------------------------------------  

Helpful information about custom review forms:

How do team members review submissions?

Can reviewers edit finalized review forms? Questions? Please email us at support@submittable.com

Organizations

  1. Getting Started With Submittable Guide
  2. How do I create or edit a submission category?
  3. New status: Completed
  4. How do I set up a submission category to sell a subscription or single issue?
  5. How do I use the Form Designer when creating or editing a category?
  6. How do I create a hidden category?
  7. How do I set up a blind review process?
  8. How do I add auto-labels for our submissions?
  9. How do I turn submission categories on and off?
  10. How do I set acceptable file types for a category?
  11. How do I add conditional logic to my submission form?
  12. How do I accept multiple files with a submission?
  13. Can I request metadata from submitters when they upload a file?
  14. How do I manually enter submissions?
  15. Can emailed submissions be automatically added to my submissions manager?
  16. How does submission scoring work?
  17. How do I review, make a note on, and rate a submission?
  18. How do we display submissions online for a public audience?
  19. How do I create a review form?
  20. Can reviewers edit finalized review forms?
  21. How do I hold a multi-round review process?
  22. How do I add a table to my application form?
  23. What spreadsheet formulas can I use in Tables?
  24. How do I add a field for internal use to my application form?
  25. Can I send additional forms to submitters to request more information?
  26. Can I schedule reminders for reviewers to review submissions or for submitters to complete additional forms?
  27. How do I use keyboard shortcuts to navigate between submissions?
  28. How do I add a private note to a submission?
  29. How do I add a Terms and Conditions checkbox to my submission form?
  30. How do I request agreement to terms and conditions when I accept a submission?
  31. What are the character limits for the Category Guidelines and Organization Profile Guidelines fields?
  32. How do I add a publication date to a submission?
  33. How do I use or remove the Calendar feature?
  34. How do I filter and organize the submissions in my submissions list?
  35. How do I label submissions?
  36. How do I assign submissions to team members for review?
  37. How do I automatically assign team members to incoming submissions for a specific category?
  38. Can I randomly assign submissions to a set number of reviewers?
  39. How many submissions are assigned to each team member and how many have they not yet reviewed?
  40. How do I attach a file to a submission?
  41. How do I replace the file on a submission?
  42. How do I send submissions to my Kindle?
  43. How do I delete a submission?
  44. How do I archive or unarchive submissions?
  45. How do I export our submission data?
  46. How do I batch export custom review data?
  47. How do I send an email to a submitter?
  48. How do I ensure new submissions get an automated response?
  49. How do I add a team member?
  50. How do I edit a team member's account?
  51. What does each team member level see?
  52. How do I customize the look and feel of my submission form?
  53. How do I upgrade or downgrade my Submittable subscription?
  54. What is an inactive plan?
  55. How do I sync the Calendar with other calendars?
  56. How do I change the default view displayed in the Submission Details screen?
  57. How do I cancel my Submittable account?
  58. Can I batch archive or batch delete submissions?
  59. How do I add and delete a file for a submission?
  60. How do I change the category of a submission?
  61. Can I integrate my Submittable account with Google Analytics?
  62. Does Submittable have an API?
  63. How do I use Zapier to connect my Submittable app to 3rd Party apps?
  64. How do I use the Submittable plugin on my WordPress site?
  65. How do I allow a submitter to edit a submission?
  66. How do I turn on or off the ability for submitters to request an edit on a submission?
  67. How can my organization receive reference letters?
  68. How can using Submittable increase the number of submissions our organization receives?
  69. How do I view and print submission document files?
  70. Can I charge a fee on my form?
  71. How do I sell memberships, subscriptions, or merchandise in my submission form?
  72. Can I charge submission fees in a non-US currency?
  73. What happens to my organization's account if we exceed our submission limit?
  74. Why did I get an error message when paying my invoice by credit card?
  75. Video File Transcode Error
  76. How do I unassign submissions?
  77. How do I remove a team member?
  78. How do I use response templates to send automated email messages?
  79. I have a Yahoo! or AOL email address. Why do my organization's emails come from notifications@email.submittable.com?
  80. How do I duplicate a submission category or form?
  81. How do I archive a submission category?
  82. When I do a batch file export, can I copy all files attached to the exported submissions into a single destination directory in Windows?
  83. How do I promote my organization’s creative call?

Feedback and Knowledge Base