Ask Editors to Rate Reviews

Publications may ask Editors to rate the quality of reviews (on a scale of 1-100). The rating is done at the time the Editor submits a decision on a manuscript. These ratings may be configured as required (i.e., must be submitted before the Editor's decision) or optional.

The Review Rating field appears on the Individual Reviews and Comments page for each Reviewer, accessed from the View Reviews and Comments page by clicking the Reviewer's recommendation term. The Editor's Decision and Comments page can also be configured to include a Review Ratings section, which lists all Reviewers and a Rate Review field for each review (for the current revision).

An Editor may enter a separate rating for each revision of the submission. For example, if a Reviewer reviewed a paper three times (for the original submission, Revision 1, and Revision 2), the system can hold three different ratings, one for each of the Reviewer's completed reviews.

Each submitted review may receive only one rating. If there are two or more Editors in the decision chain, they all share the single Review Rating. For example: The Associate Editor enters a rating of 85 when making his decision. The Editor-in-Chief can then change the rating to 50 but cannot add a separate rating of her own.

If the feature is set to require review ratings before a decision, this requirement applies to the lowest Editor in the chain. In the example above, the Associate Editor would be required to rate all reviews for the current revision before submitting his decision. The Editor-in-Chief would be able to modify the Associate Editor's ratings, and would also be required to rate any new reviews that came in while the Editor-in-Chief was handling the paper.

Note: The system does not track the history of all ratings entered. Only the ratings in place when the final decision is made are stored in the system.

To Configure:

Go to PolicyManager > Reviewer and Editor Form Policies > Editor Decision Policies > Configure Options for Review Rating.

On the Configure Options for Review Ratings page, check the box next to the setting(s) to enable:
- Display Review Ratings on the Submit Editor's Decision and Comments page.
- All reviews for the current revision must be rated before Editor's decision is made. (This option requires that the lowest level Editor enter ratings before submitting their decision. Higher level Editors may overwrite the lower level Editor rating if desired.)
Then enter any instructions to display to Editors.
When finished, click Submit.