Two simple questions by a reviewer
Posted on September 29th, 2006 by Roland Krause in PublishingThe editorial to PLoS Computational Biology sounded like it would solve the questions that I was always afraid to ask. While it clarifies the situation to some extent, Ten Simple Rules for Reviewers leaves me down on those issues that usually cross my mind when submitting a review.
1. How much time should you plan for reviewing a paper?
I have seen both reviews solely stating “Not enough novelty” as well as verbose prose the length of the original manuscript. An overly lengthy review is more showing off than an aid in the editorial decision in my eyes but how much information does the editor really want? The number of words would provide at least a rough guide. I typically reserve four hours for a review, which I found sufficient to review a paper thoroughly, if the paper is in my field but allocated time will vary for each referee.
2. Was my review useful?
Bourne and Korngreen make the point that your review will reflect on you in the round of editors. I often wonder whether my reviews in the current form were useful to the editors. They always say so (why do I complain) but the lack of any feedback makes it quite difficult to improve. A rating by the editor (as in reviews on Amazon) obviously does not make too much sense but two lines of critical feedback could prove useful.
A recurring remark in the editorial was the blank statement to consult the editors if questions arise. A little less formality in the process might be a good move to improve the situation. Maybe one should simply ask.