Recently I was asked to review a paper for a renowned engineering journal of IExx.
After all reviewers submitted their comments, I downloaded the review PDF with all commments and learned the manuscript got comments from SIX reviewers. The manuscript was not outstanding in any way, no room temperature superconductor and no very trendy technology at all, just bread and butter fundamental research.
4 reviewers voted for minor revision, 2 for major revision, no one for outstanding contribution. There was a lot of redundancy in the different comments, especially on missing references.
I'm publishing and reviewing papers for over 10 years now, I never heard of more than 3 reviewers in physics journals. The journal above was a journal with a main scope and focus on sensors. Even for a room temperature superconductor submission I cannot imagine and suggest to use more than 3 reviewers, maybe more after the first review if the 3 reviewers vote reject, publish as is, major revision.
So what happend here?
Personally I feel this is a huge waste of my time (nearly one afternoon), the other reviewers and the manuscript authors. No one of us would likely have started to interact with the journal knowing this procedure.
So the question is, within the review process, if, how and whom I should contact to communicate this?! The ADM and associate editor is not sufficient for my taste. Personally, whatever the revised manuscript will look like, I don't feel the obligation to read it again (anyway voted for minor revision). If I can trust the editor to do his job and check if the minor revision was handled correctly I also don't know after this procedure.
To me this review process looks like a complete mess. I have an idea and will to communicate this to the journal AND the other anonymous reviewers (if possible in the online review mask at all), but the biggest problem I see is that this will mostly harm the manuscript authors, who were the last to know of the SIX reviewers.
Actually, I was thinking also already several times to publish in that journal. Currently surely not.
So who is and what is the diplomatically correct way to inform everybody on the journal site that this is a mess and waste of time and from my point of view several people on journal site made here mistakes or didn't pay attention without harming the authors or myself for future submissions?
And how "much" "unnormal" is this kind of case. On a scale from 1 to 11 reviewers! (Sorry for sarcasm)
EDIT to the commenters:
I'm upset because it is a waste of my time and many authors pick a journal for max. 2 or 3 reviewers. If the associate editor has a hard time to find reviewers, it's rather a issue of the manuscript or wrong journal pick, but not to be solved by sending 6-10 invitations for review. When many journals seem to be able to organize 2-3 reviewers, then this is simply unprofessional to me. I'm also not hiring 2 grad students for same topic in case one fails, because it is tax money. Avoiding any kind of redundancy should have highest priority when time and money is limited in research, not only in manuscripts.
The solution is quite simple in the digital age: When 2-3 reviewers have downloaded on the website the manuscript, no further downloads/reviewers are allowed. This is a journal issue, not one of the associate editor who does like the reviewers an voluntary unpaid job.
I'm even more surprised, some of the commenters find this an acceptable situation? If this becomes the rule, then your future manuscripts will have a hard time to find reviewers at all. But you can answer, why you think, and my reaction is totally wrong...
The underlying important question here is simply: How much review is enough and how to practice and establish this in the community, not how can we explain such waste of time still happens in 21th century in some cases.
And personally I can only recommend to publish and review in journals that keep this practice to limit the peer review to the maximum necessary amount of work for all. The opposite of it is redundancy. This time should be better used to reproduce work of other authors.