Reviewer's Concerns about Excessive Simulation Results [closed]

Question

I am currently in the process of addressing the feedback received from a reviewer regarding a manuscript I've submitted. The primary concern raised is that there are "Too many simulation results presented in the manuscript. Almost five full pages of the manuscript are dedicated to sim-results, which is too much."

Have you encountered similar situations or have experience dealing with such feedback? The manuscript in question is a simulation-based work, totaling 17 pages. Given the nature of the research, a significant portion is dedicated to presenting simulation results.

I am unsure about the best approach to respond to the reviewer's comment. Should I consider condensing the results section, or is there a way to better justify the extensive presentation of simulation results in a simulation-focused manuscript?

Answer 1

Think of the reviewer as a reader who will more carefully read your article than the average reader. (Notice that I haven't said that the reviewer reads your article carefully, but only that they are more careful than the average reader, which is a pretty low bar.) So, if a reviewer does not understand something about your paper, then you can be pretty sure any future reader will not get it either. So the reviewer is not necessarily right, but all her/his/their comments are valuable feedback on how a serious reader would perceive your article.

So you claim that this is a simulation-focused article, but apparently the reviewer did not understand your article that way. That could be the problem. In that case, the solution is to keep the results part unchanged, but to improve the introduction, or the structure of the article to make the nature of the article clearer.

Alternatively, the reviewer could have understood the nature of your article, but thought that many of the results are superfluous and could maybe be relegated to an appendix.

So in short, you need to figure out what the problem is, and then solve it. This can be complicated, because the problem may not be what the reviewer says.

Answer 2

My first impression is that the reviewer thinks you've presented a lot of results, but not all of them are interesting. So either explain why it's important to run the simulation for all the different input parameters you used, or remove the results that are uninteresting.

Answer 3

Of course, I do not know the concrete paper you talk about, and might be completely off.

But there is a phenomenon that I sometimes call an "experimental desert" (or, in your case, a "simulation desert"). Endless experiments with variations of this or that without the reader getting a clear idea or direction where things are going.

You may, as author, want to retain the results as archivary information somewhere, and the supplementary material is a good place to act as the archive of your results.

The main paper, however, should give a compelling argument what you set out to study and what you found out. If a sequence of experiments and their results are mentioned, make a stringent case for how the question from one study follows from the previous or adds to it substantially.

I see another possible interpretation of this reviewer comment, however. Namely, that you are in a field where they may expect more real-world experiments or else theoretical computations, rather than simulations which are neither one nor the other.

Which of these might be plausible depends on your field.

TL;DR: I see two possible cases: Either you string together too many results with no compelling line of argument. Or else, the reviewer expects real-world experiments or else analytical approaches as opposed to simulations. You need to reflect which of these it might be.

Answer 4

You do not say say anything about the nature of your "results". My guess is that the problem is neither that there are too many experiments (simulations), nor that the results somewhat duplicate one another". Rather, I would guess that there is too little abstraction and that you have presented too much raw data that might better belong in either an appendix or, more likely, in a collection of supplementary material.

With that hypothesis (guess!) in mind, consider whether the results of the simulations can be abstracted in some way or presented in a way that makes the important issues clearer to the reader. Can you present any of the results in the form of graphics that highlight similarities and differences between the results of the simulations? Are there any descriptive statistics that are relevant to the results and which would summarize the results without overwhelming the reader?