Tom responds to Peter Henne’s questions.
1. Is there an objective standard for “so what?” No, there is not. Yet, this doesn’t make it fully subjective. Any good paper will explain why what it reports matters, and few papers under-sell their findings. A reviewer’s job is to evaluate the degree to which those assertions are warranted. A good rule of thumb here might be, if you are struggling to decide whether a paper you are reviewing is important, it isn’t.
2. When is a methodological flaw a disqualifier? Always. Whether such flaws warrant a reject or an R&R depends upon the severity of the flaw and the potential significance of the results once the flaw is corrected.