Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Obviously journals vary in their standards, but many of the more respected ones do require other scientists read and critique the paper. You can argue about the quality of these reviews, certainly it's a process that needs improving, but this is what "peer reviewed" means.

Trying to claim ArXiv papers are "peer reviewed" is utter nonsense. As you correctly point out, the only requirement to being on ArXiv is that someone with an account uploaded it there. There are no requirements that it passes any sort of verification or vetting process whatsoever, let alone having other scientists read and critique it.

There is a very vocal movement these days that is trying to argue that we should do away with the traditional peer review process. Apparently that sometimes includes trying to redefine the very definition of "peer review" as the OP did.



  > There is a very vocal movement these days that is trying to argue that we should do away with the ***traditional*** peer review process. Apparently that sometimes includes trying to redefine the very definition of "peer review" as the OP did.
  (emphasis my own)
Sorry, but I don't think you have an accurate image. You have it backwards.

"Peer review" is a very new thing. We're talking really about mid 20th century, with this format not really being common until the 70's. If anything, we're trying to return to the earlier version of the system[0].

The older review system didn't have these concepts of acceptance rates, novelty, and all of that. They would mostly publish if your work was void of errors, did not copy others, or was not essentially a small variation of another work and trying to take credit (I'd still consider this plagiarism).

We're fine with having conversations with reviewers, where we view this all as being "on the same team". A team trying to make the work the best work it can be. What we're not fine with is reviewers being set up as adversaries, who are looking for reasons to reject the works. That just creates perverse incentives.

Really, it's all about addressing the question:

  What is the point of publishing?
I'd say that the primary goal is to communicate the a work. A secondary goal is to help works be visible. But this form of review cannot validate works and does a bad job at invalidating works. Nor can this form of review determine how impactful a work will be and we have a clear tendency to reject works that end up being highly influential.

We're checking the alignment of our current system with our intended goals. Even if we're wrong, I think it is obtuse to be outright dismissive. Should you not even ask the question? I'd argue that not asking the question is anti-scientific. Science requires challenging the status quo. If we don't, innovation slows to a crawl. You cannot rely on those before you having gotten everything right. Use the advantage of hindsight. Trust, but you must also verify (challenge).

[0] We believe that this is the better formulation. Did it have problems? Yes. Can they all be solved? No. Does a global optima exist where all problems can be solved with a different system? Also no. So the belief is that good intentions trying to solve these problems only ended up creating worse ones. The cure was worse than the poison.

  > A 2003 editorial in Nature stated that, in the early 20th century, "the burden of proof was generally on the opponents rather than the proponents of new ideas."
https://en.wikipedia.org/wiki/Scholarly_peer_review#History




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: